通过命令lin使用jupyter内核运行python模块

2024-06-16 17:36:58 发布

您现在位置:Python中文网/ 问答频道 /正文

我在jupyter lab上配置了一个内核来运行pyspark客户端

> jupyter kernelspec list

mykernel       /home/mypath/jupyter/kernels/mykernel

内核配置文件(kernel.json)有很多参数,我想重用它们

> cat kernel.json

{
  "display_name": "mykernel",
  "language": "python",
  "argv": [
    "/home/mypath/environments/python2/bin/python",
    "-m",
    "ipykernel_launcher",
    "-f",
    "{connection_file}"
  ],
  "env": {
    "HADOOP_USER_NAME": "myusername",
    "YARN_CONF_DIR": "/somepath/hadoop/conf",
    "SPARK_HOME": "/somepath/spark/spark-2.0.0",
    "PYTHONPATH": "/somepath/spark/spark-2.0.0/python/:/somepath/spark/spark-2.0.0/python/lib/py4j-0.10.1-src.zip",
    "PYTHONSTARTUP": "/somepath/kernels/pyspark/start.py",
    "PYSPARK_SUBMIT_ARGS": "--alotofargs --moreargs --moreargs"
  }
}

有没有一种通过命令行执行的方法

jupyter mykernel run mypysparkmodule.py

非常感谢


Tags: pyjson客户端homelabjupyterkernel内核