iPython 和 Jupter Notebook 都支持spark ,调用方式如下:
PYSPARK_DRIVER_PYTHON=ipython ./bin/pysparkPYSPARK_DRIVER_PYTHON_OPTS='/usr/local/bin/jupyter-notebook' ./bin/pyspark