jupyter

Sources: ljvmiranda921, anbasile

Installation:

Step 1: pip install jupyter

Step 2: ~/.local/bin/jupyter notebook

#For connecting remote instance of jupyter:

~/.local/bin/jupyter notebook --no-browser --port=<PORT_NUM>  #on node where jupyter is installed.

ssh -N -f -L localhost:<XXYY-PORT_THAT_WILL_BE_REQUESTED_FROM_BROWSER>:localhost:<PORT_NUM_OF_JUPYTER_ON_REMOTE_NODE> <USER>@<REMOTE_NODE_IP> #On client node

Go to the browser and type http://localhost:XXYY

Setting up kernels..

Kernel built using following command, uses current loaded environment... its useful if we are using virtual environment and executing ipython within...

pip install ipykernel

ipython kernel install --user --name=testpyspark