...
The login or head node of each cluster is a resource that is shared by many users. Running Jupyter on one of these nodes may adversely affect other users. Please use one of the approaches described on this page to carry out your work.
Internet is Not Available on Compute Nodes
...
. Jupyter sessions will have to run on the compute nodes which do not have Internet access. This means that you will not be able to download files, clone a repo from GitHub, install packages, etc. You will need to perform these operations on the login node before starting the session. You can run commands which need Internet access on the login nodes (gc-prd-hpclogin1). Any files that you download while on the login node will be available on the
...
compute nodes.
...
Installation
Using Conda Environments: create a Conda environment on the login node
| No Format |
|---|
source /usr/local/bin/s3proxy.sh #To gain internet access on the login node |
...
module load anaconda3/2021.11 |
...
conda create --name snumber-tf-cpu ipykernel tensorflow pandas matplotlib |
...
(e.g: conda create --name s123456-tf-cpu ipykernel tensorflow pandas matplotlib) |
...
exit |
The ipykernel package should be installed
If additional packages are needed after this install, you may log into the login node and do the following:
| No Format |
|---|
module load anaconda3/2021.11 source activate <you environment> #e.g source activate s123456-tf-cpu conda install <another-package-1> <another-package-2> conda deactivate exit |
...
For some packages you will need to add the conda-forge channel or even perform the installation using pip as the last step. |
Using Widgets
conda create --name widg-env --channel conda-forge matplotlib jupyterlab ipywidgets ipympl
Usage
...
netstat -antp | grep :88 | sort
onDemand Nodes
Internet access is available when running Jupyter on a OnDemand node. There is no job scheduler on the onDemand nodes. Be sure to use these nodes in a way that is to fair all users.
Reference
1. https://jupyter.org/try
2. https://researchcomputing.princeton.edu/support/knowledge-base/jupyter