Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Anaconda is a completely free Python distribution (including for commercial use and redistribution). It includes over 195 of the most popular Python packages for science, math, engineering, data analysis.

Usage

No Format
ManualThe usage Usageis:
You will need to activate the environment. For example, to activate biopython

source activate biopython
discarding
module load anaconda3/2019.07.py3
OR
module load anaconda/4.00py2.7
OR:
module load anaconda/4.00py3.5
 
You need to run this after loading the modules:
source /sw/anaconda/2.0.1/bin from PATH
prepending /sw/anaconda/2.0.1/envs/biopython/bin to PATH

To deactivate this environment, use:
source deactivate

Module Usage:
=============
For example,You can use this to load biopython using python 2.7 version (anaconda) :

module load anaconda/py27biopython1.66


For python 3.5 (anaconda env), use this:
module load anaconda/py35biopython1.66


Anaconda environment py27-ver400/etc/profile.d/conda.sh  #if using module load anaconda/4.00py2.7
OR source /sw/anaconda/py3-ver400/etc/profile.d/conda.sh #if using “module load anaconda/4.00py3.5”

 Manual Usage:
You will need to activate the environment. For example, to activate biopython

source activate biopython
discarding /sw/anaconda/2.0.1/bin from PATH
prepending /sw/anaconda/2.0.1/envs/biopython/bin to PATH

To deactivate this environment, use:
source deactivate

Module Usage:
=============
For example,You can use this to load biopython using python 2.7 version (anaconda) :

module load anaconda/py27biopython1.66


For python 3.5 (anaconda env), use this:
module load anaconda/py35biopython1.66


Anaconda environment need not be loaded separately.
 
However, it can be loaded as follows if needed for other reasons:

module load anaconda/4.00py2.7

module load anaconda/4.00py3.5 




...

No Format
conda create -n biopython biopython
Fetching package metadata: ..
Solving package specifications: .
Package plan for installation in environment /sw/anaconda/2.0.1/envs/biopython:

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    biopython-1.64             |       np18py27_0         2.1 MB
    python-2.7.8               |                0        11.3 MB
    ------------------------------------------------------------
                                           Total:        13.5 MB

The following packages will be linked:

    package                    |            build
    ---------------------------|-----------------
    biopython-1.64             |       np18py27_0   hard-link
    numpy-1.8.1                |           py27_0   hard-link
    openssl-1.0.1h             |                0   hard-link
    python-2.7.8               |                0   hard-link
    readline-6.2               |                2   hard-link
    sqlite-3.8.4.1             |                0   hard-link
    system-5.8                 |                1   hard-link
    tk-8.5.15                  |                0   hard-link
    zlib-1.2.7                 |                0   hard-link

Proceed ([y]/n)? y
Fetching packages ...
biopython-1.64 100% |##########################| Time: 0:00:15 144.95 kB/s
python-2.7.8-0 100% |##########################| Time: 0:00:14 821.86 kB/s
Extracting packages ...
[      COMPLETE      ] |#######################| 100%
Linking packages ...
[      COMPLETE      ] |#######################| 100%
#
# To activate this environment, use:
# $ source activate biopython
#
# To deactivate this environment, use:
# $ source deactivate
#

Activate an environment

No Format
source activate biopython

e.g:

source activate biopython
discarding /sw/anaconda/2.0.1/bin from PATH
prepending /sw/anaconda/2.0.1/envs/biopython/bin to PATH

De-Activate an environment

No Format
source deactivate

Deleting an environment

...

Installed Environment

No Format


Useful commands

No Format
Useful commands:
 
conda info --envs
conda list
conda activate

Sample PBS file

No Format
#!/bin/bash
#PBS -N condatest
#PBS -m abe
#PBS -M YourEMAIL@griffith.edu.au
#PBS -l select=1:ncpus=1:mem=4gb,walltime=10:00:00
module load anaconda/4.00py2.7
source /sw/anaconda/py27-ver400/etc/profile.d/conda.sh 
##use /sw/anaconda/py3-ver400/etc/profile.d/conda.sh if using “module load anaconda/4.00py3.5”
echo "Starting job: "
cd  $PBS_O_WORKDIR
python <pythonFile>
 
>>>An example of the python file>>>>>>>>> 
cat pythonFile.py
import tensorflow as tf
>>>>>>>>>>>>>> 


Activate an environment

No Format
source /sw/anaconda/py27-ver400/etc/profile.d/conda.sh
OR source /sw/anaconda/py3-ver400/etc/profile.d/conda.sh if using “module load module load anaconda/4.00py3.5”
source activate biopython

e.g:

source activate biopython
discarding /sw/anaconda/2.0.1/bin from PATH
prepending /sw/anaconda/2.0.1/envs/biopython/bin to PATH

De-Activate an environment

No Format
source deactivate

Deleting an environment

No Format
conda remove -n biopython


n060 anaconda installation

No Format
module load anaconda/5.3.1py3

conda info --envs
# conda environments:
#
base                  *  /sw/centos7/anaconda/5.3.1/py3
accelerate               /sw/centos7/anaconda/5.3.1/py3/envs/accelerate
biopython                /sw/centos7/anaconda/5.3.1/py3/envs/biopython
deeplearning             /sw/centos7/anaconda/5.3.1/py3/envs/deeplearning
keras                    /sw/centos7/anaconda/5.3.1/py3/envs/keras
tensorflow-gpu           /sw/centos7/anaconda/5.3.1/py3/envs/tensorflow-gpu

e.g
module load anaconda/5.3.1py3
source activate keras
pip install soundfile

Installing packages without root access

No Format
Instructions from: https://medium.com/@danielwzou/installing-spacy-and-other-packages-without-sudo-or-root-privileges-using-anaconda-59571ec0ecad

First, navigate to your home directory.
module load anaconda/5.3.1py3
wget https://repo.continuum.io/miniconda/Miniconda3-latest-Linux-x86_64.sh
sh Miniconda3-latest-Linux-x86_64.sh
Now, we have a local installation of the Conda package manager at ~/miniconda3
Let’s add conda to our bash profile so that we can call it from the command line
vim .bash_profile
i
Add this line to the file:
export PATH=$HOME/miniconda3/bin:$PATH
esc :wq
Now, let’s reload our .bash_profile
source .bash_profile
And check that our installation was completed successfully
which conda
Which should return ~/miniconda3/bin/conda
Now that Conda is installed, we can install Spacy or other Python packages
conda install spacy
python -m spacy download en
Now, let’s make sure that Spacy is installed correctly
python
import spacy
nlp = spacy.load('en')
doc = nlp(u'Hello World!')
print([w.lemma_ for w in doc])
Now that you have Conda installed, you can use it to install many packages locally.


Anaconda on the new cluster

No Format
module load anaconda3/2019.07py3
 
This should have packages like the tensorflow env. You can find with this:
conda info --envs
 
>>>>> 
conda info --envs
# conda environments:
#
                         /sw/anaconda2/2019.07/envs/bio
                         /sw/anaconda2/2019.07/envs/bioinfoPy27
base                  *  /sw/anaconda3/2019.07
3point6                  /sw/anaconda3/2019.07/envs/3point6
R                        /sw/anaconda3/2019.07/envs/R
bioinformatics           /sw/anaconda3/2019.07/envs/bioinformatics
 
>>>>>>> 
This will give the packages in the base:
conda list
 
source activate 3point6
Next run: " conda list"
This will list the packages installed in that environment.
 
It shows among many others:
pytorch                   1.3.1           cuda100py36h53c1284_0
 
tensorboard               2.0.0              pyhb230dea_0
tensorflow                2.0.0           mkl_py36hef7ec59_0
tensorflow-base           2.0.0           mkl_py36h9204916_0
tensorflow-estimator      2.0.0              pyh2649769_0
termcolor                 1.1.0                      py_2    conda-forge
theano                    1.0.4           py36hf484d3e_1000    conda-forge
 
Remember this cluster has no GPU (currently)


Another sample pbs file


No Format
#!/bin/bash
#PBS -N condatest
#PBS -m abe
#PBS -M YourEMAIL@griffith.edu.au
#PBS -l select=1:ncpus=1:mem=4gb,walltime=10:00:00
cd  $PBS_O_WORKDIR
module load anaconda3/2019.07py3 
source activate bioinformatics
trinity <trinityinput>



Sample python code to write out a plot


Code Block
vi plot.py
>>>>>>>>>>>>>>>>>
import matplotlib.pyplot as plt
import numpy as np

np.random.seed(19680801)
data = np.random.randn(2, 100)

fig, axs = plt.subplots(2, 2, figsize=(5, 5))
axs[0, 0].hist(data[0])
axs[1, 0].scatter(data[0], data[1])
axs[0, 1].plot(data[0], data[1])
axs[1, 1].hist2d(data[0], data[1])

plt.show()
plt.savefig('test')
>>>>>>>>>>>>>>>>>>

module load anaconda3/2022.10
source activate yourenv #this should have the matlibplot packages and others.
python plot.py  would generate a plot named test.png

Reference: https://matplotlib.org/3.4.3/tutorials/introductory/sample_plots.html
Sample codes are here:
https://matplotlib.org/3.4.3/_downloads/55a714c8a6e4dde456b09326202fe492/sample_plots.py

https://matplotlib.org/3.4.3/_downloads/003118d8eb1e7df55671bcdf18bfac3c/sample_plots.ipynb



Ref: https://medium.com/@danielwzou/installing-spacy-and-other-packages-without-sudo-or-root-privileges-using-anaconda-59571ec0ecad

Reference

1. http://davebehnke.com/using-python-anaconda-distribution.html
2. https://store.continuum.io/cshop/anaconda/

3. https://medium.com/@danielwzou/installing-spacy-and-other-packages-without-sudo-or-root-privileges-using-anaconda-59571ec0ecad
4.
http://continuum.io/downloads#all