Date: Tue, 19 Mar 2024 02:55:17 +0000 (UTC) Message-ID: <1449257217.6529.1710816922505@confluence> Subject: Exported From Confluence MIME-Version: 1.0 Content-Type: multipart/related; boundary="----=_Part_6528_2125167472.1710816917498" ------=_Part_6528_2125167472.1710816917498 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Content-Location: file:///C:/exported.html
Michael Wood-Vasey update
I started with Simon's very usefully recorded prior experience below and= then set about installing the v10_0 version of the stack.
My default shell is bash. Almost all of the same issues that Simon= originally raised still apply.
Related notes.
1. Log in to NERSC:
ssh carver.nersc.gov
2. Make a working directory in the project space:
mkdir -p /project/projectdirs/m1727/lsst_S14/lsstStack
3. setup the needed modules:
module swap pgi gcc
module load git
5. Install Anaconda
cd /project/projectdirs/m1727/lsst_S14/
curl -s -L -o installer.sh http:/=
/repo.continuum.io/archive/Anaconda-2.1.0-Linux-x86_64.sh
bash installer.sh -b -p anaconda
5. Install Gettext
mkdir src
cd src
curl -O http://ftp.gnu.org/pub/gnu/ge=
ttext/gettext-0.19.tar.gz
tar zxvf gettext-0.19.tar.gz
cd gettext-0.19
./configure --prefix $PWD/../../
make install
6. Setup environment
export PATH=3D/project/projectdirs/m1727/lsst_S14/bi=
n:/project/projectdirs/m1727/lsst_S14/anaconda/bin:${PATH}
export PYTHON=3D/project/projectdirs/m1727/lsst_S14/anaconda/bin/python
source "/project/projectdirs/m1727/lsst_S14/lsstStack/loadLSST.bash"
7. Install the basic stack
cd /project/projectdirs/m1727/lsst_S14/lsstStack
curl -O https://sw.lsstcorp.org/eupspkg/newinstall.=
sh
bash newinstall.sh
#Answer no to install git? and install anaconda?
source "/project/projectdirs/m1727/lsst_S14/lsstStack/loadLSST.bash"
8. Start compiling
Either
eups distrib install lsst_apps
or
eups distrib install lsst_sims -t sims
This will go along fine until afw, at which point it will die because it= will exceed the virtual memory available on the login node.
So we'll go to a compute node to finish afw
qsub -I -q interactive -l walltime=3D00:30:00 #need this long since af= w takes a while to compile
cd /project/projectdirs/m1727/lsst_S14
mod= ule swap pgi gcc
module load m4
export PATH=3D/project/projectdirs/m1727/lsst_S14/bin:/project/projectdirs/m1727/lsst_S14/anaconda/= bin:${PATH}
export PYTHON=3D/project/projectdirs/m1727/lsst_S14/anac= onda/bin/python
source lsstStack/loadLSST.bash
#So here this gets a little tricky because as of (2015-03-05) "lsst_sims= -t sims" requires an afw version that's different than "lsst_apps" current
#If you're installing lsst_apps [current], then just
eups distrib i= nstall afw
#If you're installing lsst_sims -t sims as of 2015-03-05 then=
eups distrib install afw master-gcb7650adda
Finish up the install after exiting the interactive allocation
Either
eups distrib install lsst_apps
or
eups distrib install lsst_sims -t sims
...wait...a...very...long...time
setup lsst_apps
or
setup lsst_sims -t sims
This last succeeded except for "sims_catUtils", "sims_maf", and "lsst_si= ms".
To use this lsst_apps stack under bash:
export PATH=3D/project/projectdirs/m1727/lsst_S14/anaconda/bin:$PATH= pre>source /project/projectdirs/m1727/lsst_S14/lsstStack/loadLSST.bashsetup lsst_apps=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
In summary
ssh carver.nersc.govmkdir -p /project/projectdirs/m1727/lsst_S14/lsstStackmodule swap pgi gcc
module load gitcd /project/projectdirs/m1727/lsst_S14/
curl -s -L -o installer.sh = http://repo.continuum.io/archive/= Anaconda-2.1.0-Linux-x86_64.sh
bash installer.sh -b -p anacondamkdir src
cd src
curl -O h= ttp://ftp.gnu.org/pub/gnu/gettext/gettext-0.19.tar.gz
tar zxvf gette= xt-0.19.tar.gz
cd gettext-0.19
./configure --prefix $PWD/../../
ma= ke installexport PATH=3D/project/projectdirs/m1727/lsst_S14/bin:/project/projectdirs/m1727/lsst_S14/anaconda/= bin:${PATH}
export PYTHON=3D/project/projectdirs/m1727/lsst_S14/anac= onda/bin/python
cd /project/projectdirs/m1727/lsst_S14/lsstStack
= curl -O https://sw.lsstcorp.org/eupspkg/newinstall.= sh
bash newinstall.sh
#Answer no to install git? and install anac= onda?
source "/project/projectdirs/m1727/lsst_S14/lsstStack/loadLSST.bas= h"eups distrib install lsst_appsqsub -I -q interactive -l walltime=3D00:30:00 #need this long since af= w takes a while to compile
# The following are executed on the interacti= ve node
cd /project/projectdirs/m1727/lsst_S14
module swap pgi gcc
module load m4
export PATH=3D/project/projectdirs/m1727/lsst_S14/bin:/project/projectdirs/m1727/lsst= _S14/anaconda/bin:${PATH}
export PYTHON=3D/project/projectdirs/m1727= /lsst_S14/anaconda/bin/python
source lsstStack/loadLSST.basheups distrib install afwexit # log out of the interactive node session#Finish up the install after exiting the interactive allocation
eups distrib install lsst_apps
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D
To use this stack to:
setenv PATH /project/projectdirs/m1727/lsst/anaconda/bin:$PATHsource /project/projectdirs/m1727/lsst/lsstStack/loadLSST.cshsetup lsst_sims -t sims=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
Simon Krughoff originally p= ut this together 2014 June.
This was not as straight forward as I had hoped. Issues were:
How I did it. I tried to use bash, but my default shell is tcsh an= d I had some shell issues (path to module command wasn't defined):
To use this stack to:
$> setenv PATH /project/projectdirs/m1727/lsst/anaconda/bin:$PATH
$> source /project/projectdirs/m1727/lsst/lsstStack/loadLSST.csh
$> setup lsst_sims -t sims