For now, all on one instance.... See Notes on manually starting a condor pool on AWS for >1
This is with w_2019_14. The ci_hsc workflow was pre-made.
- Log into your AWS console
- Go to EC2 Dashboard - Images - AMIs
- Find the shared AMI name "stack-w_2019_14-htcondor-repo-EFS-CLI" and launch an instance with it
- The DATA repo and Pegasus workflow are included in this image
- LSST Stack and other software has been installed
- (set up your key pair as needed)
- ssh to the instance
- A 2-node mini-condor should be ready for use; can check by `condor_status`
cd pegasus_w14e
- This workflow needs an init step:
pipetask -b ~/DATA/butler.yaml -i raw,calib,ref/ps1_pv3_3pi_20170110,col00 -o myrun002 run --init-only --qgraph demo_qgraph_w14c.pickle
Pick myrun777 with a number of your choice - Edit the demo_wf.dax file, replace all "myrun001" string with your myrun777
./run_peg.sh