Campaigns

• repo = /repo/embargo
• Intra-night (step1 + step2a processing): LSSTComCamSim/quickLook/24
• Full (step3+) run: LSSTComCamSim/runs/intermittentcumulativeDRP/20240402_03_04/d_2024_03_29/DM-43865

Setup:
export LSST_VERSION=d_2024_03_29
source /sdf/group/rubin/sw/d_latest/loadLSST.bash
setup lsst_distrib -t ${LSST_VERSION}

Used:
   drp_pipe (tickets/DM-43659)

export DAF_BUTLER_CACHE_EXPIRATION_MODE=datasets=500

Yaml:
/sdf/home/h/homer/proc_comcam_sim/bps_Intermittent_Cumulative_DRP_sasquatch.yaml

• repo = /repo/embargo
• Intra-night (step1 + step2a processing): LSSTComCamSim/quickLook/24
  • "quickLook" is a misnomer, this actually nightly validation. Will fix this after the ops rehearsal.
• Full (step3+) run: LSSTComCamSim/runs/nightlyvalidation/{day_obs}/d_2024_03_29/DM-43612

Setup:
export LSST_VERSION=d_2024_03_29
source /sdf/group/rubin/sw/d_latest/loadLSST.bash
setup lsst_distrib -t ${LSST_VERSION}

Used:
   drp_pipe (tickets/DM-43659)

Submitting:
In: /sdf/home/h/homer/proc_comcam_sim/ select the appropriate nightly: bps_nightly_validation_onlybatch_sasquatch-copyForNightly20240402.yaml bps_nightly_validation_onlybatch_sasquatch-copyForNightly20240403.yaml bps_nightly_validation_onlybatch_sasquatch-copyForNightly20240404.yaml

Apr 2, Apr 3: 2.4.0 (d_2024_03_29) 

Apr 4: 2.5.0 (d_2024_04_04)

repo=/repo/embargo

LSSTComCamSim/prompt/output-<day_obs>

First iteration:

• repo = /repo/ops-rehearsal-3-prep
• collection = u/homer/htc-test1

Second iteration:

• repo = /repo/ops-rehearsal-3-prep
• collection = u/homer/w_2024_10/DM-43228

Third iteration:

• repo = /repo/ops-rehearsal-3-prep
• collection = u/homer/w_2024_12/DM-43439

butler: /repo/main (at USDF) hsc_pdr2_multisite (at FRDF, UKDF)

 HSC/runs/PDR2-VVDS-FR/w_2023_48/DM-40654

 HSC/runs/PDR2-VVDS-UK/w_2023_48/DM-40654

 HSC/runs/PDR2-VVDS/w_2023_48/DM-40654 (at USDF)

• https://github.com/lsst/drp_pipe/blob/main/pipelines/HSC/DRP-RC2.yaml
• https://github.com/lsst/drp_pipe/blob/main/pipelines/LSSTCam-imSim/DRP-test-med-1.yaml

butler: /repo/main

HSC/runs/RC2/w_2023_XX/DM-XXXXX

Butler: /repo/embargo

LATISS/prompt/output-YYYY-MM-DD (starting from 2024-03-25)

Runs may become more frequent than fortnightly as observing staff become available on Cerro Pachón.

Prompt Processing with AuxTel Imaging Survey Data 2024, 2023 (Includes run names)

Cumulative LATISS imaging taken since May 1st (since the new observing pattern and no_RG sequencer change). 

posted in:  AuxTel Imaging Survey Data Descriptions

Notes and Collection Names:

AP Precursor Processing Runs

• Starting with LATISS January 29

Two aspects:

• Afternoon: Check that the camera is working today (Summit)
• Intermittent: Produce combined calibs for the prompt and DR productions (USDF)

• Sierra Villarreal 

butler: repo/main

u/sierrav/cm/pandatesting/DM-42607_test1

butler: /repo/main

Goal: Find the max simultaneous cores that can be run simultaneously with the new USDF PanDA server. 

Currently testing w/ 6000 cores, some limited PanDA iDDS issues but otherwise seems fine?

2023 Internal HSC PDR2 Reprocessing at the USDF 

PDR2:  Last rerun was in 2020:  S20 HSC PDR2 Reprocessing

Collection Names:

butler: /repo/main ,  HSC/raw/all (has 26K exposure, superset of PDR2 17K),

HSC/defaults (with calibs,skymap,masks, refcats) 

Input for step1: 

 HSC/raw/PDR2/{WIDE,DEEP,UDEEP}

HSC/runs/PDR2/WIDE/v24_1_0_rc2/DM-39132/ancillary

Output for step1:

HSC/runs/PDR2/{WIDE,DEEP,UDEEP}q/v24_1_0_rc2/DM-39132/step1

Inputs for step3:

 HSC/runs/PDR2/v24_1_0/DM-39132/step3_input,HSC/runs/PDR2/v24_1_0/DM-39132/ancillary

Output for step3-6, inputs for steps 4-7:

 HSC/runs/PDR2/v24_1_0/DM-39132/step{3,4,5,6}

Output for step7 (cumulative):

 HSC/runs/PDR2/v24_1_0/DM-39132/step7 (contains step3-6 outputs and ancillary skymap collection)

Faro (tract-based metrics): HSC/runs/PDR2/v24_1_0/DM-39132/farotract

Rollup collection: HSC/runs/PDR2/v24_1_0/DM-39132 (contains step 3-7 outputs, step3 inputs, farotract outputs, ancillary inputs (with skymap)).

http://rtn-063.lsst.io