Request from EC: Could we add a couple of fields to each table: 1. what computing resources the will be used to process the campaign, 2. what tooling (e.g., panda, bps, cm_tools, prompt processing) will be used to process the campaign?
Planned
| On going | Nightly LATISS Prompt Processing at USDF |
|---|---|
| Pilot/Co-Pilot | Hsin-Fang Chiang / <open> |
| channel/contact | Currently during development, pre-campaign stage: #dm-prompt-processing / Ian Sullivan |
| Reps: | Kian-Tat Lim (Middleware) Yee Li (Infrastructure) Krzysztof Findeisen (Pipeline) ? (V&V) |
| Schedule | Expected Start Feb 2023. Every other week. |
| Data | LATISS science imaging during the biweekly reruns planned in 2023 |
| Notes | Runs may become more frequent than fortnightly as observing staff become available on Cerro Pachón |
| On going | LATISS Rapid Analysis prompt processing at the Summit |
|---|---|
| Pilot/Co-Pilot | <open>/ <open> |
| channel/contact | |
| Reps: | |
| Schedule | Earliest that pieces be in place to make it possible is April |
| Notes |
In progress
| One Time | Internal Multi-site HSC PDR2 Data Release Production with v24.0.x |
|---|---|
| Pilot/Co-Pilot | Jen Adelman-Mccarthy /<open> |
| channel/contact | ?/ Leanne Guy |
| Reps: | Yusra AlSayyad (Pipeline) ? (Middleware), Richard Dubois (Infrastructure) ? (V&V) |
| Schedule | To be completed July 2023 |
| Data | PDR2 or PDR3 datasets. Last rerun was in 2020: S20 HSC PDR2 Reprocessing |
| Notes | Produce pipeline quality metrics on real data, and test multi-site scalability with PanDA. |
| On going | Monthly DRPs on RC2/DC2 datasets |
|---|---|
| Pilot/Co-Pilot | |
| channel/contact | #dm-hsc-reprocessing / Yusra AlSayyad |
| Reps: | No formal committee: Jeff, Angelo, and pipelines folks chime in on the hsc-reprocessing channel. Reviewed at the DRP Metrics Meetings |
| Schedule | Schedule |
| Notes |
| On going | Daily LATISS 10am Analysis at USDF (DRP-mode) |
|---|---|
| Pilot/Co-Pilot | Huan Lin / <open> |
| channel/contact | |
| Reps: | Pipeline: Erik Dennihy Middleware? |
| Schedule | |
| Notes |
| Few iterations | 2023 LATISS Data Release Production at USDF |
|---|---|
| Pilot/Co-Pilot | Huan Lin / <open> |
| channel/contact | ?/ Erik Dennihy |
| Reps: | |
| Schedule | Expected to start January 2023 |
| Data | All LATISS imaging taken since Oct 1st (since the filter and sequencer changes) |
| Notes | Erik's Proposal |
| On going | Monthly AP Processing on HSC Cosmos/DECam HiTS at USDF |
|---|---|
| Pilot/Co-Pilot | |
| channel/contact | #dm-alert-prod / Ian Sullivan |
| Reps: | Eric Bellm , Kenneth Herner , Erin Howard Reviewed at the monthly AP QA meeting (links found here) |
| Schedule | |
| Notes | Found an issue in the APTemplate pipeline that crept in about a month ago related to changes about a month ago in pipe_tasks. Fix in DM-37932. |
Completed
| One time | Data Release Preview 0.2 with DC2 on IDF |
|---|---|
| Pilot/Co-Pilot | Huan Lin / |
| channel/contact | #ops-df-proecessing / Hsin-Fang Chiang |
| Reps: | Yusra AlSayyad (Pipeline) Tim Jenness (Middleware) Colin Slater (V&V) (didn't have an infrastructure rep, because execution and Hsin-Fang were on infrastructure at the time |
| Schedule | |
| Notes |