Date: Thu, 28 Mar 2024 13:40:35 +0000 (UTC)
Message-ID: <2113440777.20021.1711633240986@confluence>
Subject: Exported From Confluence
MIME-Version: 1.0
Content-Type: multipart/related;
boundary="----=_Part_20020_1686970730.1711633235976"
------=_Part_20020_1686970730.1711633235976
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Content-Location: file:///C:/exported.html
AP Pipeline Meeting, 2019-07-15
AP Pipeline Meeting, 2019-07-15
BlueJeans: https://bluejeans.com/426716450
attending: Eric Bellm John Swinbank Meredith Rawls Unknown Use=
r (emorganson) Ian Sullivan Krzysztof FindeisenUnknown User (gkovacs)
Topics for discussion
- June false positive sprint (Eric Bellm=
Yusra AlSayyad Meredith Rawls Unknown Us=
er (gkovacs) )
- lots of good findings, capturing lots of followon action in tickets.
- Gabor has tried processing HiTS with instcals but there were lots of as=
trometry failures so it's not quite ready for any kind of significant compa=
rison
- Gabor also trying to the calexp-calexp run
- DES processing (Unknown Use=
r (emorganson)):
- has done some profiling work:
- ran on DECam (half LSST size CCDs) on lsst-dev09, comparable to operati=
ons speeds
- total time 101 seconds (5x longer than desired, but still 5x faster tha=
n DESDM)
- convolution (smaller kernels?), fitsIO (pre-loading and post-saving cou=
ld help), scipy.lmdif (tune this), meas_base wrappers (the measurement plug=
in code=E2=80=93fewer measurements?), warpExposure (smaller kernel?), makeS=
tatistics are 50% of the runtime
- going to require lots of code changes, maybe accepting worse algorithms=
(e.g., smaller kernels) to get to target latencies
- or longer latencies!
- thread convolution or warping? (OpenMP) buying more processors is=
not a major budgetary issue relative to hard drives ((GPUs?))
ap_
association (Unk=
nown User (cmorrison)):
- DCR (Ian Sullivan ):
- has been gone for a week and a half; tech note (DMTN-121) is in review =
with Eric and John.
- Review CI (https://chronograf-demo.lsst.codes/):
- Krzysztof Findeisenwill =
look into 0 unassociated DIASources on 10 July=E2=80=93looks like Proc=
essCcd crashed. John says there were a failure to open the templates =
(cFITSIO error)? Probably this should have shown up as a build failur=
e in Jenkins, will ticket it
- PCW session review
- sessions that are high-priority for the team:
- Data Management All Hands
- Progress on QA Tooling
- Gen 3 porting in the hack session (as directed by Fritz, described in D=
M All Hands on day 1)
- others of interest:
- AOB
- Meredith and John are interested in understanding DESC DC2 DIA.
- we will continue to monitor slack channels etc. to see if there are alg=
orithmic learnings emerging from DESC, and/or steal their cool plots
- KF will be giving a MetricTask presentation (& how to make it work =
for DRP) to Princeton Wednesday
- John is looking for volunteers to look at Tim's QA tooling
------=_Part_20020_1686970730.1711633235976--