Date June 27, 2014

Attendees

Discussion Items

Simon

  • The team was supposed to have started their new sprint last week. Although the new sprint hadn't officially started, Russell has been addressing items from the new sprint.
  • Simon has been digging out from a pile of reviews so he's in a better position than he was last Friday.
  • No blockers


Mario 

  • Mario was at the DESC meeting. They were basically putting out the word that LSST DM is hiring. That's one of the reasons that they went to that meeting. The other reason was that DESC is going to be writing a lot of software and we want to make sure that they remain well coupled to what we are writing in DM so that they don't end up rewriting a lot of software in parallel. Mario thinks there is still a lot of work to be done to make sure that happens but we're getting there. 
  • No official notification that the 'check is coming on July 1.

K-T

  • The Middleware sprint was supposed to have been started but since he was on vacation he just backdated it. It is now running. and both Steve and Gregory are making good progress.
  • Steve is almost done with having a real nightly computing simulator which will run end-to-end. He's working on getting suitable VMs up on workers right now. That will actually complete the whole task. Then they will be able to experiment with it and test various configurations.
  • Greg has been able to show that we can get Condor to direct jobs on appropriate nodes that may have data cached. There is some question about how stable it is and how responsive the system is - how well it's going to work in the long run. There are still things to be tested out there.  Good progress is being made.
  • K-T dug out from the pile of emails which accumulated during the last week or so. He's almost back in non-vacation mode.
  • K-T is starting to think again about the butler. He has cleared out next week to work on it – as long as DM doesn't get distracted by a massive name changing.  
    • Mario: We can leave that for August.

Jim

  • The team started their sprint 2 weeks ago; it's got 4 more weeks to go.
  • Perry has been working hard on it and gotten lots of tasks done. 
    • Jim worries that he's going to be the blocker soon. Perry sent Jim a ticket which he's doesn't know if he'll get to it until next week. 
  • Jim has mostly wrapped up his HSC things which were keeping him from getting started on his tasks in this sprint. Jim's concern now is being able to write enough time to keep Perry from being blocked by him. He will try to identify if he can give any of his (Jim's) issues to Perry to ensure Perry doesn't become blocked. Jim said: "As before, he's ahead of schedule and I'm behind schedule."  
  • Perry and Jim once again overestimated how difficult Perry's tasks were and underestimated how big Jim's overheads might be. JimHe expects to have more time in the second half of the sprint than he had in the first half. He did know that fact going in to the sprint  so he wonders if he may be overestimating how bad things are at this mid-point.

Dick

  • Dick recommends that the DevOps team should open another sprint. There have been tasks that we are currently looking at but we haven't been doing our due diligence to maintain the status board.
  • Dick is working on a page on CameraGeometry and on migrating a page, which either Jim or K-T could review, on using Git. But first he needs to git-checkin a personal package on Tutorial scripts which he used as his vehicle for exercising the tutorial on using git.
    • Mario: what was the driver for migrating that page?
    • Dick: A few weeks ago there was quite a lot of traffic with folks having questions about  git. Dick needs also needs to conquer git use himself in order to install the Tutorials package. Also, a significant amount of information on that page is stale or not relevant anymore. Certainly it's a page which a lot of new developers will use. The page is mostly done; Dick is just going through all the examples to make sure all work.  
    • Mario: The reason I'm concerned about this is that we'll be switching over to Stash is a couple of months so everything that references gitolite will be obsolete on that page.
    • K-T: But the concepts will be the same.
    • Mario/K-T/Dick  had more discussion on relative priority of the task vs others in the queue.
    • Dick: The page is basically done

Robyn

  • Robyn's next task will be to get all the 3rd party software installed and the new buildbot migrated over to using/managing the DM stack. Buildbot's migration should happen sometime next week.
    • Mario: since Robyn doesn't have an easy way to run buildbot on Macs right now Buildbot is being run only on lsst-dev on RHEL6. So the stuff that buildbot works on is guaranteed to work on RHEL6 - including the 3rd party packages. So that means when these packages get upgraded, there may be packages which break on MacOS. 
    • K-T:  But doesn't Robyn have an account on the Mac now?
    • Mario: Yes but it'll take time to actually get buildbot and the lsst_build to work on the Mac.  The scripts that were written for buildbot currently use some pieces which work only on Linux; they deal with blocking. Those pieces have to modified to work on MacOS. 
    • K-T: The other question was about separating the Sims packages from building with buildbot. That is excessive. We should have two different slaves which create a Sims stack and a DM stack.
      • Mario/K-T/Robyn discuss current state (all packages built in a single stack), what is wanted (two separate stacks with Sims build using the DM stack for dependencies). Mario is going off to look at the email thread (such as it was).

Andy

  • Andy has been running regression models on DCR and refraction as a function of seeing distance. It looks like we can use bulk source colors to predict what the refraction of a given source should be – certainly from a tolerance of 5 milli-arcseconds or so.  Andy's only looked at this for stars, what he'd like to do is look at this for quasars as well – things with a bit more  different extreme spectral energy distributions. It seems that we can put out a pretty good  model that produces diffraction for DCR based upon source colors alone. He'll be adding plots to his JIRA page as he finalizes his analysis.
  • No blockers.

Action Items

  •