Tier1 and Tier-2 Weekly Report 2015-04-21

Tier1 and Tier-2 Weekly Report 2015-04-21

General News

ADC and ATLAS Computing News [20150421]
- ADC Weekly meeting
- Rucio Update
  - New release tomorrow (0.3.3)
    - Better support for replicas without rules - Listed as secondary with DQ2 client
    - PanDA developers agreed to use the information provided by the new client for brokering
      - This should solve the problem with secondary replicas seen by users/DAST but not used for brokering
    - Rucio will validate SURLs given by PanDA during registration, if they match the RSE where the files are registered
  - DaTRI successor
    - Being beta-tested
    - Will be presented during the next ADC weekly
  - Permission changes
    - Allow cloud admins to declare bad/lost files
  - Send permanent errors to PanDA
    - Rucio will send a callback if an input file cannot be transferred for fatal reasons (e.g. missing file)
- HLT Reprocessing
  - Some questions on managing output and merging HIST_HLTMON
  - How to also save AOD/ESD from first step to group disk automatically?
  - How to set up merging for HIST and cost monitoring outputs?
- Reprocessing Summary
  - Two Muon productions launched on Thursday last week: https://twiki.cern.ch/twiki/bin/view/Atlas/ReprocessingCampaigns2015#3_Reprocessing_of_2012_DRAW_ZMUM
  - 2012 DRAW_ZMUMU, 286 runs, merged-AOD only
    - essentially done, waiting on registration of final merged-ds by PS2 : is general problem right now?
    - will make a container for these data: data12_8TeV.periodAllYear.physics_Muons.PhysCont.DAOD_ZMUMU.repro17_v02/
  - Period B Muons stream, 27 runs, merged-AOD and hypermerged-HIST
    - Reco: 12/72 tasks still running, problems at IT and TW to get started
      - 2 tasks finished rather than done due to known missing lumi info ATLASRECTS-1963
    - AOD-merge: 59/72 done, 1 has a problem with 15% of jobs (although reco ok), ticket to come, is solenoid dump run 204442
    - HIST-hypermerge (3 merge steps): 56/72 done
  - Thanks to Rod over the weekend, things going rather fast, e.g. Quite a few transfers stuck for 48h, jobs killed by hand, resubmitted and done within a few hours
  - 2015 cosmic runs
    - New reprocessing underway since yesterday, only 23 runs; output AOD, ESD, HIST, NTUP_MUONCALIB
  - Containers
    - It seems the physics containers now made in AMI interface are different to before and they cannot be used for e.g. derived production in PS2
    - Not clear where the inconsistency coming from (Rucio/AMI/JEDI/DEFT/PS2) but being investigated
- AMOD/ADCoS Report
  - Most shifts covered this week (17/21) and next
  - Some Open issues
    - Global CVMFS degraded. ELOG 53275.
    - Pilotfactories degraded. ELOG 53219.
CA Cloud Squad Actions
- User DaTRI requests approved / processed (last week)
Open Issues and Ongoing Discussions
- Sites should be providing the 2014 storage pledge.
  - REBUS Site Capacities
  - REBUS Federation Resource Pledges
- ATLAS Canada HammerCloud Tests
WLCG and General Computing News
- Security News
- gLite/EMI News
ROC_Canada News
- Current shift