Tier1 and Tier-2 Weekly Report 2018-02-27

Tier1 and Tier-2 Weekly Report 2018-02-27

General News

ADC Technical Coordination Meeting [20180226]
- Direct I/O update
- Survey of job types from Kibana
- Tape prestaging and usage
ADC Weekly Meeting [20180227]
- Group Derivation Production
  - sharedWriter tests - fixes for metadata isssues being implemented
  - Few small data requests
  - No new caches this week
  - Two of the larger formats (>2% of AOD) with be merged, discontinue one
- MC Production
  - INFN back so restarted paused MC16d prod
  - Some MC16c NTUP_PILE submitted as well
  - Adding MC16e and BPHYS to P1 manually - going rapidly
  - Need MC16e to start now as evgen has to run first. Discussed in PC
  - Going through backlog of user requests - down to 34 from 60
    - Tend to be small but more work than general submissions
- Reprocessing
  - Still need to produce list of umerged AODs that can be obsoleted
  - First part of data17 reprocssing nearing the end - make containers soon
  - [RUNNING - almost done] Period B 15+1 runs to fix alignment errors in first reprocessing pass (no fork after first event)
  - Reprocessing of F, H, I and K - almost done (except K 20% 1.6B events)
  - First test runs of NCB request in pipeline - output files may be large
  - Working out details for large RPVLL reprocessing
- INFN Update - verbal
  - Still 2/3 of chillers online so not all farm there yet
  - Working on HC tests
- CRC/ADCoS Report
  - Transfer failures in ND and UK cloud due to RAL FTS
  - DAOD merging job crashes on input files
  - Some lost files to CERN-PROD under investigation
  - Minor issues at T1s
- PanDA Pilot 1 v72.5 update
  - Harvester mode - support for kill-worker file to signal end of pilot
  - Support for Rucio API in stage-in/out
  - Added missing platform (cmtconfig) string in default memory monitor setup (requested by Asoka)
  - Add new pilot error code for trf exit code 146 (user tarball cannot be downloaded)
  - Event Service
    - Restart mechanism added for Prefetcher
    - Support for remote stage-in
    - Bug fixes - disabling prefetch events, retry of merge jobs
  - Release asap
CA Cloud Squad Actions
- User DaTRI requests approved / processed (last week)
Open Issues and Ongoing Discussions
- Availability & Reliability Reports [20170328]
  - 2018 Reports - click down to find reports of format WLCG_All_Sites_ATLAS_MMMYYYY.(html|pdf)
- Sites should be providing the 2017 storage pledge.
  - REBUS Site Capacities
  - REBUS Federation Resource Pledges
- ATLAS Canada HammerCloud Tests
WLCG and General Computing News
- Security News
- gLite/EMI News
ROC_Canada News
- Current shift