Tier1 and Tier-2 Weekly Report 2018-09-11

Tier1 and Tier-2 Weekly Report 2018-09-11

General News

ADC Technical Coordination Meeting [20180910]
- DOMA Access and Caching - link to Sep 4 kickoff meeting; looking for a co-chair in Europe/ATLAS
- Intro to Kubernetes for ATLAS payloads
- Discussion on SAM tests and possible reporting
ADC Weekly Meeting [20180911]
- Group Derivation Production
  - Open ended production continues for Main and BphysPEB streams; BPhysLS stream will be resumed
  - New cache built Friday, redoing the buggy production
  - Starting with this cache, will be running MC production in trains
  - Few new requests, most pending since last week
  - Global share was raised to 20% on Monday (~60k cores)
- MC Production
  - MC16e reco launched about 6 weeks ago, running with between 100-150k slots on grid. About 4.5B events done
  - Another ~590M for single top submitted
- Data17 Reprocessing
  - Preparing for fast reprocessing of data17 (Winter 17)
  - Reprocessing of 2017 5 TeV (period M) and low mu (period N) coming up
    - Running test slices now
  - Numerous other tasks underway
- News from ADCOS
  - Presented several monitoring and debugging tools and upgrades underway to ease the shifter burden
    - New BigPanda page: Request/Task vs Region/Site. Available under Errors->Scattering Matrix: https://bigpanda.cern.ch/errorsscat/
    - Improvements proposed to the SAM tests and monitoring: https://twiki.cern.ch/twiki/bin/view/AtlasComputing/ATLASSAMTests
    - New DDM Dashboard
    - DDM Accounting dashboard - being discussed
    - Using Machine Learning - being looked at
  - Issue of shifter shortage likely to grow
- CRC/ADCoS Report
  - Mostly quiet week. Few minor T1 issues
  - Site blacklisting Thu-Fri for about 2 hours due to pilot error ("Failed to get replicas from Rucio")
- Automatic Conversion of ES Tasks with Jumbo jobs
  - For HPC sites - define task with ~1M events to be dynamically fed to resources
CA Cloud Squad Actions
- User DaTRI requests approved / processed (last week)
Open Issues and Ongoing Discussions
- Availability & Reliability Reports [20170328]
  - 2018 Reports - click down to find reports of format WLCG_All_Sites_ATLAS_MMMYYYY.(html|pdf)
- Sites should be providing the 2017 storage pledge.
  - REBUS Site Capacities
  - REBUS Federation Resource Pledges
- ATLAS Canada HammerCloud Tests
WLCG and General Computing News
- Security News
- gLite/EMI News
ROC_Canada News
- Current shift