Tier1 and Tier-2 Weekly Report 2017-05-23

Tier1 and Tier-2 Weekly Report 2017-05-23

General News

ADC Tech Coord Meeting [20170522]
- RAL-Azure Storage
- ATLAS Jobs on Azure (RAL)
- Event Service on BOINC
ADC Weekly Meeting [20170523]
- MC Production
  - No issues seen in production in last 7 days, apart from some imbalance in MC16 share (53%).
  - About 80% or resources being used for MC. Producing 30-70M sim events per day
  - ~1.5B events in queue (MC15: 1B, MC15: 0.5B)
- Group Derivation Production
  - 21.0.19.3 built yesterday
    - The broken trains in previous cache have been fixed (except HIGG1D1) - running validation (on 5 runs) for these now
    - Hoping for feeback on the validation runs in tomorrow's train coordination meeting
  - Short term plans
    - Build 21.0.19.4 sometime this week - will most probably be the cache for first collision data
    - The plan is then to move to git for AtlasDerivation
  - Open-ended production
    - Containers to be used:
      - data17_13TeV.physics_Main.OpenEnded.AOD.t0prod21_v01
      - data17_13TeV.physics_ZeroBias.OpenEnded.AOD.t0prod21_v01
    - Updated the train config based on size estimates from the validation runs
      - 99 formats in 15 trains
      - Expect a few special formats to run outside the trains
- CRC/ADCoS Report - none this week
  - Running ~300-350k slots all week
    - Last bits of reprocessing campaign, otherwise MC production
  - Couple of periods of data consolidation and rebalancing at end of reprocessing campaign (1-2PB/day transferred routinely)
    - Tape endpoints are suffering from too much data transfered too quickly to them even if the throughput from the tape buffer to real tape is OK
  - Squids and Frontier overload problems continuing
  - Last Friday BNL got tasks for MinBias stream reprocessing and also (uncorrelated but at the same time) an overlay task
    - Failovers over the weekend to TRIUMF and IN2P3 Frontier servers
CA Cloud Squad Actions
- User DaTRI requests approved / processed (last week)
Open Issues and Ongoing Discussions
- Availability & Reliability Reports [20170328]
  - 2017 Reports - click down to find reports of format WLCG_All_Sites_ATLAS_MMMYYYY.(html|pdf)
- Sites should be providing the 2016 storage pledge.
  - REBUS Site Capacities
  - REBUS Federation Resource Pledges
- ATLAS Canada HammerCloud Tests
WLCG and General Computing News
- Security News
- gLite/EMI News
ROC_Canada News
- Current shift