Tier1 and Tier-2 Weekly Report 2018-01-30

Tier1 and Tier-2 Weekly Report 2018-01-30

General News

ADC Technical Coordination Meeting [20180129]
- Switcher Future
ADC Weekly Meeting [20180130]
- Group Derivation Production
  - Only few tasks not finished from campaign (mostly stagein failures)
  - Groups creating period containers
  - MC prod of MC16a+c almost done (some affected by INFN)
  - New AthDerivation cache will be built this week - fix a few bugs
- MC Production
  - HLT farm unavailable for part of the last week - back to 300k slots
  - Solid 100-150k slots for MC16d reco for last 2 weeks - processed about 1.5B events
  - MC16c NTUP_PILEUP production for bulk samples done (apart from INFN data). User requests in progress
  - Additional evgen submitted last week - about 150M MC16e W+jets
  - Still large backlog of new user requests (almost 50) waiting for approval
- Reprocessing
  - First part of data17 reprocessing - remaining issues slowly being treated.
    - DQ has started to produce validation webdisplays.
  - Preparation of period B 15+1 runs to fix alignment errors - testing
  - Trigger tests for second part of fast reprocessing - Serves as validation of HLT monitoring with fork workflow.
  - Setup couple runs per period (F,H,I,K) for reprocessing - waiting for alignment validation
  - Reprocessing of 2017 5 TeV and 13 TeV low mu data for jet/etmiss (running)
  - Reprocessing of 2015 low-mu 13 TeV Data. Scouts taking a bit of time
- CRC/ADCoS Report
  - CERN machines rebooted to apply kernel updates
  - CERN-P1 in cooling maintenance (40k slots)
  - Wallclock issue fixed in aCT with wrong start times
  - CERN database issues last Monday
  - RAL FTS issues since last Thursday (backend database)- switch ND, IT and UK clouds to CERN and BNL
  - RAL Castor issues due to dCache performance issues after building huge backlog - caused 600TB to be deleted and 15 hours to reindex database
  - Tape buffers do not have automatic transfer throttling which is needed with new disk + tape replica storage policy
  - Need to enforce dataset name length limit (255 characters) for rucio and AMI tags - shorten sequence numbers
- Pilot Update 1 v 72.3
  - Harvester mode
    - Get job updated for Harvester work flow - implemented in pilot 1 + 2
  - Event Service updates
    - AthenaMP killed if does not respond after 360 mins
    - fix for problem with ACT logs not matching correct job id
  - release after Harverster testing
CA Cloud Squad Actions
- User DaTRI requests approved / processed (last week)
Open Issues and Ongoing Discussions
- Availability & Reliability Reports [20170328]
  - 2018 Reports - click down to find reports of format WLCG_All_Sites_ATLAS_MMMYYYY.(html|pdf)
- Sites should be providing the 2017 storage pledge.
  - REBUS Site Capacities
  - REBUS Federation Resource Pledges
- ATLAS Canada HammerCloud Tests
WLCG and General Computing News
- Security News
- gLite/EMI News
ROC_Canada News
- Current shift