Tier1 and Tier-2 Weekly Report 2018-01-16

Tier1 and Tier-2 Weekly Report 2018-01-16

General News

ADC Technical Coordination Meeting [20180115]
- Monitoring Update
- ADC Analytics - Status, Update and Future
  - Upgrade to Elastic Search 6.1
  - Consolidation and making this into a more coherent service
ADC Weekly Meeting [20180116]
- Group Derivation Production
  - November 2017 Rederivation Campaign
    - Chasing the tails of the remaining tasks
    - Few formats having issues with the bulk production are being resubmitted
  - Ongoing tests of the sharedWriter https://its.cern.ch/jira/browse/ATLASDPD-1011
  - Ongoing deletions based on the new obsolescence procedure
  - No heavy new requests
  - Up to 40k slots being used
- MC Production
  - Up to 300k slots this week (added 50k from P1)
    - 150k for MC16d, about 1B events processed. New evgen added last week
  - Over weekend added all MC16d bulk reco that does not have double tag issue (~1B events)
  - Working on 81 double-tag slices
  - Some tasks (12) affected by missing HITS from INFN
  - Progressing well on MC16c NTUP_PILE bulk samples
  - Large backlog of user requests (~30) still to be approved and plenty in the system
  - Don't start main reprocessing until done with bulk of MC16d processing (10-14 days)
- Reprocessing
  - First part of data17 reprocessing https://its.cern.ch/jira/browse/DATREP-101
  - Couple of issues being followed up on
  - Alignment tags need to be redone for 15 runs in period B
  - Second part of data17 reprocessing
    - Test tasks: https://prodtask-dev.cern.ch/prodtask/inputlist_with_request/14929/
    - Switched to release 21.0.54, new express tests running (r10232)
  - DATREP-111: reprocessing of 2016 length scale calibration run for luminosity with 2017 configuration (1 VdM run) (almost done)
- CRC/ADCoS Report
  - INFN - hope to be up end-Feb, tapes back too?
  - Some discussion about rerunning the MC data
- Pilot Update 1 v 72.2
  - Changed hostname -i to -I due to confusion with IPv6
  - Using calc_file_checksum() rather than adler32
  - Write PanDA IDs to file picked by wrapper
  - Event Service pilot now checks a site's state on DDM blacklist
CA Cloud Squad Actions
- User DaTRI requests approved / processed (last week)
Open Issues and Ongoing Discussions
- Availability & Reliability Reports [20170328]
  - 2018 Reports - click down to find reports of format WLCG_All_Sites_ATLAS_MMMYYYY.(html|pdf)
- Sites should be providing the 2017 storage pledge.
  - REBUS Site Capacities
  - REBUS Federation Resource Pledges
- ATLAS Canada HammerCloud Tests
WLCG and General Computing News
- Security News
- gLite/EMI News
ROC_Canada News
- Current shift