Tier1 and Tier-2 Weekly Report 2016-07-05

Tier1 and Tier-2 Weekly Report 2016-07-05

General News

ADC and ATLAS Computing News [20160705]
ADC Technical Coordination Meeting [20160704]
- DDM/PanDA discussion on "soft" file deletion
ADC Weekly Meeting [20160705]
- PanDA Pilot v65.5
  - Extract guids for spill-over files from jobReport
  - Fix for bad TURLs in aria2c site mover
  - Retry for jobs that failed with "Get error: Rucio returned an empty replica dictionary"
  - Improved error diagnostics for globus system errors
  - Site mover update code ready for larger scale testing
  - Updates for AES@HPC
  - Release possibly end of this week
- MC Production
  - Still issues with keeping grid full over weekend
    - Lack of multicore jobs to keep grid saturated
    - Need to get tasks defined before Thursday so scouts have chance to run
    - May be an issue keeping jobs in queue due to vacation schedules
  - New big Sherpa request expected this week but may need supervision
  - Concern that all MC15c using mu=40 but LHC delivering higher luminosity so may need a MC15d. Will discuss with PC/PMG tomorrow
- Group Production
  - Still using open-ended derivation production 20.7.6.5 on data16
  - Built new 20.7.6.6 cache yesterday (not to be used for much production?)
  - Starting production of debug streams
  - Ongoing work on testing direct I/O in derivation production, testing AthenaMP (OK with MC but problems on data), production of pileup distributions
- Reprocessing
- CRC/ADCoS report
  - Half of ~1PB/day of data transfers is production input
  - SARA had network router problem Thu-Fri - fixed
  - Tier-0 spillover jobs working but validation incomplete (some differences in outputs)
    - Work to separate spillover jobs in job dashboard
  - Task and job brokering need improving to reduce data transfers
CA Cloud Squad Actions
- User DaTRI requests approved / processed (last week)
Open Issues and Ongoing Discussions
- Availability & Reliability Report [20160216]
  - January 2016 - All Sites Report ATLAS
- Sites should be providing the 2015 storage pledge.
  - REBUS Site Capacities
  - REBUS Federation Resource Pledges
- ATLAS Canada HammerCloud Tests
WLCG and General Computing News
- Security News
- gLite/EMI News
ROC_Canada News
- Current shift