Tier1 and Tier-2 Weekly Report 2014-04-29

Tier1 and Tier-2 Weekly Report 2014-04-29

General News

ADC and ATLAS Computing News [20140429]
- ADC Weekly meeting
- MC Production
  - Quite a few dips in production last week
  - With the current status of the system a lack of (medium size) requests for a short period results in large dips in the running jobs
  - 36M (FS) and 64M (AF2) for simulation and 170M for digi+reco are in the system
  - Ready to launch AF2 200M, FS just a few M
  - Might be a larger FS 400M SM group request coming
  - Hope this will keep grid busy until the DC14 13TeV sim is validated
- Rucio Migration
  - UK migrated last week without issues
  - NDG - next week (waiting for new ARC MW release)
  - CERN - week after?
  - US Cloud
    - LUCILLE migrated (was not using panda mover)
    - AGLT2 - turned panda mover off and no issues, so migrate next week. Other to follow
- Panda Pilot Update (58k)
  - Switching to FAX site mover for transferType xrd/fax (used in HC)
  - Updated replica loop so can grab replicas from different catalogs
  - Updated process killer to alleviate problem with lingering AthenaMP orphans
  - Only setting ATHENA_PROC_NUM when NCores > 1 to prevent AthenaMP using 1 process only
  - Use --cksum if available in xrdcp
  - Updated the Panda Logger URL
  - Corrected ERR_NOATHENAMETADATA --> ERR_NOPAYLOADMETADATA
- Exporting System Libraries for ATLAS on Special Facilities
  - Provide solution for ATLAS production jobs on clusters with base SL6 OS image and no further assumptions
  - Based on Parrot to get the CVMFS image
  - Slides
  - [[http://indico.cern.ch/event/307176/contribution/4/material/slides/0.pdf]One pager]]
- AMOD/ADCOS Report
  - Transfer issues in NL cloud
  - MPPMU groupdisk data lost, 80K files
  - IN2P3-CC storage full, blacklisted for writing
  - Migration to Jira of the main projects used by shifters
- Reprocessing Status
  - NTUP_COMMON v2 production is completed
  - Train Production
    - Derivation framework is ready to run train production on NTUP_COMMON as input as a pre-DC14 test
    - Build cache today
    - Expected data volume 300TB. Bulk should take about a week
    - Collecting MC samples from groups now
CA Cloud Squad Actions
- User DaTRI requests approved / processed (last week)
Open Issues and Ongoing Discussions
- Sites should be providing the 2014 storage pledge.
  - REBUS Site Capacities
  - REBUS Federation Resource Pledges
- ATLAS Canada HammerCloud Tests
WLCG and General Computing News
- Security News
- gLite/EMI News
ROC_Canada News
- Current shift