Tier1 and Tier-2 Weekly Report 2016-09-13

General News

• ADC Technical Coordination Meeting [20160912]
  • PanDA Pilot Movers Migration
  • WLCG/Globus Online integration for data movement on US HPC sites
  • Benchmarking in VMs - Randy Sobie
• ADC Weekly Meeting [20160913]
  • MC Production
    • Grid kept busy last week - Sherpa 2.2.1 W+jets (400M) and ttbar+jets (50M)
    • Request for ECFA samples (14TeV) to be given high priority (EVGEN)
    • Low priority request for 8TeV W+jet (330M full sim, 170M EVGEN)
    • Moving forward with testing pileup file scheme once approved
    • Request to not delete log files from EVNT production (currently 1 year lifetime). To be discussed at CREM
  • Group Derivation Production
    • AthenaMP validation has not revealed any show stoppers
      • Running successfully with nGBperjob=120GB (factor 10 increase)
    • Next cache to be built this week - 20.7.7.8
      • Plan to use it for AthenaMP
      • Likely switch open-ended production too
    • Following up on some long running jobs
  • Reprocessing
  • CRC/ADCoS report
    • Routinely running 250k job slots
    • Reprocessing with 21.0.5 with RAWtoALL setup
    • Prestaging 10 datasets for next reprocessing campaign (since Wed)
    • Rebalancing data to avoid full T1 DATADISK (FZK, IN2P3, SARA, BNL)
    • Large number of pending analysis jobs (>700k pending)
      • Few users sending huge production
      • One has 5.5 GB/core - task aborted
    • Still investigating cause of Kibana instability last week
    • Few central service glitches
    • Transfer failure at TRIUMF due to load on staging area mentioned
• CA Cloud Squad Actions
  • User DaTRI requests approved / processed (last week)
• Open Issues and Ongoing Discussions
  • Availability & Reliability Report [20160216]
    • January 2016 - All Sites Report ATLAS
  • Sites should be providing the 2015 storage pledge.
    • REBUS Site Capacities
    • REBUS Federation Resource Pledges
  • ATLAS Canada HammerCloud Tests
• WLCG and General Computing News
  • Security News
  • gLite/EMI News
• ROC_Canada News
  • Current shift

ABCD Determination and Monitoring

• SSB Qualification and ABCD Determination Wiki
• CA Cloud - Panda Resource Status
• CA Cloud - Switcher Actions
• CA Cloud - ABCD Determination

SSB Results

• Critical tests for each site in the Site Status dashBoard are available at the links below
  • Australia-ATLAS
  • CA-MCGILL-CLUMEQ-T2
  • CA-SCINET-T2
  • CA-ALBERTA-WESTGRID-T2
  • CA-VICTORIA-WESTGRID-T2
  • SFU-LCG2
  • TRIUMF-LCG2

SAM Results (based on VO tests)

• ATLAS Site Availability for last two weeks - CA Cloud
• ROC_Canada
• Australia_ATLAS

APEL Accounting

• ACTION ITEM FOR SITES: Sites please regularly check and confirm that your historical APEL data has been published and looks correct when comparing with batch system utilization
  • See example steps circulated by D. Qing (20100406)
    • account09.c
  • See EGI Accounting Portal (Canada)
  • See EGI Accounting Portal (Australia)
  • Links
    • [1] http://wiki.hellasgrid.gr/wiki/bin/view/HellasGrid/GOC/MONToAPEL
    • [2] http://goc.grid.sinica.edu.tw/gocwiki/glite-APEL

APEL Synchronization Test Links

• TRIUMF-LCG2
• Australia-ATLAS
• CA-VICTORIA-WESTGRID-T2
• CA-MCGILL-CLUMEQ-T2
• CA-SCINET-T2
• SFU-LCG2

Production and Usage Status

• ADC Job Summaries Dashboard
• Within the CA Cloud and Worldwide ( Panglia View):

-- %USERSIG{LeslieGroer - 2016-09-13%

Comments