Tier1 and Tier-2 Weekly Report 2017-02-07

General News

• ADC Tech Coord Meeting [20170206]
  • Analytics Infrastructure Platform status
  • Using DynaFed as an S3 gateway
• ADC Weekly Meeting [20170207]
  • MC Production
    • Have MC prod global fairshare at 90%
    • Still about 510M events in queue
    • Planning:
      • Start mc16 asap, but need to prioritize samples. Expect about 800M events which is 25-40 days, but there is still mc15 in system
      • Suggest maybe having separate global shares for mc15 and mc16, with fractions decided by PC/PMG.
      • Data reprocessing with release 21 will start around end of Feb.
  • Group Derivation Production
    • December processing campaign coming to an end. 22 tasks in finished state. Whole campaign took about 7 weeks with average 70k slots used. This is about 60-70% of a full MC campaign.
    • Data sizes: 2.5PB data16, 358TB data15, 832/693TB mc15 skim/noskim. Total 4.3PB
  • Reprocessing
  • CRC/ADCoS Report
    • Still see incorrect spikes for running jobs in monitoring for HPC centre job queueing (Titan)
    • Using about 250-280k cores last week steadily
    • Some derivation merge jobs reported as 8 instead of single core in dashboard
    • PanDA Controller migrated from PinkPanda to AGIS
    • Not many jobs on Tier-0 cluster yesterday - being investigated
    • Still discussing how to optimally broker high and low priority tasks
• CA Cloud Squad Actions
  • User DaTRI requests approved / processed (last week)
• Open Issues and Ongoing Discussions
  • Availability & Reliability Report [20160216]
    • January 2016 - All Sites Report ATLAS
  • Sites should be providing the 2015 storage pledge.
    • REBUS Site Capacities
    • REBUS Federation Resource Pledges
  • ATLAS Canada HammerCloud Tests
• WLCG and General Computing News
  • Security News
  • gLite/EMI News
• ROC_Canada News
  • Current shift

ABCD Determination and Monitoring

• SSB Qualification and ABCD Determination Wiki
• CA Cloud - Panda Resource Status
• CA Cloud - Switcher Actions
• CA Cloud - ABCD Determination

SSB Results

• Critical tests for each site in the Site Status dashBoard are available at the links below
  • Australia-ATLAS
  • CA-MCGILL-CLUMEQ-T2
  • CA-SCINET-T2
  • CA-ALBERTA-WESTGRID-T2
  • CA-VICTORIA-WESTGRID-T2
  • SFU-LCG2
  • TRIUMF-LCG2

SAM Results (based on VO tests)

• ATLAS Site Availability for last two weeks - CA Cloud
• ROC_Canada
• Australia_ATLAS

APEL Accounting

• ACTION ITEM FOR SITES: Sites please regularly check and confirm that your historical APEL data has been published and looks correct when comparing with batch system utilization
  • See example steps circulated by D. Qing (20100406)
    • account09.c
  • See EGI Accounting Portal (Canada)
  • See EGI Accounting Portal (Australia)
  • Links
    • [1] http://wiki.hellasgrid.gr/wiki/bin/view/HellasGrid/GOC/MONToAPEL
    • [2] http://goc.grid.sinica.edu.tw/gocwiki/glite-APEL

APEL Synchronization Test Links

• TRIUMF-LCG2
• Australia-ATLAS
• CA-VICTORIA-WESTGRID-T2
• CA-MCGILL-CLUMEQ-T2
• CA-SCINET-T2
• SFU-LCG2

Production and Usage Status

• ADC Job Summaries Dashboard
• Within the CA Cloud and Worldwide ( Panglia View):

-- %USERSIG{LeslieGroer - 2017-02-07%

Comments