Tier1 and Tier-2 Weekly Report 2017-11-07

General News

• ADC Technical Coordination Meeting [20171106]
  • BigPanDA Monitoring
  • Unifying PanDA Queues for production
• ADC Weekly Meeting [20171107]
  • MC Production
    • Steady 250k running slots this week
    • Plenty in queue at moment. Finishing off tails for various samples
    • Have 200M of 650M of large BPHY sample for mc16a sim(AF2 mcore) and reco. Lower priority so taking a while
    • 400M of mc16e evgen submitted (Sherpa W, Z+jets), 256M done, another ~400M to submit
    • MC15 essentially all evgen
  • Group Derivation Production
    • Average 35k job slots, peak 60k
    • Groups should be signing off the derivations soon and plan for production starting ~Nov 20
    • Various issues during validation
      • merging issues with metadata not propagating - fixed
      • memory leaks, seg faults, output issues - resubmit without problematic carriages
    • New obsolescence procedure for derivations - presented to CREM
      • When derivation superseded a clock starts ticking and after 60 days the derivation task will be obsoleted and the data set deleted
      • Can extend for another 60 days
      • Physics groups are allowed one version (n), CP groups two (n, n-1)
      • About 2.8PB superseded right now
      • MC: http://adc-mon.cern.ch/DAODProduction/DAILYCHECK_MC
      • DATA: http://adc-mon.cern.ch/DAODProduction/DAILYCHECK_DATA
  • Reprocessing
  • CRC/ADCoS Report
  • Proposal for Tier-3 policy for ICB
• Container Testing and Deployment [20171107]
  • TRIUMF Docker Deployment - Di
• CA Cloud Squad Actions
  • User DaTRI requests approved / processed (last week)
• Open Issues and Ongoing Discussions
  • Availability & Reliability Reports [20170328]
    • 2017 Reports - click down to find reports of format WLCG_All_Sites_ATLAS_MMMYYYY.(html|pdf)
  • Sites should be providing the 2016 storage pledge.
    • REBUS Site Capacities
    • REBUS Federation Resource Pledges
  • ATLAS Canada HammerCloud Tests
• WLCG and General Computing News
  • Security News
  • gLite/EMI News
• ROC_Canada News
  • Current shift

ABCD Determination and Monitoring

• SSB Qualification and ABCD Determination Wiki
• CA Cloud - Panda Resource Status
• CA Cloud - Switcher Actions
• CA Cloud - ABCD Determination

SSB Results

• Critical tests for each site in the Site Status dashBoard are available at the links below
  • Australia-ATLAS
  • CA-MCGILL-CLUMEQ-T2
  • CA-SCINET-T2
  • CA-ALBERTA-WESTGRID-T2
  • CA-VICTORIA-WESTGRID-T2
  • SFU-LCG2
  • TRIUMF-LCG2

SAM Results (based on VO tests)

• ATLAS Site Availability for last two weeks - CA Cloud
• ROC_Canada
• Australia_ATLAS

APEL Accounting

• ACTION ITEM FOR SITES: Sites please regularly check and confirm that your historical APEL data has been published and looks correct when comparing with batch system utilization
  • See example steps circulated by D. Qing (20100406)
    • account09.c
  • See EGI Accounting Portal (Canada)
  • See EGI Accounting Portal (Australia)
  • Links
    • [1] http://wiki.hellasgrid.gr/wiki/bin/view/HellasGrid/GOC/MONToAPEL
    • [2] http://goc.grid.sinica.edu.tw/gocwiki/glite-APEL

APEL Synchronization Test Links

• TRIUMF-LCG2
• Australia-ATLAS
• CA-VICTORIA-WESTGRID-T2
• CA-MCGILL-CLUMEQ-T2
• CA-SCINET-T2
• SFU-LCG2

Production and Usage Status

• ADC Job Summaries Dashboard
• Within the CA Cloud and Worldwide ( Panglia View):

-- Leslie Groer - 2017-11-07

Comments