Tier1 and Tier-2 Weekly Report 2018-08-28

General News

• ADC Technical Coordination Meeting [20180827]
  • BigPanDA Monitoring Updates
  • Incremental Data Processing
  • Fabric Monitoring via pilot wrappers (APF) integration with Harvester
• ADC Weekly Meeting [20180828]
  • Group Derivation Production
    • No issues with main open-eneded requests (Main, calibration_BphysPEB, BPhysLS streams)
    • Test derivation production for mc16e - many tasks finished, some are being followed up
    • No new caches.
    • Bulk mc16e will start in ~ 2 weeks (about a month with 150k slots)
  • MC Production
    • MC16e reco running 100-150k slots for last few weeks - 150M events/day, 2.76B total
      • ~ 2 weeks to complete. Still need to do AOD merge, pileup steps
      • Another 0.6B single top events coming
  • Data17 Reprocessing
    • Reprocessing of data17 physics_ZeroBias complete
    • 2017 low mu data coming up (waiting on some DB updates)
    • Bunch of other tasks ongoing
  • CRC/ADCoS Report
    • Steady ~300k slots used this week
    • Recent transfer issues to SFU pointed out (restart dcache headnode)
    • Increased data throughput later in the week due to derivation job brokerage for jobs with high IO intensity
      • Jobs could not run at nuclei as their queues were full and not allowed to run at satellites as iolimit set to 200kBperS (increased to 400 now)
    • IPv6 issue at RAL caused increase in queued requests in rucio - switch to CERN FTS until resolved
    • Few other T-1 issues - resolved
    • No shifters signed up for the rest of the year
• CA Cloud Squad Actions
  • User DaTRI requests approved / processed (last week)
• Open Issues and Ongoing Discussions
  • Availability & Reliability Reports [20170328]
    • 2018 Reports - click down to find reports of format WLCG_All_Sites_ATLAS_MMMYYYY.(html|pdf)
  • Sites should be providing the 2017 storage pledge.
    • REBUS Site Capacities
    • REBUS Federation Resource Pledges
  • ATLAS Canada HammerCloud Tests
• WLCG and General Computing News
  • Security News
  • gLite/EMI News
• ROC_Canada News
  • Current shift

ABCD Determination and Monitoring

• SSB Qualification and ABCD Determination Wiki
• CA Cloud - Panda Resource Status
• CA Cloud - Switcher Actions
• CA Cloud - ABCD Determination

SSB Results

• Critical tests for each site in the Site Status dashBoard are available at the links below
  • Australia-ATLAS
  • CA-SFU-T2
  • CA-VICTORIA-WESTGRID-T2
  • CA-WATERLOO-T2
  • TRIUMF-LCG2

SAM Results (based on VO tests)

• ATLAS Site Availability for last two weeks - CA Cloud
• ROC_Canada
• Australia_ATLAS

APEL Accounting

• ACTION ITEM FOR SITES: Sites please regularly check and confirm that your historical APEL data has been published and looks correct when comparing with batch system utilization
  • See example steps circulated by D. Qing (20100406)
    • account09.c
  • See EGI Accounting Portal (Canada)
  • See EGI Accounting Portal (Australia)
  • Links
    • [1] http://wiki.hellasgrid.gr/wiki/bin/view/HellasGrid/GOC/MONToAPEL
    • [2] http://goc.grid.sinica.edu.tw/gocwiki/glite-APEL

APEL Synchronization Test Links

• TRIUMF-LCG2
• Australia-ATLAS
• CA-SFU-T2
• CA-VICTORIA-WESTGRID-T2
• CA-WATERLOO-T2

Production and Usage Status

• ADC Job Summaries Dashboard
• Within the CA Cloud and Worldwide ( Panglia View):

-- Leslie Groer - 2018-08-28

Comments