Tier1 and Tier-2 Weekly Report 2017-01-10

General News

• ADC Technical Coordination Meeting [20170109]
  • Discussions about AMI and IPv6 Readiness
• ADC Weekly Meeting [20170110]
  • MC Production
    • All the approved 1.7B events were submitted during the break
    • Grid mostly filled - processed about 600M events, about 900M in prod queue
    • One minor glitch with DB release around Dec 30
    • Is a bit of an issue that not many requests 100% completed due to all having same priority
  • Group Derivation Production
    • Big Processing Campaign 20.7.8.7
      • Using slow merge and AthenaMP with 30/25 GB input per job (data/mc) - worked well
      • DATA
        • 22 high priority formats in 12 trains submitted on data15 and data16 before Xmas
        • data15 96% done, data16 85% done
        • Not many software issues - one being followed up on
        • 76 formats submitted in 16 trains with normal priority on same data not started yet
      • MC
        • Some rejiggering of priorities needed
        • Pattern requests from Dec 22 and 96% of 17000 tasks done
        • Again, mostly smooth production
      • Sizes so far
        • data16 526TB
        • data15 92TB
        • mc15 - 626TB skim, 207TB noskim
        • About 1.4PB so far, expect ~3x more when everything processed
  • Reprocessing
    • Successfully ran over Xmas break, including full slices tests on 3 runs in the latest release 21.0.13, built in last week
    • Already fixed some issues for the next release, including large memory leak
    • Being validated before next release
      • ~Feb 5th for release for final PhysVal, potentially launching bulk 2 weeks later
    • Need to complete 2016 debugrec_hlt (almost done)
    • Potential re-reprocessing of minBias stream of (25) ALFA runs, not yet clear
  • CRC/ADCoS Report
• CA Cloud Squad Actions
  • User DaTRI requests approved / processed (last week)
• Open Issues and Ongoing Discussions
  • Availability & Reliability Report [20160216]
    • January 2016 - All Sites Report ATLAS
  • Sites should be providing the 2015 storage pledge.
    • REBUS Site Capacities
    • REBUS Federation Resource Pledges
  • ATLAS Canada HammerCloud Tests
• WLCG and General Computing News
  • Security News
  • gLite/EMI News
• ROC_Canada News
  • Current shift

ABCD Determination and Monitoring

• SSB Qualification and ABCD Determination Wiki
• CA Cloud - Panda Resource Status
• CA Cloud - Switcher Actions
• CA Cloud - ABCD Determination

SSB Results

• Critical tests for each site in the Site Status dashBoard are available at the links below
  • Australia-ATLAS
  • CA-MCGILL-CLUMEQ-T2
  • CA-SCINET-T2
  • CA-ALBERTA-WESTGRID-T2
  • CA-VICTORIA-WESTGRID-T2
  • SFU-LCG2
  • TRIUMF-LCG2

SAM Results (based on VO tests)

• ATLAS Site Availability for last two weeks - CA Cloud
• ROC_Canada
• Australia_ATLAS

APEL Accounting

• ACTION ITEM FOR SITES: Sites please regularly check and confirm that your historical APEL data has been published and looks correct when comparing with batch system utilization
  • See example steps circulated by D. Qing (20100406)
    • account09.c
  • See EGI Accounting Portal (Canada)
  • See EGI Accounting Portal (Australia)
  • Links
    • [1] http://wiki.hellasgrid.gr/wiki/bin/view/HellasGrid/GOC/MONToAPEL
    • [2] http://goc.grid.sinica.edu.tw/gocwiki/glite-APEL

APEL Synchronization Test Links

• TRIUMF-LCG2
• Australia-ATLAS
• CA-VICTORIA-WESTGRID-T2
• CA-MCGILL-CLUMEQ-T2
• CA-SCINET-T2
• SFU-LCG2

Production and Usage Status

• ADC Job Summaries Dashboard
• Within the CA Cloud and Worldwide ( Panglia View):

-- %USERSIG{LeslieGroer - 2017-01-10%

Comments