Tier1 and Tier-2 Weekly Report 2017-04-25

General News

• ADC Tech Coord Meeting [20170424]
  • New Athena Release Setup Support in PanDA
  • ProductionStep deriv (eliminate "merge" where can)
• ADC Weekly Meeting [20170425]
  • MC Production
    • Some issue with mc16 running slots few days ago - interaction with large score evnt mc15 jobs taking up slots
    • Current mc16:mc15 about 60%:40%
    • About 2.3B events in queue (mc16: 1.7B, mc15: 600M)
    • Priority order
      • mc16 digi+reco(pile) > mc16 simul > mc15
  • Group Derivation Production
    • Launched some test tasks with 21.0.1.19 - going well
    • Also testing derivation production on an AOD produced using up to 2 input files to one RAW reco job - no problems so far
    • About 4.8PB of obsoleted derivation data deleted last week
      • Question of how long to keep log files (about 3.7TB for a full campaign)
    • Seen issues again with reading 21.0.19 DAODs with POOL related to fast merge
      • Is it really worth using this as only save few percent processing time?
  • Reprocessing Campaign
    • https://twiki.cern.ch/twiki/bin/view/Atlas/Winter2017Run2Reprocessing#Bulk_processing
    • Been going for a month - getting up to 100k slots, campaign is moving along well
    • Issues with Australia timeouts now overcome
    • Task involving problematic HIST merge reported last week "recovered" yesterday, reco (re-)completed and merges now re-running, new HIST available
    • All 156 runs of 2016 now submitted, about 8 left to process
    • 25/106 runs of 2015 submitted yesterday
    • Other reprocessing: https://twiki.cern.ch/twiki/bin/view/Atlas/Special2017Reprocessing
    • HI DRAW_ZMUMU production completed (6 runs of 5 TeV pp data)
    • Tracking CP requests:
      • ZeroBias production: 6/8 runs done (AOD only)
      • MinBias production: 1/7 runs done (AOD + HIST, both merged)
  • CRC/ADCoS Report
    • Keeping 250k-300k slots filled all week, increasing fraction of mcore due to adjusting shares
    • Transferring just over 1PB/day, dominated by production inputs
    • Frontier overload problems continuing at CERN
      • Investigating (suspect local network issue?)
      • New server set up for interactive users at CERN to alleviate pain for simple software tests
  • ATLAS auto-exclusions
    • If issue or questions (switcher, blacklisting, etc): atlas-adc-autoexclusion-support@cern.ch
• CA Cloud Squad Actions
  • User DaTRI requests approved / processed (last week)
• Open Issues and Ongoing Discussions
  • Availability & Reliability Reports [20170328]
    • 2017 Reports - click down to find reports of format WLCG_All_Sites_ATLAS_MMMYYYY.(html|pdf)
  • Sites should be providing the 2016 storage pledge.
    • REBUS Site Capacities
    • REBUS Federation Resource Pledges
  • ATLAS Canada HammerCloud Tests
• WLCG and General Computing News
  • Security News
  • gLite/EMI News
• ROC_Canada News
  • Current shift

ABCD Determination and Monitoring

• SSB Qualification and ABCD Determination Wiki
• CA Cloud - Panda Resource Status
• CA Cloud - Switcher Actions
• CA Cloud - ABCD Determination

SSB Results

• Critical tests for each site in the Site Status dashBoard are available at the links below
  • Australia-ATLAS
  • CA-MCGILL-CLUMEQ-T2
  • CA-SCINET-T2
  • CA-ALBERTA-WESTGRID-T2
  • CA-VICTORIA-WESTGRID-T2
  • SFU-LCG2
  • TRIUMF-LCG2

SAM Results (based on VO tests)

• ATLAS Site Availability for last two weeks - CA Cloud
• ROC_Canada
• Australia_ATLAS

APEL Accounting

• ACTION ITEM FOR SITES: Sites please regularly check and confirm that your historical APEL data has been published and looks correct when comparing with batch system utilization
  • See example steps circulated by D. Qing (20100406)
    • account09.c
  • See EGI Accounting Portal (Canada)
  • See EGI Accounting Portal (Australia)
  • Links
    • [1] http://wiki.hellasgrid.gr/wiki/bin/view/HellasGrid/GOC/MONToAPEL
    • [2] http://goc.grid.sinica.edu.tw/gocwiki/glite-APEL

APEL Synchronization Test Links

• TRIUMF-LCG2
• Australia-ATLAS
• CA-VICTORIA-WESTGRID-T2
• CA-MCGILL-CLUMEQ-T2
• CA-SCINET-T2
• SFU-LCG2

Production and Usage Status

• ADC Job Summaries Dashboard
• Within the CA Cloud and Worldwide ( Panglia View):

-- %USERSIG{LeslieGroer - 2017-04-25%

Comments