Tier1 and Tier-2 Weekly Report 2014-02-11

General News

• ADC and ATLAS Computing News [20140211]
  • SAM VO:ATLAS AVAILABILITY
  • 
  • 
  • ADC Weekly meeting
  • HC tests with JEDI
    • Testing at 4 sites (CERN, BNL, LRZ, DESY)
    • simple ROOT job accessing SMWZ_NTUP with 1 job/task
    • Fixed various issues along the way (LFC lookups, not using local replicas)
    • Ready to expand the testing to more sites
    • Used ganga so far, need real users for prun/pathena
    • Start with some powerusers so direct control and interaction with Tadashi
  • SSB Automation
    • ABCD - measure site availability for ATLAS user analysis
      • Being done manually once per month
      • Develop metrics: 10101 (PandaResouce Status), 10100 (Switcher Actions), new 10102 (combine Panda Resource status - in testing)
      • ALL_period = GOOD_period + BAD_period + NULL_period (in last 30 days)
      • ratio = GOOD_period / (ALL_period - NULL_period
      • If test period (20 min) get 60 min grace period
      • Few corner cases to be checked and coded (e.g. grace periods when have scheduled and unscheduled downtimes back-to-back)
      • T1: A>90, C 80-90, D<80
      • T2: A(T2D)>90, B(T2)>90, C 80-90, D<80
    • T2D Status
      • metric 10097: http://dashb-atlas-ssb.cern.ch/dashboard/request.py/siteviewhistory?columnid=10097
      • Introduce T2D candidate
      • change threshhold 5MB/s to 4MB/s
      • transfer speed in both directions: was average, now look at minimum for both
      • remove T1s and T3s from the view
      • (To do) produce metric T2D candidates for medium files
      • Solve issue with transfers to NIKHEF T1
        • After that change soft criteria of < 3 Bad to strict criteria > 9 Good
      • Q: Are there T3's that should be in this (Chile)
      • Q: Old metrics will be in SSB still? A: Use only new metric as incorporates old
  • Panda Pilot Update (58i)
    • Improved error handling for failed replica lookups using DQ2 functioons
    • Increase pilot TCP message buffer from 2kB to 4kB
    • Use /afs releases correctly with no cmtconfig in path
    • Fix parsing of /ruciotest for SURLs
  • AOB
    • FR sites having issues with build jobs spawning too many processes on 24 and 32 core systems. Limit memory use per job and not per process (as seems to be done at TRIUMF). Make flags can limit this but not scalable solution.

• CA Cloud Squad Actions [20120626]
  • User DaTRI requests approved / processed (last week)
  • Declared Downtimes

• • HammerCloud autoexclusions

• • other cloud squad related savannah and / or ROC ggus tickets [20110705]
    • panda monitor for PD2P activity within clouds (default view (last 7 days) units = datasets)
• Open Issues and Ongoing Discussions
  • Sites should be providing the 2013 storage pledge.
    • http://gstat-wlcg.cern.ch/apps/capacities/sites/ http://gstat-wlcg.cern.ch/apps/pledges/resources
  • HammerCloud [20120214]
    • [20120214] Ongoing tests with McGill https://twiki.atlas-canada.ca/bin/view/AtlasCanada/McGill_Feb2012
    • [20110531] Ongoing tests with Victoria https://twiki.atlas-canada.ca/bin/view/AtlasCanada/CA_Cloud_Apr2011#Additional_Victoria_WG1_testing
    • HammerCloud tests of TRIUMF completed via panda to compare direct i/o via dcap, FileStager and full file copy
      • https://twiki.atlas-canada.ca/bin/view/AtlasCanada/TRIUMF_Aug2010
      • follow-up required to determine which modifications can be added to Panda schedconfig so as to enable the more efficient FileStager method of data input
    • HammerCloud tests of CA clouds sites is planned to be resumed soon to help measure site performance and identify any site setup bottlenecks [2010803]
      • TWiki Link: https://twiki.atlas-canada.ca/bin/view/AtlasCanada/CACloudOct2010

• Security News [20120801]

• gLite/EMI News [20121127]
  • [20121029] UMD v.2.2.1 has been released
  • [20120924] Retirement calendar of gLite 3.1 and currently unsupported gLite 3.2 products
  • [20120911] EMI-2 WN & UI rpms (SL5/x86_64) beta testing version available

• ROC_Canada News [20130625]
  • Current shift - Erming Pei June 24-28, 2013
  • Next Week - Leslie Groer

• WLCG and General Computing News [20120911]

SSB Results

• Critical tests for each site in the Site Status dashBoard are available at the links below
  • Australia-ATLAS
  • CA-MCGILL-CLUMEQ-T2
  • CA-SCINET-T2
  • CA-ALBERTA-WESTGRID-T2
  • CA-VICTORIA-WESTGRID-T2
  • SFU-LCG2
  • TRIUMF-LCG2

SSB PanDA Test Queue Availability (month) - this metric, measured for the analysis queues, defines the site status for data preplacement as alpha (T2D and avail > 90%), bravo (T2 and avail > 90%) or charlie (< 90%).

SAM Results

• site service status via Gridview - Please check your site

• April 2012 Detailed Site Information (valid until 20120430):
  • TRIUMF-LCG2
    • OPS (this month)
    • ATLAS (this month)
  • Australia-ATLAS
    • OPS (this month)
    • ATLAS (this month)
  • CA-ALBERTA-WESTGRID-T2
    • OPS (this month)
    • ATLAS (this month)
  • CA-SCINET-T2
    • OPS (this month)
    • ATLAS (this month)
  • CA-VICTORIA-WESTGRID-T2
    • OPS (this month)
    • ATLAS (this month)
  • SFU-LCG2
    • OPS (this month)
    • ATLAS (this month)

APEL Accounting

• ACTION ITEM FOR SITES: Sites please regularly check and confirm that your historical APEL data has been published and looks correct when comparing with batch system utilization
  • See example steps circulated by D. Qing (20100406)
    • account09.c
  • See EGEE Accounting Portal (Canada)
  • See EGEE Accounting Portal (Australia)

• • Links
    • [1] http://wiki.hellasgrid.gr/wiki/bin/view/HellasGrid/GOC/MONToAPEL
    • [2] http://goc.grid.sinica.edu.tw/gocwiki/glite-APEL

APEL Publishing Status

APEL Accounting Results

APEL Synchronization Test Links

• http://goc-accounting.grid-support.ac.uk/rss/TRIUMF-LCG2_Sync.html
• http://goc-accounting.grid-support.ac.uk/rss/Australia-ATLAS_Sync.html
• http://goc-accounting.grid-support.ac.uk/rss/CA-ALBERTA-WESTGRID-T2_Sync.html
• http://goc-accounting.grid-support.ac.uk/rss/CA-VICTORIA-WESTGRID-T2_Sync.html
• http://goc-accounting.grid-support.ac.uk/rss/CA-MCGILL-CLUMEQ-T2_Sync.html
• http://goc-accounting.grid-support.ac.uk/rss/CA-SCINET-T2_Sync.html
• http://goc-accounting.grid-support.ac.uk/rss/SFU-LCG2_Sync.html

Site Reports

Alberta

Recent Issues

• summary of this weeks Savannah bugs and GGUS tickets for site:

Outstanding Issues

SFU

Recent Issues

• summary of this weeks Savannah bugs and GGUS tickets for site:

Outstanding Issues

Victoria

Recent Issues

• summary of this weeks Savannah bugs and GGUS tickets for site:

Outstanding Issues

Toronto

Recent Issues

• summary of this weeks Savannah bugs and GGUS tickets for site:

Outstanding Issues

McGill

Recent Issues

• summary of this weeks Savannah bugs and GGUS tickets for site:

Outstanding Issues

TRIUMF

Recent Issues

• summary of this weeks Savannah bugs and GGUS tickets for site:

Outstanding Issues

Australia-ATLAS

Recent Issues

• summary of this weeks Savannah bugs and GGUS tickets for site:

Outstanding Issues

Production

Summary

• NOTE: ARDA ProdSys Dashboard has stopped being used by ADCoS team due to information updating issues with the interface. The historical job usage information is to appear separately within ARDA and is being validated. This will be used in the future for information presented here.

• Within the CA Cloud and Worldwide ( Panglia View):

• Alternate Views (Source link for last 7 days):
• http://dashb-atlas-prodsys.cern.ch/dashboard/request.py/summary?cloud=TRIUMF&grouping=site&grouping=cloud&end-date=2013-02-01%2020:59:59&start-date=2013-02-07%2020:00:00

-- Leslie Groer - 2014-02-11

Comments