Tier1 and Tier-2 Weekly Report 2011-06-28
General News
- ADC and ATLAS Computing News [20110627] https://indico.cern.ch/conferenceDisplay.py?confId=144167
- Data replication policy for T1's seems OK. Examining T2 policy as not necessarily doing good balance (designed more for rebrokering). Some mismatches with CPU availability at sites observed.
- Add concepts to PD2P:
- Express replica (for quick reuse) - original algorithm
- Long Term replica (aimed to balanced data distribution) - base on data disk sizes and performance in Analysis Functional Tests
- Data replication policy to be reviewed in 2 months. Pot below shows data movement for last month(?) for each cloud. Numbers for Canada inflated due to resubscription of data to Alberta.
-
- Clarify automatic MoU replication policy for NTUP and AOD even if not accessed.
- Discussion about group production
- Done aprrox. monthly by most groups (top, SM, WZ, SUSY, Higgs). Most AOD to NTUP but some use DAOD.
- Most groups moving to use common AtlasPhysics cache - allow multigroup tasks in future (will save CPU time)
- Preparation just started for rel.17
- Some discussion about management of analysis queues and cloud squad/shifter responsibilities
- Set to brokeroff and not online to allow automatic HC/GangaRobot testing and validation after going offline.
- CVMFS status report from Asoka
- Stratum 1 server in production and Stratum 0 to be decommisioned
- Integration and testing also going well on OSG sites
- CA Cloud Squad Actions [20110628]
- DaTRI requests approved / processed (last week)
| SITE |
NumRequests |
NumDatasets |
NumSubscribed |
SizeofAllDatasets (GB) |
| AUSTRALIA-ATLAS_SCRATCHDISK |
6 |
537 |
508 |
1332 |
| CA-VICTORIA-WESTGRID-T2_LOCALGROUPDISK |
4 |
206 |
206 |
8528 |
| CA-VICTORIA-WESTGRID-T2_PHYS_EXOTICS |
1 |
4 |
4 |
1 |
| SFU-LCG2_LOCALGROUPDISK |
2 |
102 |
102 |
4577 |
| TRIUMF-LCG2_LOCALGROUPDISK |
1 |
2 |
2 |
0.01 |
| TRIUMF-LCG2_SCRATCHDISK |
2 |
6 |
6 |
0.02 |
-
- Declared Downtimes
- CA-VICTORIA-WESTGRID-T2/SCHEDULED downtime (OUTAGE) [26-06-2011 10:00 to 26-06-2011 13:00 UTC] - Research network outage for replacement of a core router in our WAN
- SFU-LCG2/ SCHEDULED downtime (OUTAGE) [27-06-2011 14:00 to 01-07-2011 18:00 UTC] - UPS upgrade
- TRIUMF-LCG2/UNSCHEDULED downtime (WARNING) [27-06-2011 16:30 to 30-06-2011 01:00 UTC ] - Install new tape frames and tapes into tape library, tape system will be writing only
- SFU-LCG2/ UNSCHEDULED downtime (OUTAGE) [27-06-2011 16:00 to 29-06-2011 16:00 UTC ] - Draining the queue before the Wednesday shutdown
- ATLAS Site Exclusion Savannah entries [20110621]
- HammerCloud autoexclusions
- ANALY_SFU Auto-Excluded at Wed Jun 15 06:00:03 2011 CET
- other cloud squad related savannah and / or ROC ggus tickets [20110607]
- Open Issues and Ongoing Discussions
- Sites should be providing the April 2011 storage pledge. [see 20110315 report.
- CREAM CE deployment preparations
- HammerCloud [20110531]
- Security News [20110621]
- [20110524] UVic and Toronto participated in SSC5 (23 May - 03 June 2011) - final reports to be sent to SSC5
- [20110616] EGI CSIRT ADVISORY [EGI-ADV-20110615-02] Vulnerability for LRMS (details to be posted later)
- ROC_Canada News [20110621]
- Current shift - Reda Tafirout June 20-24
- Next Week - Sergey Chelsky
- Squid Deployment [20110329]
SAM Results
- site service status via Gridview
- Please check your site







- June 2011 Detailed Site Information (valid until 20110631):
- TRIUMF-LCG2
- Australia-ATLAS
- CA-ALBERTA-WESTGRID-T2
- CA-SCINET-T2
- CA-VICTORIA-WESTGRID-T2
- SFU-LCG2
APEL Accounting
- ACTION ITEM FOR SITES: Sites please regularly check and confirm that your historical APEL data has been published and looks correct when comparing with batch system utilization
APEL Publishing Status

APEL Accounting Results

APEL Synchronization Test Links
Site Reports
Alberta
Recent Issues
- summary of this weeks Savannah bugs and GGUS tickets for site:
- production job issues
- See "Production" Activities section below
- analysis job issues
- See "Notes" section below
Outstanding Issues
Recent Issues
- summary of this weeks Savannah bugs and GGUS tickets for site:
- production job issues
- See "Production" Activities section below
- analysis job issues
- See "Notes" section below
Outstanding Issues
Victoria
Recent Issues
- summary of this weeks Savannah bugs and GGUS tickets for site:
- production job issues
- See "Production" Activities section below
- analysis job issues
- see "Notes" section below
Outstanding Issues
Toronto
Recent Issues
- summary of this weeks Savannah bugs and GGUS tickets for site:
- production job issues
- See "Production" Activities section below
- analysis job issues
- See "Notes" section below
Outstanding Issues
McGill
Recent Issues
Outstanding Issues
Recent Issues
- production job issues
- See "Production" Activities section below
- analysis job issues
- see "Notes" section below
Outstanding Issues
Australia-ATLAS
Recent Issues
- summary of this weeks Savannah bugs and GGUS tickets for site:
- production job issues
- See "Production" Activities section below
- analysis job issues
- See "Notes" section below
Outstanding Issues
Production



Summary
- NOTE: ARDA ProdSys Dashboard has stopped being used by ADCoS team due to information updating issues with the interface. The historical job usage information is to appear separately within ARDA and is being validated. This will be used in the future for information presented here.
- Within the CA Cloud and Worldwide (Panglia
View):
Failed Jobs
- From Panda Monitor (last day)
You can find the meanings of the transform error codes on
this link.
- Highlight's of Yuri's notes: (June 21-27, 2011)
World-wide weekly ATLAS ADCoS summary (Jun.21-27,2011)
I. General summary:
---------------
A) During the past week (Jun.21-27,2011) Panda production service
- completed 1,573,923 managed group, MC production, validation
and reprocessing jobs
- average ~224,846 jobs per day
- failed 96,745 jobs
- average efficiency:
-- jobs ~94.2%
- active tasks from Panda-monitor: 982
-- distribution by cloud:
CA:38 CERN:54 DE:100 ES:61 FR:131 IT:74 ND:50 NL:85 TW:4 UK:127 US:258
B) - CA/TRIUMF-LCG downtime (SE,SRM warning), Jun.27-30.
- New DB Release 15.7.0,15.9.1 subscription done, Jun.21,27.
- New pilot version (SULU 47h) released, Jun.23.
II. Site and FT/DDM related interruptions/issues/news (+fixed, -not yet)
-------------------------------------------------
No CA related events
--
LeslieGroer - 2011-06-27