SFU < AtlasCanada

AtlasCanada Web>GridActivities>HammercloudTests>SFU (2013-02-17, AsokaDeSilva) (raw view)
---+ SFU Arbutus Tests

%TOC%
---++ Introduction

Purpose was to run and also benchmark jobs on SFU's arbutus CE. Input datasets used were !triumf19Aug2010.txt which consisted of the following:
<verbatim>
mc09_7TeV.105830.JF17_herwig_jet_filter.merge.AOD.e507_s765_s767_r1215_r1210/
total files: 1971
total size: 2.01 TB
total events: 9851996
> dq2-list-datasets-container mc09_7TeV.105830.JF17_herwig_jet_filter.merge.AOD.e507_s765_s767_r1215_r1210/
dq2-list-datasets-container mc09_7TeV.105830.JF17_herwig_jet_filter.merge.AOD.e507_s765_s767_r1215_r1210_tid125847_00
mc09_7TeV.108087.PythiaPhotonJet_Unbinned17.merge.AOD.e505_s765_s767_r1215_r1210/
total files: 1000
total size: 755.12 GB
total events: 4994464
> dq2-list-datasets-container mc09_7TeV.108087.PythiaPhotonJet_Unbinned17.merge.AOD.e505_s765_s767_r1215_r1210/
mc09_7TeV.108087.PythiaPhotonJet_Unbinned17.merge.AOD.e505_s765_s767_r1215_r1210_tid125845_00
mc09_7TeV.108087.PythiaPhotonJet_Unbinned17.merge.AOD.e505_s765_s767_r1207_r1210/
total files: 500
total size: 757.96 GB
total events: 4994464
> dq2-list-datasets-container mc09_7TeV.108087.PythiaPhotonJet_Unbinned17.merge.AOD.e505_s765_s767_r1207_r1210/
mc09_7TeV.108087.PythiaPhotonJet_Unbinned17.merge.AOD.e505_s765_s767_r1207_r1210_tid124453_00
mc09_7TeV.105001.pythia_minbias.merge.AOD.e517_s764_s767_r1204_r1210/
total files: 1000
total size: 777.51 GB
total events: 9996249
> dq2-list-datasets-container mc09_7TeV.105001.pythia_minbias.merge.AOD.e517_s764_s767_r1204_r1210/
mc09_7TeV.105001.pythia_minbias.merge.AOD.e517_s764_s767_r1204_r1210_tid123082_00
mc09_7TeV.105001.pythia_minbias.merge.AOD.e517_s764_s767_r1204_r1210_tid123186_00
</verbatim>

Note there are 5 datasets in those 4 containers. (Note: the above datasets reside in !LOCALGROUPDISK and so new HC sites reflecting this need to be created.) Additional HC configurations: uncheck "Resubmit enabled" and set "Num datasets per bulk = 5". For Panda, filesize set by Dan/Johannes to -o[defaults_DQ2JobSplitter]filesize=13336 (in MB). For Ganga, configure HC to submit with filesize=13336 so that the number of jobs will match that of the Panda test.

These tests can be compared to that at [[https://twiki.atlas-canada.ca/bin/view/AtlasCanada/HammercloudTests][other sites]]; e.g. [[https://twiki.atlas-canada.ca/bin/view/AtlasCanada/Victoria-Hermes][Victoria HermesII]].

---++ Hardware Specs

See [[CACloudSiteHardware]]

Note that unless stated otherwise, the SW area is !cvmfs mounted by !nfs on WNs.

---+++ Cluster configuration

Dec 3 - Dec 7 13:30 - worker nodes: s1, b413, b414

Dec 7 13:30 - worker nodes: +b1 (offline until we run stress tests)

Dec 12- Worker nodes - b1, s1, b413, b414

Jan 11 12:20 PM - Worker nodes - b1, s1, b413, b414, b404, b405 (s1 is temporarily offline for investigations)

---++ Benchmark Tests

---+++ Test 14609

worker nodes: b413, b414 This test has the env variables ATLAS_LOCAL_AREA is undefined and VO_ATLAS_SW_DIR points to the nfs software area (VO_ATLAS_SW_DIR=/opt/exp_soft/atlas) instead of the cvmfs software area. (ie it will be like bugaboo).

Note: a wrapper lcg-cp script is being used for an EMI/d-cache problem.

[[http://hammercloud.cern.ch/hc/app/atlas/test/20014609/][Test 14609]]

---+++ Test 14659

worker nodes: b413, b414. Using cvmfs over nfs. Otherwise identical to test 14690.

Note: a wrapper lcg-cp script is being used for an EMI/d-cache problem.

[[http://hammercloud.cern.ch/hc/app/atlas/test/20014659/][Test 14659]]

---++ Stress Tests

---+++ Test Templates

| *Template* | *Description* |
| 486 | UA 17.2.2.1 Panda |
| 481 | UA 17.6.0 Panda !TTreeCache On skipEvent |
| <strike>469</strike> | <strike>17.6.0 !AODToEgammaD3PD PANDA default data-access</strike> |
| <strike>467</strike> | <strike>MC !AtlasG4 _trf 17.2.2.2 default data access</strike> |
| 453 | 17.0.6.4 !AODToPhysicsD3PD PANDA default data-access |
| 451 | Muon 16.0.3.3 PANDA default data access |
| 447 | Muon 16.0.3.3 PANDA Output Merging copy-to-scratch |
| 446 | Muon 17.0.6 PANDA default data-access |

---+++ Round1
---++++ Test 14725

Template 486, UA 17.2.2.1 Panda

[[http://hammercloud.cern.ch/hc/app/atlas/test/20014725/][Test 14725]]

---++++ Test 14728

Template 481 UA 17.6.0 Panda !TTreeCache On skipEvent

[[http://hammercloud.cern.ch/hc/app/atlas/test/20014728/][Test 14728]]

---++++ Test 14732

Template 469 17.6.0 !AODToEgammaD3PD PANDA default data-access

[[http://hammercloud.cern.ch/hc/app/atlas/test/20014732/][Test 14732]]

Aborted as this test fails.

---++++ Test 14733

Template 467 MC !AtlasG4 _trf 17.2.2.2 default data access

[[http://hammercloud.cern.ch/hc/app/atlas/test/20014733/][Test 14733]]

Test failed to submit ad is abandoned.

---++++ Test 14736

Template 453 17.0.6.4 !AODToPhysicsD3PD PANDA default data-access

[[http://hammercloud.cern.ch/hc/app/atlas/test/20014736/][Test 14736]]

---++++ Test 14738

Template 451 Muon 16.0.3.3 PANDA default data access

[[http://hammercloud.cern.ch/hc/app/atlas/test/20014738/][Test 14738]]

---++++ Test 14740

Template 447 Muon 16.0.3.3 PANDA Output Merging copy-to-scratch

[[http://hammercloud.cern.ch/hc/app/atlas/test/20014740/][Test 14740]]

---++++ Test 14742

Template 446 Muon 17.0.6 PANDA default data-access

[[http://hammercloud.cern.ch/hc/app/atlas/test/20014742/][Test 14742]]

---+++ Round2

---++++ Test Template 486

Template 486, UA 17.2.2.1 Panda

   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20015376/][Test 15376]] Completed
   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20015607/][Test 15607]] Completed
   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20017926/][Test 17926]]

---++++ Test Template 481

Template 481 UA 17.6.0 Panda !TTreeCache On skipEvent

   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20015377/][Test 15377]] Completed
   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20015539/][Test 15539]] Completed
   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20015610/][Test 15610]] Completed
   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20017936/][Test 17936]]

---++++ Test Template 453

Template 453 17.0.6.4 !AODToPhysicsD3PD PANDA default data-access

   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20015439/][Test 15439]] Completed
   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20015608/][Test 15608]] Completed
   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20017937/][Test 17937]]

---++++ Test Template 451

Template 451 Muon 16.0.3.3 PANDA default data access

   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20015440/][Test 15440]] Completed
   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20015609/][Test 15609]] Completed
   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20017938/][Test 17938]]

---++++ Test Template 447

Template 447 Muon 16.0.3.3 PANDA Output Merging copy-to-scratch

   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20015612/][Test 15612]] Completed
   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20017939/][Test 17939]]

---++++ Test Template 446

Template 446 Muon 17.0.6 PANDA default data-access

   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20015611/][Test 15611]] Completed
   * [[http://hammercloud.cern.ch/hc/app/atlas/test/20017941/][Test 17941]] 

---++ Results

---+++ Benchmark Tests:

Please see side-by-side comparison: [[%PUBURLPATH%/%WEB%/%TOPIC%/SFU-Arbutus.pdf][SFU-Arbutus.pdf]]

These were run on 24 cores and there are not many differences, apart from SE access differences which could be because of the different loads. cvmfs over nfs for 24 cores (2 WNs) performs just as well as with regular ifs software which is expected.

-- Main.AsokaDeSilva - 2012-12-05
Attachments
Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
pdf	SFU-Arbutus.pdf	r1	manage	351.7 K	2012-12-12 - 18:07	AsokaDeSilva
Topic revision: r28 - 2013-02-17 - AsokaDeSilva
AtlasCanada
Navigate ATLAS-Canada Wiki:

* Home* * Activities * Analysis
Computing
Datasets
Getting Started
Grid Activities
* Meetings* * People in ATLAS Canada * User Services
Travel To CERN
Navigate ATLAS-Canada Wiki:

Wikis:

ATLAS-Canada Institute Websites:
