Abstract

The CMS Remote Analysis Builder (CRAB) is a distributed workflow management tool which facilitates analysis tasks by isolating users from the technical details of the Grid infrastructure. Throughout LHC Run 1, CRAB has been successfully employed by an average of 350 distinct users each week executing about 200,000 jobs per day.

CRAB has been significantly upgraded in order to face the new challenges posed by LHC Run 2. Components of the new system include 1) a lightweight client, 2) a central primary server which communicates with the clients through a REST interface, 3) secondary servers which manage user analysis tasks and submit jobs to the CMS resource provisioning system, and 4) a central service to asynchronously move user data from temporary storage in the execution site to the desired storage location. The new system improves the robustness, scalability and sustainability of the service.

Here we provide an overview of the new system, operation, and user support, report on its current status, and identify lessons learned from the commissioning phase and production roll-out.

Details

Title
CMS distributed data analysis with CRAB3
Author
Mascheroni, M 1 ; Balcas, J 2 ; Belforte, S 3 ; Bockelman, B P 4 ; Hernandez, J M 5 ; Ciangottini, D 6 ; Konstantinov, P B 7 ; Silva, J M D 8 ; M A B M Ali 9 ; Melo, A M 10 ; Riahi, H 11 ; Tanasijczuk, A J 12 ; Yusli, M N B 9 ; Wolf, M 13 ; Woodard, A E 13 ; Vaandering, E 14 

 Universita e INFN, Sezione di Milano-Bicocca 
 Vilnius University 
 Universita e INFN, Sezione di Trieste 
 University of Nebraska-Lincoln 
 CIEMAT, Madrid 
 Universita e INFN, Sezione di Perugia 
 Bulgarian Academy of Sciences 
 UNESP - Universidade Estadual Paulista 
 University of Malaya 
10  Vanderbilt University 
11  CERN 
12  University of California San Diego 
13  University of Notre Dame 
14  FNAL. 
Publication year
2015
Publication date
Dec 2015
Publisher
IOP Publishing
ISSN
17426588
e-ISSN
17426596
Source type
Scholarly Journal
Language of publication
English
ProQuest document ID
2576453399
Copyright
© 2015. This work is published under http://creativecommons.org/licenses/by/3.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.