Abstract

The ATLAS experiment has produced hundreds of petabytes of data and expects to have one order of magnitude more in the future. This data are spread among hundreds of computing Grid sites around the world. The EventIndex is the complete catalogue of all ATLAS events, real and simulated, keeping the references to all permanent files that contain a given event in any processing stage. It provides the means to select and access event data in the ATLAS distributed storage system, and provides support for completeness and consistency checks and trigger and offline selection overlap studies. The EventIndex employs various data handling technologies like Hadoop and Oracle databases, and it is integrated with other parts of the ATLAS distributed computing infrastructure, including systems for data, metadata, and production management. The project has been in operation since the start of LHC Run 2 in 2015, and it is in permanent development in order to satisfy the production and analysis demands and follow technology evolution. The main data store in Hadoop, based on MapFiles and HBase, has worked well during Run 2 but new solutions are being explored for the future. This paper reports on the current system performance and on the studies of a new data storage prototype that can carry the EventIndex through Run 3.

Details

Title
The ATLAS EventIndex and its evolution towards Run 3
Author
M Villaplana Perez 1 ; Alexandrov, E 2 ; Aleksandrov, I 2 ; Baranowski, Z 3 ; Barberis, D 4 ; Dimitrov, G 5 ; A Fernandez Casani 6 ; Gallas, E 7 ; C Garcia Montoro 6 ; S Gonzalez de la Hoz 6 ; Hrivnac, J 8 ; Alexander, I 2 ; Kazymov, A 2 ; Mineev, M 2 ; Prokoshin, F 9 ; Rybkin, G 8 ; Sanchez, J 6 ; Salt, J 6 ; Vasileva, P T 3 

 INFN Sezione di Milano; Dipartimento di Fisica, Università di Milano, Milano, Italy 
 Joint Institute for Nuclear Research, Dubna, Russia 
 CERN-IT, Geneva, Switzerland 
 INFN Sezione di Genova; Dipartimento di Fisica, Università di Genova, Genova, Italy 
 CERN-ATLAS, Geneva, Switzerland 
 Instituto de Física Corpuscular (IFIC), Centro Mixto Universidad de Valencia - CSIC, Valencia, Spain 
 Department of Physics, Oxford University, Oxford, United Kingdom 
 LAL, Universite Paris-Sud, CNRS/IN2P3, Universite Paris-Saclay, Orsay, France 
 Joint Institute for Nuclear Research, Dubna, Russia; Departamento de Física, Universidad Técnica Federico Santa María, Valparaíso, Chile 
Publication year
2020
Publication date
Apr 2020
Publisher
IOP Publishing
ISSN
17426588
e-ISSN
17426596
Source type
Scholarly Journal
Language of publication
English
ProQuest document ID
2557255343
Copyright
© 2020. This work is published under http://creativecommons.org/licenses/by/3.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.