Abstract

Translate

KAGRA is a newly built gravitational wave observatory, a laser interferometer with a 3 km arm length, located in Kamioka, Gifu prefecture, Japan. In this article, we describe the KAGRA data management system, i.e., recording of data, transfer from the KAGRA experiment site to computing resources, as well as data distribution to tier sites, including international sites in Taiwan and Korea. The amount of KAGRA data exceeded 1.0 PiB and increased by about 1.5 TB per day during operation in 2020. Our system has succeeded in data management, and has achieved performance that can withstand observations after 2023, that is, a transfer rate of 20 MB s^-1 or more and file storage of sufficient capacity for petabyte class. We also discuss the sharing of data between the global gravitational-wave detector network with other experiments, namely LIGO and Virgo. The latency, which consists of calculation of calibrated strain data and transfer time within the global network, is very important from the view of multi-messenger astronomy using gravitational waves. Real-time calbrated data delivered from the KAGRA detector site and other detectors to our computing system arrive with about 4–15 seconds of latency. These latencies are sufficiently short compared to the time taken for gravitational wave event search computations. We also established a high-latency exchange of offline calibrated data that was aggregated with a better accuracy compared with real-time data.

Details

Title

Overview of KAGRA : Data transfer and management

Author

Akutsu, T¹

; Ando, M¹; Arai, K²; Arai, Y²; Araki, S³; Araya, A⁴

; Aritomi, N⁵

; Asada, H⁶; Aso, Y⁷

; Bae, S⁸

; Bae, Y⁹; Baiotti, L¹⁰; Bajpai, R¹¹

; Barton, M A¹; Cannon, K¹²

; Cao, Z¹³

; Capocasa, E¹; Chan, M¹⁴; Chen, C¹⁵; Chen, K¹⁶; Chen, Y¹⁷; C-Y Chiang¹⁸; Chu, H¹⁶; Y-K, Chu¹⁸; Eguchi, S¹⁴; Enomoto, Y⁵; Flaminio, R¹; Fujii, Y¹⁹; Fujikawa, Y²⁰; Fukunaga, M²; Fukushima, M²¹; Gao, D²²; G Ge²²; S Ha²³; Hagiwara, A²; Haino, S¹⁸; W-B, Han²⁴

; Hasegawa, K²; Hattori, K²⁵; Hayakawa, H²⁶; Hayama, K¹⁴; Himemoto, Y²⁷

; Hiranuma, Y²⁸; Hirata, N¹; Hirose, E²; Hong, Z²⁹; Hsieh, B²; G-Z Huang²⁹; H-Y, Huang¹⁸; Huang, P²²; Y-C, Huang¹⁷; Huang, Y¹⁸; Hui, D C Y³⁰

; Ide, S³¹; Ikenoue, B²¹; Imam, S²⁹; Inayoshi, K³²

; Inoue, Y¹⁶; Ioka, K³³; Ito, K³⁴; Itoh, Y³⁵

; Izumi, K³⁶; Jeon, C³⁷; H-B, Jin³⁸

; Jung, K²³

; Jung, P²⁶; Kaihotsu, K³⁴; Kajita, T³⁹

; Kakizaki, M²⁵; Kamiizumi, M²⁶

; Kanda, N³⁵

; Kang, G⁸; Kawaguchi, K²; Kawai, N⁴⁰; Kawasaki, T⁵; Kim, C³⁷; Kim, J⁴¹; Kim, J C⁴²; Kim, W S⁹; Y-M, Kim²³; Kimura, N⁴³; Kita, N⁵; Kitazawa, H³⁴; Kobayashi, Y³⁵; Kojima, Y⁴⁴; Kokeyama, K²⁶

; Komori, K⁵

; Kong, A K H¹⁷

; Kotake, K¹⁴; Kozakai, C⁷; Kozu, R⁴⁵; Kumar, R⁴⁶; Kume, J¹²

; Kuo, C¹⁶; H-S, Kuo²⁹; Kuromiya, Y³⁴; Kuroyanagi, S⁴⁷

; Kusayanagi, K⁴⁰; Kwak, K²³

; Lee, H K⁴⁸; Lee, H W⁴²

; Lee, R¹⁷

; Leonardi, M¹

; Li, K L¹⁷

; Lin, L C-C²³

; C-Y, Lin⁴⁹

; F-K, Lin¹⁸; F-L, Lin²⁹; Lin, H L¹⁶; Liu, G C¹⁵

; L-W Luo¹⁸; Majorana, E⁵⁰; Marchio, M¹; Michimura, Y⁵

; Mio, N⁵¹; Miyakawa, O²⁶

; Miyamoto, A³⁵; Miyazaki, Y⁵; Miyo, K²⁶; Miyoki, S²⁶

; Mori, Y³⁴; Morisaki, S²

; Moriwaki, Y²⁵

; Nagano, K³⁶; Nagano, S⁵²; Nakamura, K¹

; Nakano, H⁵³

; Nakano, M²; Nakashima, R⁴⁰; Nakayama, Y²⁵; Narikawa, T²; Naticchioni, L⁵⁰; Negishi, R²⁸; L Nguyen Quynh⁵⁴

; W-T Ni²²; Nishizawa, A¹²

; Nozaki, S²⁵; Obuchi, Y²¹; Ogaki, W²; Oh, J J⁹

; K Oh³⁰

; Oh, S H⁹; Ohashi, M²⁶

; Ohashi, T³⁵; Ohishi, N⁷; Ohkawa, M²⁰

; Ohta, H¹²; Okutani, Y³¹; Okutomi, K²⁶; Oohara, K²⁸

; Ooi, C⁵; Oshino, S²⁶

; Otabe, S⁴⁰; Pan, K¹⁷; Pang, H¹⁶; Parisi, A¹⁵; Park, J⁵⁵

; Peña Arellano, F E²⁶; Pinto, I⁵⁶; Sago, N⁵⁷; Saito, S²¹; Saito, Y²⁶; Sakai, K⁵⁸; Sakai, Y²⁸; Sakuno, Y¹⁴; Sasaki, Y⁵⁹; Sato, S⁶⁰; Sato, T²⁰; Sawada, T³⁵

; Sekiguchi, T¹²; Sekiguchi, Y⁶¹

; Shao, L³²

; Shibagaki, S¹⁴; Shimizu, R²¹; Shimoda, T⁵; Shimode, K²⁶

; Shinkai, H⁶²

; Shishido, T⁶³; Shoda, A¹; Somiya, K⁴⁰

; Son, E J⁹; Sotani, H⁶⁴; Sugimoto, R³⁶; Suresh, J²; Suzuki, T²

; Tagoshi, H²

; Takahashi, H⁵⁹

; Takahashi, R¹

; Takamori, A⁴

; Takano, S⁵; Takeda, H⁵

; Takeda, M³⁵; Tanaka, H⁶⁵; Tanaka, K³⁵; Tanaka, T²

; Tanioka, S¹; E N Tapia San Martin¹; Telada, S⁶⁶; Tomaru, T¹

; Tomigami, Y³⁵; Tomura, T²⁶

; Travasso, F⁶⁷; Trozzo, L²⁶; Tsang, T⁶⁸; J-S Tsao²⁹; Tsubono, K⁵; Tsuchida, S³⁵

; Tsutsui, T¹²; Tsuzuki, T²¹; Tuyenbayev, D¹⁸; Uchikata, N²

; Uchiyama, T²⁶

; Ueda, A⁴³; Uehara, T⁶⁹

; Ueki, S⁵⁹; Ueno, K¹²

; Ueshima, G⁵⁹; Uraguchi, F²¹; Ushiba, T²

; M H P M van Putten⁷⁰

; Vocca, H⁷¹; Wang, J²²; Washimi, T¹

; C Wu¹⁷

; H Wu¹⁷

; S Wu¹⁷; W-R, Xu²⁹; Yamada, T⁶⁵; Yamamoto, K²⁵

; Yamamoto, T²⁶

; Yamashita, K²⁵; Yamazaki, R³¹

; Yang, Y⁷²

; Yokogawa, K³⁴; Yokoyama, J⁵

; Yokozawa, T²⁶; Yoshioka, T³⁴; Yuzurihara, H²

; Zeidler, S⁷³; Zhan, M²²; Zhang, H²⁹; Zhao, Y¹

; Z-H Zhu¹³

; Brockill, P⁷⁴; Clark, J A⁷⁵; Zweizig, J⁷⁵

¹ Gravitational Wave Science Project, National Astronomical Observatory of Japan (NAOJ) , 2-21-1 Osawa, Mitaka City, Tokyo 181-8588, Japan
² Institute for Cosmic Ray Research (ICRR), KAGRA Observatory, The University of Tokyo , 5-1-5 Kashiwa-no-Ha, Kashiwa City, Chiba 277-8582, Japan
³ Accelerator Laboratory, High Energy Accelerator Research Organization (KEK) , 1-1 Oho, Tsukuba City, Ibaraki 305-0801, Japan
⁴ Earthquake Research Institute, The University of Tokyo , 1-1-1 Yayoi, Bunkyo-ku, Tokyo 113-0032, Japan
⁵ Department of Physics, The University of Tokyo , 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
⁶ Department of Mathematics and Physics, Hirosaki University , 3 Bunkyo-cho, Hirosaki City, Aomori 036-8561, Japan
⁷ Kamioka Branch, National Astronomical Observatory of Japan (NAOJ) , 238 Higashi-Mozumi, Kamioka-cho, Hida City, Gifu 506-1205, Japan
⁸ Korea Institute of Science and Technology Information (KISTI) , 245 Daehak-ro, Yuseong-gu, Daejeon 34141, Korea
⁹ National Institute for Mathematical Sciences , 70 Yuseong-daero, 1689 Beon-gil, Yuseong-gu, Daejeon 34047, Korea
¹⁰ International College, Osaka University , 1-1 Machikaneyama-cho, Toyonaka City, Osaka 560-0043, Japan
¹¹ School of High Energy Accelerator Science, The Graduate University for Advanced Studies (SOKENDAI) , 1-1 Oho, Tsukuba City, Ibaraki 305-0801, Japan
¹² Research Center for the Early Universe (RESCEU), The University of Tokyo , 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
¹³ Department of Astronomy, Beijing Normal University , No. 19 Xinjiekou Street, Beijing 100875, China
¹⁴ Department of Applied Physics, Fukuoka University , 8-19-1 Nanakuma, Jonan, Fukuoka City, Fukuoka 814-0180, Japan
¹⁵ Department of Physics, Tamkang University , No. 151, Yingzhuan Rd., Danshui Dist., New Taipei City 25137, Taiwan
¹⁶ Department of Physics, Center for High Energy and High Field Physics, National Central University , No.300, Zhongda Rd, Zhongli District, Taoyuan City 32001, Taiwan
¹⁷ Department of Physics and Institute of Astronomy, National Tsing Hua University , No. 101 Section 2, Kuang-Fu Road, Hsinchu 30013, Taiwan
¹⁸ Institute of Physics, Academia Sinica , 128 Sec. 2, Academia Rd., Nankang, Taipei 11529, Taiwan
¹⁹ Department of Astronomy, The University of Tokyo , 2-21-1 Osawa, Mitaka City, Tokyo 181-8588, Japan
²⁰ Faculty of Engineering, Niigata University , 8050 Ikarashi-2-no-cho, Nishi-ku, Niigata City, Niigata 950-2181, Japan
²¹ Advanced Technology Center, National Astronomical Observatory of Japan (NAOJ) , 2-21-1 Osawa, Mitaka City, Tokyo 181-8588, Japan
²² State Key Laboratory of Magnetic Resonance and Atomic and Molecular Physics, Innovation Academy for Precision Measurement Science and Technology (APM), Chinese Academy of Sciences , West No. 30, Xiao Hong Shan, Wuhan 430071, China
²³ Department of Physics, School of Natural Science, Ulsan National Institute of Science and Technology (UNIST) , 50 UNIST-gil, Ulju-gun, Ulsan 44919, Korea
²⁴ Chinese Academy of Sciences, Shanghai Astronomical Observatory , 80 Nandan Road, Shanghai 200030, China
²⁵ Faculty of Science, University of Toyama , 3190 Gofuku, Toyama City, Toyama 930-8555, Japan
²⁶ Institute for Cosmic Ray Research (ICRR), KAGRA Observatory, The University of Tokyo , 238 Higashi-Mozumi, Kamioka-cho, Hida City, Gifu 506-1205, Japan
²⁷ College of Industrial Technology, Nihon University , 1-2-1 Izumi, Narashino City, Chiba 275-8575, Japan
²⁸ Graduate School of Science and Technology, Niigata University , 8050 Ikarashi-2-no-cho, Nishi-ku, Niigata City, Niigata 950-2181, Japan
²⁹ Department of Physics, National Taiwan Normal University , 88 Ting-Chou Rd., sec. 4, Taipei 116, Taiwan
³⁰ Astronomy & Space Science, Chungnam National University , 9 Daehak-ro, Yuseong-gu, Daejeon 34134, Korea
³¹ Department of Physics and Mathematics, Aoyama Gakuin University , 5-10-1 Fuchinobe, Sagamihara City, Kanagawa 252-5258, Japan
³² Kavli Institute for Astronomy and Astrophysics, Peking University , Yiheyuan Road 5, Haidian District, Beijing 100871, China
³³ Yukawa Institute for Theoretical Physics (YITP), Kyoto University , Kita-Shirakawa Oiwake-cho, Sakyou-ku, Kyoto City, Kyoto 606-8502, Japan
³⁴ Graduate School of Science and Engineering, University of Toyama , 3190 Gofuku, Toyama City, Toyama 930-8555, Japan
³⁵ Department of Physics, Graduate School of Science, Osaka Metropolitan University, Sumiyoshi-ku , Osaka City, Osaka 558-8585, Japan
³⁶ Institute of Space and Astronautical Science (JAXA) , 3-1-1 Yoshinodai, Chuo-ku, Sagamihara City, Kanagawa 252-0222, Japan
³⁷ Department of Physics, Ewha Womans University , 52 Ewhayeodae, Seodaemun-gu, Seoul 03760, Korea
³⁸ National Astronomical Observatories, Chinese Academic of Sciences , 20A Datun Road, Chaoyang District, Beijing, China
³⁹ Institute for Cosmic Ray Research (ICRR), The University of Tokyo , 5-1-5 Kashiwa-no-Ha, Kashiwa City, Chiba 277-8582, Japan
⁴⁰ Graduate School of Science and Technology, Tokyo Institute of Technology , 2-12-1 Ookayama, Meguro-ku, Tokyo 152-8551, Japan
⁴¹ Department of Physics, Myongji University , Yongin 17058, Korea
⁴² Department of Computer Simulation, Inje University , 197 Inje-ro, Gimhae, Gyeongsangnam-do 50834, Korea
⁴³ Applied Research Laboratory, High Energy Accelerator Research Organization (KEK) , 1-1 Oho, Tsukuba City, Ibaraki 305-0801, Japan
⁴⁴ Department of Physical Science, Hiroshima University , 1-3-1 Kagamiyama, Higashihiroshima City, Hiroshima 903-0213, Japan
⁴⁵ Institute for Cosmic Ray Research (ICRR), Research Center for Cosmic Neutrinos (RCCN), The University of Tokyo , 238 Higashi-Mozumi, Kamioka-cho, Hida City, Gifu 506-1205, Japan
⁴⁶ California Institute of Technology , 1200 East California Boulevard, Pasadena, CA 91125, USA
⁴⁷ Institute for Advanced Research, Nagoya University , ES bldg. 604, Furocho, Chikusa-ku, Nagoya City, Aichi 464-8602, Japan
⁴⁸ Department of Physics, Hanyang University , Wangsimniro 222, Sungdong-gu, Seoul 04763, Korea
⁴⁹ National Center for High-performance computing, National Applied Research Laboratories , No. 7, R&D 6th Rd., Hsinchu Science Park, Hsinchu City 30076, Taiwan
⁵⁰ Istituto Nazionale di Fisica Nucleare (INFN), Universita di Roma ‘La Sapienza’ , P.le A. Moro 2, 00185 Roma, Italy
⁵¹ Institute for Photon Science and Technology, The University of Tokyo , 2-11-16 Yayoi, Bunkyo-ku, Tokyo 113-8656, Japan
⁵² The Applied Electromagnetic Research Institute, National Institute of Information and Communications Technology (NICT) , 4-2-1 Nukuikita-machi, Koganei City, Tokyo 184-8795, Japan
⁵³ Faculty of Law, Ryukoku University , 67 Fukakusa Tsukamoto-cho, Fushimi-ku, Kyoto City, Kyoto 612-8577, Japan
⁵⁴ Department of Physics, University of Notre Dame , 225 Nieuwland Science Hall, Notre Dame, IN 46556, USA
⁵⁵ Korea Astronomy and Space Science Institute (KASI) , 776 Daedeokdae-ro, Yuseong-gu, Daejeon 34055, Korea
⁵⁶ Department of Engineering, University of Sannio , Benevento 82100, Italy
⁵⁷ Department of Physics, Kyoto University , Kita-Shirakawa Oiwake-cho, Sakyou-ku, Kyoto City, Kyoto 606-8502, Japan
⁵⁸ Department of Electronic Control Engineering, National Institute of Technology, Nagaoka College , 888 Nishikatakai, Nagaoka City, Niigata 940-8532, Japan
⁵⁹ Department of Information and Management Systems Engineering, Nagaoka University of Technology , 1603-1 Kamitomioka, Nagaoka City, Niigata 940-2188, Japan
⁶⁰ Graduate School of Science and Engineering, Hosei University , 3-7-2 Kajino, Koganei City, Tokyo 184-8584, Japan
⁶¹ Faculty of Science, Toho University , 2-2-1 Miyama, Funabashi City, Chiba 274-8510, Japan
⁶² Faculty of Information Science and Technology, Osaka Institute of Technology , 1-79-1 Kitayama, Hirakata City, Osaka 573-0196, Japan
⁶³ The Graduate University for Advanced Studies (SOKENDAI) , 2-21-1 Osawa, Mitaka City, Tokyo 181-8588, Japan
⁶⁴ iTHEMS (Interdisciplinary Theoretical and Mathematical Sciences Program), The Institute of Physical and Chemical Research (RIKEN) , 2-1 Hirosawa, Wako, Saitama 351-0198, Japan
⁶⁵ Institute for Cosmic Ray Research (ICRR), Research Center for Cosmic Neutrinos (RCCN), The University of Tokyo , 5-1-5 Kashiwa-no-Ha, Kashiwa City, Chiba 277-8582, Japan
⁶⁶ National Metrology Institute of Japan, National Institute of Advanced Industrial Science and Technology , 1-1-1 Umezono, Tsukuba City, Ibaraki 305-8568, Japan
⁶⁷ University of Camerino , via Madonna delle Carderi 9, 62032 Camerino (MC), Italy
⁶⁸ Faculty of Science, Department of Physics, The Chinese University of Hong Kong , Shatin, N.T., Hong Kong
⁶⁹ Department of Communications Engineering, National Defense Academy of Japan , 1-10-20 Hashirimizu, Yokosuka City, Kanagawa 239-8686, Japan
⁷⁰ Department of Physics and Astronomy, Sejong University , 209 Neungdong-ro, Gwangjin-gu, Seoul 143-747, Korea
⁷¹ Istituto Nazionale di Fisica Nucleare, University of Perugia , Via Pascoli 1, Perugia 06123, Italy
⁷² Department of Electrophysics, National Chiao Tung University , 101 Univ. Street, Hsinchu, Taiwan
⁷³ Department of Physics, Rikkyo University , 3-34-1 Nishiikebukuro, Toshima-ku, Tokyo 171-8501, Japan
⁷⁴ University of Wisconsin-Milwaukee , Milwaukee, WI 53201, USA
⁷⁵ LIGO Laboratory, California Institute of Technology , Pasadena, CA 91125, USA

Publication year

2023

Publication date

Oct 2023

Publisher

Oxford University Press

e-ISSN

20503911

Source type

Scholarly Journal

Language of publication

English

DOI

https://doi.org/10.1093/ptep/ptad112

ProQuest document ID

3171920863

© The Author(s) 2023. Published by Oxford University Press on behalf of the Physical Society of Japan. This work is published under https://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.

Overview of KAGRA : Data transfer and management

Jump to:

Abstract

Details

Suggested sources