Content area

Abstract

We train an object detector built from convolutional neural networks to count interference fringes in elliptical antinode regions in frames of high-speed video recordings of transient oscillations in Caribbean steelpan drums illuminated by electronic speckle pattern interferometry (ESPI). The annotations provided by our model aim to contribute to the understanding of time-dependent behavior in such drums by tracking the development of sympathetic vibration modes. The system is trained on a dataset of crowdsourced human-annotated images obtained from the Zooniverse Steelpan Vibrations Project. Due to the small number of human-annotated images and the ambiguity of the annotation task, we also evaluate the model on a large corpus of synthetic images whose properties have been matched to the real images by style transfer using a Generative Adversarial Network. Applying the model to thousands of unlabeled video frames, we measure oscillations consistent with audio recordings of these drum strikes. One unanticipated result is that sympathetic oscillations of higher-octave notes significantly precede the rise in sound intensity of the corresponding second harmonic tones; the mechanism responsible for this remains unidentified. This paper primarily concerns the development of the predictive model; further exploration of the steelpan images and deeper physical insights await its further application.

Details

1009240
Title
ConvNets for Counting: Object Detection of Transient Phenomena in Steelpan Drums
Publication title
arXiv.org; Ithaca
Publication year
2021
Publication date
Sep 7, 2021
Section
Computer Science; Physics (Other)
Publisher
Cornell University Library, arXiv.org
Source
arXiv.org
Place of publication
Ithaca
Country of publication
United States
University/institution
Cornell University Library arXiv.org
e-ISSN
2331-8422
Source type
Working Paper
Language of publication
English
Document type
Working Paper
Publication history
 
 
Online publication date
2024-06-19
Milestone dates
2021-02-01 (Submission v1); 2021-09-07 (Submission v2)
Publication history
 
 
   First posting date
19 Jun 2024
ProQuest document ID
2486132868
Document URL
https://www.proquest.com/working-papers/convnets-counting-object-detection-transient/docview/2486132868/se-2?accountid=208611
Full text outside of ProQuest
Copyright
© 2021. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Last updated
2024-06-20
Database
ProQuest One Academic