1. Introduction
Bees play relevant roles in the pollination of innumerable wild plants and crop fields, which have been estimated to generate 153 billion euros globally [1]. Honey bee populations, however, are in decline worldwide [2,3,4], and its cause is not yet fully understood, but environmental pollutants such as agricultural pesticides have been suggested as one of the leading causes of this phenomenon [5,6,7,8,9]. The pesticide-mediated problems go beyond the direct lethality of these compounds, as the potential sublethal contamination of the hive individuals has been shown to alter the visual perceptions, learning, locomotion, and foraging activities of individuals [5,6,10,11]. However, how this sublethal contamination affects colony dynamics has not received adequate attention, possibly due to the challenges associated with such measures [10,12,13].
A powerful tool for analyzing collective dynamics of animal behaviors is the utilization of video tracking [14,15,16,17]. This technique is under constant development as it has applicability in a wide range of fields [18]. Due to its lower cost and the relevant advances in computational power, video tracking has been targeted by sophisticated techniques in image processing [19,20,21,22]. However, it is still a challenge to solve complex problems, such as tracking similar objects near each other [23,24], especially under heavy background noise [18,23]. Using deep neural networks has provided significant contributions [25], but these approaches are still computationally expensive, hindering their widespread application [26]. Recent approaches to object tracking (e.g., hierarchical learned features for tracking and cognitive vision) present similar difficulties as algorithms and are limited to tracking only a few objects at the same time [27,28].
Labeling methods provide efficient performance for distinguishing between objects during multi-target tracking [29,30]. The primary challenge of the multi-target tracking algorithm is the non-swapping of the labels when two objects (for example, animals being tracked) intersect. All of these multi-target video tracking challenges occur within natural colonies of social insects such as honey bees, Apis mellifera, as honey bee colonies are densely composed of individuals that exhibit similarities in their form and locomotion [31]. The quantitative understanding of worker behaviors within the honey bee colonies (e.g., swarm entropy [32], kinetic energy [33,34], spatial distribution, and collective activities [35]), however, is useful to recognize colony health, which can be used as indirect evidence of potential contamination by environmental pollutants.
Here, we propose a Bayesian multi-target strategy that addresses the above constraints and establishes the theoretical framework to track the movement of several A. mellifera individuals at colony level. We automatically monitored the movement of A. mellifera individuals within natural colonies. The monitored individuals were first fed with diets containing sublethal concentrations of agricultural pesticides (i.e., a commercial formulation containing the synthetic fungicides thiophanate-methyl and chlorothalonil) commonly used to control pathogens in Brazilian fields of melon, Cucumis melo L. [12,36,37], which is an agricultural crop heavily dependent on bee-mediated pollination.
2. Materials and Methods
In this section, we describe the experimental setup, video recording, and approaches for the preprocessing of the video frames. The algorithms for detecting and tracking each labeled individual bee are also presented. A comprehensive overview of the recording techniques and tracking is illustrated in Figure 1. The methods employed to analyze bee behavior through movement and location patterns are described.
2.1. Bees’ Exposure and Experimental Setup
Recently emerged (<24 h old) A. mellifera bees were selected from the four colonies in the experimental apiary of the Universidade Federal de Viçosa (UFV, Viçosa, MG, Brazil) and fed upon a saccharose (50%, w/v) solution that was either uncontaminated (control treatment) or had a sublethal concentration ( g i.a./mL) of a commercial formulation containing the synthetic fungicides thiophanate-methyl and chlorothalonil as previously described in [6]. The bees were housed in controlled environments comparable to those seen in a colony (34 ± 2 °C and 70 ± 10% relative humidity) and were kept in the dark until the experiments were completed. Afterwards, they were placed inside the observation colonies (for detail, see Figure 1A,B). We labeled the uncontaminated and pesticide-contaminated bees with different colors for easy identification. The mesonotum of each worker bee was tagged with different colors according to the contaminated and uncontaminated groups. We released 200 labeled bees in each hive that already had approximately 800 unexposed and unmarked bees.
After being reintroduced to their colonies, the bees’ activities were recorded on the 1st hour, 5th and 10th days. The initial observation periods (1st and 5th days) were defined considering the possible effect of the fungicide on behavior (e.g., walking and stopping [6]), possible mortality by manipulation, and rejection with the removal of the introduced workers from the experimental beehive due to hygienic behavior. At 10 days of age in natural conditions, workers start caring for the brood as nurse workers in the central area of the comb (task location) (for a review see in [38]). In this way, it was possible to verify the effect of the fungicide on the behavior of the workers over time within the nest. The recordings were performed using a CCD (charge-coupled device) camera (ViewPoint LifeSciences, Montreal, QC, Canada). We used four hives for each treatment, and due to the amount of data and the better technical conditions for the recordings, the hives were recorded in two periods (9:00 a.m. and 5:00 p.m.) in order to cover the moments when there are external activities occurring in the experimental colonies under natural conditions. Recording took place for 12 min in each hive at each period of the day, and all recorded videos and images were in Full HD (1920 × 1080, at 30 frames/s). The dataset comprised 48 videos (2 videos each day, for four nuclei per treatment, two treatments, and three evaluation days).
2.2. Image Preprocessing
The analysis of the video was performed with the extraction of its frames. A 3 frames/second rate was used in order to save computational time without losing relevant data of the bees’ activities. After that, each frame was analyzed in order to detect moving objects in the video and identify colored marks on the bees. To accomplish that, an algorithm of background subtraction [39,40] was performed, followed by a selection of colors in a previously determined range of RGB (Red-Green-Blue) values of each pixel.
The background subtraction algorithm estimated a probabilistic distribution for each pixel of the video based on a Gaussian mixture model (GMM) or k-nearest neighbors (k-NN) model [41,42]. Based on the estimated probabilistic values, the pixels of each frame of the video should be classified as background or foreground, allowing the exclusion of background information. Here, we used a k-nearest neighbors approach. After the background subtraction, each pixel was segregated according to its RGB value, and if its value was in a color range sought for tracking, it became white in accordance with the markings on the bees; otherwise, this pixel was made black.
With the objects defined as the bees’ marks, their coordinates could be evaluated by calculating their center of mass [43]. This approach is exemplified in Figure 1C. After that, each processed frame was analyzed by the algorithm from top to bottom and left to right, and each swarm object (marked workers) on the comb was labeled in order of occurrence. Because the bees are always moving, their identities (or labels) vary with each frame. If an element is labeled A in the first frame, it may be labeled B in the next frame due to its mobility. The labels of the tracked objects are reversed, which must be adjusted in order to retrieve their trajectory. The initial label must be preserved until the end of the video stream. However, even when the radius of displacement of the items is restricted, there may be more than one feasible location in the following moment due to the closeness of other bees’ positions. Similarly to that, many bees were briefly hidden behind other bees or outside of the camera capture field. Those are widely described problems in video tracking theory [23]. To solve the issues presented above, Bayesian inference was used in such a way that the next right point of the trajectory is estimated to maximize the likelihood of the preceding information, yielding a mensuration for the variable, given the prior information about the path traveled by the individuals. Then, the coordinates previously obtained were used to feed a Bayesian algorithm for tracking.
2.3. Bayesian Tracking
With the bees’ positions saved, the next step is to determine their correct trajectory. We are confronted with two issues here: selecting the appropriate location and the overlapping issue. The latter occurs because certain bees are overlapping with their partners and so are not visible for a period of time. To overcome this limitation, it is assumed that the bee does not move while being covered by others, thus retaining their locations. Visual investigation corroborated this empirically.
It was determined that the next correct location of the bee’s trajectory is smooth, i.e., the angle between two consecutive points is small or close to zero. The Probability Distribution Function (PDF) for the angle is assumed to be a von Mises distribution [44,45], with and . The inference is calculated for each bee in each frame as follows: the angle variance between the bee’s potential future position, within a radius region, and the current one is evaluated. Then, the next position is optimally calculated based on the von Mises distribution, and its parameters are updated for the following step. Mathematical formulations are presented in Section S1 of the Supplementary Material.
After all iterations, a von Mises PDF is obtained for the angular displacement for each bee, and another distribution is obtained for the radius over a uniform non-informative prior. With the corrected path of each object, a Kernel Density Estimator (KDE) algorithm [41,42] creates a continuous PDF from the empirical data of angular displacement and translational displacement. More mathematical details are presented in Section S1 of the Supplementary Material.
For the real case study, the algorithm was executed on the experimental dataset of the bees previously described. The time for processing a video of approximately 12 min was ~60 min. The algorithms were developed using OpenCV 10 with Python 3.7.11.
Synthetic Video Simulation
As traditional databases could not offer material for the algorithm’s quality assessments, they were evaluated in a particle swarm simulation. During 500 s, a succession of frames with several dimensions and 200, 300, and 600 randomly dispersed circular objects traveling across the region was created computationally to evaluate algorithm quality and the impact of the radius on the performance.
The simulation behaves exactly like the marked bees from the previous section: the objects were chosen to be in a set of frames with the same dimensions as a Full HD video, i.e., 1080 pixels in the vertical direction and 1920 pixels in the horizontal direction, because the goal is to apply the method to real-life particle swarm videos. Complementary information about the simulation and its results are presented in Section S2 of Supplementary Material.
2.4. Dynamical Evaluation
Based on the acquired PDF for angle and radius, the entropy of the movement of the contaminated bees on different days may be calculated to evaluate bee dynamics. Given that the intended function of agrochemicals is to alter the metabolism of insects [33,34], this entropy should decrease with time. However, it is worthwhile to register that the entropy being assessed here is not the thermodynamical entropy, which should increase for polluted bees as they die and thus tend to reach equilibrium with the environment [46]. The entropy measured at the molecular scale certainly would grow [47].
In this work, the Shannon entropy [48] is used to evaluate the randomness of the tracked item and thus infer about their movement in space. According to the traditional view, an event’s entropy indicates how much information is required to represent the complete space state. In reality, this means that the higher the entropy, the less predictable the event, while occurrences with zero entropy have no uncertainty [49]. As it may be understood as a measurement of the randomness of the variable, the entropy of a system can give insight into the nature of the evaluated variables [48,50]. In the context of motion analysis, a greater entropy suggests that the object’s route is less predictable. For each bee, the entropy was determined using the algebraic formulation of the PDF acquired by KDE (expressed in Section S1 of the Supplementary Material).
Another measure to evaluate the dynamics of the bees is Kinetic Energy (KE). KE is a measure of how many tracked objects are moving, and it is given by the equation , where m is the object mass, and v is its velocity. Therefore, assuming all bees have the same mass, and as KE is proportional to the velocity squared, variations of energy might be represented just by . Decreased energy suggests lower entropy as movement becomes less random and can provide crucial insights into a variety of real-world systems. A lower KE suggests that a bee spends more time not moving and, combined with entropy, indicates improper insect behavior [33,34].
Further details and mathematical formulation for both dynamical measures presented in this section are available in Section S3 of the Supplementary Material.
3. Results
3.1. Spatial Distribution
The distribution of bees in the colony over time was determined by counting the number of centroids in each comb area at each frame. In order to provide intuitive analysis, a map of this distribution was generated using the Seaborn library for Python, which is presented in Figure 2. In those colonies that received fungicide-contaminated bees, there was an earlier, faster, and more intense spread of bees’ activities from the center to the boards when compared to those colonies that received only uncontaminated bees.
3.2. Dynamical Measurements
The trajectories obtained from the Bayesian algorithm, through KE calculations (using the average velocity), revealed that the energy decreases from the first to the last evaluation day for beehives that received fungicide-contaminated worker bees (Figure 3A). On the other hand, it is noticeable that the KE values considerably increased in the last evaluation day for the hives that received labeled non-contaminated bees (Figure 3A). Based on the PDF values of each bee, there was a notable reduction in the entropy values over time for hives that received fungicide-contaminated labeled bees when compared to those hives that had only uncontaminated bees (Figure 3B). Our record of dead bees at the hive’s entrance revealed an increase in the number of labeled bees for the hives that received fungicide-contaminated bees, which is in accordance with the Bayesian algorithm that also recorded a smaller number of labeled bees in such fungicide-contaminated hives (Figure 4).
The Bayesian approach is sufficiently robust to determine the number of living bees each day. Other bees normally evict the dead bees from the colony. Because the nucleus has access to the outside environment, the number of bees might vary, but with a general decreasing tendency, as seen in Figure 4, which can be better explained as mortality by the agrochemical.
4. Discussion
Here, we present a Bayesian strategy capable of simultaneously tracking the movement of several A. mellifera individuals at the colony level, allowing determination of the entropy and probability distribution function (PDF) of tracked organisms. Such approaches facilitated the quantification of unintended effects mediated by agricultural pesticides (e.g., a commercial formulation containing the synthetic fungicides chlorothalonil and thiophanate-methyl) in A. mellifera colonies. Colonies that received pesticide sublethally-treated bees exhibited higher mortality levels, had lower swarm entropy and energy levels, and anticipated the collective activities for the peripheral hive areas, indicating a behavioral change possibly related to physiological alteration, which is suggested as a social behavioral strategy in honey bees [51,52].
Our Bayesian tracking algorithm reached great precision and performed well even with 200 labeled bees within a hive. Such a tracked number is much higher than those tracked by other software and algorithms used in biological measurements [28,53,54], maintaining an accuracy greater than 99% for the specified radius (r = 10). For instance, when the algorithms faced the image swap problems, the code had learnt the PDF of the object motions and did not make any errors in their trajectories. Another advantage of our Bayesian analysis strategy is its ability to detect the variations in the distribution, which makes the code usable for any application that tracks objects (or individuals) at variable color background possibilities, using algorithms with much fewer complexities than those presented elsewhere [27].
Despite its potentialities for measurements in dynamically evolving systems, entropy estimation via Bayesian inference is still a rather uncommon approach. Previous studies have dealt with high-quality background treatment [55] and tracking of unlabeled organisms [31,56], resulting in precise measurements. However, differently from our efforts, the other algorithms have the disadvantages of needing a low-noise image and lacking the ability to extract dynamical features of the system, as their identification is made by a convolutional neural network (a black-box model).
As previously described elsewhere [6,10,12,57,58], a commercial formulation of synthetic or natural pesticides can present risks to pollinator bees that surpass the mortality. Our Bayesian multi-target strategy clearly identified reductions in kinetic energy and entropy of hives containing individuals previously sublethally exposed to fungicides. The entropy evaluation revealed that pesticide-treated colonies had their behavior changed, with their movement becoming more predictable than before.
In general, sublethal doses of pesticides in bees can act as physiological stressors, altering metabolic responses (e.g., oxidative stress), glandular (e.g., hypopharyngeal, fat body), and bee brain (e.g., JH, biogenic amines), which alter their behavior and decrease longevity [52]. On the other hand, the distancing behavior has a social character, in which the contaminated worker bees distance themselves from the brood area, representing the most susceptible individuals in the colony, migrating earlier than expected to the peripheral areas of the comb [59,60], thus preserving colony health [52]. Despite fungicides seeming to represent lower acute toxicity, recent studies have shown their abilities to unbalance bee health by modifying quercetin-dependent detoxification [57,58,61], which can detrimentally affect mitochondrial regeneration and ATP production. Although further investigations are needed before drawing firm conclusions, it is worth noting that the disruption of quercetin-mediated detoxification has been proposed as one of the main causes for lifespan reductions in honey bees [61,62].
5. Conclusions
Our Bayesian tracking technique proved successful and superior to comparable ones in that it allowed for the estimation of dynamical parameters such as entropy and kinetic energy. Our technique can also convert past information about the system into mathematical equations and learn patterns whenever fresh data are added, which are two major benefits compared with traditional inferences. These qualities enabled the algorithm to detect and repair mistakes during processing, as well as forecast pathways and distributions in other scenarios of color segmentation, making the tracking more adaptable. Finally, the findings described here also contribute to getting a better understanding of potential unintended effects mediated by environmental stressors (e.g., pesticides, electromagnetic fields, noise, and light intensities) alone or in combination in pollinator bees at colony levels.
Conceptualization, J.N.O.J., E.E.O., C.H.S.A., K.H., W.C.S., J.A.A. and C.D.M.; Investigations, J.N.O.J., M.B., C.H.S.A., P.F.S.T., S.M.R., J.C.S. and L.O.V.J.; First Draft Preparation, J.N.O.J. and C.D.M.; Review and Editing, J.C.S., E.E.O. and C.D.M. All authors have read and agreed to the published version of the manuscript.
This research was funded by Coordenação de Aperfeiçoamento de Pessoal de Nível Superior—Brasil (CAPES—finnance code 001), Conselho Nacional de Desenvolvimento Científico e Tecnológico—Brasil (CNPq—308576/2018-7 and 427304/2018-0 for EEO; CNPq-465755/2014-3 for CDM), Fundação de Amparo à Pesquisa do Estado de Minas Gerais (Fapemig—APQ 03771-18 for EEO), and Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP 2014/50851-0 and BPE Fapesp 2018/19150-6 for CDM).
Not applicable.
Not applicable.
The authors thank Thiago Svacina for his excellent technical assistance during the conduction of investigations.
The authors declare no conflict of interest. The funders had no role in the writing of the manuscript, or in the decision to publish the results.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Figure 1. Representation of the video recording setup. An observation beehive (wooden frame with 52.5 cm x 43.5 cm) covered on the laterally with plate glass allowed the video recording of the colony. A lateral view (A) and a frontal view (B) of the experimental setup are presented. Marked workers were detected using a background subtraction algorithm and color picking (C). By using a Bayesian multi-target strategy, we tracked the trajectories traveled by labeled workers (either pesticide-unexposed or sublethally exposed to commercial fungicide formulation) (D).
Figure 2. Spatial distribution of labeled Apis mellifera individuals at the 1st hour, 5th and 10th days after being introduced within a hive. Higher intensity color represents a higher probability of having a worker bee occupying the region. The labeled bees consisted of either pesticide-unexposed individuals (uncontaminated beehives) or individuals that were sublethally exposed to a commercial formulation containing the synthetic fungicides chlorothalonil and thiophanate-methyl (pesticide-contaminated beehives). The heatmaps indicate the number of labeled worker bee appearances in each comb region. As shown in Figure 1, the hive’s entrance is located at the lower right side of each panel representation.
Figure 3. Dynamic quantification of swarm entropy (A) and kinetic energy (B) within a hive of Apis mellifera bees. The measurements were based on the trajectories traveled by labeled bees (i.e., either pesticide-unexposed individuals or individuals that were sublethally exposed to a commercial formulation containing the synthetic fungicides chlorothalonil and thiophanate-methyl). Each symbol represents the average value of four colonies. The measurements were conducted at the 1st hour, 5th and 10th day after the introduction of labeled bees within the colony.
Figure 4. Temporal quantifications of labeled Apis mellifera individuals within observational hives. Each symbol represents the average value of four colonies. The measurements were conducted at the 1st hour, 5th and 10th day after the introduction of labeled bees within the hive.
Supplementary Materials
Further details and mathematical formulations for the presented method are available online at
References
1. Khalifa, S.A.; Elshafiey, E.H.; Shetaia, A.A.; El-Wahed, A.A.A.; Algethami, A.F.; Musharraf, S.G.; AlAjmi, M.F.; Zhao, C.; Masry, S.H.; Abdel-Daim, M.M. et al. Overview of bee pollination and its economic value for crop production. Insects; 2021; 12, 688. [DOI: https://dx.doi.org/10.3390/insects12080688] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/34442255]
2. Cameron, S.A.; Lozier, J.D.; Strange, J.P.; Koch, J.B.; Cordes, N.; Solter, L.F.; Griswold, T.L. Patterns of widespread decline in North American bumble bees. Proc. Natl. Acad. Sci. USA; 2011; 108, pp. 662-667. [DOI: https://dx.doi.org/10.1073/pnas.1014743108] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/21199943]
3. Brettell, L.E.; Martin, S.J. Oldest Varroa tolerant honey bee population provides insight into the origins of the global decline of honey bees. Sci. Rep.; 2017; 7, 45953. [DOI: https://dx.doi.org/10.1038/srep45953] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28393875]
4. Becher, M.A.; Twiston-Davies, G.; Penny, T.D.; Goulson, D.; Rotheray, E.L.; Osborne, J.L. Bumble-BEEHAVE: A systems model for exploring multifactorial causes of bumblebee decline at individual, colony, population and community level. J. Appl. Ecol.; 2018; 55, pp. 2790-2801. [DOI: https://dx.doi.org/10.1111/1365-2664.13165]
5. Rundlöf, M.; Andersson, G.K.; Bommarco, R.; Fries, I.; Hederström, V.; Herbertsson, L.; Jonsson, O.; Klatt, B.K.; Pedersen, T.R.; Yourstone, J. et al. Seed coating with a neonicotinoid insecticide negatively affects wild bees. Nature; 2015; 521, pp. 77-80. [DOI: https://dx.doi.org/10.1038/nature14420]
6. Tomé, H.V.; Ramos, G.S.; Araújo, M.F.; Santana, W.C.; Santos, G.R.; Guedes, R.N.C.; Maciel, C.D.; Newland, P.L.; Oliveira, E.E. Agrochemical synergism imposes higher risk to neotropical bees than to honeybees. R. Soc. Open Sci.; 2017; 4, 160866. [DOI: https://dx.doi.org/10.1098/rsos.160866]
7. Farina, W.M.; Balbuena, M.S.; Herbert, L.T.; Goñalons, C.M.; Vázquez, D.E. Effects of the herbicide glyphosate on honey bee sensory and cognitive abilities: Individual impairments with implications for the hive. Insects; 2019; 10, 354. [DOI: https://dx.doi.org/10.3390/insects10100354]
8. Feldhaar, H.; Otti, O. Pollutants and their interaction with diseases of social hymenoptera. Insects; 2020; 11, 153. [DOI: https://dx.doi.org/10.3390/insects11030153]
9. Ilyasov, R.; Lim, S.; Lee, M.L.; Kwon, H.W.; Ni̇kolenko, A. Effect of miticides amitraz and fluvalinate on reproduction and productivity of honey bee Apis mellifera. Uludağ Arıcılık Derg.; 2021; 21, pp. 21-30. [DOI: https://dx.doi.org/10.31467/uluaricilik.883775]
10. Almeida, C.H.; Haddi, K.; Toledo, P.F.; Rezende, S.M.; Santana, W.C.; Guedes, R.N.C.; Newland, P.L.; Oliveira, E.E. Sublethal agrochemical exposures can alter honey bees’ and Neotropical stingless bees’ color preferences, respiration rates, and locomotory responses. Sci. Total Environ.; 2021; 779, 146432. [DOI: https://dx.doi.org/10.1016/j.scitotenv.2021.146432]
11. Shepherd, S.; Lima, M.; Oliveira, E.; Sharkh, S.; Aonuma, H.; Jackson, C.; Newland, P. Sublethal neonicotinoid exposure attenuates the effects of electromagnetic fields on honey bee flight and learning. Environ. Adv.; 2021; 4, 100051. [DOI: https://dx.doi.org/10.1016/j.envadv.2021.100051]
12. Tschoeke, P.H.; Oliveira, E.E.; Dalcin, M.S.; Silveira-Tschoeke, M.C.A.; Sarmento, R.A.; Santos, G.R. Botanical and synthetic pesticides alter the flower visitation rates of pollinator bees in Neotropical melon fields. Environ. Pollut.; 2019; 251, pp. 591-599. [DOI: https://dx.doi.org/10.1016/j.envpol.2019.04.133] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/31108292]
13. Lim, S.; Yunusbaev, U.; Ilyasov, R.; Lee, H.S.; Kwon, H.W. Abdominal contact of fluvalinate induces olfactory deficit in Apis mellifera. Pestic. Biochem. Physiol.; 2020; 164, pp. 221-227. [DOI: https://dx.doi.org/10.1016/j.pestbp.2020.02.005] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/32284130]
14. Aguiar, P.; Mendonça, L.; Galhardo, V. OpenControl: A free opensource software for video tracking and automated control of behavioral mazes. J. Neurosci. Methods; 2007; 166, pp. 66-72. [DOI: https://dx.doi.org/10.1016/j.jneumeth.2007.06.020]
15. Oh, D.Y.; Barr, I.G.; Hurt, A.C. A novel video tracking method to evaluate the effect of influenza infection and antiviral treatment on ferret activity. PLoS ONE; 2015; 10, e0118780. [DOI: https://dx.doi.org/10.1371/journal.pone.0118780]
16. Cho, H.J.; Lee, Y.H.; Kim, B.R.; Kim, H.K.; Chung, H.J.; Park, S.C.; Seong, J.K.; Yoon, J.H.; Kim, C.H. Newly developed method for mouse olfactory behavior tests using an automatic video tracking system. Auris Nasus Larynx; 2018; 45, pp. 103-110. [DOI: https://dx.doi.org/10.1016/j.anl.2017.03.007]
17. Rossetti, B.J.; Dynes, T.; Brosi, B.; de Roode, J.C.; Kong, J. GRAPHITE: A graphical environment for scalable in situ video tracking of moving insects. Methods Ecol. Evol.; 2018; 9, pp. 956-964. [DOI: https://dx.doi.org/10.1111/2041-210X.12944]
18. Tekalp, A.M. Digital Video Processing; Prentice Hall Press: Hoboken, NJ, USA, 2015; 592.
19. Henriques, J.F.; Caseiro, R.; Martins, P.; Batista, J. High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell.; 2015; 37, pp. 583-596. [DOI: https://dx.doi.org/10.1109/TPAMI.2014.2345390]
20. Hare, S.; Golodetz, S.; Saffari, A.; Vineet, V.; Cheng, M.M.; Hicks, S.L.; Torr, P.H. Struck: Structured Output Tracking with Kernels. IEEE Trans. Pattern Anal. Mach. Intell.; 2016; 38, pp. 2096-2109. [DOI: https://dx.doi.org/10.1109/TPAMI.2015.2509974]
21. Xue, W.; Xu, C.; Feng, Z. Robust Visual Tracking via Multi-Scale Spatio-Temporal Context Learning. IEEE Trans. Circuits Syst. Video Technol.; 2018; 28, pp. 2849-2860. [DOI: https://dx.doi.org/10.1109/TCSVT.2017.2720749]
22. Bazhenov, N.A.; Korzun, D.G. Use of Everyday Mobile Video Cameras in IoT Applications. Proceedings of the 22nd Conference of Open Innovations Association, FRUCT, FRUCT Oy; Helsinki, Finland, 15–18 May 2018; pp. 305-308.
23. Maggio, E.; Cavallaro, A. Video Tracking: Theory and Practice; John Wiley & Sons: Hoboken, NJ, USA, 2011; 266.
24. Pérez-Escudero, A.; Vicente-Page, J.; Hinz, R.C.; Arganda, S.; De Polavieja, G.G. IdTracker: Tracking individuals in a group by automatic identification of unmarked animals. Nat. Methods; 2014; 11, pp. 743-748. [DOI: https://dx.doi.org/10.1038/nmeth.2994] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/24880877]
25. Forys, B.; Xiao, D.; Gupta, P.; Boyd, J.; Murphy, T. Real-time markerless video tracking of body parts in mice using deep neural networks. bioRxiv; 2018; 482349. [DOI: https://dx.doi.org/10.1101/482349]
26. Anil, R.; Pereyra, G.; Passos, A.; Ormandi, R.; Dahl, G.E.; Hinton, G.E. Large scale distributed neural network training through online distillation. Proceedings of the 6th International Conference on Learning Representations, ICLR 2018-Conference Track Proceedings; Vancouver, BC, Canada, 30 April–3 May 2018.
27. Wang, L.; Liu, T.; Wang, G.; Chan, K.L.; Yang, Q. Video Tracking Using Learned Hierarchical Features. IEEE Trans. Image Process.; 2015; 24, pp. 1424-1435. [DOI: https://dx.doi.org/10.1109/TIP.2015.2403231]
28. Hong, W.; Kennedy, A.; Burgos-Artizzu, X.P.; Zelikowsky, M.; Navonne, S.G.; Perona, P.; Anderson, D.J. Automated measurement of mouse social behaviors using depth sensing, video tracking, and machine learning. Proc. Natl. Acad. Sci. USA; 2015; 112, pp. E5351-E5360. [DOI: https://dx.doi.org/10.1073/pnas.1515982112] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26354123]
29. Turetken, E.; Wang, X.; Becker, C.J.; Haubold, C.; Fua, P. Network Flow Integer Programming to Track Elliptical Cells in Time-Lapse Sequences. IEEE Trans. Med Imaging; 2017; 36, pp. 942-951. [DOI: https://dx.doi.org/10.1109/TMI.2016.2640859]
30. Wang, X.; Fan, B.; Chang, S.; Wang, Z.; Liu, X.; Tao, D.; Huang, T.S. Greedy Batch-Based Minimum-Cost Flows for Tracking Multiple Objects. IEEE Trans. Image Process.; 2017; 26, pp. 4765-4776. [DOI: https://dx.doi.org/10.1109/TIP.2017.2723239]
31. Bozek, K.; Hebert, L.; Portugal, Y.; Stephens, G.J. Markerless tracking of an entire honey bee colony. Nat. Commun.; 2021; 12, 1733. [DOI: https://dx.doi.org/10.1038/s41467-021-21769-1]
32. Popovic, M. Researchers in an entropy wonderland: A review of the entropy concept. arXiv; 2017; arXiv: 1711.07326
33. Mullin, C.A.; Frazier, M.; Frazier, J.L.; Ashcraft, S.; Simonds, R.; VanEngelsdorp, D.; Pettis, J.S. High Levels of Miticides and Agrochemicals in North American Apiaries: Implications for Honey Bee Health. PLoS ONE; 2010; 5, e9754. [DOI: https://dx.doi.org/10.1371/journal.pone.0009754]
34. Blacquière, T.; Smagghe, G.; Van Gestel, C.A.; Mommaerts, V. Erratum: Neonicotinoids in bees: A review on concentrations, side-effects and risk assessment. Ecotoxicology; 2012; 21, 1581. [DOI: https://dx.doi.org/10.1007/s10646-012-0890-7]
35. Almeida, C.H.S. Exposições Subletais a Pesticidas Alteram Comportamentos de Abelhas a Nível de Indivíduos e de Colônias. Master’s Thesis; Universidade Federal de Viçosa: Viçosa, Brazil, 2017.
36. Tschoeke, P.H.; Oliveira, E.E.; Dalcin, M.S.; Silveira-Tschoeke, M.C.A.; Santos, G.R. Diversity and flower-visiting rates of bee species as potential pollinators of melon (Cucumis melo L.) Braz. Cerrado. Sci. Hortic.; 2015; 186, pp. 207-216. [DOI: https://dx.doi.org/10.1016/j.scienta.2015.02.027]
37. dos Santos, G.R.; Tschoeke, P.H.; Sarmento, R.A.; Oliveira, E.E.; Rodrigues-Silva, N.; Dalcin, M.S.; Haddi, K.; Silva, R.S. Impact of growing seasons and pesticides used on the occurrence and severity of the gummy stem blight in melon cultivation in Brazil. Eur. J. Plant Pathol.; 2021; 161, pp. 171-184. [DOI: https://dx.doi.org/10.1007/s10658-021-02312-w]
38. Robinson, G.E. Regulation of Division of Labor in Insect Societies. Annu. Rev. Entomol.; 1992; 37, pp. 637-665. [DOI: https://dx.doi.org/10.1146/annurev.en.37.010192.003225] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/1539941]
39. Zivkovic, Z. Improved adaptive Gaussian mixture model for background subtraction. Proceedings of the International Conference on Pattern Recognition; Cambridge, UK, 26–26 August 2004; Volume 2, pp. 28-31. [DOI: https://dx.doi.org/10.1109/icpr.2004.1333992]
40. Zivkovic, Z.; Van Der Heijden, F. Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern Recognit. Lett.; 2006; 27, pp. 773-780. [DOI: https://dx.doi.org/10.1016/j.patrec.2005.11.005]
41. Loftsgaarden, D.O.; Quesenberry, C.P. A nonparametric estimate of a multivariate density function. Ann. Math. Stat.; 1965; 36, pp. 1049-1051. [DOI: https://dx.doi.org/10.1214/aoms/1177700079]
42. Terrell, G.R.; Scott, D.W. Variable kernel density estimation. Ann. Stat.; 1992; pp. 1236-1265. [DOI: https://dx.doi.org/10.1214/aos/1176348768]
43. Pabst, W.; Gregorova, E. Characterization of particles and particle systems. ICT Prague; 2007; 122, 122.
44. Risken, H. The Fokker-Planck Equation; Springer: Berlin/Heidelberg, Germany, New York, NY, USA, 1996; 472.
45. Gatto, R.; Jammalamadaka, S.R. The generalized von Mises distribution. Stat. Methodol.; 2007; 4, pp. 341-353. [DOI: https://dx.doi.org/10.1016/j.stamet.2006.11.003]
46. Evans, W.E.D. The Chemistry of Death; Charles C Thomas Publisher: Springfield, IL, USA, 1963.
47. Schneider, E.D.; Kay, J.J. Life as a manifestation of the second law of thermodynamics. Math. Comput. Model.; 1994; 19, pp. 25-48. [DOI: https://dx.doi.org/10.1016/0895-7177(94)90188-0]
48. Shannon, C.E. A Mathematical Theory of Communication. Bell Syst. Tech. J.; 1948; 27, pp. 379-423. [DOI: https://dx.doi.org/10.1002/j.1538-7305.1948.tb01338.x]
49. Oliveira, J.; Avila, I.; Pinheiro, M.; Maciel, C. Entropy: From Thermodynamics to Information Theory. Entropy; 2021; 23, 9800. [DOI: https://dx.doi.org/10.3390/entropy2021-09800]
50. Jaynes, E.T. Information theory and statistical mechanics (notes by the lecturer). Stat. Phys.; 1963; 3, 181.
51. Stockmaier, S.; Stroeymeyt, N.; Shattuck, E.C.; Hawley, D.M.; Meyers, L.A.; Bolnick, D.I. Infectious diseases and social distancing in nature. Science; 2021; 371, 6533. [DOI: https://dx.doi.org/10.1126/science.abc8881] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/33674468]
52. Pusceddu, M.; Cini, A.; Alberti, S.; Salaris, E.; Theodorou, P.; Floris, I.; Satta, A. Honey bees increase social distancing when facing the ectoparasite Varroa destructor. Sci. Adv.; 2021; 7, eabj1398. [DOI: https://dx.doi.org/10.1126/sciadv.abj1398] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/34714677]
53. Noldus, L.P.; Spink, A.J.; Tegelenbosch, R.A. EthoVision: A versatile video tracking system for automation of behavioral experiments. Behav. Res. Methods Instruments Comput.; 2001; 33, pp. 398-414. [DOI: https://dx.doi.org/10.3758/BF03195394] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/11591072]
54. Parker, J.E.; Angarita-Jaimes, N.; Abe, M.; Towers, C.E.; Towers, D.; McCall, P.J. Infrared video tracking of Anopheles gambiae at insecticide-treated bed nets reveals rapid decisive impact after brief localised net contact. Sci. Rep.; 2015; 5, 13392. [DOI: https://dx.doi.org/10.1038/srep13392] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/26323965]
55. Ning, J.; Zhang, L.; Zhang, D.; Wu, C. Robust mean-shift tracking with corrected background-weighted histogram. IET Comput. Vis.; 2012; 6, pp. 62-69. [DOI: https://dx.doi.org/10.1049/iet-cvi.2009.0075]
56. Bozek, K.; Hebert, L.; Mikheyev, A.S.; Stephens, G.J. Towards Dense Object Tracking in a 2D Honeybee Hive. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Salt Lake City, UT, USA, 18–23 June 2018; pp. 4185-4193. [DOI: https://dx.doi.org/10.1109/CVPR.2018.00440]
57. Mao, W.; Schuler, M.A.; Berenbaum, M.R. Disruption of quercetin metabolism by fungicide affects energy production in honey bees (Apis mellifera). Proc. Natl. Acad. Sci. USA; 2017; 114, pp. 2538-2543. [DOI: https://dx.doi.org/10.1073/pnas.1614864114]
58. Fisher, A.; DeGrandi-Hoffman, G.; Smith, B.H.; Johnson, M.; Kaftanoglu, O.; Cogley, T.; Fewell, J.H.; Harrison, J.F. Colony field test reveals dramatically higher toxicity of a widely-used mito-toxic fungicide on honey bees (Apis mellifera). Environ. Pollut.; 2021; 269, 115964. [DOI: https://dx.doi.org/10.1016/j.envpol.2020.115964]
59. Remolina, S.C.; Hafez, D.M.; Robinson, G.E.; Hughes, K.A. Senescence in the worker honey bee Apis mellifera. J. Insect Physiol.; 2007; 53, pp. 1027-1033. [DOI: https://dx.doi.org/10.1016/j.jinsphys.2007.05.015]
60. Perry, C.J.; Søvik, E.; Myerscough, M.R.; Barron, A.B. Rapid behavioral maturation accelerates failure of stressed honey bee colonies. Proc. Natl. Acad. Sci. USA; 2015; 112, pp. 3427-3432. [DOI: https://dx.doi.org/10.1073/pnas.1422089112] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/25675508]
61. Ardalani, H.; Vidkjær, N.H.; Laursen, B.B.; Kryger, P.; Fomsgaard, I.S. Dietary quercetin impacts the concentration of pesticides in honey bees. Chemosphere; 2021; 262, 127848. [DOI: https://dx.doi.org/10.1016/j.chemosphere.2020.127848] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/32771708]
62. Liao, L.H.; Wu, W.Y.; Berenbaum, M.R. Impacts of dietary phytochemicals in the presence and absence of pesticides on longevity of honey bees (Apis mellifera). Insects; 2017; 8, 22. [DOI: https://dx.doi.org/10.3390/insects8010022] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/28216580]
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
Simple Summary
The number of honey bee, Apis mellifera L., colonies has reduced around the globe, and one potential cause is their unintended exposure to sublethal stressors such as agricultural pesticides. The quantification of such effects at colony level is a very complex task due to the innumerable collective activities done by the individual within colonies. Here, we present a Bayesian and computational approach capable of tracking the movements of bees within colonies, which allows the comparison of the collective activities of colonies that received bees previously exposed to uncontaminated diets or to diets containing sublethal concentrations of an agricultural pesticide (a commercial formulation containing the synthetic fungicides thiophanate-methyl and chlorothalonil). Our Bayesian tracking technique proved successful and superior to comparable algorithms, allowing the estimation of dynamical parameters such as entropy and kinetic energy. Our efforts demonstrated that fungicide-contaminated colonies behaved differently from uncontaminated colonies, as the former exhibited anticipated collective activities in peripheral hive areas and had reduced swarm entropy and kinetic energies. Such findings may facilitate the electronic monitoring of potential unintended effects in social pollinators, at colony level, mediated by environmental stressors (e.g., pesticides, electromagnetic fields, noise, and light intensities) alone or in combination.
AbstractInteractive movements of bees facilitate the division and organization of collective tasks, notably when they need to face internal or external environmental challenges. Here, we present a Bayesian and computational approach to track the movement of several honey bee, Apis mellifera, workers at colony level. We applied algorithms that combined tracking and Kernel Density Estimation (KDE), allowing measurements of entropy and Probability Distribution Function (PDF) of the motion of tracked organisms. We placed approximately 200 recently emerged and labeled bees inside an experimental colony, which consists of a mated queen, approximately 1000 bees, and a naturally occurring beehive background. Before release, labeled bees were fed for one hour with uncontaminated diets or diets containing a commercial mixture of synthetic fungicides (thiophanate-methyl and chlorothalonil). The colonies were filmed (12 min) at the 1st hour, 5th and 10th days after the bees’ release. Our results revealed that the algorithm tracked the labeled bees with great accuracy. Pesticide-contaminated colonies showed anticipated collective activities in peripheral hive areas, far from the brood area, and exhibited reduced swarm entropy and energy values when compared to uncontaminated colonies. Collectively, our approach opens novel possibilities to quantify and predict potential alterations mediated by pollutants (e.g., pesticides) at the bee colony-level.
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details








1 Laboratório de Processamento de Sinais, Departamento de Engenharia Elétrica, Universidade de São Paulo, São Carlos 13566-590, SP, Brazil;
2 Departamento de Entomologia, Universidade Federal de Viçosa, Viçosa 36570-900, MG, Brazil;
3 Departamento de Entomologia, Universidade Federal de Viçosa, Viçosa 36570-900, MG, Brazil;
4 Departamento de Entomologia, Universidade Federal de Lavras, Lavras 37200-900, MG, Brazil;
5 Department of Electrical Engineering, Federal University of Minas Gerais, Belo Horizonte 31270-901, MG, Brazil;
6 Department of Social Medicine, University of São Paulo, Ribeirão Preto 14040-900, SP, Brazil;