Rapid detection of fish calls within diverse coral reef soundscapes using a convolutional neural networka)

The quantity of passive acoustic data collected in marine environments is rapidly expanding; however, the software developments required to meaningfully process large volumes of soundscape data have lagged behind. A significant bottleneck in the analysis of biological patterns in soundscape datasets is the human effort required to identify and annotate individual acoustic events, such as diverse and abundant fish sounds. This paper addresses this problem by training a YOLOv5 convolutional neural network (CNN) to automate the detection of tonal and pulsed fish calls in spectrogram data from five tropical coral reefs in the U.S. Virgin Islands, building from over 22 h of annotated data with 55 015 fish calls. The network identified fish calls with a mean average precision of up to 0.633, while processing data over 25× faster than it is recorded. We compare the CNN to human annotators on five datasets, including three used for training and two untrained reefs. CNN-detected call rates reflected baseline reef fish and coral cover observations; and both expected biological (e.g., crepuscular choruses) and novel call patterns were identified. Given the importance of reef-fish communities, their bioacoustic patterns, and the impending biodiversity crisis, these results provide a vital and scalable means to assess reef community health.

Structural and functional evolution of the mechanosensory lateral line system of fishesa)

The mechanosensory lateral line system is the flow sensing system present in all 34 000+ species of fishes. Its neuromast receptor organs, located on the skin or in bony canals on the head and tubed scales on the trunk, respond to the near field component of acoustic stimuli as well as short range, low frequency (0-200 Hz) water flows of biotic and abiotic origin. Here, I discuss the genesis of my research career and its focus on the structural and functional evolution of the lateral line system among a wide taxonomic range of fishes including those from different aquatic habitats (tropical lakes to coral reefs and the deep sea). I discuss the importance of investigating structure before function, using investigations in my laboratory that had unexpected outcomes, as well as the role of serendipity in the evolution of a career and in the nature of scientific discovery.

Limited possibilities for prezygotic barriers in the reproductive behaviour of sympatric Ophthalmotilapia species (Teleostei, Cichlidae)

Since prezygotic rather than postzygotic barriers are believed to maintain the diversity of closely related sympatric cichlids, differences in phenotypic traits and reproductive behaviours are likely involved in maintaining species boundaries. Here, we focused on the reproductive behaviour of three Ophthalmotilapia species with distributions that only overlap on a small stretch of the shore line of Lake Tanganyika. Repeated introgression of mitochondrial DNA between these species was previously reported, which suggested they can hybridise. Our aim is to test the hypothesis that reproductive behaviour acts as a prezygotic barrier that prevents frequent hybridisation in sympatric Ophthalmotilapia species. We performed a quantitative analysis of twelve reproductions (four for O. ventralis, six for O. nasuta, one for O. boops, and one between a female O. ventralis and a male O. nasuta). Although similar ethograms were obtained for these reproductions, the O. ventralis and O. boops males displayed a behaviour that was never performed by O. nasuta males. This behaviour was displayed during courtship and we called it 'invite'. In O. ventralis, we could show that it was associated with the emission of a single pulse sound. The comparison of O. nasuta and O. ventralis reproductive behaviours also revealed some quantitative differences: O. ventralis males showed the location of the bower more often to the female, whereas O. ventralis females followed the male more often. The similarity between the reproductive behaviours in O. ventralis and O. nasuta could explain the occurrence of the heterospecific spawning event recorded between an O. nasuta male and an O. ventralis female. Importantly, few eggs were laid and the maternal mouthbrooding that resulted from this heterospecific reproduction only lasted for two days, which suggested the abortion of egg development. Hence, in the absence of conspecifics, courtship and mating behaviours alone do not constitute perfect prezygotic barriers between these two species.

Acoustic Communication in Butterflyfishes: Anatomical Novelties, Physiology, Evolution, and Behavioral Ecology

Coral reef fishes live in noisy environments that may challenge their capacity for acoustic communication. Butterflyfishes (Family Chaetodontidae) are prominent and ecologically diverse members of coral reef communities worldwide. The discovery of a novel association of anterior swim bladder horns with the lateral line canal system in the genus Chaetodon (the laterophysic connection) revealed a putative adaptation for enhancement of sound reception by the lateral line system and/or the ear. Behavioral studies show that acoustic communication is an important component of butterflyfish social behavior. All bannerfish (Forcipiger, Heniochus, and Hemitaurichthys) and Chaetodon species studied thus far produce several sound types at frequencies of <1 to >1000 Hz. Ancestral character state analyses predict the existence of both shared (head bob) and divergent (tail slap) acoustic behaviors in these two clades. Experimental auditory physiology shows that butterflyfishes are primarily sensitive to stimuli associated with hydrodynamic particle accelerations of ≤500 Hz. In addition, the gas-filled swim bladder horns in Chaetodon are stimulated by sound pressure, which enhances and extends their auditory sensitivity to 1700-2000 Hz. The broadband spectrum of ambient noise present on coral reefs overlaps with the frequency characteristics of their sounds, thus both the close social affiliations common among butterflyfishes and the evolution of the swim bladder horns in Chaetodon facilitate their short-range acoustic communication. Butterflyfishes provide a unique and unexpected opportunity to carry out studies of fish bioacoustics in the lab and the field that integrate the study of sensory anatomy, physiology, evolution, and behavioral ecology.

Unusual sound production mechanism in the triggerfish Rhinecanthus aculeatus (Balistidae)

The ability to produce sounds has been known for decades in Balistidae. Sounds of many species have been recorded and a variety of sound producing mechanisms have been proposed including teeth stridulation, collision of buccal teeth, and movements of the fins. The best supported hypothesis involves movements of the pectoral fins against the lateral parts of the swimbladder called a drumming membrane. In this study, we describe for the first time the sounds made by the Blackbar triggerfish Rhinecanthus aculeatus that sound like short drum rolls with an average duration of 85 ms, 193 Hz dominant frequency and 136 dB SPL level at 3 cm distance. Sounds are a series of pulses that result from alternate sweeping movements of the right and left pectoral fins, which push a system of three scutes that are forced against the swimbladder wall. Pulses from each fin occur in consecutive pairs. High-speed videos indicate that each pulse consists in two cycles. The first part of each cycle corresponds to the inward buckling of the scutes whereas the second part of the cycle corresponds to an apparent passive recoil of the scutes and swimbladder wall. This novel sound production mechanism is likely found in many members of Balistidae because these peculiar scutes are found in other species in the family. Comparison of sound characteristics from fishes of different sizes shows that dominant frequency decreases with size in juveniles but not in adults.

Automated detection of broadband clicks of freshwater fish using spectro-temporal features

Large scale networks of embedded wireless sensor nodes can passively capture sound for species detection. However, the acoustic recordings result in large amounts of data requiring in-network classification for such systems to be feasible. The current state of the art in the area of in-network bioacoustics classification targets narrowband or long-duration signals, which render it unsuitable for detecting species that emit impulsive broadband signals. In this study, impulsive broadband signals were classified using a small set of spectral and temporal features to aid in their automatic detection and classification. A prototype system is presented along with an experimental evaluation of automated classification methods. The sound used was recorded from a freshwater invasive fish in Australia, the spotted tilapia (Tilapia mariae). Results show a high degree of accuracy after evaluating the proposed detection and classification method for T. mariae sounds and comparing its performance against the state of the art. Moreover, performance slightly improves when the original signal was down-sampled from 44.1 to 16 kHz. This indicates that the proposed method is well-suited for detection and classification on embedded devices, which can be deployed to implement a large scale wireless sensor network for automated species detection.

Vocalisations of the bigeye Pempheris adspersa: characteristics, source level and active space

Fish sounds are an important biological component of the underwater soundscape. Understanding species-specific sounds and their associated behaviour is critical for determining how animals use the biological component of the soundscape. Using both field and laboratory experiments, we describe the sound production of a nocturnal planktivore, Pempheris adspersa (New Zealand bigeye), and provide calculations for the potential effective distance of the sound for intraspecific communication. Bigeye vocalisations recorded in the field were confirmed as such by tank recordings. They can be described as popping sounds, with individual pops of short duration (7.9±0.3 ms) and a peak frequency of 405±12 Hz. Sound production varied during a 24 h period, with peak vocalisation activity occurring during the night, when the fish are most active. The source level of the bigeye vocalisation was 115.8±0.2 dB re. 1 µPa at 1 m, which is relatively quiet compared with other soniferous fish. Effective calling range, or active space, depended on both season and lunar phase, with a maximum calling distance of 31.6 m and a minimum of 0.6 m. The bigeyes' nocturnal behaviour, characteristics of their vocalisation, source level and the spatial scale of its active space reported in the current study demonstrate the potential for fish vocalisations to function effectively as contact calls for maintaining school cohesion in darkness.

Sound pressure enhances the hearing sensitivity of Chaetodon butterflyfishes on noisy coral reefs

Butterflyfishes are conspicuous members of coral reefs that communicate with acoustic signals during social interactions with mates and other conspecifics. Members of the genus Chaetodon have a laterophysic connection (LC), a unique association of anterior swim bladder horns and the cranial lateral line, but the action of the LC system on auditory sensitivity was previously unexplored. Baseline auditory evoked potential threshold experiments show that Forcipiger flavissimus (which lacks swim bladder horns and LC) is sensitive to sound tones from 100 Hz up to 1000 Hz, and that thresholds for three species of Chaetodon were 10-15 dB lower with extended hearing ranges up to 1700-2000 Hz. The relatively high thresholds to sound pressure and low pass response near 500 Hz for all four species is consistent with a primary sensitivity to hydrodynamic particle acceleration rather than sound pressure. Deflation of the swim bladder in Forcipiger had no measurable effect on auditory sensitivity. In contrast, displacement of gas from the swim bladder horns in C. multicinctus and C. auriga increased thresholds (decreased sensitivity) by approximately 10 dB with the greatest effect at 600 Hz. The evolution of swim bladder horns associated with the LC system in Chaetodon has increased hearing sensitivity through sound pressure transduction in the frequency bands used for social acoustic communication. The close affiliative behaviors that are common in Chaetodon and other butterflyfish species facilitate sound perception and acoustic communication at close distances relative to the high background noise levels found in their natural reef environment.

Variation in swim bladder drumming sounds from three doradid catfish species with similar sonic morphologies

A variety of teleost fishes produce sounds for communication by vibrating the swim bladder with fast contracting muscles. Doradid catfishes have an elastic spring apparatus (ESA) for sound production. Contractions of the ESA protractor muscle pull the anterior transverse process of the 4th vertebra or Müllerian ramus (MR) to expand the swim bladder and elasticity of the MR returns the swim bladder to the resting state. In this study, we examined the sound characteristics and associated fine structure of the protractor drumming muscles of three doradid species: Acanthodoras cataphractus, Platydoras hancockii, and Agamyxis pectinifrons. Despite important variations in sizes, sounds from all three species had similar mean dominant rates ranging from 91-131 Hz and showed frequencies related to muscle contraction speed rather than fish size. Sounds differed among species in terms of waveform shape and their rate of amplitude modulation. In addition, multiple distinguishable sound types were observed from each species: three sound types from A. cataphractus and P. hancockii, and two sound types from A. pectinifrons. Though sounds differed among species, no differences in muscle fiber fine structure were observed at the species level. Drumming muscles from each species bear features associated with fast contractions, including sarcoplasmic cores, thin radial myofibrils, abundant mitochondria, and an elaborated sarcoplasmic reticulum. These results indicate that sound differences between doradids are not due to swimbladder size, muscle anatomy, muscle length, or Müllerian ramus shape, but instead result from differences in neural activation of sonic muscles.

Diversity and evolution of sound production in the social behavior of Chaetodon butterflyfishes

Fish produce context-specific sounds during social communication but it is not known how acoustic behaviors have evolved in relation to specializations of the auditory system. Butterflyfishes (family Chaetodontidae) have a well-defined phylogeny and produce pulsed communication sounds during social interactions on coral reefs. Recent work indicates two sound production mechanisms exist in the bannerfish clade and others for one species in the Chaetodon clade which is distinguished by an auditory specialization, the laterophysic connection (LC). We determine the kinematic action patterns associated with sound production during social interactions in four Chaetodon subgenera and the non-laterophysic Forcipiger. Some Chaetodon species share the head bob acoustic behavior with Forcipiger which along with other sounds in the 100-1000 Hz spectrum are likely adequate to stimulate the ear, swim bladder or LC of a receiver fish. In contrast, only Chaetodon produced the tail slap sound which involves a 1-30 Hz hydrodynamic pulse that likely stimulates the receiver's ear and lateral line at close distances, but neither the swim bladder nor LC. Reconstructions of ancestral character states appear equivocal for the head bob and divergent for the tail slap acoustic behaviors. Independent contrast analysis shows a correlation between sound duration and stimulus intensity characters. The intensity of the tail slap and body pulse sound in Chaeotodon is correlated with body size and can provide honest communication signals. Future studies on fish acoustic communication should investigate low frequency and infrasound acoustic fields to understand the integrated function of the ear and lateral line, and their evolutionary patterns.

Sound production in the longnose butterflyfishes (genus Forcipiger): cranial kinematics, muscle activity and honest signals

Many teleost fishes produce sounds for social communication with mechanisms that do not involve swim bladder musculature. Such sounds may reflect physical attributes of the sound-production mechanism, be constrained by body size and therefore control signal reliability during agonistic behaviors. We examined kinematics of the cranium, median fins and caudal peduncle during sound production in two territorial chaetodontid butterflyfish sister species: forcepsfish (Forcipiger flavissimus) and longnose butterflyfish (F. longirostris). During intraspecific agonistic encounters, both species emit a single pulse sound that precedes rapid cranial rotation at velocities and accelerations that exceed those of prey strikes by many ram-and suction-feeding fishes. Electromyography showed that onsets of activity for anterior epaxialis, sternohyoideus, A1 and A2 adductor mandibulae muscles and sound emission are coincident but precede cranial elevation. Observations indicate that sound production is driven by epaxial muscle contraction whereas a ventral linkage between the head and pectoral girdle is maintained by simultaneous activity from the adductor mandibulae and sternohyoideus. Thus, the girdle, ribs and rostral swim bladder are pulled anteriorly before the head is released and rotated dorsally. Predictions of the hypothesis that acoustic signals are indicators of body size and kinematic performance were confirmed. Variation in forcepsfish sound duration and sound pressure level is explained partly by cranial elevation velocity and epaxial electromyogram duration. Body size, however, explains most variation in duration and sound pressure level. These observed associations indicate that forcepsfish sounds may be accurate indicators of size and condition that are related to resource holding potential during social encounters.

Sound production and mechanism in Heniochus chrysostomus (Chaetodontidae)

The diversity in calls and sonic mechanisms appears to be important in Chaetodontidae. Calls in Chaetodon multicinctus seem to include tail slap, jump, pelvic fin flick and dorsal–anal fin erection behaviors. Pulsatile sounds are associated with dorsal elevation of the head, anterior extension of the ventral pectoral girdle and dorsal elevation of the caudal skeleton in Forcipiger flavissiumus. In Hemitaurichthys polylepis, extrinsic swimbladder muscles could be involved in sounds originating from the swimbladder and correspond to the inward buckling of tissues situated dorsally in front of the swimbladder. These examples suggest that this mode of communication could be present in other members of the family. Sounds made by the pennant bannerfish (Heniochus chrysostomus) were recorded for the first time on coral reefs and when fish were hand held. In hand-held fishes, three types of calls were recorded: isolated pulses (51%), trains of four to 11 pulses (19%) and trains preceded by an isolated pulse (29%). Call frequencies were harmonic and had a fundamental frequency between 130 and 180 Hz. The fundamental frequency, sound amplitude and sound duration were not related to fish size. Data from morphology, sound analysis and electromyography recordings highlight that the calls are made by extrinsic sonic drumming muscles in association with the articulated bones of the ribcage. The pennant bannerfish system differs from other Chaetodontidae in terms of sound characteristics, associated body movements and, consequently, mechanism.