Every spring, river herring populations migrate from Massachusetts coastal waters to start their annual journey up rivers and streams to freshwater spawning habitat. River herring have confronted extreme inhabitants declines over the previous a number of a long time, and their migration is extensively monitored throughout the area, primarily via conventional visible counting and volunteer-based applications.
Monitoring fish motion and understanding inhabitants dynamics are important for informing conservation efforts and supporting fisheries administration. With the annual herring run getting underway this month, researchers and useful resource managers as soon as once more tackle the problem of counting and estimating the migrating fish inhabitants as precisely as doable.
A crew of researchers from the Woodwell Local weather Analysis Heart, MIT Sea Grant, the MIT Pc Science and Synthetic Intelligence Lab (CSAIL), MIT Lincoln Laboratory, and Intuit explored a brand new monitoring methodology utilizing underwater video and laptop imaginative and prescient to complement citizen science efforts. The researchers — Zhongqi Chen and Linda Deegan from the Woodwell Local weather Analysis Heart, Robert Vincent and Kevin Bennett from MIT Sea Grant, Sara Beery and Timm Haucke from MIT CSAIL, Austin Powell from Intuit, and Lydia Zuehsow from MIT Lincoln Laboratory — revealed a paper describing this work within the journal Distant Sensing in Ecology and Conservation this February.
The open-access paper, “From snapshots to continuous estimates: Augmenting citizen science with computer vision for fish monitoring,” outlines how current developments in laptop imaginative and prescient and deep studying, from object detection and monitoring to species classification, supply promising real-world options for automating fish counting with improved effectivity and information high quality.
Conventional monitoring strategies are constrained by time, environmental circumstances, and labor depth. Volunteer visible counts are restricted to temporary daytime sampling home windows, lacking nighttime motion and quick migration pulses, when a whole lot of fish go by throughout the span of some minutes. Whereas applied sciences like passive acoustic monitoring and imaging sonar have superior steady fish monitoring below sure circumstances, probably the most promising and low-cost choice — guide overview of underwater video — continues to be labor-intensive and time-consuming. With the rising demand for automated video processing options, this research presents a scalable, cost-effective, and environment friendly deep learning-based system for dependable automated fish monitoring.
The crew constructed an end-to-end pipeline — from in-field underwater cameras to video labeling and mannequin coaching — to realize automated, laptop vision-powered fish counting. Movies had been collected from three rivers in Massachusetts: the Coonamessett River in Falmouth, the Ipswich River (Ipswich), and the Santuit River in Mashpee.
To arrange the coaching dataset, the crew chosen video clips with variations in lighting, water readability, fish species and density, time of day, and season to make sure that the pc imaginative and prescient mannequin would work reliably throughout numerous real-world situations. They used an open-source net platform to manually label the movies frame-by-frame with bounding containers to trace fish motion. In whole, they labeled 1,435 video clips and annotated 59,850 frames.
The researchers in contrast and validated the pc imaginative and prescient counts with human video evaluations, stream-side visible counts, and information from passive built-in transponder (PIT) tagging. They concluded that fashions skilled on numerous multi-site and multi-year information carried out finest and produced season-long, high-resolution counts in step with historically established estimates. Going one step additional, the system offered insights into migration habits, timing, and motion patterns linked to environmental elements. Utilizing video from the 2024 Coonamesset River migration, the system counted 42,510 river herring and revealed that upstream migration peaked at daybreak, whereas downstream migration was largely nocturnal, with fish using darker, quieter durations to keep away from predators.
With this real-world software, the researchers purpose to advance laptop imaginative and prescient in fisheries administration and supply a framework and finest practices for integrating the expertise into conservation efforts for a variety of aquatic species. “MIT Sea Grant has been funding work on this matter for a while now, and this wonderful work by Zhongqi Chen and colleagues will advance fisheries monitoring capabilities and enhance fish inhabitants assessments for fisheries managers and conservation teams,” Vincent says. “It is going to additionally present training and coaching for college kids, the general public, and citizen science teams in assist of the ecologically and culturally essential river herring populations alongside our coasts.”
Nonetheless, continued conventional monitoring is crucial for sustaining consistency in long-term datasets till fisheries administration companies totally implement automated counting techniques. Even then, laptop imaginative and prescient and citizen science must be seen as complementary. Volunteers will likely be vital for digital camera upkeep and for contributing on to the pc imaginative and prescient workflow, from video annotation to mannequin verification. The researchers envision that integrating citizen observations and laptop vision-generated information will assist create a extra complete and holistic strategy to environmental monitoring.
This work was funded by MIT Sea Grant, with further assist offered by the Northeast Local weather Adaptation Science Heart, an MIT Abdul Latif Jameel Water and Meals Programs seed grant, the AI and Biodiversity Change International Heart (supported by the Nationwide Science Basis and the Pure Sciences and Engineering Analysis Council of Canada), and the MIT Undergraduate Analysis Alternatives Program.
