Innovative Camera System Provides a Closer Look at Elusive Ocean Predators

Piscivore combines MBARI’s advanced underwater robots, high-definition cameras, and artificial intelligence to study ocean predators. (Image credit: Jared Figurski, 2024 MBARI)

Marine predators such as tunas, sharks, seabirds, and marine mammals play a pivotal role in structuring ocean ecosystems. Despite their importance, these animals remain challenging to study. They spend much of their time far from shore and dispersed across remote stretches of the global ocean.

Many are highly mobile and associate with dynamic ocean habitats that change hourly and can be wary of boats and submersibles.

Now, a new camera system developed by MBARI’s (Monterey Bay Aquarium Research Institute) engineers gives us a glimpse into the secret lives of these ocean predators. MBARI’s innovative Piscivore system can observe active ocean predators and document their dynamic surroundings.

“Marine predators are difficult to study because they’re rare, highly mobile, and the ocean is vast. The challenge is being in the right place at the right time, but now robots equipped with MBARI’s Piscivore system can give us a glimpse into the lives of tunas, sharks, and other predators, providing valuable information to better understand these important animals,” said Ocean Observatory Engineer Jared Figurski, the principal investigator for MBARI’s Piscivore project.

image2 Piscivore white shark 02Piscivore allows researchers to observe elusive marine predators. During a recent deployment, this innovative system captured footage of a curious female white shark (Carcharodon carcharias). (Image credit: 2024 MBARI)

Tunas, sharks, seabirds, and marine mammals face an uncertain future due to threats like overfishing and climate change. We urgently need to understand these key animals so we can better protect them. Piscivore seeks to gather vital information about marine predators and their prey.

Piscivore (pronounced “pie-si-voar”) uses autonomous robots to survey marine predators far beyond coastal waters. The camera system is mounted on the long-range autonomous underwater vehicle (LRAUV), an advanced underwater robot developed by MBARI engineers. About two meters (6.6 feet) long, 30 centimeters (12 inches) in diameter, and weighing 110 kilograms (242.5 pounds), the LRAUV is a versatile platform for science. It can carry a variety of instrumentation payloads to study the ocean and its inhabitants.

MBARI engineers developed the Piscivore system to observe marine life from the perspective of this nimble underwater robot as it travels across the fertile waters of Monterey Bay.

Piscivore has two cameras—one faces ahead of the vehicle and the other watches what approaches from behind. Many predators move out of the way of animals and objects that approach them. Piscivore compensates for the skittishness of pelagic predators by dragging a piece of textured metal in its wake. As the metal attractor swirls in the currents, it catches sunlight and flashes like a silvery fish, piquing the curiosity of predators. The cameras record continuously to see who approaches.

MBARI researchers pilot the LRAUV remotely from our facilities on shore using cellular and satellite data connections on the vehicle. They can target hotspots of ocean productivity where food is plentiful and predators will be most abundant, then send Piscivore in for a closer look.

image3 Piscivore forward camera closeup 1150 768x624A forward-facing camera captures high-definition video of marine life in front of Piscivore as MBARI’s long-range autonomous underwater vehicle (LRAUV) travels through the waters of Monterey Bay. A second camera films animals that approach from behind. (Image credit: Jared Figurski, 2023 MBARI)

Researchers deploy Piscivore for roughly two weeks at a time. After its mission is complete, MBARI’s marine operations crew retrieves the vehicle and downloads the camera data on shore. Each deployment logs approximately 200 hours of high-definition video, 100 hours from each of Piscivore’s two cameras. Machine-learning algorithms developed by MBARI’s software engineers leverage the power of artificial intelligence to help researchers quickly review and catalog Piscivore’s observations.

Piscivore has filmed encounters with a wide diversity of ocean predators.

During a recent deployment, Piscivore observed a large female white shark (Carcharodon carcharias). On past deployments, Piscivore has filmed other pelagic sharks, including blue sharks (Prionace glauca) and shortfin mako sharks (Isurus oxyrinchus), as well as fishes like Pacific bluefin tuna (Thunnus orientalis) and salmon (Onychorhynchus sp.).

Piscivore catches glimpses of diving seabirds, such as common murres (Uria aalge) and cormorants (Phalacrocorax sp.). Seabirds are highly mobile animals that nest and shelter on land, but feed at sea. They often migrate seasonally, sometimes traversing thousands of kilometers. Seabirds underscore the connection between land, sky, and sea and are sentinels that can reveal important information about ocean health.

Curious marine mammals, including Pacific white-sided dolphins (Lagenorhynchus obliquidens) and California sea lions (Zalophus californianus), often approach Piscivore for a closer look.

image4 Piscivore cormorant 01Over the past year, Piscivore has observed six different species of seabirds, including diving cormorants. (Image credit: 2024 MBARI)

“Our team is interested in understanding the relationships among ocean animals. We use sound to map life in Monterey Bay using robots to tell us how many of what types of animals are where. Using sonar alone, however, it is difficult to identify specific species. Piscivore fills that gap, giving us a new window to understanding predator-prey relationships,” said Senior Scientist Kelly Benoit-Bird, who leads MBARI’s Acoustical Ocean Ecology Team.

Piscivore sometimes encounters aggregations of prey, like schooling sardines (Sardinops sagax), anchovies (Engraulis mordax), and mackerel (Scomber japonicus). These smaller forage fish are a vital food source for larger predators and humans too.

Piscivore also gathers visual data about the “neighbors” that live alongside ocean predators. It films the gelatinous animals that live in the open ocean and have historically been challenging to study.

“One thing Piscivore shows us is that the best way to gain insight on what is happening in the open ocean is to spend more time out there and cover more area. Ships and deep-diving robots gather detailed data from specific, targeted locations, but Piscivore can collect data for weeks at a time across the open sea,” said Senior Scientist Steve Haddock, who leads MBARI’s Biodiversity and Biooptics Team.

image5 Piscivore sea nettles 01 1In addition to filming elusive marine predators, Piscivore provides vital data about jelly blooms. (Image credit: 2024 MBARI)

Haddock and his team are interested in studying how populations of gelatinous animals ebb and flow. They use a variety of approaches to get a grasp on the dynamics of jelly blooms, including robot-mounted cameras, above-water drones for photographing the sea surface, and community science observations through JellyWatch. “Piscivore is an important new tool in our belt. It’s exciting to be operating in a time when there are so many options besides dragging a net behind a large ship,” said Haddock.

Piscivore has already shown great promise as a platform for observing marine life. In 2023, MBARI had 10 Piscivore deployments, sampling an estimated 1,800 kilometers (about 1,100 miles) in the Monterey Bay area and encountering 10 species of fish, four species of marine mammals, and six species of seabirds. Five research groups at MBARI have leveraged Piscivore in their research, and labeled video from Piscivore is being added to the FathomNet database to help train AI algorithms to recognize marine organisms.

But Piscivore is much more than a camera—it is an innovative sensor system for studying the open ocean.

MBARI’s LRAUV carries a suite of environmental sensors inside its housing. During Piscivore deployments, the host vehicle collects information about the physical surroundings. The LRAUV logs data about ocean salinity, temperature, chlorophyll, oxygen, and chemistry. These data provide valuable context about the environments that ocean predators frequent.

The ocean is incredibly dynamic, which makes it difficult to study the mobile species associated with marine habitats. Just like in a forest, grassland, or other habitat on land, marine habitats are defined by physical properties that support a unique community of species.

image6 Piscivore aft camera with attractor at surface 1150 768x534MBARI’s LRAUV is a versatile platform for ocean science and engineering. This advanced underwater robot supports the unique Piscivore system for observing marine predators. (Image credit: Jared Figurski, 2023 MBARI)

“Offshore, or pelagic, marine habitats are constantly changing, shifting and traveling with the currents, as are the species that associate with those habitats,” explained Figurski. “To fully understand just how dynamic ocean habitats are, imagine going to bed looking at a forest of trees in your backyard, then waking up to find those trees and all of the other plants and animals are now 10 miles away. This is the challenge we face when trying to study mobile marine predators in the open ocean. The solution requires technology that allows us to efficiently survey vast expanses of the ocean.”

MBARI engineers are currently developing new capabilities for the sensor suite. Ongoing research and development aims to add on-board AI for real-time video analysis, new attractors, stereo imaging cameras capable of estimating the sizes of animals captured on video, and complementary environmental DNA (eDNA) sampling.

MBARI technology is gathering important data about marine life that decision-makers can use to protect and manage ocean animals, environments, and resources.

MBARI shares our data and technology with partners in education and conservation. We recently partnered with Saab, Inc. to make the LRAUV—the host vehicle for Piscivore—accessible to global markets so our peers in the ocean exploration community can develop their own unique science instrumentation for this tech platform.

image7 UAV and Piscivore joint deployment 1150 768x505MBARI researchers recently tested deploying two robotic technologies in tandem to get a more complete picture of life in the open ocean. An uncrewed aerial vehicle (UAV, left) equipped with advanced cameras scouted locations for further study with the LRAUV and Piscivore camera system (right). (Image credit: Chris Wahl, 2024 MBARI)

“At MBARI, ocean exploration is a partnership of science, engineering, and marine operations. Piscivore is an exciting collaboration spanning multiple labs. These diverse perspectives allow us to tackle important and challenging questions about how a changing ocean influences marine predators and their prey.” said Figurski. “Engineers at MBARI have been developing an ecosystem of robots that can sample across a wide array of marine habitats. We use Piscivore to leverage those advances and collaborate with other groups that are, for example, using multispectral cameras on drones and bioacoustics on wave gliders. Just as it takes more than just a hammer to build a house, we must develop and use a wide array of tools to achieve our mission.”

MBARI researchers envision Piscivore joining a fleet of advanced robotic technologies that work together to study the ocean and report real-time data so resource managers can assess and track ocean health.

latest issue

From groundbreaking marine instrumentation to metocean data visualization and lab-to-market efforts carried out by research-industry partnerships, the ongoing expansion of…

Search