Australian researchers have received neuromorphic data from space after installing bio-inspired cameras on the International Space Station (ISS). 

Neuromorphic cameras - otherwise known as ‘silicon retinas’ - are a new type of imaging device that do not use a shutter as conventional cameras do. Instead, each pixel inside a neuromorphic camera operates independently and asynchronously. 

Their design is based on the biological systems of eyeballs and optic nerves. 

“These cameras don’t take pictures, but rather sense changes and only send those when they happen. This method of sensing the visual world allows them to perform tasks that simply cannot be done with a conventional camera,” says Associate Professor Gregory Cohen from Western Sydney University’s International Centre for Neuromorphic Systems (ICNS). 

Two cameras developed and built at ICNS have been sent into space as part of Project Falcon Neuro – a joint initiative between the University and the US Air Force Academy, launched in December 2021. 

The two neuromorphic cameras are designed for earth observation and analysis of atmospheric events such as sprites – a fascinating high-altitude phenomenon caused by upward electrical discharges from thunderstorms.

One of the neuromorphic cameras is pointing directly downward and the other is pointing forward in the direction of motion of the ISS.

Project Falcon Neuro is the first use of these sensors for earth observation from orbit, and the data received is the first neuromorphic data to be transmitted from space.

Falcon Neuro has been used to capture data as the ISS passed over the coastline of Honduras earlier this year. The cameras recorded data that was later streamed back to earth and processed using algorithms developed by the ICNS research team.

“The result we saw from the first resolved data image was fantastic. Although it may look like a normal image when we display it, the information was collected in a completely new and novel way,” said Associate Professor Cohen.

“This is only the first step. Now we know the cameras are working and operating in space, we can start using them for scientific experiments and further explore the incredible potential of these sensors and what they can do from orbit.”

Associate Professor Cohen said this is an enormous technological advancement that is vital for Australia’s space capabilities and growing space sector.

“It’s easy to lose sight of just how hard building things for space can be. There are so many technical challenges between the scientific goal and actually placing a working sensor in orbit. It’s really a testament to the absolutely fantastic engineering efforts by the technical team at ICNS and the cadets and faculty at US Air Force Academy,” he said.