- Wildfires take a heavy toll in lives and property loss
- Emergency responders are challenged to make timely, life-saving decisions
- Deep learning is changing the game for disaster preparedness teams
The intelligence of machines is a topic that generates a lot of anxiety. But what if artificial intelligence could save lives? That’s the hope of DeepEye.
An analytical tool designed to aid emergency response teams, DeepEye uses remotely sensed data, photo databases, and a real-time stream of social media data, to give disaster responders a head start.
Ghost in the machine?
When a machine ‘learns,’ it means a computer program has been immersed in sufficient fragments of data (e.g. striations on a shark fin, blotches on a giraffe’s neck) that it can predict and recognize an item.
When a pile of leaves is exhumed from an archeological site, the computer reads the features of a digital image and identifies and informs the human researcher about the content of that pile of leaves.
In contrast, humans learn by seeing a horse, a second horse, a third horse and so on, and then coming to grasp what a horse is (as opposed to, say, a camel).
Machine learning looks at fragments (mane, nostrils, fetlocks, hooves) and eventually pieces them together to identify a horse whenever it is presented with another fragment.
Computers can 'remember' a virtually unlimited set of examples, and they have a nearly infinite capacity to recall and quickly associate.
Deep learning, a subset of machine learning, attempts to simulate the collocation of cognitive concepts humans hold in mind.
Whereas machine learning may learn about fragments of one aspect (a corner of an image, a syllable) and then build a base of knowledge, ‘deep’ learning plunges through many more layers.
Accordingly, deep learning requires much larger stores of memory and more computing cores to make the associations required for a desired output.
Fire? Ready, aim!
DeepEye uses deep learning to great effect and social benefit, finding a welcome partner in disaster management teams.
Scientists at institutions like the National Center for Atmospheric Research (NCAR) have previously used computer models to simulate where wildfires will strike. These models, however, are mostly unable to give emergency response teams a minute by minute prediction of how a wildfire may spread throughout a region.
But what if there were a way researchers could chart potential paths of destruction in real time? With lives hanging in the balance, every single second counts.
Real time monitoring of natural disasters is the ability Damian Borth wants. He could achieve it, using deep learning programs to predict future wildfire routes.
“For me, it’s very important to look into areas where we can use artificial intelligence for good,” says Borth, director of the Deep Learning Competence Center at the German Research Center for Artificial Intelligence (DFKI). “We want to create applications that can protect our planet and save lives.”
To track nascent wildfires in real time, Borth’s team developed DeepEye, a multimodal analytical tool to aid emergency response teams. DeepEye had to ingest a large cross section of data to identify wildfires.
The team used LandSat satellite imagery, a dataset of images from Flickr, and over 18,000 posts from Twitter to train the program to recognize wildfire markers.
The images collected from LandSat were grouped into various spectral bands. DeepEye categorized the satellite data in three various areas: RGB image, vegetation health, and fire scars.
The RGB images of the area were unaltered, while the vegetation health images measured the well-being of the province’s plant ecosystem. Fire scar pictures tracked where the wildfire had marred the landscape.
The combination of data is a potent weapon for the DeepEye project. It combines pictures that users take of the wildfire on the ground with satellite images tracking the fire's progress from above as inputs for its network. Then, it produces outputs of where a wildfire will strike next.
“You can give a response team information like ‘these are areas that are burnt already. Here's the probability of where new burns will come,’” Borth says. “With this added knowledge, emergency response teams can then dispatch resources more effectively.”
Diving into data with deep learning might be the next step for disaster response teams. It could soon prevent a single flame from turning into an all-encompassing inferno.
If you'd like a closer look, you can preview the DeepEye project at the MediaEval Workshop in Dublin, Ireland from September 13-15.