• Subscribe

Drones upgrade film animation

Speed read
  • Producing realistic animated film figures is a highly complex technical endeavor
  • Drones can be used to greatly reduce the time, effort, and expense required
  • Technique may also be used for sport motion analysis over long distances

Drones are going to change the film industry in a major way. Tobias Nägeli, for one, is sure of that.

<strong>Follow the actor.</strong> Drones follow an actor across a landscape, anticipating his movements in real-time and automatically adjusting their position so the target is always filmed from two angles. Courtesy ETH Zurich / Tobias Nägeli. The computer scientist, who recently finished his doctoral thesis with Otmar Hilliges, professor of computer science and head of the Advanced Interactive Technologies Lab at ETH Zurich, was previously able to show that spectacular, highly technical film scenes could be shot in a much easier way using these mini aircraft.

Now, in a further project, Nägeli has demonstrated that drones also have great potential for animated film.

Drones to replace dozens of cameras

“It’s a very time-consuming task to make figures look realistic in an animated film,” explains Nägeli. “For the figures to appear natural, the first step is to film an actor performing the movements. The second step is then to build the animated figure around this.”

Star potential. To create convincing 3D animations, actors are filmed performing the movements—traditionally with stationary cameras or complex installations involving dollies and cranes. Drones greatly simplify the process. Courtesy ETH Zurich/Tobias Nägeli.

In order to reconstruct an actor’s movements for 3D animation, they must first be recorded with at least two cameras simultaneously.

Sequences of motion that cover a great deal of space in particular create an enormous amount of technical work. It requires either installing numerous cameras in different places, of which only a few can be used at the same time, or other tricky installations involving dollies and cranes.

But these complicated techniques may soon be rendered obsolete. Nägeli and his colleagues at ETH Zurich and Delft University of Technology have developed a system that, in its simplest configuration, consists of two commercially available drones and a laptop.

The drones follow the actor’s every move and automatically adjust their position so that the target can always be shot from two angles, in any kind of lighting and environmental condition. This reduces the amount of camera work required, since the cameras only have to be in the spots where they are actually needed.

Impressively, the system anticipates the actor’s movements in real-time and then calculates where the drones need to fly in order to keep the actor in the frame.

<strong>Infrared diode markers</strong> are fixed to the actor’s joints, allowing the drones to record only the light from the markers in order to simplify data processing. Courtesy ETH Zurich / Tobias Nägeli.To minimize the volume of data generated, infrared diode markers are fixed to the actor’s joints. The drones, which are equipped with a true light filter, record only the light from the markers, greatly simplifying data processing. The system only sees a few points, from which it then determines the body’s position and directional movement.

“What makes our system so unique is that it can also reliably capture sudden and fast movements,” explains Nägeli. “Of course, this kind of demo system is not good enough to meet the requirements of the film industry yet. But it does offer a promising approach.”

As the young researcher explains, the system could also be extended with additional drones to capture movement in even greater detail. It is also conceivable that the current approach with light markers could be replaced by automatic image analysis, in which a machine learning model directly identifies the joints without the use of diodes, thus reducing the technical complexity of film production even further.

Sport motion analysis by drone?

The team conducted various tests to show how the system can be used to track human movement over longer distances – something that makes the approach interesting for sport motion analysis.

<strong>Simple modification.</strong> The commercially-available drones require only minimal hardware modification to remove an infrared filter (red) and fit a daylight filter (blue) to the lens mount. Then the camera is reassembled and re-calibrated. Courtesy ETH Zurich / Tobias Nägeli.“Until now, it has been impossible to perform a comprehensive motion analysis on runners, for example, because it is much too complicated,” explains Nägeli. “With our system, it’s very easy now to examine how a runner’s kinetics changes over a period of time.”

For the time being, this is still just a vision. Now, the challenge is to continue developing the system for practical applications. Together with two colleagues, Nägeli plans to tackle this task at the new start-up company Tinamu Labs. And who knows – maybe he and his drones will soon land in Hollywood.

Read more:

Read the original article on ETH Zurich's site.

Join the conversation

Do you have story ideas or something to contribute? Let us know!

Copyright © 2023 Science Node ™  |  Privacy Notice  |  Sitemap

Disclaimer: While Science Node ™ does its best to provide complete and up-to-date information, it does not warrant that the information is error-free and disclaims all liability with respect to results from the use of the information.


We encourage you to republish this article online and in print, it’s free under our creative commons attribution license, but please follow some simple guidelines:
  1. You have to credit our authors.
  2. You have to credit ScienceNode.org — where possible include our logo with a link back to the original article.
  3. You can simply run the first few lines of the article and then add: “Read the full article on ScienceNode.org” containing a link back to the original article.
  4. The easiest way to get the article on your site is to embed the code below.