- A Newtonian numerical method can improve the quality of simulations.
- Inexact computing opts for energy savings over unnecessary precision.
- Weather and climate models look to gain resolution with method.
Computer scientists from Rice University, Argonne National Laboratory, and the University of Illinois at Urbana-Champaign (UIUC) have used one of Isaac Newton’s numerical methods to demonstrate how 'inexact computing' can dramatically improve the quality of simulations run on supercomputers.
The research is part of an ongoing effort by scientists at Rice University’s Center for Computing at the Margins (RUCCAM) to dramatically improve the resolution of weather and climate models with new ultra-efficient approaches to supercomputing.
The research stems from an idea put forward in 2003 by RUCCAM director Krishna Palem: Accuracy and energy are exchangeable in computation, and sacrificing minimal accuracy can yield tremendous energy savings.
“In many situations, having an answer that is accurate to seven or eight decimal places is of no greater value than having an answer that is accurate to three or four decimal places, and it is important or realize that there are very real costs, in terms of energy expended, to arrive at the more accurate answer,” Palem said. “The discipline of inexact computing centers on saving energy wherever possible by paying only for the accuracy that is required in a given situation.”
Palem, who won a Guggenheim Fellowship in 2015 to adapt these approaches to climate and weather modeling, collaborated with Oxford University physicist and climate scientist Tim Palmer to show that inexact computing could potentially reduce by a factor of three the amount of energy needed to run weather models without compromising the quality of the forecast.
“It is analogous to rebalancing an investment portfolio: If you have one investment that has maxed out its potential, you might want to reinvest some or all of those funds to a new source with more potential.” ~Mark Snir.
In the newly published research, Palem, working with colleagues Sven Leyffer, Stefan Wild, and Marc Snir, showed it is possible to leapfrog from one part of a computation to the next and reinvest the energy saved from inexact computations. Each new leap increases the quality of the final answer while retaining the same energy budget.
Palem likened the new approach to calculating answers in a relay of sprints rather than in a marathon.
“By cutting precision and handing off the saved energy, we achieve significant quality improvements,” said Palem. “This model allows us to change the way computational energy resources are utilized in supercomputers to dramatically improve solutions within a fixed energy budget.”
The research team took advantage of one of the most commonly used tools of numerical analysis, a method known as Newton-Raphson that was created in the 1600s by Isaac Newton and Joseph Raphson. In supercomputing, the method is used to allow high-performance computers to find successively better approximations to complex mathematical functions.
The researchers demonstrated that the solution’s quality could be improved by more than three orders of magnitude for a fixed energy cost when an inexact approach to calculation was used rather than a traditional high-precision approach.
“In simple terms, it is analogous to rebalancing an investment portfolio,” said Snir. “If you have one investment that’s done well but has maxed out its potential, you might want to reinvest some or all of those funds to a new source with more potential for a much better return on investment.”
Palem said, “A specific goal is to encourage the application of this approach as a way to advance the quality of weather and climate modeling by improving model resolution.”
He said RUCCAM is working with Oxford’s Palmer and others to explore possible ways to improve the resolution of the OpenIFS model that was developed by the European Center of Medium Range Weather Forecasting.
Additional co-authors include Mike Fagan of Rice, and Kazutomo Yoshii and Hal Finkel of Argonne. The research was supported by the US Department of Energy (DoE), the US Defense Advanced Research Projects Agency (DARPA) and the Guggenheim Foundation.
Read the original Rice article here.