• Subscribe

Equal access for blind gamers

Speed read
  • New display gives blind players the same speed, control, and excitement that sighted players experience
  • Novel sonification techniques provide info about car’s movement and track geography
  • Can be integrated into almost any racing game, improving accessibility

Brian A. Smith, a PhD candidate in computer science at Columbia Engineering, has developed the RAD—a racing auditory display—to enable gamers who are visually impaired to play the same types of racing games that sighted players can play with the same speed, control, and excitement that sighted players experience.

A RADical new way to playBrian A. Smith, a PhD candidate in Computer Science at Columbia Engineering, has developed an adaptive auditory display that can be integrated by developers into almost any racing video game, making a popular genre of games equally accessible to people who are blind. Courtesy Columbia University.

The audio-based interface, which a player can listen to using a standard pair of headphones, can be integrated by developers into almost any racing video game, making a popular genre of games equally accessible to people who are blind.

 “The RAD is the first system to make it possible for people who are blind to play a ‘real’ 3D racing game—with full 3D graphics, realistic vehicle physics, complex racetracks, and a standard PlayStation 4 controller,” says Smith, who worked on the project with Shree Nayar, T.C. Chang Professor of Computer Science. “It’s not a dumbed-down version of a racing game tailored specifically to people who are blind.”

<strong>A RAD display</strong> allows visually impaired gamers to play racing games with the same speed, control, and excitement as sighted players. Courtesy Brian A. Smith/Columbia Engineering.While there are a number of games on the market suitable for the blind, many are loaded with competing sources of information that players must sift through, slowing down the fun of playing the game.

Others are versions of popular games so simplified that a blind gamer does nothing more than follow orders. There has been a fundamental tradeoff between preserving a game’s full complexity and its pace when making it blind-accessible.

“Our challenge,” says Smith, “was to give visually impaired players enough information about the game so that they could have the same sense of control and thrill that sighted players have, but not so much information that they would get overwhelmed by audio overload or bogged down in just figuring out how to interpret the sounds.”

Smith’s work builds on two distinct areas of research: building audio navigation systems and developing blind-accessible racing games and driver assistance systems. The RAD comprises two novel sonification techniques: a sound slider for understanding a car’s speed and trajectory on a racetrack, and a turn indicator system for alerting players about upcoming turns well in advance of the actual turns.

Together, these approaches enable players to understand aspects about the race and perform a wide variety of actions in a way that is not possible in current blind-accessible racing games. Smith’s aim was to design an interface that would give players enough relevant information to form a plan of action.

<strong>Full control.</strong> The assisted display gives enough information for players who are blind to form a plan of action themselves. As a result, they can cut corners and race comparably to casual sighted players. Courtesy Brian A. Smith/Columbia Engineering.“The RAD’s sound slider and turn indicator system work together to help players know the car’s current speed; align the car with the track’s heading; learn the track’s layout; profile the direction, sharpness, timing, and length of upcoming turns; cut corners; choose an early or late apex; position the car for optimal turning paths; and know when to brake to complete a turn,” says Smith.

He will present his paper at ACM CHI 2018’s Conference on Human Factors in Computing Systems April 21–26 in Montreal, the leading international conference for Human-Computer Interaction.

Smith designed the RAD and then built a prototype car racing game in Unity, one of the most popular game engines in the world, and integrated the RAD into that prototype. He ran two studies with 15 participants he recruited through the Brooklyn-based Helen Keller Services for the Blind and volunteers at Columbia.

The players preferred the RAD’s interface over that of Mach 1, a popular blind-accessible racing game. One player commented that at times he felt like he had as much information as if he could actually see the track.

Another gamer, Edis Adilovic, had played Top Speed, a blind-friendly racing game before, but the RAD was the first time he played a video game with realistic vehicle physics. He was able to race on a complex racetrack as well as casual sighted players could.

<strong>Navigating by sound.</strong> Parita Pooj, a blindfolded study participant, uses the sound slider. When she hears the car's sound move far toward the left, she will steer right to bring the sound back toward the center and away from the edge of the track. Courtesy Brian A. Smith/Columbia Engineering.“With the RAD, Edis could not only play our prototype racing game, but do so with the same lap times and driving paths as sighted players,” Smith notes.

Adilovic liked the fact that, unlike other blind-friendly racing games, the RAD did not constantly tell him to “do this, do that,” and added that, “after the training was done, I had the possibility of doing whatever I wanted to.”

Smith is planning his next steps, which include incorporating more racing game elements such as rival vehicles. He also hopes to create similar systems for other genres of games, including adventure games, role-playing games, and first-person shooters.

“My hope,” he adds, “is that game designers will soon be able to build game systems from a suite of tools that are similarly intuitive and functional to the RAD, and make their video games equally accessible to people who are blind. We think the RAD marks the beginning of a whole new suite of such tools.”

Read the original article on Columbia Engineering's site here.

Join the conversation

Do you have story ideas or something to contribute? Let us know!

Copyright © 2021 Science Node ™  |  Privacy Notice  |  Sitemap

Disclaimer: While Science Node ™ does its best to provide complete and up-to-date information, it does not warrant that the information is error-free and disclaims all liability with respect to results from the use of the information.


We encourage you to republish this article online and in print, it’s free under our creative commons attribution license, but please follow some simple guidelines:
  1. You have to credit our authors.
  2. You have to credit ScienceNode.org — where possible include our logo with a link back to the original article.
  3. You can simply run the first few lines of the article and then add: “Read the full article on ScienceNode.org” containing a link back to the original article.
  4. The easiest way to get the article on your site is to embed the code below.