Friday, February 25, 2011

Virginia Tech students help bring Blind Driver Challenge to Daytona

A team of graduate and undergraduate students from the Virginia Tech College of Engineering helped make history Jan. 29, 2011, at Daytona International Speedway.

As part of the ongoing Blind Driver Challenge, a blind man drove a 2010 Ford Escape Hybrid SUV on 1.5 miles of the famed course during the three-day Rolex 24 race extravaganza. At a top speed of 27 mph, he steered through a set of obstacles that included barrels and cardboard boxes randomly thrown from the back of a van. He then passed the moving van. Assisting the driver was high-tech hardware developed by Hokies, past and present.

The driver – Mark Riccobono, an executive with the National Federation of the Blind (NFB) -- did perfectly. His trek complete, he parked the vehicle at track’s end and within minutes embraced and kissed his wife. The trek made international news: CNN, “Wired,” Fox News, and more.

The 10-minute trip caps years of research engineering work by teams of College of Engineering students, led by Dennis Hong, director of Virginia Tech’s Robotics and Mechanisms Laboratory and associate professor of mechanical engineering.

“As Mark arrived safely at the finish line, hugging his wife with tears in his eyes, I couldn’t help but also cry,” Hong said. “I asked Mark if he could give me a ride back to my hotel. He is blind, but I knew he could see the big smile on my face.”

History

Having the freedom to drive an automobile has long been a dream of blind people. It’s among the first things they are told they never can do. But in 2004, the National Federation of the Blind – a nonprofit advocacy group based in Baltimore – put forth the Blind Driver Challenge: Create non-visual interface technology that one day could allow a blind person to safely and reliably drive an automobile.

Virginia Tech is the only university and research institution to take up the call. Work began in earnest in 2006. Within three years, undergraduate engineering students built a prototype buggy that used laser range finders to scan the surrounding environment and relay information back to the driver via a variety of new non-visual interface technologies.

Riccobono was one of the first blind people to drive the red buggy in May 2009 on Virginia Tech’s campus. At the time, he said, “This is sort of our going to the moon project.” The buggy publicly debuted shortly thereafter at the NFB’s Youth Slam summer camp in College Park, Md., in July 2009. The debut made international news, but it was merely the beginning of the effort.

From there, work began on the second-generation of Blind Driver vehicles, highway-ready cars that could conceivably by used on the open road. The set goal was large: Debut the cars on one of the most famous pieces of asphalt in the United States, a landmark among racing fans. The Daytona International Speedway.

Technology

To meet the goal, Virginia Tech enlisted the help of TORC Technologies, a company founded by College of Engineering alumni and based at the university’s Corporate Research Center. TORC had an essential ingredient: ByWire XGV technology that can be integrated to a vehicle, in this case two Ford Escape Hybrids. The tech provides reliable and safe electronic control of the vehicle and the capability to be stopped remotely, among other modifications.

Engineering students designed the non-visual interface devices used by blind drivers to steer and operate the vehicle. The hardware includes wire-enhanced vibrating gloves called DriveGrips and a vibrating seat cushion called SpeedStrip. Both interfaces vibrate certain cues that indicate directions to accelerate or halt, turn right or left. The vehicles can “see” obstacles and the road ahead, via strategically placed laser range finders and cameras.

“Through the help of technology and ingenuity, the possibilities for the blind are limitless,” said Matt Dowden, a College of Engineering graduate research assistant from Falls Church, Va., who originated DriveGrip while an undergraduate. “This project, from the original concept to the dune buggy to the highway-ready SUVs has always been and always will be about breaking barriers.”

With the technology in place to allow a driver to steer the SUV through a closed course, practice began. For months, on campus, at the nearby Virginia Tech Transportation Institute’s Smart Road, and then the rural Virginia International Raceway in Danville, Va., Riccobono and other blind drivers tested the vehicles as students and TORC employees perfected the technology.

Daytona debut

Emotions and excitement ran high even before the Blind Driver vehicles debuted at the racetrack.

On the eve of Rolex 24, Riccobono for the first time was able to drive his family around a speedway-owned parking lot in one of the two Blind Driver Challenge SUVs. With his wife – who is also blind – in the passenger seat, and his two children strapped in the back, Riccobono drove the SUV, dodging traffic islands and other obstacles.

“This really hit home for me as my goal is to use engineering to help people overcome life’s toughest challenges,” said Paul D’Angio, a mechanical engineering doctoral student from Basking Ridge, N.J. Added Hong: “To witness and truly feel our hard work directly touching others hearts, giving people hope and inspiring others, was an experience that I will never forget.”

Riccobono himself said his driving the Daytona track was a historic moment for blind people all over -- there are an estimated 1.3 million legally blind people just in the United States – but that the short, quiet drive he took with his family was a personal life highlight.

The next day, Jan. 29, Riccobono drove the track. Before hundreds of fellow federation members and thousands of race fans parked and camped within the track, Riccobono turned the ignition at the track’s iconic starting line. All engines go. A group of photographers and cameramen filmed his departure and then raced themselves to the finish line to capture the arrival.

He took an 18-degree bank, steered through white barrels, and navigated around those cardboard boxes thrown from the back of a van. A track announcer called out every move Riccobono made as he drove to demo’s end point. Riccobono exited the vehicle elated, emotional.

“People asked me what are you going to say, and I had some things in mind of what I was going to say,” Riccobono said afterward. “But for me the moment spoke for itself, there were no words. Even words that I conjure up ahead of time that would fit the moment.”

D’Angio was in the van, dropping the boxes the SUV dodged. “We made a large amount of practice runs, so during the actual track run we were focused on performing our individual tasks,” he said. “Once the vehicle came to a stop however, screams of celebration echoed throughout the lead vehicle ... after eight months of work we had finally done it!”

Added Ryan Colby, a master’s student in mechanical engineering from Rochester, N.Y.: “Experiencing the actual demo from up close, it seemed so natural to see a blind man driving since our team had already seen this happening firsthand in our practice sessions.”

Back in Blacksburg, at least one Virginia Tech Blind Driver Challenge team member listened via Internet to the live broadcasted demo. “I could feel the excitement and palpable anticipation as Mark was handed the keys. I thought, ‘He’s really going to do this – it is reality. All the hard work is about to pay off,’” said Chelsea Cook, a freshman majoring in physics from Newport News, Va., who is blind.

“What came next seemed analogous to a space shuttle launch: Systems check, preparing the non-visual interfaces, checking their functionality, giving a thumbs-up to the other crews. I always get the sense that driving the [Blind Driver] vehicle is like being a test pilot: exhilarating, slight risk involved, and the old mantra: Pushing the edge of the envelope,” said Cook, a self-proclaimed “NASA geek.”

Future

What is next for the Blind Driver Challenge vehicles? Advocates at federation know well the barriers that loom before them are large, not just the technology-based hurdles, but the societal ones as well. Having blind drivers sharing the road is several years off. The technology likely will be ready before insurers, highway regulators, and everyday motorists are open to the concept.

But hopes remain undeterred. “This is just one piece,” said Riccobono. “We have a lot more work to do to continue this effort. … This is not just a dream, but a path to something that is going to be real.” Marc Maurer, president of the National Federation of the Blind, said before the Daytona demo, “This isn’t the end, this is just the beginning.”

Hong and his research team plan to meet the end-goal of the Blind Driver Challenge: Develop a car that can be driven by a blind person independently. “The SpeedStrip and DriveGrip interfaces were simple ‘instructional cue’ devices that we are moving away from, and we are now pursuing more sophisticated ‘informational cue’ devices for the driving interfaces,” Hong said.

“What we have shown at Daytona is that the human brain is capable of surpassing our wildest imaginations when coupled with the right technology,” said Jesse Hurdus, a software engineer with TORC who earned a bachelor’s and master’s degree in mechanical engineering from Virginia Tech. “Partnering with Virginia Tech and RoMeLa to achieve this difficult challenge shows the power of combining industry expertise with student creativity.”

The devices used in the SUVs, as well as other technologies developed by students during the Blind Driver Challenge likely have other uses outside of driving – perhaps being adopted to home appliances, computers, and other everyday objects used by the blind. The laser range finders and technologies on the SUVs also could be adapted to all cars and trucks. Think how handy it would be to have a laser-based collision warning alarm on a dangerous, fog-covered mountain road.

“Humans do not adapt easily to what they think is impossible, unless, of course, you are brought up to embrace technology, as some of us in the blind community have,” said Cook, who has since driven one of the Blind Driver vehicles on a close-ended highway course. “The ability to control a vehicle independently is amazing, but I’m just as curious to see the spin-offs and applications in other fields until society is ready for us to hit the road.”

Editor’s Note: This is a full-text version of an article appearing at the Virginia Tech website. The original article includes additional photographs and video links about the Blind Driver Challenge. All images by Steven D. A. Mackay, Virginia Tech College of Engineering, and Suzanne Shaffer, National Federation of the Blind.

From the "Fremont (Nebraska) Tribune": FPS teacher watches blind man drive

Mary Robinson recently got the chance to watch something very few people thought was possible: Watch a blind person drive a vehicle.

Robinson, a teacher for Fremont Public Schools' Blind and Visually Impaired Program, watched Mark Anthony Riccobono drive a Ford Escape hybrid during the Rolex 24 in late January at Daytona Beach, Fla.

Riccobono's vehicle was equipped with non-visual technology, including a pad that gave him cues for when to stop, speed up and slow down, as well as gloves that indicated which direction to turn.

Riccobono also had to avoid obstacles, including boxes that were dropped from a van.

Robinson was amazed by... Read more

Image: As he exits the Blind Driver Challenge vehicle at Daytona International Speedway, Mark Riccobono is greeted by family, friends and cameramen. Photo by Steven D. A. Mackay.

Thursday, February 17, 2011

In Daytona: A photo album

A team of Virginia Tech College of Engineering graduate and undergraduate students helped make history January 29, 2011, at the Daytona International Speedway. As part of the ongoing Blind Driver Challenge, a blind man drove a specially-outfitted 2010 Ford Escape Hybrid SUV on 1.5 miles of the famed auto course. We've posted a photo album marking highlights of this unique occasion.

Image: National Federation of the Blind Jernigan Institute Executive Director and BDC driver Mark Riccobono takes on the famed Daytona track. Photo by Suzanne Shaffer, an art director at the National Federation of the Blind.

Wednesday, February 16, 2011

From 'Wired': High-Tech Car Allows the Blind to Drive

A Ford Escape poking along at 25 mph isn’t usually the most exciting event on the track at the Daytona International Speedway. Consider that the driver is blind, however, and that slow-moving Ford is an example of how technology can grant autonomy.

Mark Riccobono, a blind executive at the National Federation of the Blind, handled the curves, avoided obstacles thrown in his path from a van ahead of him and then passed that van. He did it in a vehicle built by students using off-the-shelf technology.

“That was fun because nobody expected that we’d do that,” Riccobono said. “We kept exactly what we were going to do on the track, we held that close to the vest and even our members didn’t know that was going to happen.”

Although we’re a long way from the day ... Read more

At the Daytona International Speedway, Mark Riccobono prepares to drive the Blind Driver Challenge car known as BRIAN. Photo by Steven D. A. Mackay

Thursday, February 10, 2011

Virginia Tech video of a triumphant run

Watch the National Federation of the Blind's Mark Riccobono steer the course at the Daytona International Speedway in this brief video from January 29, 2011.

Riccobono, executive director of the NFB's Jernigan Institute, said he was "honored" to be the first person to taker the race course as part of the Blind Driver Challenge. More personal, though, Riccobono said was the chance to drive his family -- wife and two children -- around a nearby parking lot the day prior. The car's public debut came at the famed Rolex24 race.

Added Dennis Hong, associate professor of mechanical engineering at Virginia Tech, "The Daytona demo we did is just the beginning. It was to let the world know about the challenge, and to inspire other scientists and researchers to join our efforts in developing technology for the blind."

Video edited by Virginia Tech's Josh Napier.

Photo: A triumphant and emotional Mark Riccobono talks to a cameraman (just out of frame), after his Daytona demo drive. Image by Steven D. A. Mackay

Tuesday, February 8, 2011

Virginia Tech video: Behind the Blind Driver Challenge

The second-generation Blind Driver Challenge vehicles are explained in this Virginia Tech University Relations video featuring Associate Professor Dennis Hong (pictured at right) of our mechanical engineering department. Video was at the Virginia International Raceway, 11 days before our successful January 29 run at Daytona International Speedway.

Photo by Steven D. A. Mackay

Monday, February 7, 2011

From Engadget: 'Hokies give (tactile) sight to the blind so they can drive...'


Daytona International Speedway is synonymous with speed, auto racing, and . . . blind people? Virginia Tech's Robotics and Mechanisms Laboratory (RoMeLa), along with the National Federation of the Blind (NFB), recently debuted its sight-optional and street-legal SUV at the famed racetrack. Dr. Dennis Hong and his students first let blind folks drive a dune buggy without the help of a sighted copilot in 2009 -- as a first step to achieving the goal of a street-legal SUV for the sightless crowd.

Read more

Photo by Steven D. A. Mackay

From Inside Science News Service: 'Driving Blind At Daytona'


(ISNS) -- Last Saturday, a blind driver dodged cardboard boxes thrown in front of him while driving a modified Ford Hybrid Escape around the Daytona International Speedway.

He had only seconds to react to the obstacles.

"If we just put boxes on the track, people might think we planned the route," said Dennis Hong, whose robotics and mechanisms lab at Virginia Tech modified the cars.

Instead, Hong's team threw boxes from a van so they bounced around. “That shows everyone that their position is random, and that the drivers are really driving,” said Hong.

Read more...

Photo by Steven D. A. Mackay