Iowa State’s Virtual Reality Project Impacts Operation of Unmanned Aerial Vehicles

  • Published
  • By Maria Callier
  • Air Force Office of Scientific Research
Arlington, Va. --  An Air Force Office of Scientific Research (AFOSR)-managed research team is building a virtual reality (VR) environment for the battlespace initiative so the full potential of Unmanned Aerial Vehicles (UAVs) can be achieved.

"We are applying advanced physical and eye-tracking systems and voice interfaces. Our goal is to provide role specific interfaces for a team and shared situational awareness using a large display," said lead researcher, Dr. James Oliver.

Dr. Oliver and his colleagues are first trying to solve significant human interface issues arising from limitations affecting operators who control UAVs from the ground. They are also designing and testing the hardware, software and aeronautical systems to create immersive ground control stations based on VR technology.

"We are using a virtual environment of the battleground as the primary interface context, with the variety of information sources available in a modern military engagement," said Dr. Oliver. "We are also developing and measuring the effectiveness of new human interface techniques to enable operators to effectively control multiple, semi-autonomous aircraft. Already, up to 230 persons can be interfaced to participate in the system simultaneously," he said.

The VR environment uses a 3-D audiovisual stereoscopic facility, with six walls, 24 projectors, ultrasonic motion tracking, eight-channel audio and a graphics computer. The context has many benefits including large field of view and innovative information representation.

The virtual VR environment will enable participants to see the vehicles, the surrounding airspace and the terrain they are flying over as well as information from instruments, cameras, radar and weapons systems. This approach can solve the critical operational and training challenges that must be overcome to allow an operator to simultaneously monitor and control several UAVs at the same time.

"We are also exploring new ways to employ VR to address the challenge of time lag that is characteristic of applications where machines are operated at a distance," he said.

Last spring the researchers convened a scientific advisory panel of experts in the field and received outstanding feedback because their research has now begun to focus on human effectiveness.