Virtual reality game

Video games
Platforms Arcade video game Console game Game console Home console Handheld console Electronic game Audio game Electronic handheld Online game Browser game Social-network game Mobile game PC game Linux Mac Virtual reality game
Genres Action Shooter Action-adventure Adventure Casual Puzzle Role-playing Simulation Sports Racing Strategy
Lists Arcade games highest-grossing Best-selling games franchises Longest-running franchises Most-played mobile games Games considered the best Game of the Year soundtracks Negative reception Cancelled games
Development Producer Developer Designer Artist Programmer Design Level design Programming Engine AI Graphics Music Testing
v t e

A virtual reality game or VR game is a video game played on virtual reality (VR) hardware. Most VR games are based on player immersion, typically through a head-mounted display unit or headset with stereoscopic displays and one or more controllers.

The video game industry made early attempts at VR in the 1980s, most notably with Mattel's Power Glove and Nintendo's Virtual Boy. With the introduction of the first consumer-ready VR product, the Oculus Rift, in 2013, VR games soon followed, including existing games adapted for the VR hardware, and new games designed directly for VR. While VR hardware and games grew modestly for the remainder of the 2010s, Half-Life: Alyx, a full VR game developed by Valve and released in 2020, was considered the killer application for VR games.

The advent of VR in gaming marks a significant milestone in the quest for fully immersive digital experiences. As VR technology continues to advance, it has the potential to further transform the gaming industry, offering even more interactive experiences that push the boundaries of what is possible through digital entertainment.

Research into virtual reality (VR) hardware and software started as early as 1968 by Ivan Sutherland and his student Bob Sproull, but most equipment was too expensive for consumer use, and its use for games was limited. The first VR head mounted display was connected to a computer. In the late 1980s, Jaron Lanier and Thomas G. Zimmerman, former programmers for Atari, Inc., began developing hardware under the name VPL Research, with Lanier coining the term "virtual reality" for their products.^[1] One of VPL's products was the VPL DataGlove; a glove that sensed the user's finger movement and translated it into computer input. The idea inspired engineers at Abrams/Gentile Entertainment (AGE) to work with Mattel and Nintendo to build a low-cost version of the DataGlove to work with the Nintendo Entertainment System (NES), omitting much of the technical sophistication and movement sensitivity of the DataGlove as to achieve a reasonable consumer cost.^[2] The Power Glove was released in 1989.^[3] The games Super Glove Ball and Bad Street Brawler were specifically designed to use the Power Glove, while other NES games could be played using the Power Glove by mapping its output to various controls. About one million Power Glove units were sold before Mattel discontinued it in 1990. Its low cost compared to the DataGlove and other similar gloves led academics to buy the unit for their own research.^[2]

Interest in VR grew in the 1990s, particularly after the 1992 film Lawnmower Man, which helped popularize the idea of VR headsets with the general public.^[1] Reflection Technology, Inc. (RTI) had been developing a head-mounted, stereoscopic head-tracking system using light-emitting diode (LED) displays, the Private Eye. One application they had tested included a tank game. Seeking funding for larger production, RTI licensed the technology to Nintendo, and under Gunpei Yokoi, Nintendo developed the Virtual Boy, released in 1995.^[4] The Virtual Boy used red LED displays rather than full-color ones, as they were the most inexpensive to produce, and required mounting to a stand to be played, rather than head-mounted. The system was thus awkward to use both from looking into the viewer and the eyestrain from the red LEDs. Only 22 games were produced for the Virtual Boy, and it was considered to be one of Nintendo's commercial failures.^[4] Sega developed a low-cost VR device, the Sega VR, in the early 1990s, for its arcade games and home consoles; the unit did not advance beyond the prototype stage, though Sega incorporated some of its head-tracking technology into its arcade cabinets.^[5]

VR systems without head-mounted hardware were also developed in the 1990s, including the Cave automatic virtual environment (CAVE). CAVE systems included multiple flat screen displays, typically at least three walls to surround the human player, and incorporated some type of tracking sensor system to match the images on the walls to what direction the player was looking. Early applications of CAVE system were game-based demonstrations, but the cost remained prohibitive for commercial deployment even through the 2010s.^[6][7]

Around this same time in the 1990s, major innovations in real-time 3D graphics had been made across computer, console, and arcade video games, and with further improvements in affordable consumer technologies, arcade games began to decline as they could not compete with these innovations. Arcade game manufacturers instead focused on offering games that could not easily be replicated at home, which included the introduction of VR-based arcade games. For example, the Virtuality Group produced its Virtuality line of arcade games starting in the early 1990s that typically included a VR headset with head-tracking and other features. However, the cost and upkeep of these machines made it difficult to continue support for them.^[8]

There remained strong interest from academics to explore what VR, along with augmented reality and other mixed reality systems, could bring to video games, through the 2000s, but these games were mostly prepared for research proof-of-concepts to demonstrate the interaction of VR hardware, software, and human motion rather than for commercial release, since hardware costs were still high.^[9]

After decades of attempts from its introduction, low-cost, consumer-grade VR hardware began to appear in the 2010s.^[7] The Oculus Rift is considered the first consumer-ready VR headset and was first released in 2016. The unit was developed by Palmer Luckey, and first announced in 2013 as an inexpensive VR option for video games.^[10] During testing, Luckey had gained the help of id Software's John Carmack to develop a VR version of Doom 3 for Oculus. While this helped to successfully demonstrate the Oculus, which led to Facebook acquiring Oculus in 2014 for $2 billion,^[11] it also led to a lawsuit between ZeniMax Media, id's parent company, against Oculus over intellectual property theft over Carmack's participation. The case was settled out of court.^[12] Nine games were available at launch and Oculus had established a number of partnerships to provide more games following its release.^[13][14]

The Oculus Rift offered an immersive gaming experience that was unprecedented at the time, heralding a new era for video games. The Oculus Rift's inclusions of high-resolution display and precise head tracking collectively contribute to a deeply immersive environment and richer experience that can accept the hardware requirements of gaming.^[15] The Rift also enables intuitive interaction with virtual environments, allowing for a range of actions such as grabbing, throwing, and manipulating objects with realistic precision. All of this is in order to increase immersion of the player when playing fast-paced shooters, adventure games, and simulation experiences.^[15]

The Oculus Rift announcement led to other VR developments. Sony Computer Entertainment developed the PlayStation VR system for the PlayStation 4, while Valve partnered with HTC to develop the HTC Vive; both of these units were released in 2016.^[16][17] Valve later developed their own headset without HTC, the Valve Index, which was released in 2019.^[18]

Despite its successes, the Oculus Rift at the time faced some challenges, including the need for a tethered connection to a PC, which can limit mobility and the overall sense of immersion.^[19] Additionally, the initial cost of the headset, combined with the requirement for a high-end PC, made it less accessible to the average consumer.^[20]

As a result, more affordable headsets designed to accommodate mobile devices were also released, using the devices to create the stereoscopic display, some of the positioning functions, and other VR tracking embedded in the additional hardware. In 2014, Google introduced Google Cardboard, a inexpensive headset package that constructed from cardboard for use with Android phones; the completed headset creates the necessary visual space to support stereoscopic view from the phone's display.^[21] Samsung, in conjunction with Oculus, released the Samsung Gear VR in 2015 to support its Samsung Galaxy smartphones; services for the Gear VR ended in 2020.^[22] Nintendo released the Nintendo Labo VR Kit in 2019 as part of its Labo series of toys-to-life cardboard products.^[23] A handful of Nintendo Switch games support Labo VR functionality, such as the 2017 games Super Mario Odyssey and The Legend of Zelda: Breath of the Wild.^[24]

Despite the availability of low-cost hardware for VR, the technology had still not taken off for video games by 2018 as had been expected when the Oculus Rift was announced. This was attributed to the lack of a killer application, a game that would drive people to buy the hardware to play it. There had been several games from smaller studios that had been considered successful, such as Superhot VR and Beat Saber, but the triple-A studios had not ventured into the area. Sales of VR hardware had been steadily increasing since 2016, but were still under 10 million units by 2018, and there were signs manufacturers were starting to back off in this area.^{[25][26][27][28]}

Many journalists stated that the first "killer app" VR game was Half-Life: Alyx, developed by Valve and released in March 2020.^{[29][30][31][32]} Alyx includes a number of novel control schemes to avoid the motion sickness problems of previous VR games, such as the 2019 indie title Boneworks.^[33][34] Within a week of Alyx's announcement, Valve sold out of their stock of Index units and began taking pre-orders with expectations to fulfill before the game's release.^[35][36] Other VR hardware, including the Oculus, saw increased sales leading to the release of Alyx.^[37]

In 2024, the newly released Apple Vision Pro was a major advancement in virtual reality and gaming due to its unique advantages underscored by the filing of 5,000 patents in recent years and the leverage of a vast capital in the form of Apple.^[38] This device features hardware such as dual panels that offer 24 million pixels, far surpassing devices such as the Oculus Rift. ^[38] The device also features modern optics, and an ergonomic headband. The integration of the R1 chip, working in tandem with the M2 chip,^[38] results in a polling rate of 12 milliseconds, getting rid of the dizzying latency issues that were prevalent in previous devices. The major advancements in hardware alongside the inclusion of enabling software such as the App Store holds a bright future for the world of VR gaming, with mobile games such as Plants vs Zombies and Clash Royale becoming future games for the VR experience.

Nearly all VR games, as generally defined, require the use of a VR headset that provides stereoscopic displays that simulate three dimensional reality and create immersion for the player. Most headsets include some means of positional tracking to provide head-tracking (that is, to tell which direction a player's head is looking), either through sensors built into the unit or from external sensors or cameras that are placed at the corners of the play area. Some headsets further provide eye tracking.^[7] To provide immersive audio, either surround sound speaker systems are used, or headsets may be outfitted with speakers or headphones for the player that provide 3D audio effects.^[7]

Some type of player input is also required. This is most commonly provided through the use of one or more game controllers. A controller can be as simple as a keyboard-and-mouse (KBM) or a standard game controller, or may be specialized hardware that includes positional tracking. Most often for specialized VR hardware, the player will have two controllers, one for each hand. These controllers may also provide haptic feedback to the user.^[7]

Nearly all VR games are played from a first-person perspective to take advantage of the level of immersion created by the headset. Player input, which includes the motion of their head, hands, and body and any controller buttons or triggers they depress, are translated into actions within the game. Most commonly, the player's view of the game's environment will track with how they move their hand, and they will be shown virtual hands to guide them how to interact with the environment, with VR translating the player's motions one-to-one with the virtual appendages.^[7] While games can be controlled through traditional controls such as KBM or a standard console controller, these interfaces break the level of immersion, and instead, more specialized controllers are used, typically designed to fit naturally into a player's hand.^[7]

VR offers several novel control schemes - how the player manipulates their in-game character through the game world and the direction they are looking - compared to the traditional free look or mouselook offered by the traditional KBM or standard controller. Movement and aim may be coupled between the headset and the controllers or may be decoupled, typically with the headset controlling the direction of movement and controller the aim, which generally leads to more immersive experiences.^[39]

Some VR systems such as the HTC Vive and Oculus offer room scale tracking, which not only incorporate the motions of the player but where they are physically located within a given area and the physical positioning of their body. This allows the player to move around the area as part of the VR experience. Games usually make this an optional experience since not all VR systems support it, and not all players have space to be able to move about. Example of games that support room scale tracking include Job Simulator and Rec Room.^[40][41] When room scale is not available, alternate movement schemes have been developed when character movement is required. A player may be moved automatically by the game as necessary, a player may need to look at a target location and indicate through a control scheme their desire to move their character to that spot, or the player may use more traditional controls such as an analog stick or keyboard presses to move their character.

VR games are designed to enhance immersion—the perception that one is actually in the virtual world—and presence—the psychological effect that they are actually interacting with the virtual world outside of their physical bodies—concepts which cannot readily be done with traditional "flat screen" games played on a computer monitor or television.^[42]

A limiting factor for VR games until the 2010s was the overall system latency between a player's actions and the feedback they saw on the headset. For VR to be felt as an immersive experience, the latency needs to be as small as possible so that the player sees feedback in real-time soon following their actions. Technology bottlenecks had been from two major components of VR systems. One area was the rendering speed of computer hardware to update the 3D displays at a fast-enough frame rate. Frame rates of 20 Hz or less appear to most users as a series of separate images rather than continuous video stream, which breaks immersion.^[43] In the late 1990s, this computational power could only reasonably been delivered by high-performance workstations such as those from Sun Microsystems and Silicon Graphics.^[43] Since then, improvements in graphics processor technology and game engines with optimized rendering systems give consumer-grade hardware the capacity to perform high-speed real-time 3D rendering at 60 Hz or greater at resolutions appropriate for VR applications.^[7]

The second bottleneck is the processing time to convert tracking sensor information into feedback that is incorporated into the game. Earlier VR systems took some time for complete acquisition of all tracking sensor information into usable feedback to the user, but this was at a longer timescale compared to the traditional inputs and the display feedback cycle.^[43] Improvements have been made since in sensor technology and the software libraries to register movements, and VR games can also include other methods such as limited prediction of a player's movements, to bring sense feedback to the same timescale as rendering. Both issues combine to the overall factor of synchronization between the feedback loops. If the game takes too long to respond to a player's action, even if more than about 25 milliseconds, it further breaks the sense of immersion.^[43] While many of the latency problems are resolved with the VR hardware of the 2010s, VR games still must be programmed with these concerns in mind.^[43]

In its current meaning, "virtual reality" generally has been taken to creating immersion and presence with the player by creating a new visual stimulus (through a VR headset for example) that obscures to real world view.^[44] This definition distinguishes VR from augmented reality where additional visual information is added atop the real world view.^[7] A broader definition of virtual reality can be taken to be any application that replaces one or more of the human senses with a virtual one.^[7] Thus, games featuring any alternative control scheme compared to a typical game controller or keyboard-and-mouse system could be considered as a virtual reality game, where the sense of touch of these traditional controls is replaced with a novel scheme. Such games would include those with alternate peripherals such as Dance Dance Revolution and Guitar Hero, or games featuring motion controls such as many Wii-based games.^[8] However, with the expansion of VR hardware in the 2010s, the use of "virtual reality" to include these types of games has been deprecated.^[7]

Cross-platform compatibility in VR games plays a vital role in extending the reach of VR experiences to diverse devices, operating systems, and hardware configurations. With VR continuing to evolve, developers face unique challenges in designing games that provide consistent, high-quality performance across desktop systems (e.g., Windows, macOS), mobile platforms, and a variety of VR headsets, including Meta Quest, HTC Vive, and PlayStation VR. Achieving this cross-platform functionality requires strategic use of adaptable game engines, efficient 3D modeling techniques, and optimization processes to ensure that users have immersive, uninterrupted experiences regardless of their chosen platform.

The choice of game engine is critical for VR game developers aiming for cross-platform distribution. Leading engines like Unreal Engine 4 (UE4) and Unity stand out for their flexibility, VR-specific tools, and expansive community support. Unreal Engine 4, for instance, incorporates a sophisticated visual scripting system called Blueprints, enabling developers to create VR interactions and gameplay mechanics without needing advanced programming skills. Blueprints allow teams to rapidly prototype and refine VR experiences, making it easier for developers to implement complex interactive elements, such as avatar controls, movement systems, and environmental interactions, that translate well across multiple platforms. Additionally, UE4’s open-source code and robust asset management system support customizations that facilitate high-quality rendering on both high-end VR systems and mobile-based VR headsets.^[45]

Unity, another widely-used engine for VR, also offers extensive cross-platform support and compatibility with multiple VR devices, making it a practical choice for developers focused on wide-reaching VR applications. Unity’s VR development tools and intuitive interface facilitate the creation of immersive environments, allowing developers to fine-tune graphics and performance settings according to the specifications of different devices. This adaptability is particularly beneficial for multi-platform VR games, where users may access the game via a range of devices with varying computational capabilities. For example, Unity’s lightweight scripting API and its support for the Vulkan graphics API enable it to run smoothly on both Android-based mobile VR headsets and high-performance desktop VR systems.^[46]

One of the core elements of successful VR game development, especially for cross-platform use, is creating immersive, multiuser environments. Multiuser features enable players to engage with others in real time, establishing a virtual community within the game and amplifying the immersive experience. Platforms like Epic Online Services (EOS) support multiuser interactions by providing tools for user sessions, voice communication, and avatar customization. In VR games, these features foster social interactions that contribute to player engagement and immersion, encouraging collaborative gameplay and shared experiences in a virtual space.^[45][47] EOS’s integration within Unreal Engine allows developers to seamlessly incorporate multiplayer components into VR games, supporting both cooperative and competitive play. Additionally, voice systems, integrated through services such as Vivox, allow players to communicate directly within the VR environment, enhancing immersion and enabling real-time strategy and cooperation among users.^[45]

Optimization is a pivotal aspect of making VR applications perform well across platforms. High-detail 3D models, textures, and animations that work on high-end systems may not perform as smoothly on mobile VR devices due to differences in processing power and memory. For this reason, developers use methods like polygon reduction and efficient data transfer protocols to maintain visual quality while ensuring optimal performance on a range of devices. Unreal Engine 4, for example, supports the Datasmith transfer method, which facilitates the import of detailed 3D assets from external modeling software such as Autodesk’s 3ds Max and Maya. Datasmith simplifies the transition of high-detail models to VR-ready formats, enabling models to retain essential visual fidelity while minimizing computational demands on mobile VR headsets.^[48][45]

Autodesk’s 3ds Max and other modeling tools play an essential role in VR development, providing capabilities for creating complex, high-polygon models that can then be retopologized or optimized for VR. Retopology, or the process of simplifying high-polygon models, allows developers to reduce the number of polygons in 3D assets, significantly improving rendering performance on VR platforms with lower processing capabilities, such as Meta Quest. Meta Quest, for example, is optimized for models with 300,000–500,000 polygons, while high-end VR devices may handle up to 2 million polygons, necessitating careful optimization by developers aiming for multi-platform compatibility.^[48]

The exportation phase marks the final step in cross-platform VR game development. Once all elements are optimized and tested, the project is compiled and packaged for the intended platforms, with considerations for compatibility across desktop, mobile, and VR-specific operating systems. UE4 and Unity both streamline this exportation process, allowing developers to select target platforms and configure settings to ensure performance stability on each. For example, Unreal Engine’s packaging tools enable developers to export applications compatible with Windows, macOS, Android, and iOS, or VR headsets like Meta Quest, which require dedicated optimization to ensure fluid frame rates and immersive experiences on mobile chipsets.^[45][46]

Through the integration of robust multiuser systems, optimized 3D modeling techniques, and adaptive game engines, cross-platform VR game development continues to evolve. As hardware capabilities and VR ecosystems expand, these practices allow developers to meet the growing demand for VR games that provide consistent, immersive experiences across platforms, fostering an inclusive and engaging VR landscape.

The integration of Virtual Reality games into the field of health mark an evolution in how immersive technologies can influence human behavior and learning processes. In healthcare, VR games have emerged as a revolutionary tool for physical rehabilitation, psychological therapy, and health education, offering interactive and immersive methods to improve patient outcomes. One example of VR in healthcare is the effectiveness of VR games on improving health in elderly post-stroke patients, revealing VR sports games as more effective than traditional rehabilitation training on improving cognitive, physical, and emotional functions.^[49] Additionally, VR games have been applied in mental health treatment, offering exposure therapy for phobias, anxiety, and PTSD in a safe, but realistic environment. As vulnerability to stress is directly linked to poor mental health, VR games that stimulate relaxation aims to help people with mental health conditions by reducing stress in a fully immersive environment.^[50] A specific application of VR games is for people living in busy cities to get to experience a real-world simulation of peaceful woodland or relaxing farmhouse, reducing all the stress that could potentially come from their environment.

There is also research being done on integrating VR games with cognitive behavior therapies.^[50] Not only can VR games be useful for treatment of mental and physical health, but it can also be used as a tool to diagnose, manage, and treat an individual's health without needing to go to a clinic.^[50] There are current risks with VR gaming being used as a coping mechanism that reduces real-world situations to just a simulation, but if addressed properly, VR gaming can become a modern advancement in the field of health.^[50]

• Comparison of virtual reality headsets

https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4611167#:~:text=Khritish%20Swargiary,-Independent&text=The%20study%20aimed%20to%20investigate,learning%20at%20the%20schooling%20level.