Mixed Reality Head Mounted Display Device
Disclosed are a Head mounted Display (HMD) device for use in mixed reality applications such as virtual or augmented reality. The disclosed HMD includes improvement to comfort and convenience of wearing. Convenience features include shifting portions of the HMD's heat generating and heavier components off the user's head and on to their neck, or neck and shoulders. Shifting components to the user's neck opens additional input schemes and enables the use of further feedback devices that improve the immersiveness of the mixed reality experience. An additional convenience feature is an adjustable visor that lifts up and down such that the user may view the real-world or the virtual-world without having to remove the HMD fully from their heads.
This disclosure relates to head mounted display devices and more particularly to the physical structure thereof.
BACKGROUNDVirtual reality (VR) and augmented reality (AR) visualization systems are starting to enter the mainstream consumer electronics marketplace. These devices are often bulky and limit the ability of the user to move comfortably or see.
One or more embodiments of the present disclosure are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements.
In this description, references to “an embodiment,” “one embodiment” or the like, mean that the particular feature, function, structure or characteristic being described is included in at least one embodiment of the technique introduced here. Occurrences of such phrases in this specification do not necessarily all refer to the same embodiment. On the other hand, the embodiments referred to also are not necessarily mutually exclusive.
Head mounted displays (HMD) are often used for virtual reality or augmented reality applications, often inclusively referred to as mixed reality. An engineering concern HMDs is often the ease of wearing. HMD's may be physically and visually restrictive, heavy, awkward, bulky hot, and disorienting. The present disclosure includes improvements upon these issues.
One way to improve upon mobility and comfort is to remove components from the user's head. This is sometimes done with backpacks or connections to external computers. However, these methods make it more difficult to market, sell all-in-one HMD devices, and cause the user to be tethered to external devices. The primary issue is removing weight, bulk, and heat from the user's head or face area. To achieve that, it is unnecessary to go so far as placing it on their back. Instead, the components that do not necessarily need to be on the user's face may be moved to their neck, and worn as a necklace.
Another issue is visibility. This issue is more particularly noticeable in immersive virtual reality applications. Current designs must be taken all the way off in order for a user to see the real world again. Thus having a display that can be adjusted to either be in front of the user's face (in use) or propped up on their forehead as if the HMD were a pair of glasses enables the user to view the real world again without having to concern themselves with tightness settings.
The connection 14 can be configured to carry any kind of data, such as image data (e.g., still images and/or full-motion video, including 2D and 3D images), audio data (including voice), multimedia, and/or any other type(s) of data. The processing device 12 may be, for example, a game console, personal computer, tablet computer, smartphone, or other type of processing device. The connection 14 can be, for example, a universal serial bus (USB) connection, Wi-Fi connection, Bluetooth or Bluetooth Low Energy (BLE) connection, Ethernet connection, cable connection, DSL connection, cellular connection (e.g., 3G, LTE/4G or 5G), or the like, or a combination thereof. Additionally, the processing device 12 may communicate with one or more other processing systems 5 via a network 4, which may be or include, for example, a local area network (LAN), a wide area network (WAN), an intranet, a metropolitan area network (MAN), the global Internet, or a combination thereof.
The processing system 12 may further connect to a network 16, such as the Internet, a local area network (LAN), or a virtual private network (VPN). Through the network 16, the HMD device 10 may make use of a secondary processing systems 18.
The hybrid device 20 includes some additional enabling components. One such enabling component is a means for mounting the face-mounted unit 22 to the user's head/face. Such means is displayed in
The neck-mounted unit 24 in
An advantage of the displayed embodiment is that the face-mounted unit is lighter and thus will fit more comfortably on the user's face. This enables the user to be more mobile during use. The neck-mounted unit 24 is significantly lighter than a backpack, but still enables weight to be removed from the face-mounted unit 22. Additionally, a more robust cooling system may be employed on the neck-mounted unit 24 than would otherwise be comfortable on a face-mounted unit 22. Vibrations created by a fan are more noticeable and irritating as felt through the skull than on the clavicle. Vibrations received through the skull are often audible (e.g., music played through a metal rod that is clenched in the teeth can be heard). Conversely, a user cannot hear weak vibrations through the clavicle.
The “4” Figure series illustrates a number of embodiments for the neck-mounted unit 24.
The necklace configuration 34 may position components within a hollow volume of the neck-mounted unit. The exact positioning of each component within the hollow volume may vary. In some embodiments, the components within the hollow volume are positioned to balance weight across the entire neck-mounted unit.
The pendant itself does not necessarily have to be positioned on the front, center of the user's neck. The weight of the components may be distributed at the back, on the sides, or evenly on either side.
While other configurations may include the same additional components, the mantle configuration 36 is more readily configured for haptic feedback, jets of air or water used for improving an immersive experience, and speakers including bass tones or subwoofers. While it might not be preferable to feel vibration from a fan on one's skull (thereby “hearing” the fan), experiencing the pulsing of a subwoofer on one's shoulders can improve an immersive experience. The additional immersive experience components may be positioned on one or both shoulders of the mantle configuration 36.
Sensors in the sensor suite include a binocular optical module 40, a front facing camera 42, the proximity sensor 44, an eye-gaze sensor 46, and inertial measurement unit (IMU) 48 or accelerometer, a microphone 50, a radar sensor 52, a LIDAR sensor 54, speakers 56, or other sensory equipment known in the art. The binocular optical module 40 refers to a set of lenses that adapt a display to be suited for view separately in each of two eyes, and very close up.
While these components may be used for multiple purposes, components such as the display 38, the binocular optical module 40, and the speakers 56 provide output to the user. Components such as the camera 42, the proximity sensor 44, the radar 52, or the LIDAR 54 are used to provide input to the HMD 20 that is environmentally based (i.e., not directly provided by the user). While these environmentally based input sensors may also be positioned on the neck-mounted unit 24, positioning the sensors on the user's face enable them to capture the environment within the line of sight of the user despite the orientation of the user's body.
Finally, components such as the eye-gaze sensor 46, the IMU 48, and the microphone 50 each collect direct user input. The eye gaze sensor 46 must be positioned on the face-mounted unit 22 and within proximity of the user's eyes in order to detect where the user's eyes are looking on the display. The microphone 50 may be positioned on the neck-mounted unit 24; however, placing the microphone closer to the user's mouth (i.e., their face) improves microphone performance.
The IMU 48 is positioned on the face-mounted unit 22 in order to detect the motion of the user's head. One advantage of moving heavy components from the user's face to their neck is that movement of the user's head will feel more natural. Detecting the movement of the user's head is important element in maintaining an immersive experience. The neck mounted unit 24 may also include IMU 48. Such inclusion of an additional IMU 48 enables mixed reality programs to isolate input types. For example, a first IMU 48 on the user's face detects orientation and positioning of the user's head, a second IMU 48 on the user's neck detects motion of the body.
The distinction between the two input types corresponds to input provided in many known controller based video games—one control to move a player's character (commonly left control stick or WASD keys), and a second control to direct the player character's point of view (commonly right control stick or mouse cursor). Isolating user input into more than one type and from multiple positions may provide increased performance. For example, if a user whips their head forward very quickly, the HMD 20 will not interpret this as forward motion, because the neck-mounted IMU 48 did not move.
In some embodiments, the IMU 48 includes matching components in both the face-mounted unit 22 and the neck-mounted unit 24 that make use of magnetic fields to determine their relation in positioning to one another. This provides high-performance detection for user had positioning and orientation.
The neck-mounted unit 24 includes the remaining components necessary to operate the HMD 20. Notably, these components include a battery 58 in some form of controller or processing unit. The controller may include a CPU 60, and/or a GPU 62. In some embodiments, processing features are not moved to the neck-mounted unit 24. Processors such as the CPU 60 and the GPU 62 may be built with a very small profile and do not weigh very much. Accordingly, the processing components may be placed in the face-mounted unit 22 or an additional unit, such as one positioned at the back of the user's head.
A number of other components may optionally be positioned in the neck-mounted unit 24. Such components include memory or storage space 64, a cooling system (fan) 66, a haptic feedback system 68, the simulated weather system (air jets/water jets) 70, speakers/subwoofers 72, a wireless transceiver (Bluetooth, Wi-Fi, near field communication, etc.), or other suitable devices known in the art. Components such as the battery 58 or processing cores 60, 62 often generate a lot of heat. In addition to management of the weight of the HMD 20 heat management poses limitations for the processing power of the HMD 20. The ability to include a fan 66 can improve the overall processing power of the HMD 20.
Haptic feedback systems are often not implemented on head mounted devices for comfort reasons. Placement of the haptic feedback system 68 on the neck-mounted unit 24 increases functionality without increasing user discomfort. Similarly, including simulated weather/environment systems 70, such as air jets or water jets, on a face-mounted device is difficult. This is due to the difficulty in obtaining a good angle at which to shoot the jet at the user. When mounted on the neck, the HMD 20 has more ability to angle the jets in usable ways. Air or fluid jets may have additional uses beyond replicating micro-weather. For example, the weather/environment system 70 may also create the sense of motion or scent. Perfumes or scented sprays may be emitted from the environment system 70. Further air jets can simulate the sensation of not only the movement or air, but the user's movement through the air (e.g., as if on a virtual motorcycle).
Similarly, subwoofers 72 or other larger speakers that are often difficult to include on a compact, face mounted device. The neck-mounted unit provides more surface area and an internal volume (to resonate sound waves) which in turn makes the use of subwoofers more feasible.
Wireless communication is also a relevant portion of modern computing and gaming. Thus, the inclusion of a wireless transceiver 74 in HMDs is beneficial. As the wireless communicator does not necessarily have to be mounted on the face of the user, optional placement on the neck reduces face-mounted components. The wireless transceiver 74 enables the HMD 20 to communicate with external networks and the Internet or additional peripherals, such as handheld controllers.
The HMD 20 may additionally communicate with outside peripherals, such as a controller 80. Communication with the controller 80 may be wired or wireless.
The adjustable HMD 82 includes an adjustable visor 84 attached to a head mount 86 via a hinge 88. The adjustable visor 84 includes the near-eye display of the HMD device. In use, the adjustable visor 84 is positioned in front of the user's eyes. When the user wishes to view the real-world again without taking the adjustable HMD 82 off, the user lifts the adjustable visor 84 to a raised position on their head and locks the visor in position via the hinge 88. The head mount 86 wraps fully around the user's head such that the visor 84 is not required to stabilize the adjustable HMD 82. The features of the adjustable HMD 82 may be used with the features of the hybrid HMD 20 such that an adjustable visor 84 is included in the same HMD as a neck-mounted unit 24.
One such means includes a contact surface 89 between an inner ring 90 and outer ring 92 of the hinge 88. Each of the head mount 86 and the adjustable visor 84 is associated with one of either the inner ring or the outer ring 90, 92. Wiring connects each of the respective portions of the adjustable HMD 82 to the rings 90, 92. The contact surface 89 provides the necessary electrical connection there between.
An alternative means is to make use of the central area 94 of the hinge 88. In some embodiments, a wire merely runs through the central area 94. Alternatively, each side of the central area 94, respectively one side for the adjustable visor 84 and one side for the head mount 86, includes a contact surface.
Although the subject matter has been described in language specific to structural features and/or acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as examples of implementing the claims and other equivalent features and acts are intended to be within the scope of the claims.
Claims
1. A head mounted display comprising:
- a face-mounted unit, configured to mount on a face of a user, including: a display; and
- a neck-mounted unit configured to wrap around a neck of the user and communicatively coupled to the face unit, the neck-mounted unit having a single hollow volume that encircles the neck of the user, the hollow volume encasing: a controller; and a battery.
2. The head mounted display of claim 1, wherein the communicative connection between the face-mounted unit and the neck-mounted unit is implemented via a wired connection.
3. The head mounted display of claim 1, wherein the communicative connection between the face-mounted unit and the neck-mounted unit is implemented via a wireless connection, and the face-mounted unit further comprises:
- a wireless transceiver; and
- a second battery that powers the wireless transceiver and the display.
4. The head mounted display of claim 1, wherein the controller further comprises any of:
- a central processing unit; or
- a graphics processing unit.
5. The head mounted display of claim 4, wherein the battery provides the majority of the power consumed by any of:
- the display;
- the central processing unit; or
- the graphics processing unit.
6. The head mounted display of claim 1, the face-mounted unit further comprising any of:
- a binocular optical module;
- a camera sensor;
- an inertial measurement sensor;
- a microphone;
- a radar sensor;
- a LIDAR sensor;
- a proximity sensor;
- an eye gaze sensor; or
- speakers.
7. The head mounted display of claim 6, further comprising:
- a sensor fusion system that is configured to fuse sensor data locally collected from the face-mounted unit into an input stream and communicates the input stream to the processor.
8. The head mounted display of claim 1, further comprising any of:
- buttons; or
- a peripheral control device.
9. The head mounted display of claim 1, wherein the neck-mounted unit further comprises any of:
- a cooling system;
- a haptic feedback system;
- speakers;
- an air jet system;
- a memory; or
- a wireless transceiver.
10. The head mounted display of claim 1, wherein the neck-mounted unit is shaped in a necklace configuration.
11. The head mounted display of claim 10, wherein the battery and the controller are positioned in a pendant module on the necklace configuration.
12. The head mounted display of claim 1, wherein the neck-mounted unit is shaped in a mantle configuration and is further supported by shoulders of the user.
13. The head mounted display of claim 1, further comprising:
- a rear processing unit mounted behind the head of the user and including any of: a graphics processing unit; or a central processing unit.
14. A mixed reality device comprising:
- a near-eye display mounted on a head of a user;
- a neck-mounted unit including a battery, a processor, and a cooling unit, wherein the battery provides power for both the processor and the near-eye display and the processor provides graphical processing for the near-eye display to render, and the cooling unit manages temperatures for the battery and the processor; and
- a connection between the near-eye display and the neck-mounted unit that transmits power and electrical signals there between.
15. The mixed reality device of claim 14, the near-eye display further comprising any of:
- a binocular optical module;
- a camera sensor;
- an inertial measurement sensor;
- a microphone;
- a radar sensor;
- a LIDAR sensor;
- a proximity sensor;
- an eye gaze sensor; or
- speakers.
16. The mixed reality device of claim 14, wherein the neck-mounted unit further comprises any of:
- a haptic feedback system;
- speakers;
- an air jet system;
- a memory; or
- a wireless transceiver.
17. The mixed reality device of claim 14, wherein the neck-mounted unit is shaped in a necklace configuration.
18. The mixed reality device of claim 17, wherein the battery and the processor are positioned in a pendant module on the necklace configuration.
19. The mixed reality device of claim 14, wherein the neck-mounted unit is shaped in a mantle configuration and is further supported by shoulders of the user.
20. A method of operating a mixed reality device comprising:
- displaying a mixed reality experience on a near-eye display mounted on a head of a user to the user; and
- transmitting power and electrical signals between a neck-mounted unit and the near-eye display via a connection, wherein the neck-mounted unit includes a battery and a processor contained within a single hollow volume that encircles a neck of the user.
Type: Application
Filed: Jun 20, 2017
Publication Date: Dec 20, 2018
Inventors: Jonathan Mendoza (Santa Clara, CA), Toby Stopper (Santa Clara, CA), Kevin Hoffman (Santa Clara, CA), Ignazio Moresco (Santa Clara, CA), Allen Yang (Santa Clara, CA)
Application Number: 15/628,560