Abstract: A display control device for a vehicle is mounted on a host vehicle, and the display control device for a vehicle is configured to generate a non-rectangular image from a rectangular image of an area located rearward of the host vehicle, the rectangular image being captured by a capturing unit mounted on the host vehicle, and display the non-rectangular image in a rectangular display area of a display unit.

Abstract: Aspects of the present invention relate to providing assistance to medical professionals during the performance of medical procedures through the use of technologies facilitated through a head-worn computer.

Abstract: A method for monitoring and visualizing a patient's medical condition, wherein a graphical representation of the patient comprising a body having at least a torso and a head, as well as particularly two legs and two arms, is displayed using a display device, wherein said displayed graphical representation comprises at least one region which is allocated to at least one or several provided (e.g. measured and/or determined) patient monitoring quantities, and wherein the appearance of the at least one region is altered in real-time when the at least one patient monitoring quantity to which said at least one region is allocated changes.

Abstract: Techniques for aligning a virtual object with a physical object in an Augmented Reality (AR) or Virtual Reality (VR) application are described. An electronic peripheral includes a first inertial measurement unit (“IMU”). A head mounted display includes a second IMU. An estimated attitude for the electronic peripheral is generated using data from the first IMU. An estimated attitude for the head mounted display is generated using data from the second IMU. An orientation of a virtual object is determined based on the estimated first and second attitudes, such that the virtual object is aligned with an object in a user's physical environment when the virtual object is displayed to the user. The virtual object is displayed on the head mounted display.

Abstract: A method and system of visually communicating navigation instructions can use translational and rotational arrow cues (TRAC) defined in an object-centric frame while displaying a single principal view that approximates the human's egocentric view of the actual object. A visual guidance system and method can be used to pose a physical object within three-dimensional (3D) space. Received pose data (402) indicates a current position and orientation of a physical object within 3D space, such that the pose data can provide a view of the physical object used to generate a virtual view of the physical object in 3D space. At least two of six degrees of freedom (6DoF) error can be calculated (404) based on a difference between the current position of the physical object and a target pose of the physical object.

Abstract: Examples of systems and methods for matching a base mesh to a target mesh for a virtual avatar or object are disclosed. The systems and methods may be configured to automatically match a base mesh of an animation rig to a target mesh, which may represent a particular pose of the virtual avatar or object. Base meshes may be obtained by manipulating an avatar or object into a particular pose, while target meshes may be obtain by scanning, photographing, or otherwise obtaining information about a person or object in the particular pose. The systems and methods may automatically match a base mesh to a target mesh using rigid transformations in regions of higher error and non-rigid deformations in regions of lower error.

Abstract: An example of an image display system includes a goggle apparatus having a display section. A virtual camera and a user interface are placed in a virtual space. The orientation of the virtual camera in the virtual space is controlled in accordance with the orientation of the goggle apparatus. When the goggle apparatus rotates by an angle greater than or equal to a predetermined angle in a pitch direction, the user interface is moved to the front of the virtual camera in a yaw direction.

Abstract: Systems and methods are disclosed for operating a head-mounted display system based on user perceptibility. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes by presenting the content with different amounts of wavefront divergence. Some embodiments include obtaining an image captured by an imaging device of the display system. Whether a threshold measure or more of motion blur is determined to be exhibited in one or more regions of the image. Based on a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, one or more operating parameters of the wearable display are adjusted. Example operating parameter adjustments comprise adjusting the depth plane on which content is presented (e.g., by switching from a first depth plane to a second depth plane), adjusting a rendering quality, and adjusting power characteristics of the system.

Abstract: Physicians performing invasive procedures require accuracy and precision when working with surgical tools. Surgical procedures are increasingly becoming minimally invasive, with physicians operating using cameras to view the surgery site and directing their tools through oculars or video displays. Ideally, the physician should be able to perform the invasive procedure while simultaneously observing both the real-time image of the patient and additional data critical for his medical decisions about the manipulation of the surgical tool and the next surgical step. The augmented reality navigation system of the present disclosure provides tool location visibility for invasive procedures through the use of location sensors included on a camera and/or on the tools used during a procedure. A location tracking system determines and monitors the locations of the tools and camera based on the characteristics of signals detected by the sensors and displays informational overlays on images obtained with a camera.

Abstract: Disclosed herein is a method of graphically presenting an indicating marker over a 3-D model of a tissue surface during a catheterization procedure, comprising determining a region over the 3-D model, deforming the indicating marker to congruently match a shape defined by the 3-D model across the region at a plurality of positions; and rendering the 3-D model into an image including the deformed indicating marker by generating an image of the 3-D model covered by said deformed indicating marker.

Abstract: An electronic device may include a display panel and an image data source designed to determine a differing region in the image frame by comparing source image data and image data corresponding with a previous image frame. The electronic device may also include a display pipeline between the image data source and the display panel. The display pipeline may include image processing circuitry to convert image data from a source space to a display space and image processing circuitry to spatially process the image data. The display pipeline may determine a crop region by converting the differing region to the display space and determine a partial frame region, based on the image data to be spatially processed, by the image processing circuitry. The display pipeline may also determine and retrieve a fetch region smaller than the image frame by converting the partial frame region to the source space.

Abstract: A method of signaling includes receiving a first type of energy at a beacon device, converting the first type of energy into a second type of energy, and transmitting the second type of energy to indicate a position of the beacon device in a real-world environment to a hybrid reality (HR) system. A beacon device includes a receiver to receive a first type of energy, a conversion apparatus to convert the first type of energy into a second type of energy, and a transmitter to transmit the second type of energy to a hybrid reality (HR) system.

Abstract: A method and system for designing a dental appliance for an individual. A 3D model of the individual's features including a portion of their face and arches is displayed on a 3D display. The 3D model includes an augmented reality dental appliance. The 3D model can be manipulated by inputs detected by a motion sensor, a brain-computer interface, both, or other sensors. In response to gestures neural activity, or other inputs, the augmented reality dental appliance or other aspects of the 3D model are modified. The 3D model is updated in response to the modified dental appliance or other changes, and repositioned to provide an updated 3D model. The updated 3D model is displayed on the 3D display. This system and method facilitates modification of the augmented reality dental appliance and observation of the resulting aesthetic effects.

Abstract: Graphics processing renders a scene with a plurality of different rendering parameters for different locations on a screen area. Graphics depicting one or more objects mapped to a screen area are processed. The screen area includes a plurality of zones, each having a different set of rendering parameters. Primitives belonging to one of the objects that covers at least two of the zones are received. Each primitive is assembled to screen space by iterating each primitive over each zone it covers using the rendering parameters of the respective zone with each iteration.

Abstract: An augmented reality/mixed reality system that provides a more immersive user experience. That experience is provided with increased speed of update for occlusion data by using depth sensor data augmented with lower-level reconstruction data. When operating in real-time dynamic environments, changes in the physical world can be reflected quickly in the occlusion data. Occlusion rendering using live depth data augmented with lower-level 3D reconstruction data, such as a raycast point cloud, can greatly reduce the latency for visual occlusion processing. Generating occlusion data in this way may provide faster operation of an XR system using less computing resources and enabling the system to be packaged in a battery operated wearable device.

Abstract: A system includes a head-mounted display (HMD) and one or more beacon devices. A beacon device includes a receiver to receive a first type of energy, a conversion apparatus to convert the first type of energy into a second type of energy, and a transmitter to transmit the second type of energy to the HMD. The HMD includes a display, a structure adapted to position the display in a field-of-view of the user, a sensor to receive the second type of energy from the beacon device, and a processor. The processor is programmed to receive the second type of energy from the beacon device located in a real-world environment, determine a position of the beacon device based on the second type of energy received from the beacon device, and provide a stimulus to a user on the HMD based on the position of the beacon device.

Abstract: A method for assisting the location of a target for a first user equipped with an observation device includes an augmented reality observation device associated with a first user reference frame. According to this method, a reference platform associated with a master reference frame is positioned on the terrain, the reference platform is observed from at least one camera worn by the first user, the geometry of the observed platform is compared with a numerical model of same and the orientation and location of the first user reference frame is deduced with respect to the master reference frame. It is then possible to display, on an augmented reality observation device, at least one virtual reticle locating the target.

Abstract: An apparatus includes a cable having two ends and at least two object markers coupled to the cable configured to enable augmented reality (AR) detection of each end of the cable among a plurality of cables. A computer-implemented method using augmented reality (AR) technology includes selecting a cable of interest, identifying an object marker at a first end of the cable of interest, and storing the object marker. The method also includes scanning a plurality of cables, detecting a second instance of the object marker, and identifying a second end of the cable of interest based on the object marker. A computer program product for detecting ends of cables using augmented reality (AR) technology, includes a computer readable storage medium having program instructions embodied therewith. The program instructions executable by a computer to cause the computer to perform the foregoing method.

Abstract: A method to provide positional information to a user of a hybrid reality (HR) system includes receiving a signal at the HR system from a beacon device located in a real-world environment, determining a position of the beacon device based on the signal, and providing a stimulus to the user on the HR system based on the position of the beacon device. A head-mounted display (HMD) includes a display, a structure, coupled to the display and adapted to position the display in a field-of-view (FOV) of the user, and a processor, coupled to the display, the processor configured to perform the method.

Abstract: Embodiments of the present disclosure disclose a method for data collection and model generation of a house. According to the method, when a model of a house is to be established, both collected depth images of the house and pictures of the house are acquired. A virtual three-dimensional model of the house is created by using the depth images, and a panoramic image of a functional space is generated by using the pictures. When a user needs to learn about the structure of the house, the user can view the virtual three-dimensional model created from the depth images; and when the user needs to learn about specific details of a functional space, the user can view the panoramic image of the functional space. The details of a functional space of the house can be displayed, and the structure of the house can be displayed as well, which helps the user to fully learn about the house.