Abstract: The exemplary embodiments disclose a method, a computer program product, and a computer system for enhancing a user's appetite with one or more augmented reality devices. The exemplary embodiments may include collecting data of the user, the user's environment, and one or more consumable items, extracting one or more features from the collected data, determining one or more augmented reality appetite enhancements based on the extracted one or more features and one or more models, and enhancing the user's appetite by way of the one or more augmented reality devices according to the determined one or more augmented reality appetite enhancements.

Abstract: The present disclosure has a configuration in which a distributor who performs a separate distribution that is different from this live content, or a viewer who views this separate distribution can participate in a virtual space and express intent or participate in visual recognition through the commitment of a virtual item.

Abstract: A vision assistance apparatus may include an image acquisition unit configured to acquire an image by capturing the scene of the front which a user watches, a sensor unit configured to acquire sensing information on objects located in front of the user, a control unit configured to analyze the image acquired by the image acquisition unit and generate a notification signal for the front scene through an analysis result of the image and the sensing information acquired by the sensor unit, and an output unit configured to provide the user with the notification signal generated by the control unit in the form of sound.

Abstract: An information display method and an information display system are provided. The method is adapted to the information display system including a first image capturing device and a transparent display, and the method includes the following steps. A pattern image is obtained by shooting a pattern placed on a real object through the first image capturing device, wherein the real object is located on one side of the transparent display. Relative position information between the transparent display and the pattern is obtained according to the pattern image. Augmented image data is obtained according to the relative position information. The augmented image data is displayed through the transparent display, wherein the augmented image data include a virtual object augmented based on the real object.

Abstract: A processor may receive physical parameter data associated with a physical parameter of an object. The processor may receive pathway data associated with one or more potential pathways for transporting the object from an origin point to a destination point. The processor may determine a recommended pathway, the recommended pathway may have one or more path segments for transportation of the object from the origin point to the destination point. The processor may determine a first recommended orientation and a first recommended movement for transportation of the object through a first path segment of the recommended path. The processor may provide, to a user, a virtual rendering of the first recommended orientation and the first recommended movement of the object through the first path segment of the recommended path.

Abstract: Methods and systems are disclosed for presenting virtual objects on a limited number of depth planes using, e.g., an augmented reality display system. A farthest one of the depth planes is within a mismatch tolerance of optical infinity. The display system may switch the depth plane on which content is actively displayed, so that the content is displayed on the depth plane on which a user is fixating. The impact of errors in fixation tracking is addressed using partially overlapping depth planes. A fixation depth at which a user is fixating is determined and the display system determines whether to adjust selection of a selected depth plane at which a virtual object is presented. The determination may be based on whether the fixation depth falls within a depth overlap region of adjacent depth planes. The display system may switch the active depth plane depending upon whether the fixation depth falls outside the overlap region.

Abstract: A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content has an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.

Abstract: Providing learned interactions in a virtual reality or augmented reality (collectively, a computer-mediated reality) can include determining a probable physical action of a user interacting with a computer-mediated reality (CMR) environment. A learned interaction corresponding to the probable physical action can be generated based on a CMR-physical action (CMRPA) model that correlates physical actions with results of the physical actions in a CMR scenario of the CMR environment. In response to determining, based on at least one identified characteristic of the user, a statistical likelihood of benefiting the user by providing the learned interaction, a learned interaction corresponding to the probable physical action can be provided to the user.

Abstract: A transparent optical module system or device comprising an optical architecture hierarchy based on a patch unit. In aspects, the transparent optical module comprises a display sparsely populated with pixels. The patch unit comprises one or more regions of display pixels, or a pixel pattern(s), and an associated lenslet, for example on a microlens array. The lenslet is capable of transmitting display-emitted light to an eye of the wearer of the transparent optical module, which then focuses the light to form a retinal image, which is seen or perceived by the wearer. The patch units can be combined further into patch groups, wherein members of a group serve a similar role in retinal image production as a patch unit and/or lenslet. This hierarchy allows the system to be scaled to larger and more complex systems.

Abstract: A system is disclosed in which an eye-tracking sensor signal is received and a moving image is generated to be rendered on one or more displays based on the eye-tracking sensor signal. Responsive to an input control signal from a user-operable control device or based on a determination that the user's gaze direction is tracking the moving image, the system adjusts the moving image.

Abstract: A wearable display device includes a display element, a first circuit board, a second circuit board, and an outer packaging case housing the display element, the first circuit board, and the second circuit board, wherein the second circuit board has a larger calorific value than the first circuit board, and is disposed at a further outer side, which is an opposite to a wearer than the first circuit board, in the outer packaging case.

Abstract: Disclosed are a lamp for a vehicle and a vehicle including the lamp. A lamp for a vehicle according to one aspect of the present disclosure includes: a light source configured to emit first light; and a beam splitter configured to form transmitted light by transmitting a part of the first light and form reflected light by reflecting another part of the first light, in which the transmitted light transmitted through the beam splitter and the reflected light reflected by the beam splitter form beam patterns outside.

Abstract: Interactive augmented reality experiences with an eyewear device including a virtual eyewear beam. The user can direct the virtual beam by orienting the eyewear device or the user's eye gaze or both. The eyewear device may detect the direction of an opponent's eyewear device or eye gaze of both. The eyewear device may calculate a score based on hits of the virtual beam of the user and the opponent on respective target areas such as the other player's head or face.

Abstract: The disclosure provides a system that provides a mixed reality experience for users. Mixed reality is the blending of real and virtual (or digital) worlds to produce environments and visualizations where both physical and digital objects co-exist and can also interact in real time. The disclosure provide a MR system for the interaction of users, computers, and an environment in which users can experience using all five senses. In one example, the disclosure provides a mixed reality system that includes: (1) a structure, (2) a vehicle configured to support at least one user, wherein the vehicle is suspended from the structure via an articulating universal connection mount, and (3) a system controller configured to provide virtual reality video content to a virtual reality interface in response to interactions of the user with the vehicle and the virtual reality interface, wherein the virtual reality video content corresponds to the real world of the vehicle.

Abstract: An object is to provide an image projection system in which a size and weight of a head-mounted portion are reduced and binocular vision is enabled.

Abstract: The disclosed computer-implemented method may include (1) displaying one or more images to a user via a display comprising multiple display regions, (2) switching each of the display regions to a blocking state in which a view of the user's real-world environment in a corresponding region of the user's field of view is blocked from the user, (3) detecting a pass-through triggering event involving one or more objects in the user's real-world environment, (4) identifying one or more display regions corresponding to a region of the user's field of view occupied by the object, and (5) switching each of the one or more display regions to a pass-through state in which the view of the user's real-world environment in the corresponding region of the user's field of view is passed through to the user. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A foveated projection system in a wearable device is configured for tracking an eye gaze of a user wearing the wearable device. The foveated projection system may distribute and concentrate pixels only at a portion of a display screen of the wearable device, which is in direct line with a current position of the eye gaze of the user. The portion of the display screen will have a high concentration of pixels in comparison to remaining portions of the display screen, which results in the user viewing information within the portion at a high resolution. As the eyes of the user moves in a different position, all the pixels are seamlessly moved to concentrate at new portions of the display screen, which are now in line with most recent positions of the eye gaze of the user.

Abstract: An optical waveguide includes an input diffractive optical element arranged for being aligned with an optical projector for diffracting the light beam therefrom, a waveguide substrate arranged for reflecting the light beam diffracted by the input diffractive optical element by means of total internal reflection, and an output diffractive optical element coupled at said waveguide substrate for partially diffracting the light beam as a diffracted light and partially transmitting the light beam as a transmitted light during the total internal reflection of the light beam within the waveguide substrate. The diffracted light is diffracted by the output diffractive optical element and is projected out of the waveguide substrate toward the user eye. The transmitted light is continuously transmitted and reflected within the waveguide substrate by the total internal reflection until the transmitted light is totally diffracted out of the waveguide substrate, so as to complete an exit pupil expansion.

Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. An augmented reality display system comprises a handheld component housing an electromagnetic field emitter, the electromagnetic field emitter emitting a known magnetic field, the head mounted component coupled to one or more electromagnetic sensors that detect the magnetic field emitted by the electromagnetic field emitter housed in the handheld component, wherein a head pose is known, and a controller communicatively coupled to the handheld component and the head mounted component, the controller receiving magnetic field data from the handheld component, and receiving sensor data from the head mounted component, wherein the controller determining a hand pose based at least in part on the received magnetic field data and the received sensor data.

Abstract: Systems and methods for a flexible, head-mounted display is provided. The head-mounted display system may comprise a base member and one or more arm members that are coupled to the base member. Each of the arm members are coupled to the base member via a hinge that allows the arm members to move with respect to one another. Interior walls of the arm members and base member may define one or more chambers. One or more first batteries are positioned within a chamber in the first arm member and one or more second batteries are positioned within a chamber in the second arm member. One or more wired connections coupled to the batteries extend through the arm member(s) and hinges, and into one or more chambers in the base member, where the one or more wired connections are coupled to a battery monitor.

Abstract: By arranging cables, which transmit video signals to a pair of video image display elements arranged on the right side and the left side, along a frame for supporting a pair of right and left light guiding devices, it is possible to concentrate the cables on one of the right and left sides. That is, it is possible to integrally form the cables. By accommodating the cables in a cable cover portion, which extends along the frame, in a cover inside, it is possible to suppress an increase in size which accompanies cable arrangement and to implement the apparatus as a whole in a small body.

Abstract: Eyewear dynamically adjusts viewing effects to match the wearer, the object or scene being viewed (luminance, color prominence, glare, visual blur/noise), other conditions: sensory parameters (gaze direction, focal length, eye gestures, other eye activity, other senses, wearer inputs), medical conditions, wearer location, environmental parameters, wearer activity, use by the wearer, the wearer's field of view. The eyewear can adjust visual features presented to the wearer, such as changes in refraction, polarization/shading, color, prismatic angles/functions, 3D displays. Eyewear can be tailored to form factor: glasses, contacts, RID, IOL, facemask/helmet, vehicles, windows, screens, scopes, AR/VR devices, nerve sensors, external devices. Eyewear can adjust refraction, polarization/shading, color filtering/injection, false coloring, color change; prismatic angles/functions.

Abstract: Head mounted displays (HMD) and corresponding display methods are provided, which obtain, repeatedly, from a monitoring system of a vehicle and, a reference vector relating to the vehicle; display on the HMD a reference symbol that indicates the reference vector; and determine movements of a HMD symbology according to a spatial relation between a received user's line of sight (LOS) and the reference vector. For example, the vehicle may be an aircraft and the reference vector a flight path vector (FPV) received from the aircraft's avionics. The proposed HMD enhances the displayed information content while avoiding excessive movements of the symbology. The HMD's functional parameters may be pre-set or adapted according to user preference and flight stage characteristics. The reference symbol anchors most of the symbology, while minimal critical information may be moved along with the user's LOS, providing a clearer and more stable view through the HMD.

Abstract: An apparatus configured, based on a first virtual space in which visual imagery is presented to a first user and a second, different, virtual space in which visual imagery is presented to a second user, the first and second virtual spaces based on respective virtual reality content that comprises visual imagery and wherein a representation of the first user, viewable by the second user, is provided in the second virtual space and based on a communication initiation input from the second user; to provide for communication and presentation in the second virtual space, at a virtual location based on a location of the second representation of the first user, of a context-volume comprising a sub-volume of the first virtual space at least partly surrounding the first user to enable the second user to seethe first virtual space currently experienced by the first user.

Abstract: A system for displaying medical data is provided having a source providing image data, a monitor presenting the image data, a plurality of medical devices generating signals each indicative of a medical parameter, and a display for presenting at least one signal correlated with a view vector of the display.

Abstract: A head mounted display apparatus includes a display, a focus adjuster and a controller. The display generates a display image. The focus adjuster is disposed between a target zone and the display, and is configured to adjust a position of a focus plan of the display image according to a control signal. The controller generates the control signal according to vision depth information.

Abstract: A method for controlling movement of a computer display cursor based on a point-of-aim of a pointing device within an interaction region includes projecting an image of a computer display to create the interaction region. At least one calibration point having a predetermined relation to the interaction region is established. A pointing line is directed to substantially pass through the calibration point while measuring a position of and an orientation of the pointing device. The pointing line has a predetermined relationship to the pointing device. Movement of the cursor is controlled within the interaction region using measurements of the position of and the orientation of the pointing device.

Abstract: A depth camera assembly (DCA) for depth sensing of a local area. The DCA includes a polarized light generator, an imaging device, and a controller. The polarized light generator modulates one or more optical beams emitted from an illumination source to generate modulated light, and projects the modulated light into the local area as polarized light having a first polarization. The imaging device receives light from the local area, the received light including ambient light and a portion of the polarized light reflected from the local area. The imaging device reduces an intensity of the received light having polarization different from a second polarization to generate filtered light substantially composed of light of the second polarization, and detects the portion of the polarized light having the second polarization using the filtered light. The controller determines depth information for the local area based on the detected portion of the polarized light.

Abstract: A shared augmented reality system can support the sharing of video captured by a local user, using a head mounted display (HMD), with a remote user. The remote user may add augmented reality annotations (markings, notes, drawings) to certain objects within the environment captured within the video, where the annotations track the movement of those objects within the shared video. An HMD may not, however, provide a convenient interface for performing certain user-interface intensive tasks, which might be better performed on an additional device such as a mobile phone, tablet, or computer. During a shared augmented reality session, the additional device can be configured to communicate with a HMD such that certain tasks can be performed by the user through the additional device, and other tasks can be performed or experienced through the HMD. The additional device, the HMD and the remote user's device can communicatively coordinate during the session.

Abstract: A wearable device for augmented media content experiences can be formed with a mountable physical structure that has removably mountable positions and component devices that are removably mounted through the removably mountable positions. The component devices can be specifically selected based on a specific type of content consumption environment in which the wearable device is to operate. The mountable physical structure may be subject to a device washing process to which the component devices are not subject to, after the wearable device including the mountable physical structure and the component devices is used by a viewer in a content consumption session in the specific type of content consumption environment, so long as the component devices are subsequently removed from the mountable physical structure.

Abstract: Exemplary embodiments of the present disclosure are directed towards an integrated smart helmet system, comprising: a control unit-PCB 201 is wirelessly connected to a computing device 303 over network 305, computing device 303 is configured to enable a user to use different functionalities without having to remove helmet 102 and access the computing device 303 and the control unit-PCB 201 is configured to detect crashes while wearing the helmet 102 by the user and notify crash detected information to computing device 303 over network 305, buttons 213a-213d are positioned at the rear or side of helmet 102 and control unit-PCB 201 is electrically coupled to buttons 213a-213d, buttons 213a-213d are configured to initiate prompts to direct the user to put away the computing device 303 while driving and disable certain dangerous functions.

Abstract: One or more cameras capture objects at a higher resolution than the human eye can perceive. Objects are segmented from the background of the image and scaled to human perceptible size. The scaled-up objects are superimposed over the unscaled background. This is presented to a user via an augmented reality display whereby the process selectively amplifies the size of the objects' spatially registered retinal projection while maintaining a natural (unmodified) view in the remainder of the visual field.

Abstract: A method comprising determining a set of position parameters for an inertial measurement unit (IMU) on a headset worn by a user. The set of position parameters includes at least a first yaw measurement and a first roll measurement. The set describes a pointing vector. The method further comprises calculating a drift correction component that describes a rate of correction. The drift correction component is based at least in part on the set of position parameters. The method further comprises applying the drift correction component to one or more subsequent yaw measurements for the IMU. The drift correction component forces an estimated nominal position vector to the pointing vector at the rate of correction.

Abstract: Apparatuses, methods, systems, and program products are disclosed for adjustable bone conduction speaker for head mounted display. An apparatus includes a sliding member couplable to a head mounted display (“HMD”) unit and comprising at least one bone conduction speaker, the sliding member adjustable along a first axis to position the bone conduction speaker along the first axis. An apparatus includes a protrusion member coupled to the sliding member and housing the at least one bone conduction speaker, the protrusion member adjustable along a second axis, substantially perpendicular to the first axis, to position the bone conduction speaker along the second axis.

Abstract: A projecting apparatus is provided, and includes a frame, a light source module, at least one collimator lens, at least one adhesive, and a microelectromechanical systems (MEMS) module. The frame includes a first frame portion and a second frame portion. The first frame portion has a carrier and a carrying bridge having an end connected to the carrier. The frame has a processing slot that uses the carrying bridge as a bottom thereof, and the carrying bridge has at least one thru-hole that is in spatial communication with the processing slot. The second frame portion is connected to the carrier and another end of the carrying bridge of the first frame portion. The at least one adhesive corresponds in position to the at least one thru-hole, and connects the at least one collimator lens onto the carrying bridge. The MEMS module is disposed on the second frame portion.

Abstract: An augmented reality apparatus for use in a hazardous area comprises a display unit for providing information within a user's field of view. The augmented reality apparatus also comprises a controller configured to control the display. The controller is configured modify the mode of operation of the display unit in dependence of location information indicating that the augmented reality apparatus is in the hazardous area.

Abstract: A method can include displaying a first front view of 360° content based on a first user position configured based on a head position of a user and a body position of the user, the 360° content being displayed based on user position information in a 360° space; in response to determining that the user position information indicates that the head position has changed to a changed head positon while the body position remains unchanged, displaying a second front view of the 360° content according to the changed head position, the second front view being different than the first front view; and in response to determining that the user position information indicates that the head position has changed to the changed head position and the body position has changed to a changed body position, continuing to display the first front view according to the changed head position and the changed body position.

Abstract: Aspects of the present disclosure relate to controlling virtual reality (VR) content displayed on a VR head mounted display (HMD). Communication can be established between a computer system, a VR HMD, and a mobile device. A user input configured to control VR content displayed on a display of the VR HMD can be received on the mobile device. The VR content displayed on the VR HMD can then be controlled based on the user input received on the mobile device.

Abstract: The present disclosure proposes an information processing device, an information processing method and a program, which are capable of, while virtual reality content is displayed, informing a user of positional relationship between the user and a boundary region of a space in which the user can act in the real space. The information processing device comprising: an obtaining unit that obtains body information of a user; and an output control unit that, while virtual reality content is displayed by a display unit, causes a sign indicating positional relationship between the user and a boundary region of a second real space in which the user can act in a first real space in which the user is located, the boundary region having been determined on the basis of the body information of the user, to be displayed with the sign superimposed on the content.

Abstract: A periphery monitoring device includes: an acquisition unit that acquires capture images which are captured by an imaging unit in time series when a vehicle is moving, the imaging unit being provided in the vehicle and capable of imaging surroundings of the vehicle; and a restoration processing unit that, in a case where dirt is present in a latest capture image among the capture images, inputs the capture images into a first learned model and generates a first restoration image as a restoration image obtained by restoring a region concealed with the dirt in the latest capture image, the first learned model being a result obtained by machine learning a relationship between a first learning image in which learning dirt is not present and first learning dirt images each of which is made by causing the learning dirt to be present in the first learning image.

Abstract: A headset can include at least one display; virtual reality circuitry operatively coupled to the at least one display; and a display frame that includes a nosepiece coupling and a nosepiece received in part by the nosepiece coupling, where the nosepiece includes a ball, an extension, a carrier and nose pads coupled to the carrier, where the carrier is rotatable via the ball and translatable via the extension.

Abstract: A display device includes a display operable to generate a real image and an optical system including: a plurality of optical channel bundles, each bundle comprising one or more channels, each channel comprising a lenslet arranged to generate a sub-image from a respective partial real image on the display, Each lenslet is configured to project light from the display to a corresponding eye position among two eye positions. The sub-images combine to form two virtual images so that different optical channel bundles image a same portion of the display to different portions of the virtual images. The optical system is configured to allow light to flow through selected channels and prevent, light from flowing through other selected channels. The system successively opens the optical channel bundles and displays partial real images associated with the channels of the corresponding optical channel bundle.

Abstract: An adaptation status judging unit (112) judges an adaptation status of a driver to a color. A goal color decision unit (113) decides a goal color of a display range based on the adaptation status of the driver. An applicable color decision unit (115) decides an applicable color of a display portion on a screen of a display based on the goal color, the display portion displaying information. A control unit (116) controls the display based on the applicable color of the display portion.

Abstract: The technology disclosed relates to highly functional/highly accurate motion sensory control devices for use in automotive and industrial control systems capable of capturing and providing images to motion capture systems that detect gestures in a three dimensional (3D) sensory space.

Abstract: A head-mounted display comprises: a wearing body; a display; a communication module configured to perform communication connection with a mobile information terminal; a field of view (FOV) sensor configured to output status data used for determining whether the mobile information terminal is included in a user's FOV through the wearing body; and a controller connected to each of the display, the communication module, and the FOV detection sensor. The controller determines whether the mobile information terminal is included in the user's FOV based on the status data, and performs display control with respect to the display so as to display an application screen of the mobile information terminal on the display when determining that the mobile information terminal is not included in the FOV, and not to display the application screen on the display when determining that the mobile information terminal is included in the FOV.

Abstract: A multi-layer viewing system includes a stationary imager and a beam projector to project physical layer markings onto a region of an object. A headset includes an augmented reality display that is sufficiently transparent to enable a user who is wearing the headset to directly view the object through the display, and to display annotation that is superimposed on the object. A processor is configured to receive a selected location relative to the target for display of the annotation, determine an orientation of the augmented reality display by identifying images of markings in acquired images or markings on the object, calculate a display location for displaying the annotation on the augmented reality display such that the annotation is perceivable by the user as displayed at the selected position, and display the annotation at the calculated display location.

Abstract: A system includes a head mounted display (HMD), a processor, and a memory. The HMD is configured to generate sensor data indicative of a gaze vector of a user and a position of the user. The processor is configured to communicate with the HMD. The memory is coupled to the processor and stores instructions that, when executed by the processor, cause the processor to obtain data indicating the gaze vector of the user and the position of the user. The instructions also cause the processor to determine a component vector for a virtual component of a virtual reality simulator based on the position of the user and a position of the virtual component. The instructions further cause the processor to calculate an alignment value based on the gaze vector and the component vector, and adjust a simulation setting of the virtual component based on the alignment value.

Abstract: The present invention relates to a method implemented by computer means of selecting an optical filtration of an ophthalmic device for a wearer, the method comprising: —obtaining wearer's preferences relatively to at least one predetermined type of visual environment comprising multispectral or hyper spectral data; —selecting at least one filter: —corresponding to said wearer's preferences relatively to said at least one predetermined type of visual environment, and —determined on the basis of said multispectral or hyper spectral data.

Abstract: The invention discloses an optical system of near-eye see-through head-mounted display, comprising a first lens, a second lens and a micro image display, the first lens and the second lens are attached to the micro image display, and the first lens and the second lens are free-form lenses with a uniform thickness. The architecture of the optical system of near-eye see-through head-mounted display provided by the present invention can not only reduce the number of times the light is refracted in the architecture of the optical system, but also eliminate the aberration of the light emitted by the micro image display in all directions, making the images be viewed from all directions and angles with no aberration.

Abstract: A device to stimulate the retina comprises one or more light sources coupled to one or more optical elements. The one or more optical elements is configured to illuminate the retina with one or more images at a location away from a fovea of a wearer. In some embodiments, each of the one or more images comprises a depth of focus and a spatial resolution. The one or more images can be formed at a distance anterior to the retina, at a distance posterior to the retina or on the retina. In some embodiments, the depth of focus is less than the distance, and the spatial resolution greater than a spatial resolution of the retina at the location.