Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.

Abstract: An electronic device includes a processor; and a memory storing a program which, when executed by the processor, causes the electronic device to: obtain a plurality of VR images that are sequentially captured; and generate, from each of the plurality of VR images, a VR image in which a reference direction of the VR image is corrected to a direction in which a specific subject is present in the VR image.

Abstract: Provided is a wearable device that includes: a first display provided on a first surface of the wearable device configured to face a face of a user wearing the wearable device, and a second display provided on a second surface of the wearable device configured to face an external environment of the wearable device when the wearable device is worn by the user. The wearable device may be configured to display a first execution screen of a first application on the first display, while the wearable device is worn by the user, determine a display type for information to be displayed on the second display, while displaying the first execution screen on the first display, and display information related to the first execution screen on the second display based on the display type.

Abstract: A display device includes a housing having a first end capable of connecting to a night vision device and a second end capable of connecting to an eyepiece, a camera configured to receive an image from the night vision device, a decoder configured to convert the image from the night vision device from an analogue signal into digital signal, and a display to display the converted image, so that the converted image can be viewed though the eyepiece.

Abstract: The control device 50 includes a control unit 52 that controls a state of video projected onto a predetermined projection plane by a projector 20 provided in a space in the moving body 10 on the basis of space situation information input from a sensor that detects a space situation in the moving body 10.

Abstract: A method for the satellite-based localization of a vehicle in a map-based reference system. A trajectory in a map-based reference system is determined at regular time intervals, on which trajectory the vehicle is to be brought to a stop at least partially automatically in a defined emergency, and are stored in a circular buffer. In the defined emergency and in the event of failure of the at least one camera used for the full localization, an emergency trajectory is selected from the trajectories stored in the circular buffer. An initial vehicle position in the map-based reference system is determined based on the emergency trajectory. A vehicle orientation is ascertained based on a continuously acquired yaw rate of the vehicle. The stretch of route traveled by the vehicle is ascertained based on position data of the vehicle that are acquired in a satellite-based manner.

Abstract: A method, medium and system for auto-aligning displays of a head/helmet mounted display. The method, medium and system may provide for an auto-alignment of components of a headband, headgear, or a helmet. The method, medium and system may provide for a first sensor mounted to the helmet of a user and configured to communicate and transfer align with a vehicle comprising an inertial navigation system (INS). The method, medium and system may provide for display comprising a second sensor configured to communicate with the first sensor and transfer align the second sensor with the first sensor based on the transfer alignment of the first sensor with the vehicle. The method, medium and system may provide for wherein the first sensor and the second sensor comprise an inertial measurement unit (IMU). Further, the method, medium and system may also provide for the aligning of two displays on the head/helmet relative to each other in real time.

Abstract: Eyewear having unsynchronized rolling shutter (RS) cameras such that images produced by each camera are unaligned, and a state that includes velocity and gravity orientation in the eyewear's reference system is calculated. The state is not limited to these two parameters as other parameters such as the acceleration bias, the gyroscope bias, or both may be included. Math solvers are used such that processing time to calculate the velocity and gravity orientation are acceptable. Arranging the RS cameras in an unsynchronized configuration allows estimating the motion of the eyewear from just one stereo image pair and removes the requirement of possessing more images.

Abstract: An electronics-enabled eyewear device includes a mode indicator comprising a series of light emitters arranged on a forward-facing surface of the eyewear device, for example being provided by a ring of LEDs arranged peripherally about a camera lens opening in a front surface of an eyewear frame. The mode indicator automatically displays different visual indications corresponding to different modes of operation or states of the eyewear device. One visual indication provides an animated pattern of circulating LEDs during video capture by the eyewear device.

Abstract: A two-dimensional exit pupil expansion method for waveguide display based on polarization volume gratings (PVGs) is provided. Based on the polarized diffraction properties of the PVGs as waveguide coupling elements, a light beam from a microimage source system is introduced into and then propagates in a waveguide medium. By a composite PVG structure, a light field of a transmitted image is subjected to two-dimensional exit pupil expansion and emission, and finally incident into human eyes to achieve waveguide augmented reality imaging.

Abstract: A single unit in one piece, comprising components for smart glasses, to be positioned in glasses, the single unit comprising at least one cpu, at least one sensor and at least one battery provided on a pcb reaches, when positioned in glasses, at least from a first temple via a frame at least past a first lens positioned closest to the first temple in the frame up to a second lens positioned closest to a second temple, and preferably past also said second lens, and preferably further to said second temple. The single unit comprises at least one hinge, which, when positioned in glasses, will provide at least a hinge between the first temple and the frame, and the single unit is in one piece. A method of making a pair of smart acetate glasses comprising the single unit. A method of exchanging electronics in a single unit comprising electronics.

Abstract: According to examples, a head-mounted display (HMD) headset may include at least two exterior-facing color cameras mounted on the front face of the HMD and in the same visual plane as the user's eyes. The at least two exterior-facing color cameras may collect images for stereo view synthesis. The HMD may include a processor, and a memory storing instructions, which when executed by the processor, cause the processor to perform stereo view synthesis with a machine-learning (ML) based technique including at least one of depth estimation, imaging sharpening, forward splatting, disocclusion filtering, or fusion.

Abstract: A surgical system including a XR headset, a tracking system, and an XR headset controller. The XR headset can be worn by a user during a surgical procedure and includes a see-through display screen configured to display a world-registered XR image and to allow at least a portion of a real-world scene to pass therethrough for viewing by the user. The tracking system can determine a real-world pose of the XR headset and a real-world pose of a real-world element. The real-world pose of the XR headset and the real-world pose of the real-world element being determined relative to a real-world coordinate system. The XR headset controller can generate the world-registered XR image based on the real-world pose of the XR headset and the real-world pose of the real-world element. The world-registered XR image includes a virtual element that is generated based on a characteristic of the real-world element.

Abstract: In one implementation, a method of controlling a dimming level of dimmable optical element based on a predicted ambient light level is performed at a device including one or more processors, non-transitory memory, and a dimmable optical element. The method includes predicting a change, in a first direction, in an ambient light level at a future time. The method includes changing, at a first time in advance of the future time and in the first direction, a transmission coefficient of the dimmable optical element based on the predicted change in the ambient light level. The method includes changing, at a second time after the first time and in a second direction opposite the first direction, the transmission coefficient of the dimmable optical element based on the ambient light level at the second time.

Abstract: A structured optical surface and an optical imaging system including the structured optical surface is described. The structured optical surface includes a plurality of structures formed by an intersection of at least first and second Fresnel patterns, such that when the structured optical surface is incorporated in an optical imaging system comprising a pixelated display surface with at least one pixel comprising at least two sub-pixels spaced apart by a gap, the structured optical surface images the at least two sub-pixels onto an image surface as at least two corresponding imaged sub-pixels spaced apart by a corresponding imaged gap, and the structured optical surface diffracts light so that the diffracted light at least partially fills the imaged gap without substantially overlapping any of the at least two imaged sub-pixels.

Abstract: A conventional head-mounted display (HMDs) can display a virtual image at a fixed focus (e.g., infinite focus). If the user looks at an object that appears closer than the virtual image, then accommodation by the user's eyes will cause the virtual image to appear blurry. The HMDs disclosed herein include a dynamic electro-active focusing element that changes the focus of the virtual image to account for accommodation by the user. This dynamic electro-active focusing element may include a curved layer of electro-active material, such as nematic or bi-stable (e.g., cholesteric) liquid crystal, disposed between a static concave mirror and a convex surface on a beam splitter or other optical element. Changing the refractive index of the electro-active material causes the focus of the dynamic electro-active focusing element, making it possible to shift the virtual image's focus in as the user's eyes change focus.

Abstract: A head-mounted extended reality (XR) display device includes a rigid mounting element coupled to a frame. The XR display device further includes right-side and left-side visible light cameras coupled to the rigid mounting element, right-side and left-side near-infrared (NIR) cameras coupled to the rigid mounting element, and an NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the NIR cameras. The visible light cameras are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and the NIR cameras are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame.

Abstract: A mobile wireless device (100) in the configuration of user wearable glasses includes at least one lens including at least one transparent display (110). The at least one display is operable to provide visual outputs that are visually perceivable to the user of the device. The user is enabled to see through the at least one lens, physical surroundings in a direct field of view. The device includes at least one input device (116, 122, 114) which receives user inputs. At least one circuit is in operative connection with the at least one display, the at least one input device, a data store (106) and a wireless transceiver (120). At least one user input is operative to cause the device to communicate at least one wireless message which includes data usable to identify a financial account. At least one remote circuit is operative responsive to the at least one wireless message to cause a financial transfer to or from the financial account.

Abstract: A method, a system and a recording medium for accessory pairing are provided. The method comprises: determining a type of the accessory based on the identifying information of an accessory; recognizing a type of a user body part according to an image; in response to the accessory is applicable to the user body part according to the type of accessory and the type of the user body part, obtaining a first position of the accessory within an environment and obtaining a second position of the user body part within the environment; and configuring the accessory to pair the user body part according to the first position of the accessory and the second position of the user body part.

Abstract: The present invention relates to an optical device for augmented reality using a plurality of images for augmented reality, the optical device including: a plurality of image output units configured to output respective rays of image light corresponding to images for augmented reality; a plurality of reflective units configured to transfer the respective rays of image light to the pupil of an eye of a user; and an optical means in which the reflective units are disposed and configured to transmit at least part of image light output from a real object therethrough; wherein each of the plurality of reflective units corresponds to at least any one of the plurality of image output units, and transfers image light corresponding to an image for augmented reality and output from the corresponding image output unit to the pupil of the eye of the user.

Abstract: A headset in the form of glasses for use in creating an augmented reality experience is implemented with a capacitive smart sensor disposed on an inside surface of an arm of the glasses. The capacitive smart sensor can be trained, using a neural network, to identify and distinguish different gestures associated with a touch event on an outside surface of the arm of the glasses. The smart sensor thus transforms the headset into a user input device without adding a touch pad.

Abstract: The present invention relates to novel virtual reality (VR), augmented reality (AR), and mixed reality (MR) systems for providing a user additional information that was previously invisible to the naked eye. More specifically, the invention relates to a system that is capable of overlaying information onto human vision such that the user can see both the environment around them, and the information superimposed over it.

Abstract: An information processing apparatus (10) is an information processing apparatus causing a user of a head mounted display to perceive a depth position of a virtual object by controlling display positions of a right-eye image and a left-eye image related to the virtual object, the information processing apparatus including: a determination unit (143) that determines an opened/closed state of an eye of the user on the basis of a detection result of a sensor (11) that detects a visual recognition state of both eyes of the user; a calculation unit (141) that calculates a display position in a depth direction of the virtual object; and a display control unit (145) that, in a case where it is determined that the display position in the depth direction is within a first distance indicating a predetermined short distance and both eyes of the user are opened, reduces visibility of the right-eye image and the left-eye image related to the virtual object, and in a case where it is determined that the display position in

Abstract: The present invention includes a jig for installing a protection member to a portable electronic device and a guide jig device including the same. The jig includes a main body and retaining members formed to be elastically deformed and coupled or connected to the main body while surrounding a mounting space in which the portable electronic device formed in the main body is inserted. The guide jig device is advantageous in that it can be used for a portable electronic device that is manufactured and sold in a size relatively greater than the size of the portable electronic device disclosed before its release.

Abstract: A display apparatus may include a display area including a plurality of pixels arranged over a first substrate along a first direction and a second direction crossing the first direction, a circuit layer disposed in the display area and configured to include a plurality of pixel driving lines coupled to the plurality of pixels, a planarization layer covering the circuit layer, a light emitting device layer disposed over the planarization layer, a first encapsulation layer wholly or fully covering the light emitting device layer and directly contacting an uppermost surface of the circuit layer, a second encapsulation layer wholly or fully covering the first encapsulation layer and directly contacting the uppermost surface of the circuit layer, and a third encapsulation layer wholly or fully covering the second encapsulation layer and directly contacting the uppermost surface of the circuit layer.

Abstract: A beam of light is directed onto, and scanned across, a controllably-selected portion of a concave-curved light-redirecting surface that provides for redirecting and redistributing the light and illuminating a two-dimensional image-display modulation array. A virtual image of the two-dimensional image-display modulation array is formed by an optical subsystem. Light thereof propagating from an aperture of the optical subsystem is collected onto a subpupil within an exit pupil of the optical subsystem on a surface proximate to an outer surface of an eye location. The subpupil is associated with the controllably-selected portion of the concave-curved light-redirecting surface, and with a corresponding portion less than all of the light of the virtual image that is associated with a gaze direction of the eye when viewing the subpupil. A location of the subpupil within the exit pupil corresponds to a location of the controllably-selected portion on the concave-curved light-redirecting surface.

Abstract: Devices, media, and methods are presented for an audio enhanced augmented reality (AR) experience using an eyewear device. The eyewear device has a microphone system, a presentation system, a support structure configured to be head-mounted on a user, and a processor. The support structure supports the microphone system and the presentation system. The eyewear device is configured to capture, with the microphone system, audio information of an environment surrounding the eyewear device, identify an audio signal within the audio information, detect a direction of the audio signal with respect to the eyewear device, classify the audio signal, and present, by the presentation system, an application associated with the classification of the audio signal.

Abstract: A head-mounted display unit includes a display assembly and a head support coupled to the display assembly that supports the head-mounted display unit worn on a head of a user. The head support includes a band that is formed from a stretchable material to allow for expansion and contraction of the band, a cord that extends through the band, and an adjustment mechanism that is coupled to the cord and is configured to extend and retract the cord to thereby shorten and lengthen the head support.

Abstract: In certain embodiments, pupil-related characteristic detection or spectacles correction/adjustment based thereon may be facilitated. In some embodiments, a stimulus may be presented at a location on a first display portion of the user device at a first time to cause a first eye of a user to fixate on the location. A stimulus may be presented at the location on a second display portion of the user device to cause a second eye of the user to fixate on the location at a time subsequent to the first time. Movement of the first or second eye to fixate on the location on the respective first or second display portion in connection with the stimulus presentation at the second time may be determined. In response to the movement of the first or second eye exceeding a threshold movement amount, a user profile may be generated that includes the user's pupil distance.

Abstract: An eye-gaze tracking apparatus and a method of eye-gaze tracking. The eye-gaze tracking apparatus comprises: a plurality of foreground cameras each arranged to capture at least a portion of a target view area of a user; and an eye-gaze estimation module having at least one eye-gaze camera each arranged to capture an image an eye of the user, so as to estimate a position of a pupil of the eye based on the image of the eye; wherein each of the plurality of foreground cameras includes a field-of-view (FOV) being different from each other.

Abstract: An electronic device is disclosed. The electronic device includes an inertial measurement element and a processor. The inertial measurement element is configured to obtain a first inertial measurement data when the electronic device moves. The processor is configured to perform the following operations: establishing a mixed reality environment coordinate system in correspondence according to the real space, and calculating a starting coordinate point of the electronic device in the mixed reality environment coordinate system; converting the first inertial measurement data into a first movement vector in the mixed reality environment coordinate system according to an inertial measurement data mapping model; calculating a first spatial operation point in the mixed reality environment coordinate system according to the starting coordinate point and the first movement vector in the mixed reality environment coordinate system; and executing a 3D scene editing program with the first spatial operation point.

Abstract: A user's environment is scanned and an augmented reality game such as a treasure is set up based on the scan. The user needs to use a phone to uncover clues in a game environment that is customized to user's own personal real-world environment, which is discovered using SLAM or GPS so that a map of furniture can be built. The game hides a virtual object behind a virtualized image of the real-world furniture. Machine learning may be used to train a model with common objects and where interesting hidden spaces could exist. Given the user's inputted data, real world physical room data and objects are used to determine a likely location to hide a virtual object.

Abstract: A technique for user interaction with an autonomous unmanned aerial vehicle (UAV) is described. In an example embodiment, perception inputs from one or more sensor devices are processed to build a shared virtual environment that is representative of a physical environment. The sensor devices used to generate perception inputs can include image capture devices onboard an autonomous aerial vehicle that is in flight through the physical environment. The shared virtual environment can provide a continually updated representation of the physical environment which is accessible to multiple network-connected devices, including multiple UAVs and multiple mobile computing devices. The shared virtual environment can be used, for example, to display visual augmentations at network-connected user devices and guide autonomous navigation by the UAV.

Abstract: A system and method quantify light exposure of a patient retina during an ophthalmic procedure. A light source illuminates the patient retina with directed light during the procedure to produce an illuminated retina surface. A camera collects image data of the illuminated retina surface. An electronic control unit (ECU) in communication with the camera and an indicator device receives the image data, calculates a cumulative energy spectral density of the directed light falling incident upon the retina, and executes a control action indicative of possible light toxicity in response to the cumulative energy spectral density exceeding a light toxicity threshold, including activating the indicator device. The illuminated retina surface may be divided into virtual zones, with the ECU mapping the cumulative energy spectral density to the illuminated retina surface. Each of the optional zones has a corresponding cumulative energy spectral density.

Abstract: Eyewear device that includes two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear device, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate all peripheral components, and a second SoC performing computational tasks. This is a low-risk architecture since the second SoC is not required to operate any of the peripherals, and it has low standby power since the second SoC can be fully shutdown in a low-power mode. The second SoC does not have any direct access to camera data, so an interprocessor communication bus continuously transmits camera buffer data for most augmented reality (AR) compute tasks. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

Abstract: Aspects of the present invention relate to control system (100) for controlling a transition of a vehicle between a first driving mode and a second driving mode. The control system comprises one or more controllers, configured to: receive (302) a first request signal indicative of an occupant-initiated preparatory request; receive (303) a second request signal indicative of an occupant-initiated transition request; determine (304) a first control signal for controlling output of information to an occupant of the vehicle indicative of the driving environment in dependence on receipt of the first request signal; determine (308) a second control signal for causing transition of the vehicle from the first driving mode to the second driving mode in dependence on receipt of both the first request signal and the second request signal; and output (306, 310) the first or second control signal to a vehicle system.

Abstract: A support arm assembly for a head-worn device includes a metal support arm configured to form a rear face, a bottom face, and a top face of an enclosure for a projector, thermally coupled to the projector to act as a heatsink, configured to structurally attach to a rear structural element of the head-worn device, and configured to structurally attach to an optical element holder of the head-worn device, such that the metal support arm forms a structural support joining the optical element holder to the rear structural element without placing mechanical load on the projector.

Abstract: A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.

Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.

Abstract: A head-mounted display comprises: a wearing body; a display; a communication module configured to perform communication connection with a mobile information terminal; a field of view (FOV) sensor configured to output status data used for determining whether the mobile information terminal is included in a user's FOV through the wearing body; and a controller connected to each of the display, the communication module, and the FOV detection sensor. The controller determines whether the mobile information terminal is included in the user's FOV based on the status data, and performs display control with respect to the display so as to display an application screen of the mobile information terminal on the display when determining that the mobile information terminal is not included in the FOV, and not to display the application screen on the display when determining that the mobile information terminal is included in the FOV.

Abstract: The present invention provides a technique for judging the reflexivity of an eyeball movement. The judging the reflexivity comprises extracting a first feature value of a saccade appearing in a pupil movement performed by a subject during a task involving moving an eye so as to follow a visual cue and a second feature value of a saccade during a task involving moving the eye in an opposite direction to the visual cue. A judgement result indicates whether an eyeball movement performed by the subject has occurred reflexively based on a degree of difference between the first feature value and the second feature value. The judging further comprises generating, based on the degree of difference between the first and second feature values, a judgement result indicating whether the eyeball movement performed by the subject has occurred reflexively.

Abstract: A head mounted display includes a display device having a display surface, an optical system configured to adjust a focal point of an eye of an observer to the display device, a driving mechanism configured to drive the display device, a line-of-sight detector configured to detect a line of sight of the observer, and a controller configured to control, based on an output from the line-of-sight detector, the driving mechanism so that an angle formed by the line of sight and the display surface falls within a preset allowable range with respect to 90° at an intersection point of the line of sight and the display surface.

Abstract: Embodiments of this application relates to the field of wearable device technologies, and provides a mask and a head-mounted display device. The mask includes a support, an elastic support, and a face fitting spring plate. Lens holes are disposed in the support, the face fitting spring plate is connected to the support by using the elastic support, a middle part of the face fitting spring plate is sunken to the support, an eyepiece hole facing the lens holes is disposed in the face fitting spring plate, and a nose support is disposed in a middle part on a lower side edge of the face fitting spring plate. The head-mounted display device includes the mask and a display device connected to the mask. In the mask, the face fitting spring plate can be deformed under an external force.

Abstract: A device for providing a reverse pass-through view of a user of a headset display to an onlooker includes an eyepiece comprising an optical surface configured to provide an image to a user on a first side of the optical surface. The device also includes a first camera configured to collect an image of a portion of a face of the user reflected from the optical surface in a first field of view, a display adjacent to the optical surface and configured to project forward an image of the face of the user, and a screen configured to receive light from the display and provide the image of the face of the user to an onlooker.

Abstract: A method and system of tracking and analyzing data during a medical procedure is provided. A wearable sensor (e.g. EEG system to obtain EEG signals) is worn by a practitioner, where the wearable sensor covers a body part of the practitioner. The practitioner performs a medical procedure on a person. The medical procedure is video recorded. A computer system digitally registers the medical procedure by registering (i) the digital data from the wearable sensor, and (ii) the digital data of the video recording. The computer system synchronizes the registered digital data of (i) and (ii) into a synchronized data set, and sections are then identified for the synchronized data set. The computer system generates sensor data maps from the synchronized data set and the identified sections, which are then useful for the practitioner, colleagues and other learners for feedback and training purposes.

Abstract: An apparatus embedded with one or more terahertz transceivers is described. The one or more terahertz transceivers based on at least one resonant tunnelling diodes is provided to facilitate wireless communication in the apparatus, where the apparatus is embedded with one or more planar antennas. The transceiver operates in terahertz and may be coupled to one or two different antennas, one for transmission and the other for reception.

Abstract: A composite polyester hot-melt adhesive, a preparation method thereof and a preparation method of an anti-scouring geotextile are provided. The preparation method of the composite polyester hot-melt adhesive includes the following steps: performing an esterification reaction on a dibasic acid and a dihydric alcohol under a protection of nitrogen and an action of a titanium/cobalt composite catalyst, adding a stabilizer for a polycondensation reaction to obtain a polyester hot-melt adhesive, then adding polymethyl methacrylate (PMMA) microspheres for mixing and stirring to obtain the composite polyester hot-melt adhesive. The anti-scouring geotextile is obtained by bonding a polyethylene terephthalate woven fabric with a polypropylene geotextile by the composite polyester hot-melt adhesive.

Abstract: The present disclosure generally relates to interaction between a user and an apparatus, sometimes referred to as user-apparatus interaction or human-computer interaction. More specifically, the present disclosure generally relates to combined gaze-based and scanning-based control of an apparatus, such as a computer, a tablet computer, or a desktop computer. In more detail, the present disclosure presents methods, apparatuses, computer programs and carriers, which combine gaze-based control with scanning-based control for controlling the apparatus.

Abstract: Systems and methods for using reduced hops to generate an augmented virtual reality scene in a head mounted display. The head mounted display is used for game play via a game cloud system. The head mounted display includes a communications circuit for sending real-world media associated with a game program via a network. The real-world media is processed by the game cloud system and streamed directly from the communications circuit to the game cloud system. The head mounted display further includes a game processing circuit coupled to the communications circuit. The game processing circuit is used for decoding computer-generated interactive media received from the game cloud system via the network. The game processing circuit drives a portion of interactivity associated with the game program by superimposing the computer-generated interactive media on the real-world media. The computer-generated interactive media is generated based on the real-world media.

Abstract: The following generally relates to using Augmented Reality (AR) to enhance pedestrian navigation. In some examples, AR techniques are applied to provide AR indications of a location of a group member that includes two or more AR devices. In these examples, AR techniques may be applied to determine a relative position of the group member and/or provide navigational guidance to the group member. In other examples, AR techniques are applied to provide AR-assisted pedestrian guidance. In these examples, AR techniques may be applied to present an AR display that includes information for a point of interest along a route.