Abstract: An image display device includes a first display unit including a first frame and a first optical system, a second display unit including a second frame and a second optical system, and a fixing member configured to fix the first display unit and the second display unit relative to each other, wherein the fixing member has a shape configured to rotate the first optical system and the second optical system in rotational directions around two or more axes when the first display unit and the second display unit are aligned prior to fixing.

Abstract: An electronic device is provided. The electronic device includes a first lens support, a second lens support movable with respect to the first lens support, a first moving member coupled to the first lens support to move together with the first lens support, a second moving member coupled to the second lens support to move together with the second lens support, a plurality of friction members penetrating the first moving member and the second moving member and movable with respect to each other, and at least one deforming member disposed between the plurality of friction members and configured to press each of the plurality of friction members in a direction away from each other friction member.

Abstract: A head-mounted device may have a head-mounted housing. The head-mounted housing may have displays that display images for a user. The images are viewable from eye boxes while the head-mounted device is being worn by the user. A head strap may be removably coupled to the head-mounted housing to help hold the displays in position during operation of the head-mounted device. The head strap and head-mounted housing may have wireless power circuitry and communications circuitry. The wireless power circuitry may be used to transmit power from a battery in the head strap to the head-mounted housing. The communications circuitry may include wireless radio-frequency circuitry and/or optical circuitry that allow the head strap to convey wireless data to the head-mounted housing. The head-mounted housing may also transmit power and/or data to the strap.

Abstract: A computer-implemented method for displaying thermal images by a thermal imager device is provided. The method includes displaying, by a user interface of a computing device, a plurality of thermal images corresponding to a respective plurality of objects in a scene captured by the thermal imager device. The plurality of thermal images are displayed by a first representation scheme based on a first thermal scale comprising a first range of temperature values corresponding to the plurality of objects. The method includes receiving, by the computing device, a user selection of a subplurality of the plurality of thermal images. And the method includes, responsive to the user selection, displaying, by the user interface, the subplurality of the plurality of thermal images by a second representation scheme based on a second thermal scale comprising a second range of temperature values corresponding to a respective subplurality of the plurality of objects.

Abstract: Systems and methods for estimating emotional states, moods, affects of an individual and providing feedback to the individual or others are disclosed. Systems and methods that provide real time detection and monitoring of physical aspects of an individual and/or aspects of the individual's activity and means of estimating that person's emotional state or affect and change to those are also disclosed. Real time feedback to the individual about the person's emotional change, change or potential change is provided to the user, helping the user cope, adjust or appropriately act on their emotions.

Abstract: A virtual image display apparatus includes an image light emitting unit configured to emit image light, and a see-through mirror which is an optical member having a reflective film that reflects the image light, wherein the see-through mirror includes a first region on which a light ray of the image light corresponding to a center angle of view is incident and a second region on which a light ray of the image light which different from the light ray corresponding to the center angle of view is incident, a film thickness in the first region of the reflective film is thicker than a film thickness in the second region, and the first region of the reflective film has reflectivity characteristics corresponding to a wavelength band which is wider toward the long wavelength side than a wavelength band of the image light emitted from the image light emitting unit.

Abstract: A retinal projection display device is provided. The retinal projection display device includes a light source configured to emit light, a spatial light modulator configured to generate diffracted light by diffracting the emitted light, a holographic optical element configured to reflect the diffracted light by duplicating the diffracted light into a plurality of complex wavefronts, and a field lens configured to focus the plurality of complex wavefronts to a plurality of respective focal points in an eye-box, wherein the plurality of complex wavefronts overlap each other.

Abstract: A processor of a wearable device may display, based on identifying a location in a first area based on data of a sensor, a visual object. The processor may be configured to adjust, based on an input indicating selection of the visual object, the state of the camera to a first state for recording media. The processor may be configured to identify whether the location of the wearable device moves to a second area in the first area. The processor may be configured to obtain, based on identifying that the location of the wearable device moves into the second area, media based on the camera of the first state. The present disclosure relates to a metaverse service for enhancing interconnectivity between a real-world object and a virtual object, and the metaverse service may be provided over a network based on 5th generation (5G) and/or 6th generation (6G) communication systems.

Abstract: In an embodiment, an apparatus is disclosed that includes at least one processor configured to determine a target portion of an eye motion box and to identify a facet of a light-guide optical element that is configured to direct a light beam comprising at least a portion of an image field of view toward the target portion of the eye motion box. The at least one processor is configured to identify a display region of an image generator that is configured to inject the light beam into the light-guide optical element at an angle that, in conjunction with the identified facet, is configured to direct the light beam toward the target portion of the eye motion box. The at least one processor is configured to selectively activate the identified facet and the identified display region to direct the light beam toward the target portion of the eye motion box.

Abstract: A head-mounted display device employs light field directional backlighting to provide three-dimensional (3D) pupil steering without mechanical adjustment while maintaining a compact form factor and performance. An example light field directional backlighting unit includes two substantially flat components: an array of light sources and an array of modulators (e.g., a micro lens array (MLA), a stack of transmissive display elements, a pinhole array, and similar ones). By digitally modifying the illumination pattern on the array of light source and pairing to the light field directional backlighting unit to an extra transmissive display element as the main display panel and one or more viewing optical elements, a light field created by the light field directional backlighting unit is moved in three-dimensional (3D) space to correspond to pupil shift without interfering with the display content.

Abstract: A wearable electronic device including a display, a frame attachable to the display, a facial interface movably attached to the frame, and a linkage assembly movably connecting the facial interface to the frame. The linkage assembly can include a first arm pivotably attached to the frame, the first arm comprising a first end and a second end, a second arm pivotably attached to the first end and attached to the facial interface, and a third arm pivotably attached to the second end and attached to the facial interface.

Abstract: An apparatus embedded with one or more terahertz transceivers is described. The one or more terahertz transceivers based on at least Gunn diode are provided to facilitate wireless communication in the apparatus, where the apparatus is embedded with one or more planar antennas. The transceiver operates in terahertz and may be coupled to one or two different antennas, one for transmission and the other for reception.

Abstract: A monitoring system incorporates, and method and computer program product provide a monitoring system that captures image stream of regions of interest based on identified facial cues of a person. A controller of the monitoring system receives a first image stream that encompasses a face of a person and a second image stream that encompasses surrounding object(s) and surface(s) viewable by the person. The controller detects a facial expression of the face. In response to determining that the facial expression is a mood associated expression, the controller determines, from the first image stream, an eye gaze direction of the person. The controller determines a region of interest (ROI) aligned with the eye gaze direction. The controller captures the second image stream and identifies an object contained within the ROI. The controller communicates a notification including the expression and the object within the ROI to an output device.

Abstract: An electronic device according to various embodiments may include: a frame, a window supported by the frame, a display configured to output visual information to the window, a camera disposed in the frame configured to photograph a front of the frame, a communication module comprising communication circuitry, a memory, and a processor. The memory may store instructions that, when executed, cause the processor to: establish a communication connection with an external device through the communication module, acquire display attribute information of at least one first display connected to the external device, and display at least one virtual object having a same display attribute as the at least one first display in at least a portion of an area corresponding to a field of view of a user wearing the electronic device, based on the acquired display attribute information.

Abstract: A display device includes a pair of display units each including displays 1R and 1L and ocular optical systems 2R and 2L. A first driving unit can change an optical positional relationship between the displays 1R and 1L and the ocular optical systems 2R and 2L. A second driving unit can change an interval between the pair of display units. An interpupillary distance adjustment unit adjusts the interval between the display units by the second driving unit in accordance with a detection result obtained by the interpupillary distance detector. After interpupillary distance adjustment is performed, a diopter adjustment unit performs diopter adjustment related to the display unit by the first driving unit.

Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.

Abstract: Provided is a wearable device that includes: a first display provided on a first surface of the wearable device configured to face a face of a user wearing the wearable device, and a second display provided on a second surface of the wearable device configured to face an external environment of the wearable device when the wearable device is worn by the user. The wearable device may be configured to display a first execution screen of a first application on the first display, while the wearable device is worn by the user, determine a display type for information to be displayed on the second display, while displaying the first execution screen on the first display, and display information related to the first execution screen on the second display based on the display type.

Abstract: An electronic device includes a processor; and a memory storing a program which, when executed by the processor, causes the electronic device to: obtain a plurality of VR images that are sequentially captured; and generate, from each of the plurality of VR images, a VR image in which a reference direction of the VR image is corrected to a direction in which a specific subject is present in the VR image.

Abstract: A display device includes a housing having a first end capable of connecting to a night vision device and a second end capable of connecting to an eyepiece, a camera configured to receive an image from the night vision device, a decoder configured to convert the image from the night vision device from an analogue signal into digital signal, and a display to display the converted image, so that the converted image can be viewed though the eyepiece.

Abstract: Eyewear having unsynchronized rolling shutter (RS) cameras such that images produced by each camera are unaligned, and a state that includes velocity and gravity orientation in the eyewear's reference system is calculated. The state is not limited to these two parameters as other parameters such as the acceleration bias, the gyroscope bias, or both may be included. Math solvers are used such that processing time to calculate the velocity and gravity orientation are acceptable. Arranging the RS cameras in an unsynchronized configuration allows estimating the motion of the eyewear from just one stereo image pair and removes the requirement of possessing more images.

Abstract: A method, medium and system for auto-aligning displays of a head/helmet mounted display. The method, medium and system may provide for an auto-alignment of components of a headband, headgear, or a helmet. The method, medium and system may provide for a first sensor mounted to the helmet of a user and configured to communicate and transfer align with a vehicle comprising an inertial navigation system (INS). The method, medium and system may provide for display comprising a second sensor configured to communicate with the first sensor and transfer align the second sensor with the first sensor based on the transfer alignment of the first sensor with the vehicle. The method, medium and system may provide for wherein the first sensor and the second sensor comprise an inertial measurement unit (IMU). Further, the method, medium and system may also provide for the aligning of two displays on the head/helmet relative to each other in real time.

Abstract: A method for the satellite-based localization of a vehicle in a map-based reference system. A trajectory in a map-based reference system is determined at regular time intervals, on which trajectory the vehicle is to be brought to a stop at least partially automatically in a defined emergency, and are stored in a circular buffer. In the defined emergency and in the event of failure of the at least one camera used for the full localization, an emergency trajectory is selected from the trajectories stored in the circular buffer. An initial vehicle position in the map-based reference system is determined based on the emergency trajectory. A vehicle orientation is ascertained based on a continuously acquired yaw rate of the vehicle. The stretch of route traveled by the vehicle is ascertained based on position data of the vehicle that are acquired in a satellite-based manner.

Abstract: The control device 50 includes a control unit 52 that controls a state of video projected onto a predetermined projection plane by a projector 20 provided in a space in the moving body 10 on the basis of space situation information input from a sensor that detects a space situation in the moving body 10.

Abstract: An electronics-enabled eyewear device includes a mode indicator comprising a series of light emitters arranged on a forward-facing surface of the eyewear device, for example being provided by a ring of LEDs arranged peripherally about a camera lens opening in a front surface of an eyewear frame. The mode indicator automatically displays different visual indications corresponding to different modes of operation or states of the eyewear device. One visual indication provides an animated pattern of circulating LEDs during video capture by the eyewear device.

Abstract: According to examples, a head-mounted display (HMD) headset may include at least two exterior-facing color cameras mounted on the front face of the HMD and in the same visual plane as the user's eyes. The at least two exterior-facing color cameras may collect images for stereo view synthesis. The HMD may include a processor, and a memory storing instructions, which when executed by the processor, cause the processor to perform stereo view synthesis with a machine-learning (ML) based technique including at least one of depth estimation, imaging sharpening, forward splatting, disocclusion filtering, or fusion.

Abstract: A single unit in one piece, comprising components for smart glasses, to be positioned in glasses, the single unit comprising at least one cpu, at least one sensor and at least one battery provided on a pcb reaches, when positioned in glasses, at least from a first temple via a frame at least past a first lens positioned closest to the first temple in the frame up to a second lens positioned closest to a second temple, and preferably past also said second lens, and preferably further to said second temple. The single unit comprises at least one hinge, which, when positioned in glasses, will provide at least a hinge between the first temple and the frame, and the single unit is in one piece. A method of making a pair of smart acetate glasses comprising the single unit. A method of exchanging electronics in a single unit comprising electronics.

Abstract: A two-dimensional exit pupil expansion method for waveguide display based on polarization volume gratings (PVGs) is provided. Based on the polarized diffraction properties of the PVGs as waveguide coupling elements, a light beam from a microimage source system is introduced into and then propagates in a waveguide medium. By a composite PVG structure, a light field of a transmitted image is subjected to two-dimensional exit pupil expansion and emission, and finally incident into human eyes to achieve waveguide augmented reality imaging.

Abstract: A head-mounted extended reality (XR) display device includes a rigid mounting element coupled to a frame. The XR display device further includes right-side and left-side visible light cameras coupled to the rigid mounting element, right-side and left-side near-infrared (NIR) cameras coupled to the rigid mounting element, and an NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the NIR cameras. The visible light cameras are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and the NIR cameras are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame.

Abstract: A structured optical surface and an optical imaging system including the structured optical surface is described. The structured optical surface includes a plurality of structures formed by an intersection of at least first and second Fresnel patterns, such that when the structured optical surface is incorporated in an optical imaging system comprising a pixelated display surface with at least one pixel comprising at least two sub-pixels spaced apart by a gap, the structured optical surface images the at least two sub-pixels onto an image surface as at least two corresponding imaged sub-pixels spaced apart by a corresponding imaged gap, and the structured optical surface diffracts light so that the diffracted light at least partially fills the imaged gap without substantially overlapping any of the at least two imaged sub-pixels.

Abstract: In one implementation, a method of controlling a dimming level of dimmable optical element based on a predicted ambient light level is performed at a device including one or more processors, non-transitory memory, and a dimmable optical element. The method includes predicting a change, in a first direction, in an ambient light level at a future time. The method includes changing, at a first time in advance of the future time and in the first direction, a transmission coefficient of the dimmable optical element based on the predicted change in the ambient light level. The method includes changing, at a second time after the first time and in a second direction opposite the first direction, the transmission coefficient of the dimmable optical element based on the ambient light level at the second time.

Abstract: A method, a system and a recording medium for accessory pairing are provided. The method comprises: determining a type of the accessory based on the identifying information of an accessory; recognizing a type of a user body part according to an image; in response to the accessory is applicable to the user body part according to the type of accessory and the type of the user body part, obtaining a first position of the accessory within an environment and obtaining a second position of the user body part within the environment; and configuring the accessory to pair the user body part according to the first position of the accessory and the second position of the user body part.

Abstract: A mobile wireless device (100) in the configuration of user wearable glasses includes at least one lens including at least one transparent display (110). The at least one display is operable to provide visual outputs that are visually perceivable to the user of the device. The user is enabled to see through the at least one lens, physical surroundings in a direct field of view. The device includes at least one input device (116, 122, 114) which receives user inputs. At least one circuit is in operative connection with the at least one display, the at least one input device, a data store (106) and a wireless transceiver (120). At least one user input is operative to cause the device to communicate at least one wireless message which includes data usable to identify a financial account. At least one remote circuit is operative responsive to the at least one wireless message to cause a financial transfer to or from the financial account.

Abstract: A conventional head-mounted display (HMDs) can display a virtual image at a fixed focus (e.g., infinite focus). If the user looks at an object that appears closer than the virtual image, then accommodation by the user's eyes will cause the virtual image to appear blurry. The HMDs disclosed herein include a dynamic electro-active focusing element that changes the focus of the virtual image to account for accommodation by the user. This dynamic electro-active focusing element may include a curved layer of electro-active material, such as nematic or bi-stable (e.g., cholesteric) liquid crystal, disposed between a static concave mirror and a convex surface on a beam splitter or other optical element. Changing the refractive index of the electro-active material causes the focus of the dynamic electro-active focusing element, making it possible to shift the virtual image's focus in as the user's eyes change focus.

Abstract: A surgical system including a XR headset, a tracking system, and an XR headset controller. The XR headset can be worn by a user during a surgical procedure and includes a see-through display screen configured to display a world-registered XR image and to allow at least a portion of a real-world scene to pass therethrough for viewing by the user. The tracking system can determine a real-world pose of the XR headset and a real-world pose of a real-world element. The real-world pose of the XR headset and the real-world pose of the real-world element being determined relative to a real-world coordinate system. The XR headset controller can generate the world-registered XR image based on the real-world pose of the XR headset and the real-world pose of the real-world element. The world-registered XR image includes a virtual element that is generated based on a characteristic of the real-world element.

Abstract: The present invention relates to an optical device for augmented reality using a plurality of images for augmented reality, the optical device including: a plurality of image output units configured to output respective rays of image light corresponding to images for augmented reality; a plurality of reflective units configured to transfer the respective rays of image light to the pupil of an eye of a user; and an optical means in which the reflective units are disposed and configured to transmit at least part of image light output from a real object therethrough; wherein each of the plurality of reflective units corresponds to at least any one of the plurality of image output units, and transfers image light corresponding to an image for augmented reality and output from the corresponding image output unit to the pupil of the eye of the user.

Abstract: The present invention relates to novel virtual reality (VR), augmented reality (AR), and mixed reality (MR) systems for providing a user additional information that was previously invisible to the naked eye. More specifically, the invention relates to a system that is capable of overlaying information onto human vision such that the user can see both the environment around them, and the information superimposed over it.

Abstract: A headset in the form of glasses for use in creating an augmented reality experience is implemented with a capacitive smart sensor disposed on an inside surface of an arm of the glasses. The capacitive smart sensor can be trained, using a neural network, to identify and distinguish different gestures associated with a touch event on an outside surface of the arm of the glasses. The smart sensor thus transforms the headset into a user input device without adding a touch pad.

Abstract: A display apparatus may include a display area including a plurality of pixels arranged over a first substrate along a first direction and a second direction crossing the first direction, a circuit layer disposed in the display area and configured to include a plurality of pixel driving lines coupled to the plurality of pixels, a planarization layer covering the circuit layer, a light emitting device layer disposed over the planarization layer, a first encapsulation layer wholly or fully covering the light emitting device layer and directly contacting an uppermost surface of the circuit layer, a second encapsulation layer wholly or fully covering the first encapsulation layer and directly contacting the uppermost surface of the circuit layer, and a third encapsulation layer wholly or fully covering the second encapsulation layer and directly contacting the uppermost surface of the circuit layer.

Abstract: The present invention includes a jig for installing a protection member to a portable electronic device and a guide jig device including the same. The jig includes a main body and retaining members formed to be elastically deformed and coupled or connected to the main body while surrounding a mounting space in which the portable electronic device formed in the main body is inserted. The guide jig device is advantageous in that it can be used for a portable electronic device that is manufactured and sold in a size relatively greater than the size of the portable electronic device disclosed before its release.

Abstract: An information processing apparatus (10) is an information processing apparatus causing a user of a head mounted display to perceive a depth position of a virtual object by controlling display positions of a right-eye image and a left-eye image related to the virtual object, the information processing apparatus including: a determination unit (143) that determines an opened/closed state of an eye of the user on the basis of a detection result of a sensor (11) that detects a visual recognition state of both eyes of the user; a calculation unit (141) that calculates a display position in a depth direction of the virtual object; and a display control unit (145) that, in a case where it is determined that the display position in the depth direction is within a first distance indicating a predetermined short distance and both eyes of the user are opened, reduces visibility of the right-eye image and the left-eye image related to the virtual object, and in a case where it is determined that the display position in

Abstract: A beam of light is directed onto, and scanned across, a controllably-selected portion of a concave-curved light-redirecting surface that provides for redirecting and redistributing the light and illuminating a two-dimensional image-display modulation array. A virtual image of the two-dimensional image-display modulation array is formed by an optical subsystem. Light thereof propagating from an aperture of the optical subsystem is collected onto a subpupil within an exit pupil of the optical subsystem on a surface proximate to an outer surface of an eye location. The subpupil is associated with the controllably-selected portion of the concave-curved light-redirecting surface, and with a corresponding portion less than all of the light of the virtual image that is associated with a gaze direction of the eye when viewing the subpupil. A location of the subpupil within the exit pupil corresponds to a location of the controllably-selected portion on the concave-curved light-redirecting surface.

Abstract: Devices, media, and methods are presented for an audio enhanced augmented reality (AR) experience using an eyewear device. The eyewear device has a microphone system, a presentation system, a support structure configured to be head-mounted on a user, and a processor. The support structure supports the microphone system and the presentation system. The eyewear device is configured to capture, with the microphone system, audio information of an environment surrounding the eyewear device, identify an audio signal within the audio information, detect a direction of the audio signal with respect to the eyewear device, classify the audio signal, and present, by the presentation system, an application associated with the classification of the audio signal.

Abstract: In certain embodiments, pupil-related characteristic detection or spectacles correction/adjustment based thereon may be facilitated. In some embodiments, a stimulus may be presented at a location on a first display portion of the user device at a first time to cause a first eye of a user to fixate on the location. A stimulus may be presented at the location on a second display portion of the user device to cause a second eye of the user to fixate on the location at a time subsequent to the first time. Movement of the first or second eye to fixate on the location on the respective first or second display portion in connection with the stimulus presentation at the second time may be determined. In response to the movement of the first or second eye exceeding a threshold movement amount, a user profile may be generated that includes the user's pupil distance.

Abstract: A head-mounted display unit includes a display assembly and a head support coupled to the display assembly that supports the head-mounted display unit worn on a head of a user. The head support includes a band that is formed from a stretchable material to allow for expansion and contraction of the band, a cord that extends through the band, and an adjustment mechanism that is coupled to the cord and is configured to extend and retract the cord to thereby shorten and lengthen the head support.

Abstract: An eye-gaze tracking apparatus and a method of eye-gaze tracking. The eye-gaze tracking apparatus comprises: a plurality of foreground cameras each arranged to capture at least a portion of a target view area of a user; and an eye-gaze estimation module having at least one eye-gaze camera each arranged to capture an image an eye of the user, so as to estimate a position of a pupil of the eye based on the image of the eye; wherein each of the plurality of foreground cameras includes a field-of-view (FOV) being different from each other.

Abstract: An electronic device is disclosed. The electronic device includes an inertial measurement element and a processor. The inertial measurement element is configured to obtain a first inertial measurement data when the electronic device moves. The processor is configured to perform the following operations: establishing a mixed reality environment coordinate system in correspondence according to the real space, and calculating a starting coordinate point of the electronic device in the mixed reality environment coordinate system; converting the first inertial measurement data into a first movement vector in the mixed reality environment coordinate system according to an inertial measurement data mapping model; calculating a first spatial operation point in the mixed reality environment coordinate system according to the starting coordinate point and the first movement vector in the mixed reality environment coordinate system; and executing a 3D scene editing program with the first spatial operation point.

Abstract: A user's environment is scanned and an augmented reality game such as a treasure is set up based on the scan. The user needs to use a phone to uncover clues in a game environment that is customized to user's own personal real-world environment, which is discovered using SLAM or GPS so that a map of furniture can be built. The game hides a virtual object behind a virtualized image of the real-world furniture. Machine learning may be used to train a model with common objects and where interesting hidden spaces could exist. Given the user's inputted data, real world physical room data and objects are used to determine a likely location to hide a virtual object.

Abstract: A technique for user interaction with an autonomous unmanned aerial vehicle (UAV) is described. In an example embodiment, perception inputs from one or more sensor devices are processed to build a shared virtual environment that is representative of a physical environment. The sensor devices used to generate perception inputs can include image capture devices onboard an autonomous aerial vehicle that is in flight through the physical environment. The shared virtual environment can provide a continually updated representation of the physical environment which is accessible to multiple network-connected devices, including multiple UAVs and multiple mobile computing devices. The shared virtual environment can be used, for example, to display visual augmentations at network-connected user devices and guide autonomous navigation by the UAV.

Abstract: Eyewear device that includes two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear device, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate all peripheral components, and a second SoC performing computational tasks. This is a low-risk architecture since the second SoC is not required to operate any of the peripherals, and it has low standby power since the second SoC can be fully shutdown in a low-power mode. The second SoC does not have any direct access to camera data, so an interprocessor communication bus continuously transmits camera buffer data for most augmented reality (AR) compute tasks. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

Abstract: A system and method quantify light exposure of a patient retina during an ophthalmic procedure. A light source illuminates the patient retina with directed light during the procedure to produce an illuminated retina surface. A camera collects image data of the illuminated retina surface. An electronic control unit (ECU) in communication with the camera and an indicator device receives the image data, calculates a cumulative energy spectral density of the directed light falling incident upon the retina, and executes a control action indicative of possible light toxicity in response to the cumulative energy spectral density exceeding a light toxicity threshold, including activating the indicator device. The illuminated retina surface may be divided into virtual zones, with the ECU mapping the cumulative energy spectral density to the illuminated retina surface. Each of the optional zones has a corresponding cumulative energy spectral density.