Abstract: An exhibition supporting device 110 includes a recognition result information acquisition unit 1112 configured to acquire recognition result information on a display item in accordance with image information on the display item, an exhibition information acquisition unit 1114 configured to acquire exhibition information in accordance with the recognition result information and exhibition-related user information, and a display unit 114 configured to display the exhibition information.

Abstract: The present disclosure relates to techniques for providing tangibility visualization of virtual objects within a computer-generated reality (CGR) environment, such as a CGR environment based on virtual reality and/or a CGR environment based on mixed reality. A visual feedback indicating tangibility is provided for a virtual object within a CGR environment that does not correspond to a real, tangible object in the real environment. A visual feedback indicating tangibility is not provided for a virtual representation of a real object within a CGR environment that corresponds to a real, tangible object in the real environment.

Abstract: Various embodiments include a computer-implemented method for augmenting a physical infrastructure with an information element.

Abstract: Methods and systems are disclosed for displaying an augmented reality virtual object on a multimedia device. One method comprises detecting, in an augmented reality environment displayed using a first device, a virtual object; detecting, within the augmented reality environment, a second device, the second device comprising a physical multimedia device; and generating, at the second device, a display comprising a representation of the virtual object.

Abstract: The invention relates to a display device for displaying an image for a user having a visual impairment. The display device comprises a pixelated display, a processor, an eye-tracking system and a microlens array. The invention is also related to a method for displaying an image for a user having a visual impairment on a display device. The invention is further related to a user having a visual impairment and a computer program for performing the method of the invention.

Abstract: A wearable device for communicating with at least one counterpart device according to a trigger event and a control method are provided. The wearable device includes a display module and at least one processor, wherein the at least one processor is configured to control the display module such that at least one graphical object is displayed in a display area, identify whether a user's body part is positioned in a first area, identify a group corresponding to the first area, based on a fact that the user's body part is positioned in the first area, identify whether a trigger event by the user is detected while the user's body part is positioned in the first area, and perform, based on the detection of the trigger event, a function corresponding to the trigger event with respect to at least one counterpart device included in the identified group.

Abstract: An information processing apparatus (2000) acquires a shelf rack image (12) in which a product shelf rack on which a product is displayed is imaged. The information processing apparatus (2000) performs image analysis on the shelf rack image (12), and generates information (actual display information) relevant to a display situation of the product on a product shelf rack (20). The information processing apparatus (2000) acquires reference display information representing a reference for display of the product on the product shelf rack (20). The information processing apparatus (2000) compares the actual display information generated by performing the image analysis on the shelf rack image (12) with the acquired reference display information, and generates comparison information representing a result.

Abstract: A system for implementing a shared mixed reality experience to participants in a same physical room having a plurality of VR headsets, each of which is adapted to be worn by a participant in the room. Each VR headset having a forward-facing color camera stereo pair. The system includes a computer in communication with at least one of the VR headsets. The system includes a memory in communication with the computer. The memory storing an original 3D digital representation of the room. The computer calculates a rendered VR scene for the at least one of the headsets from a point of view of each of the participant's two eyes, based on the VR headset's current position and orientation. A method for implementing a shared mixed reality experience to participants in a same physical room.

Abstract: In an embodiment, an apparatus is disclosed that includes at least one processor. The at least one processor is configured to select a light source from a plurality of lights sources based at least in part on a location of a pupil of an eye relative to an eye motion box. The selected light source is configured to illuminate a portion of the eye motion box that corresponds to the location of the pupil with a light beam. The at least one processor is further configured to activate the selected light source to illuminate the portion of the eye motion box.

Abstract: A mobile device that includes a camera and an extended reality software application program is employed by a user in an operating environment, such as an industrial environment. The user aims the camera within the mobile device at optical data markers, such as QR codes, that are associated with machines in the environment. The mobile device acquires an image from the camera and decodes the optical data markers included in the acquired image. The mobile device queries the data intake and query system for the values of metrics for the machines associated with the decoded optical data markers. Upon receiving the metric values from the data intake and query system, the mobile device generates AR overlays and superimposes the AR overlays onto the acquired image. The mobile device displays the image with superimposed AR overlays on a display device.

Abstract: Cloud-based 5G security, implemented in a Multi-Access Edge Compute (MEC) system, includes steps of receiving a request for a workload from User Equipment (UE) via a Radio Access Network (RAN); determining a path to the workload; creating a tunnel to the workload; and steering the request to the workload via the tunnel that is independent of any underlying mobile network for the RAN. The tunnel can be encrypted and used on a per-application and per-session basis.

Abstract: A foldable electronic device includes a first housing and a second housing that are foldable with respect to each other; at least one sensor; a display; a camera configured to operate in a first mode associated with user recognition, and a second mode associated with user authentication; a memory storing instructions; at least one processor configured to execute the instructions to: control the display to display notification information about an event corresponding to the foldable electronic device; based on a folding state of the foldable electronic device detected using the at least one sensor satisfying a predetermined condition, obtain at least one first image using the camera operating in the first mode; identify whether a face is present in the at least one first image; based on identifying that the face is present in the at least one first image, obtain at least one second image using the camera operating in the second mode; perform face recognition-based biometric authentication using at least part o

Abstract: The present invention relates to a light guiding apparatus, comprising a light transmitting polymer guide having a first end, a second end extending from the first end, and a light path extending between the first end and the second end, and at least one light reflector disposed along the light path and at an angle relative to the light path. The present invention also relates to a method of fabricating the light guiding apparatus.

Abstract: Optimizing media distribution of a media steam performed by at least one processor, is provided, including: receiving immersive media data for an immersive presentation from a content source; acquiring asset information corresponding to media assets in a set of scenes included in the immersive media data; analyzing characteristics of the media assets, from the asset information, used in the set of scenes to determine whether a respective media asset is unique among the media assets; and generating metadata information that uniquely identifies the respective media asset for reusing the respective media asset in the set of scenes, based on determining that the respective media asset is not unique among the media assets in the set of scenes included in the immersive media data for the immersive presentation.

Abstract: Aspects of the present disclosure relate to implementing on-device latency detection into operating system (OS)-level functionality of a client device in client-server and/or network communications. An example method includes extracting packet headers from data-connection packets transmitted between a local application client and a remote application server. Data records including packet headers and timestamps are stored. Data records for related data-connection packets (e.g., queries and responses, handshakes) are identified via the packet headers, and timestamps of the identified data records are compared to determine latency measurements. Latency measurements are then distributed to relevant application clients locally residing on an upper layer. The latency measurements are presented in dashboard display to an end user and used for server-side dynamic load balancing.

Abstract: Systems and methods for nonlinear media playback using a linear media player are described. In one implementation, a video tree representing a branching video presentation is provided, and a dynamic playlist is provided to a linear video player. A controller component interacts with the linear video player through a standard interface of the linear video player. During playback of a video content segment in the dynamic playlist by the linear video player, an indication of a user interaction with the playing video content segment is received by the controller component and from the linear video player via the standard interface, and the dynamic playlist is modified based on video content segments in a branch of the video tree. In another implementation, an uncompressed media file is selected and combined with a preceding and/or following media file. The combined files are compressed and a portion of the compressed file corresponding to the original media file is extracted.

Abstract: Aspects of the subject disclosure may include, for example, determining a personalized cloud service requirement based on a user identity and proximity to a first location. A first edge network is configured based on the personalized cloud service requirement and the first location, and the user is provided with access to a personalized cloud service via the configured first edge network according to their proximity to the first location. A second, different location is determined, and a second edge network is configured based on the personalized cloud service requirement and according to the second location. The user is provided with access to the personalized cloud service via the configured second edge network according to their proximity to the second location. In this manner, the edge network may be reconfigured to effectively follow the user, thereby extending remote access to a consistent, personalized cloud service. Other embodiments are disclosed.

Abstract: An example device is described for facilitating polygon localization. In various aspects, the device can comprise a processor. In various instances, the device can comprise a non-transitory machine-readable memory that can store machine-readable instructions. In various cases, the processor can execute the machine-readable instructions, which can cause the processor to localize a polygon depicted in an image, based on execution of a deep learning pipeline. In various aspects, the deep learning pipeline can comprise a circular-softmax block.

Abstract: Provided is a pair of smart glasses. The smart glasses include a front frame, and legs rotatably connected to the front frame through a rotating module. A heat conducting structure is housed in the rotating module. The heat conducting structure includes an upper flange and a lower flange that are closely fitted in an up and down direction and rotatable relative to each other. The upper flange is connected to a front frame heat pipe provided in the front frame, and the lower flange is connected to a leg heat pipe provided in the legs and rotates with the leg heat pipe.

Abstract: In accordance with some embodiments, an exemplary process for controlling the generation and display of suggested additional content based on a context of a workspace is described.

Abstract: A surgical system includes an XR headset and an XR headset controller. The XR headset is configured to be worn by a user during a surgical procedure and includes a see-through display screen configured to display an XR image for viewing by the user. The XR headset controller is configured to receive a plurality of two-dimensional (“2D”) image data associated with an anatomical structure of a patient. The XR headset controller is further configured to generate a first 2D image from the plurality of 2D image data based on a pose of the XR headset. The XR headset controller is further configured to generate a second 2D image from the plurality of 2D image data based on the pose of the XR headset. The XR headset controller is further configured to generate the XR image by displaying the first 2D image in a field of view of a first eye of the user and displaying the second 2D image in a field of view of a second eye of the user.

Abstract: A virtual local presence display apparatus, system and method is disclosed.

Abstract: A method comprises receiving a value corresponding to a height of a subject, and then determining, using processing circuitry, an eye height of the subject based on the height of the subject and on anthropometric data. In some embodiments, the subject may be using a virtual reality application that includes a displayed virtual environment. Based on the determined eye height of the subject, the processing circuitry may cause at least one environmental parameter of the virtual environment to be modified.

Abstract: A geometric plane defined by a building-perimeter feature in an image capture by a mobile device is identified. The building-perimeter feature is co-located with an exterior wall of a building within which the mobile device is located. An orientation and/or location of the mobile device with respect to the geometric plane and an orientation of the mobile device with respect to a defined geographical direction are determined. A building model for the building and defining perimeter portions of the building (each perimeter portion corresponding to a respective exterior wall) is obtained or accessed. Based on the orientation and/or location of the mobile device with respect to the geometric plane, the orientation of the mobile device with respect to the defined geographical direction, and/or the building model, a particular perimeter portion of the building model that corresponds to the building-perimeter feature is identified and corresponding location information is determined.

Abstract: Methods, systems, and mobile devices for providing users with social media-related information about other users based on the relative geographic locations of the users.

Abstract: Methods, systems, and mobile devices for providing users with social media-related information about other users based on the relative geographic locations of the users.

Abstract: Systems, devices, media, and methods are presented for producing an augmented reality (AR) experience for display on a smart eyewear device. The AR production system includes a marker registration utility for setting and storing markers, a localization utility for locating the eyewear device relative to a marker location and to the mapped environment, and a virtual object rendering utility to presenting one or more virtual objects having a desired size, shape, and orientation. A high-definition camera captures an input image of the environment. If the input image includes a marker, the system retrieves from memory a set of data including a first marker location expressed in terms relative to a marker coordinate system. The localization utility determines a local position of the eyewear device relative to the marker location.

Abstract: An image processing system enables a user wearing a head-mounted display to experience a virtual environment combined with a representation of a real-world object. The image processing system receives a captured scene of a real-world environment that includes a target object. The image processing system identifies the target object in the captured scene and generates a representation of the target object. In some cases, the image processing system may include a graphical overlay with the representation of the target object. The image processing system can generate a combined scene that includes the target object and the virtual environment. The combined scene is presented to the user, thereby allowing the user to interact with the real-world target object (or a representation thereof) in combination with the virtual environment.

Abstract: Systems and methods for utilizing a device as a marker for virtual content viewed in an augmented reality environment are discussed herein. The device (or sign post) may comprise a wirelessly connectable device linked to a power source and associated with multiple linkage points. The device may provide information to a user (or a device of a user) defining virtual content and a correlation between the linkage points and a reference frame of the virtual content. When rendered by a display device, the virtual content may be presented based on the reference frame of the virtual content correlated to the real world by virtue of the position of the linkage points in the real world.

Abstract: In one embodiment, a method includes capturing, by a first VR display device, one or more frames of a shared real-world environment. The VR display device identifies one or more anchor points within the shared real-world environment from the one or more frames. The first VR display device receives localization information with respect to a second VR display device in the shared real-world environment and determines a pose of the first VR display device with respect to the second VR display device based on the localization information. A first output image is rendered for one or more displays of the first VR display device. The rendered image may comprise a proximity warning with respect to the second VR display device based on determining the pose of the first VR display device with respect to the second VR display device is within a threshold distance.

Abstract: A methodology is described that provides access to an augmented reality (AR) component maintained by a messaging server system directly from a web view application. When a user activates, from a web view application executing in the messaging client, a user selectable element that references an AR component, a web view AR system obtains the identification of the AR component, performs validation of the identification and of any additional launch data, and launches a camera view user interface (UI) with the AR component loaded in the camera view UI. Content captured from the camera view UI can be shared to other computing devices.

Abstract: A computer implemented medical method of calibrating a medical instrument is provided. The method calculates a position of the instrument tip model within the indentation model, associated with an estimated position of the instrument tip within the indentation and calibrates the medical instrument, thereby using the determined position of the instrument tip model. The position of any arbitrary medical instrument tip, such as an indentation of a calibration device, can be estimated. This is an improvement of accuracy in view of the generic approach of using the same reference point of the indentation of the calibration device for any arbitrary medical instrument tip. A virtual model of a shape of a medical instrument, such as the instrument tip, is matched onto a virtual model of a shape of a calibration device, such as an indentation of the calibration device.

Abstract: The method, apparatus and computer program product estimate the depth to objects within a scene that is captured by first and second cameras of a mobile terminal. A method includes determining, based upon an image including an eye of a user captured by a first camera of a mobile terminal and an image of a scene captured by a second camera of the mobile terminal, two or more angles of a geometric shape defined by the eye, the mobile terminal and an object of the scene. Based upon the image captured by the first camera, the method also determines a first distance from the first camera to the eye. The method further estimates the depth to the object in the scene relative to the mobile terminal based upon the first distance and one or more angles of the geometric shape defined by the eye, the mobile terminal and the object.

Abstract: A first video is displayed that is generated based on motion of a user and is represented as viewed from a viewpoint of the user, the user being a user of the terminal device. In combination with the first video, an input object is displayed that functions as a user interface enabling input by the user. The input object that is displayed is caused to change according to the type of the first video that is displayed.

Abstract: An electronic device includes a memory storing a plurality of motion prediction models, and a processor configured to estimate a current pose of the electronic device based on external data; predict a first motion of the electronic device at a future first prediction time through a first model in which the plurality of motion prediction models are combined for the future first prediction time, and calculate a first pose of the electronic device at the first prediction time based on the current pose and the first motion; and predict a second motion of the electronic device at a future second prediction time through a second model in which the plurality of motion prediction models are combined for the future second prediction time, and calculate a second pose of the electronic device at the second prediction time based on the first pose and the second motion.

Abstract: Methods, systems, apparatuses, and computer-readable media are provided for moving a virtual cursor along two traversing virtual planes. In one implementation, the computer-readable medium includes instructions to cause a processor to generate, via a wearable extended reality appliance, a display including a virtual cursor and virtual objects located on a first virtual plane that traverses a second virtual plane overlying a physical surface; receive a first two-dimensional input reflective of an intent to select a first virtual object located on the first virtual plane; cause a first cursor movement, toward the first virtual object, along the first virtual plane; receive a second two-dimensional input reflective of an intent to select a second virtual object appearing on the physical surface; and cause a second cursor movement, toward the second virtual object, including a partial movement along the first virtual plane and a partial movement along the second virtual plane.

Abstract: In the image processing system according to the present invention, the data acquisition unit acquires a captured image showing a loading/unloading target of a transporting material of a work machine. The area-specifying unit specifies an area including the loading/unloading target from the captured image. The loading/unloading target-specifying unit specifies at least one predetermined surface of the loading/unloading target from the area including the loading/unloading target.

Abstract: Systems, methods, and non-transitory computer-readable media for providing situational awareness to users of wearable extended reality appliances are disclosed. In one implementation, a non-transitory computer-readable medium contains instructions that when executed by at least one processor cause the at least one processor to: cause virtual content to be displayed through a first wearable extended reality appliance; detect a second wearable extended reality appliance in proximity to the first wearable extended reality appliance; establish a link between the first wearable extended reality appliance and the second wearable extended reality appliance; and transmit data representing at least a portion of the virtual content in an obscured form to the second wearable extended reality appliance, wherein the obscured form provides an indication of a position of the at least a portion of the virtual content in a three-dimensional space without revealing substance of the virtual content in obscured form.

Abstract: In a mechanical fastening work method in an augmented reality space, a mechanical fastening part and a mechanical fastening part virtual body correspond one-to-one, and a tool and a tool virtual body correspond one-to-one. An augmented reality configuration system generates an augmented reality space including: a camera that captures a real space; a server that analyzes an image captured by the camera and generates the augmented reality space; and a tool that acquires torque information observed when tightening or loosening the mechanical fastening part and transmits and receives the torque information to and from the server. The mechanical fastening work method includes a step of, when the tool detects torque information that the mechanical fastening part is to be tightened or loosened, defining the mechanical fastening part virtual body corresponding one-to-one to the mechanical fastening part, and making the defined mechanical fastening part virtual body appear in the virtual space.

Abstract: An electronic device and a method for tracking an object thereof are provided. The electronic device identifies whether there is a first object being tracked, when obtaining an image and rotation information of a camera of the electronic device, corrects state information of the first object using the rotation information, when there is the first object, detects a second object matched to the first object from the image based on the corrected state information, and tracks a position of the second object using an object tracking algorithm.

Abstract: Methods, systems, and mobile devices for providing users with social media-related information about other users based on the relative geographic locations of the users.

Abstract: A method to measure a cognitive load based upon ocular information of a subject includes the steps of: providing a video camera configured to record a close-up view of at least one eye of the subject; providing a computing device electronically connected to the video camera and the electronic display; recording, via the video camera, the ocular information of the at least one eye of the subject; processing, via the computing device, the ocular information to identify changes in ocular signals of the subject through the use of convolutional neural networks; evaluating, via the computing device, the changes in ocular signals from the convolutional neural networks by a machine learning algorithm; determining, via the machine learning algorithm, the cognitive load for the subject; and displaying, to the subject and/or to a supervisor, the cognitive load for the subject.

Abstract: In examples, a saliency metric may be determined for an instance of content and/or a location of a digital environment. Accordingly, a set of candidate content and/or locations may be ranked according to associated saliency metrics, such that content and/or an associated location with which to adapt the digital environment for a given user may be determined from a set of candidates. For example, the digital environment may be adapted to present a two-dimensional or a three-dimensional asset to a user. As another example, a game mechanic of the digital environment may be altered. In examples, content from another digital environment may be identified and used to adapt the digital environment, thereby incorporating external content. Thus, a saliency metric associated with a location or an instance of content may be used to programmatically generate a relative or absolute metric with which to evaluate and adapt aspects of the digital environment.

Abstract: A processor may receive environment data associated with a smart environment having one or more intelligent environment device. A processor may analyze the environment data and intelligent environment device information, wherein the intelligent environment device information is associated with the intelligent environment device. A processor may generate a simulation based, at least in part on, the environment data and the intelligent environment data. A processor may identify one or more hazards in the smart environment from the simulation, wherein the one or more hazards are associated with the one or more intelligent environment devices.

Abstract: Apparatus and methods of artificial intelligent based provision of digital content where and when the digital content is needed based upon where a user is located and a purpose for accessing the content as well as credentials of a user seeking to access the digital content. Persistent digital content is linked to location coordinates. More specifically, the present invention links a physical onsite location with digital content to enable a user interface with augmented reality that combines aspects of the physical area with location specific digital content. In addition, access to digital content may be limited to users in defined access areas.

Abstract: An augmented reality-based acoustic analysis method includes identifying structural elements of a space and determining structural parameters of the structural elements and a structural parameter of the space. The method further includes displaying, by an augmented reality (AR) device, a virtual lighting fixture model on a viewport of the AR device, where the virtual lighting fixture model is overlaid on a real-time image of the space. The method also includes determining, by the AR device, a sound reverberation time of the space based on at least a sound absorption parameter associated with the virtual lighting fixture model and a sound absorption parameter of the space determined based on the structural parameters of the structural elements and the structural parameter of the space.

Abstract: Described herein are a system and methods for generating a record of objects, as well as respective positions for those objects, with respect to a user. In some embodiments, a user may use a user device to scan an area that includes one or more objects. The one or more objects may be identified from image information obtained from the user device. Positional information for each of the one or more objects may be determined from depth information obtained from a depth sensor installed upon the user device. In some embodiments, the one or more objects may be mapped to object models stored in an object model database. The image information displayed on the user device may be augmented so that it depicts the object models associated with the one or more objects instead of the actual objects.

Abstract: The present application provides a virtual reality-based derailment accident passenger comfort degree monitoring system and method, wherein the system comprises a train dynamics calculation module, a train operation state virtual simulation module, a six-degree-of-freedom motion platform, a train seat, a head-mounted display, a human body monitoring sensor system and a monitoring data storage terminal. The system establishes a database of the injury degrees of passengers with different ages under the train derailment; the test cost is low, the safety coefficient is high, and the repeatability of the test conditions is good, wherein the comfort degree test data of the passengers under the same derailment inducement can be repeatedly obtained; the safety risk in the actual test is eliminated, so that the authenticity of the test result is ensured, and the test cost is low and the repeatability is high.

Abstract: An information processing device according to an embodiment includes a detection unit, a determination unit, and a display control unit. The detection unit detects a wearing state of a wearer with respect to a display device that has optical transparency and projects a plurality of content images duplicated from a single content image toward the eyeballs of the wearer. The determination unit determines whether or not the mounting misalignment is occurring with the wearer on the basis of the detection result of the wearing state detected by the detection unit. In a case where the determination unit determines that the mounting misalignment is occurring, the display control unit displays a notification regarding the mounting misalignment on the display device.

Abstract: A method for authenticating a communication session in a metaverse environment may be provided. The method may include authenticating a user device and an entity associated with the virtual kiosk in order to initiate the communication session. The authenticating of the user device may include confirming that a selected base 3D mesh matches a pre-selected base 3D meshes stored within an identity profile associated with the user's device. In response to the confirming, the method may include authenticating the user's device. The method may further include authenticating the virtual kiosk by distorting the pre-selected base 3D mesh to generate a distorted base 3D mesh and comparing the distorted base 3D mesh to a static distorted base 3D mesh stored at the user's device. The method may also include confirming that the generated distorted base 3D mesh matches the static distorted base 3D mesh and authenticating the virtual kiosk.