Abstract: In a display device 100, a photographing unit 12 is configured to photograph the surroundings of the display device 100, and the recognizing unit 16 is configured to recognize a clock 300 (a real object regarding a time or date) from a result of the photographing. When the recognizing unit 16 recognizes the clock 300, the schedule obtaining unit 11 is configured to obtain schedule information, and the display controller 17 is configured to display and output the schedule information in accordance with a position of the clock 300. In this case, since the display device 100 displays the schedule information in accordance with the position of the clock 300, the schedule information can be displayed in association with actual environment, and the schedule information can be outputted in a format that is easier to recognize the schedule information.

Abstract: Systems and methods are described for improved sharing of an experience between users. A first image captured using a first user device is received by control circuitry. A second image captured using a second user device is received by the control circuitry. Control circuitry determines a first set of elements of the first image. Control circuitry determines a second set of elements of the second image. Control circuitry determines whether at least one element of the first set of elements corresponds to at least one element of the second set of elements. Control circuitry determines that a transient element is present in the first set of elements and is not present in the second set of elements. Control circuitry generates for display the transient element on the second user device.

Abstract: A system and method for adaptive volume-based scene reconstruction for XR platform application are provided. The system includes an image sensor and a processor to perform the method for display distortion calibration. The method includes determining a processor computation load. The method also includes, based on the determined computation load, adjusting one or more parameters for the 3D scene reconstruction to compensate for the determined computation load. The method further includes rendering a reconstructed 3D scene.

Abstract: Systems and methods for overlaying virtual objects in a virtual environment based on user interest and user interactions are disclosed. The methods analyze a live view of a surface viewed through camera or a transparent lens and determine if the policies of the surface allow overlaying of virtual objects. The method fetches a virtual object and calculates a score based on user interest, user gaze, and user engagement. Virtual objects that meet the policies of the surface and a scoring criterion are overlayed on the surface in the virtual environment and enhanced based on a plurality of enhancement factors. Virtual objects are also overlayed in frames of a live broadcast based on their scores. Virtual objects displayed on a conference call interface, which may be meeting tools or icons associated with other conferencing functionality, are enhanced, or removed from the user interface based on their utilization.

Abstract: An augmented reality device is provided. The augmented reality device includes a display, a camera, a sensor, and at least one processor, wherein the at least one processor is configured to detect a gaze direction of a user by using the sensor, capture a first image in the gaze direction of the user by using the camera, recognize a first object included in the captured first image, generate first object data including first content classification information to which the recognized first object belongs, acquire, based on the first object data, first priority data including a priority for the first content classification information, select, based on the acquired first priority data, a first object of interest among at least one object included in the first image acquired using the camera, and display a first augmented reality content including information on the selected first object of interest.

Abstract: A method for real-time shadow rendering using cached shadow maps and deferred shading by a video processor of a game console or the like includes, for at least each key frame of video output, determining a viewpoint for a current key frame based on user input, filtering a texel of a frame-specific shadow map based on a dynamic mask wherein the texel is filtered, for a shadowed light, from a static shadow map and a dynamic shadow map or from the static shadow map only, based on the dynamic mask value for the texel, and rendering the current key frame based on the frame-specific shadow map and a deferred-shadow rendering algorithm. The method enables efficient rendering of thousands of shadowed lights in large environments by consumer-grade game consoles.

Abstract: A method includes, while presenting a representation of a physical environment of the device, obtaining contextual data that indicates a characteristic of the physical environment, the device or a user of the device, and obtaining an indication of historical content associated with the device. The method includes determining, based on the characteristic indicated by the contextual data and the historical content, a user interest value that indicates a user interest level in the physical environment. The method includes storing an image captured by an image sensor in response to the user interest value being greater than a threshold interest value.

Abstract: A method for resolving body-garment collisions in avatars for immersive reality applications is provided. The method includes forming a two-dimensional projection of a dressed avatar in an immersive reality application running in a headset, identifying, from the two-dimensional projection, an area that includes a garment collision, and replacing a pixel in the area that includes the garment collision, with a pixel indicative of a garment for the dressed avatar, to form a new two-dimensional projection of the dressed avatar. A system and a non-transitory, computer-readable medium storing instructions to perform the above method, are also provided.

Abstract: A method generating an image according to a style is described. The method includes receiving a textual description describing a first image. The method further includes applying an artificial intelligence (AI) model to determine the style of a second image based on the textual description, the first image, a plurality of descriptions, and a plurality of images to generate a suggestion. The style provides a context to the second image. The style is lacking in the first image. The method includes generating the second image with the suggestion according to the style and providing the second image to a client device for display.

Abstract: A method, device, and computer-readable storage medium for generating a proxy mesh are disclosed. The method includes: receiving a reference mesh, wherein the reference mesh comprises a polygonal mesh that is a computer representation of a three-dimensional (3D) object; computing quadrics corresponding to the reference mesh; receiving a second polygonal mesh, wherein the second polygonal mesh comprises a polygonal mesh generated based on the reference mesh; transferring the quadrics corresponding to the reference mesh to the second polygonal mesh; and generating a proxy mesh based on the quadrics corresponding to the reference mesh transferred to the second polygonal mesh.

Abstract: Systems and methods for providing augmented reality overlay displays related to repairs may include obtaining sensor data associated with a home or vehicle and analyzing the sensor data associated to identify a vehicle component and/or home appliance that is not functioning properly. Repairs for the vehicle component and/or home appliance that is not functioning properly may be identified, and a determination may be made as to whether it is safe for a vehicle operator and/or home resident to perform the repair. If so, an augmented reality overlay display may be presented upon images/video of the vehicle/home captured in real time, identifying vehicle/home components that must be manipulated in order to perform the repair. If not, the augmented reality display may identify portions of the vehicle or home of which the vehicle operator must capture images in order to request a professional repair or submit an insurance claim.

Abstract: Systems and methods are described for adjusting streaming of screen data from a server to a client based on visibility of the window in which the screen data is presented on the client. Visibility of a window in the graphical user interface (GUI) can be monitored, for example by detecting when the window is minimized or obscured by other objects in the GUI, and the streaming of screen data to the window can be dynamically adjusted based on the window visibility. When the window is minimized or fully obscured, the streaming of screen data can be stopped. When the window is partially obscured, the streaming can be modified such as by decreasing the frame rate.

Abstract: Embodiments are related to providing external device communication and localization for virtual reality based equipment using radio-frequency identification (RFID). At least two receivers and a transmitter are used to recognize an external device and determine a location of the external device relative to the headset, based on tags coupled to the external device. A three-dimensional (3D) model is downloaded of the external device based on information received by the at least two receivers from the tags. A location of the external device is matched to the 3D model based on the tags. A virtual image is displayed of the external device corresponding to the location of the external device.

Abstract: A method of generating a 3D model for digital dentistry using a virtual bridge based multi input Boolean operation, includes generating a first group model by generating a first virtual bridge connecting models spaced apart from each other among first input models of a first input group when the models are spaced apart from each other among the first input models, generating a second group model by generating a second virtual bridge connecting models spaced apart from each other among second input models of a second input group when the models are spaced apart from each other among the second input models, generating a first result model by a Boolean operation of the first group model and the second group model and removing a remaining first virtual bridge or a remaining second virtual bridge when the first virtual bridge or the second virtual bridge remains in the first result model.

Abstract: Telematics systems and methods are described for generating interactive animated guided user interfaces (GUIs). A telematics cloud platform is configured to receive vehicular telematics data from a telematics device onboard a vehicle. A GUI value compression component determines, based on the vehicular telematics data, a plurality of GUI position values and a plurality of corresponding GUI time values. A geospatial animation app receives the plurality of GUI position values and the plurality of corresponding GUI time values. The geospatial animation app implements an interactive animated GUI that renders a plurality of geospatial graphics or graphical routes on a geographic area map via a display device. The geospatial graphics or graphical routes are rendered to have different visual forms based on differences between respective GUI position values and corresponding GUI time values.

Abstract: A virtual background associated with a first user of a virtual meeting is identified. In response to identifying the virtual background associated with the first user, a device associated with a second user of the virtual meeting is synchronized to use the virtual background during the virtual meeting. A composite video depicting the first user or the second user overlaid on the virtual background is generated for display on a device connected to the virtual meeting.

Abstract: A display apparatus is provided. The display apparatus includes: a display with a first display module and a second display module; a timing controller; a communication interface; and one or more processor configured to, based on content received from a plurality of source devices through the communication interface in a multi-view mode, control the display to display the received content through different regions on the display, identify a first frame rate of first content received from a first source device and a second frame rate of second content received from a second source device, control the timing controller to control the first display module to operate at the first frame rate, and control the timing controller to control the second display module to operate at the second frame rate.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a method comprises: receiving, by one or more processors of a cloud computing platform, context data from a wearable multimedia device, the wearable multimedia device including at least one data capture device for capturing the context data; creating a data processing pipeline with one or more applications based on one or more characteristics of the context data and a user request; processing the context data through the data processing pipeline; and sending output of the data processing pipeline to the wearable multimedia device or other device for presentation of the output.

Abstract: A system may access an image that is captured by an imaging device and that depicts an operational scene illuminated by close-range light. The system may also access a depth map of the operational scene. Based on the image and the depth map, the system may generate a processed image depicting the operational scene as being illuminated by a virtual light source that is to be simulated to be illuminating the operational scene and may provide the processed image for presentation on a display screen. Corresponding systems and methods are also disclosed.

Abstract: Systems and methods for simultaneously being present in multiple extended reality (XR) apps running on the same XR device are disclosed. The methods concurrently run multiple XR apps on the user's XR device and use an avatar to represent the user's presence in each app. The methods determine whether the user is actively present in a first app or a second app. When the user is not actively present in a first app, activity in the first app is monitored, the avatar is configured to provide auto-responses based on AI, ML, or preprogrammed responses for relevant queries to simulate the user's presence. Notifications and summary of the activities in the first app are provided to the user while they are actively present in the second app. Instead of rendering the first app, back-end simulations of the activities in the first app are processed and made available when rendering is resumed.