Abstract: The present invention relates to an image output device mounted on a vehicle so as to implement augmented reality, and a control method therefor. At least one from among an autonomous vehicle, a user terminal, and a server of the present invention can be linked with an artificial intelligence module, a drone (unmanned aerial vehicle, UAV), a robot, an augmented reality (AR) device, a virtual reality (VR) device, a device related to a 5G service, and the like.

Abstract: A method for foreground and background segmentation related to a virtual three-dimensional (3D) video conference, the method may include segmenting each image of multiple images of a video stream, to segments, each segment has one or more properties that are constant; determining temporal properties of the segments; and classifying each segment as a background segment or a foreground segment, based at least in part, on the temporal properties of the segments.

Abstract: A method for displaying a virtual object is disclosed, applied to an electronic device (10) having a display component (323) and a camera (324). The method includes: detecting an operation of starting an application by a user; in response to the operation, downloading a global submap and storing the global submap in a simultaneous localization and mapping SLAM system of the electronic device (10), where the global submap (123) is a submap corresponding to a location of the electronic device (10) in a global map; and displaying a location and a posture of the virtual object on the display component (323), where the location and the posture of the virtual object are obtained by performing pose calculation based on at least a video image collected by the camera (324) and the global submap (123).

Abstract: Some embodiments provide a mobile device configured to guide a user, via an augmented reality (AR) interface generated by the mobile device, to capture images of the physical object using a camera of the mobile device. The mobile device may be configured to obtain boundary information indicative of a boundary enclosing the physical object (e.g., a box enclosing the physical object). The mobile device may be configured to use the boundary information to determine positions from which the user is to capture images of the physical object. The mobile device may be configured to guide the user to capture the images using the AR interface by guiding the user to each of the positions in the AR interface (e.g., by generating on or more GUI elements in the AR interface that indicate a position from which the user is to capture an image).

Abstract: An image processing apparatus includes one or more processors, and a memory storing instructions which, when the instructions are executed by the one or more processors, cause the image processing apparatus to function as an acquisition unit configured to acquire image signals from an image capturing element in which a plurality of pixels that receive rays of light having passed through different pupil areas of an image forming optical system is arrayed, a combining unit configured to, based on the image signals acquired by the acquisition unit, combine virtual objects with the respective image signals corresponding to the different pupil areas to generate a pair of mixed reality images, and a focus adjustment unit configured to adjust a lens position of the image forming optical system based on an image defocus amount between the pair of mixed reality images.

Abstract: Systems and methods described herein provide for retrieving, from a storage device, first image data previously captured by a client device. The systems and methods further detect a selection of a first image processing operation and perform the first image processing operation on the first image data to generate second image data. The systems and methods further detect a selection of a second image processing operation and perform the second image processing operation on the second image data to generate third image data. The systems and methods generate a message comprising the third image data.

Abstract: The present invention provides an optical device for augmented reality having an external light leakage prevention function, the optical device including: an image output unit configured to output image light corresponding to an image for augmented reality; at least one reflective unit configured to transfer the image light to the pupil of an eye of a user by reflecting the image light; and an optical means configured such that the reflective unit is disposed therein and it transmits at least part of image light, output from a real object, therethrough toward the pupil; wherein the at least one reflective unit is formed to have a size of 4 mm or less, and includes a first surface configured to reflect the former image light toward the pupil and a second surface which is a surface opposite to the first surface; and wherein the second surface is made of a light absorbing material.

Abstract: An auxiliary system for intelligent well control includes augmented reality (AR) glasses, a server, and a first sensor group. The first sensor group is configured to collect real-time data of a wellbore and the surface and transmit the real-time data to the server. The server is configured to analyze a target pressure value of a choke valve of the surface according to the real-time data, obtain an actual pressure value of the choke valve of the surface from the real-time data, and transmit the actual pressure value and the target pressure value to the AR glasses. The AR glasses are configured to dynamically display the actual pressure value and the target pressure value in real time. Through the first sensor group and the server, the actual pressure value and the target pressure value can be accurately received by an operator in real time.

Abstract: An apparatus and method are described for a non-uniform rasterizer. For example, one embodiment of an apparatus comprises: a graphics processor to process graphics data and render images using the graphics data; and a non-uniform rasterizer within the graphics processor to determine different resolutions to be used for different regions of an image, the non-uniform rasterizer to receive a plurality of polygons to be rasterized and to responsively rasterize the polygons in accordance with the different resolutions.

Abstract: Data related to the adherence of a patient to a therapy regime can be collected from multiple medical devices, each of which may have an incomplete data set with data entries associated with times. Each incomplete data set represents a portion of a complete data set. The data sets can be integrated to create a complete data set with data entries from each incomplete data set being arranged in a temporal sequence with respect to one another. A report may be generated, the report having the data entries of the complete data set or a function of the data entries of the complete data set.

Abstract: In one embodiment, a method includes receiving a source image and its associated parameters from each of multiple image sources, associating each of the source images with a layer in a range of layers based on the parameters associated with the source images, the range of layers specifying a composition layering order of the source images, generating a corresponding customized distortion mesh for each particular source image in the source images based on the parameters associated with the particular source image and at least a portion of the parameters associated with each of the source images that is associated with any layer preceding a layer associated with the particular source image, modifying each of the source images using the corresponding customized distortion mesh, generate a composite image using the modified source images, and display the composite image as a frame in a video.

Abstract: Systems and methods are described for improved color rendering. In some embodiments, video is captured of a real-world scene, and a region of screen content is detected in the captured video. A processor selectively applies a screen-content color transformation on the region of screen content to generate processed video, and the processed video is displayed substantially in real time, for example on a video-see-through head-mounted display. The screen-content color processing may be different for different types of external displays. The screen-content color processing may also be determined based at least in part on illumination conditions. In some embodiments, the color of displayed virtual objects is adjusted based on visual parameters of the screen content.

Abstract: Methods, devices, and apparatuses are provided to facilitate a positioning of an item of virtual content in an extended reality environment. For example, a placement position for an item of virtual content can be transmitted to one or more of a first device and a second device. The placement position can be based on correlated map data generated based on first map data obtained from the first device and second map data obtained from the second device. In some examples, the first device can transmit the placement position to the second device.

Abstract: An object tracking system that includes a sensor and a tracking system. The sensor configured to capture a frame of at least a portion of a rack within a global plane for a space. The tracking system is configured to detect an item was removed from the rack. The tracking system is further configured to receive the frame of the rack, to identify a marker on an item within a predefined zone in the frame, and to identify the item associated with the identified marker. The tracking system is further configured to determine a pixel location for a person, to determine the person is within the predefined zone associated with the, and to add the identified item to a digital cart associated with the person.

Abstract: A computing device enhances digital content on a display based on a distance to an individual from the computing device. The computing device detects an individual in the environment around the computing device and determines a distance from the computing device to the individual. The computing device enhances the information included in the digital content when the distance is within a first threshold distance from the computing device. Similarly, the computing device removes information included in the digital content when the distance is outside of a second threshold distance from the computing device.

Abstract: An electronic device, computer program product, and method enhance an augmented reality (AR) display by visually tethering notification content to an identified object. The electronic device includes at least one network interface that communicatively connects the electronic device to the AR display device. A controller of the electronic device is communicatively coupled to the at least one network interface. The controller receives an image stream from a field of view (FOV) of the AR display device. The controller identifies at least one object within the image stream. The controller generates notification content associated with a particular object of the at least one object. The controller presents, at the AR display device, the notification content visually tethered to the particular object.

Abstract: A contextual filter system configured to perform operations that include, capturing an image frame at a client device, wherein the image frame includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image frame, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image frame at the client device.

Abstract: In one embodiment, a method includes rendering, for a VR display device and based on a field of view of a user, a first output image of a VR environment comprising a virtual boundary corresponding to a real-world environment; determining, responsive to the user approaching within a first threshold distance of the virtual boundary, a speed of movement and the field of view of the user; accessing one or more images of the real-world environment captured by one or more cameras of the VR display device; and rendering, for the VR display device, a second output image comprising a portion of the VR environment and a portion of a passthrough view of the real-world environment based on the accessed images, where an area of the portion of the passthrough view is based on the determined speed of movement and the field of view of the user.

Abstract: A computing device generates a first set of glyphs from a first data set. Each glyph in the first set of glyphs represents the same set of user-selected columns in a first row of the plurality of rows in the data set. For each glyph in the first set of glyphs, the computing device defines a set of marks to be displayed. Each mark is defined by one or more visual features, with a respective visual feature assigned to each column of the user-selected columns. Each visual feature is displayed with a visual property determined based on a data value in the first row for the respective column. A user specifies a specific visual feature for a first mark from the first set of glyphs. The computing device generates a second set of glyphs. Each glyph in the second set of glyphs includes a mark with the specific visual feature.

Abstract: Systems and methods are provided for providing a timeline representing a culture media protocol for a culture medium. Providing a timeline representing a culture media protocol can include receiving the culture media protocol for the culture media generating the timeline on a user interface based on the culture media protocol, monitoring time on the timeline, receiving one or more culture media images related to the culture media protocol, associating each of the one or more culture media images with a position on the timeline that correlates to a time at which the culture media image was captured, and generating a selectable marker for each culture media image associated with the timeline, the selectable marker being aligned with the position on the timeline that correlates to the time at which the culture media image was captured.