Abstract: A system receives image data associated with an item, where the image data comprising a view of the item from two or more angles; determines physical attributes of the item; generates a base model of the item; samples the base model to generate one or more sampled models, each of the one or more sampled models comprising a subset of the geometric data, the subset of the geometric data determined based on one or more device characteristics of one or more user devices that interface with the system; receives device characteristics of a user device associated with a request from the user device for the item; selects, based on the received device characteristics, a sampled model of the item; and transmits a data object comprising the selected sampled model to the user device to cause the user device to generate a three-dimensional rendering of the item.

Abstract: Various embodiments of the invention pertain to an augmented reality interface for facilitating identification of an arriving vehicle and/or a passenger that improve upon some or all of the above-described deficiencies. According to some embodiments of the invention, a mobile device may be used by a passenger to scan scenery. The mobile device may determine whether and where a requested vehicle is located and display an indicator of the requested vehicle on the mobile device. Similarly, a mobile device may be used by a driver to scan scenery. The mobile device may determine whether and where a passenger is located and display an indicator of the requesting passenger on the mobile device.

Abstract: Embodiments of the present disclosure provide a display method based on augmented reality, a device, a storage medium, and a program product, a real-time scene image is acquired, then a head image of a target object is acquired from the real-time scene image if the real-time scene image includes a face image of the target object, where the head image of the target object includes the face image of the target object; a virtual image of the target object is generated according to the head image; and the virtual image of the target object is displayed in the real-time scene image based on an augmented reality display technology.

Abstract: The subject technology retrieves, by a client device from a storage device, first image data captured by the client device at a previous time. The subject technology receiving first metadata corresponding to a selected image processing operation. The subject technology generates second image data based on the first metadata and the image processing operation performed on the first image data. The subject technology generates second metadata comprising information related to the image processing operation, the second metadata including a first identifier associated with the first image data, and second identifier associated with the second image data. The subject technology generates a message comprising the second metadata, the second image data, and the first image data.

Abstract: An augmented reality system is provided for use with a medical imaging scanner. The AR system obtains a digital image from a camera, and identifies a pose of a gantry of the medical imaging scanner based on content of the digital image. The gantry includes a movable C-arm supporting an imaging signal transmitter and a detector panel that are movable along an arc relative to a station. A range of motion of the movable C-arm along the arc is determined based on the pose. A graphical object is generated based on the range of motion and the pose, and is provided to a display device for display as an overlay relative to the medical imaging scanner.

Abstract: A VR sickness reduction system, a head-mounted display, a VR sickness reduction system, and a program are provided that may reduce VR sickness. An HMD includes a display section positioned in front of a user when the head-mounted display is mounted on the user. A rocking section may rock a head of the user on which the HMD is mounted. An entertainment apparatus causes the display section to display a moving image representing a state viewed from a point of view. The entertainment apparatus controls rocking of the rocking section depending on an acceleration status of the point of view in the moving image displayed on the display section.

Abstract: Systems, computer-implemented methods, and computer program products to facilitate automatic multi-dimensional model generation and tracking in an augmented reality environment are provided. According to an embodiment, a system can comprise a processor that executes computer executable components stored in memory. The computer executable components comprise a label component that annotates a multi-dimensional point cloud representation of an object present in augmented reality data. The computer executable components further comprise a content generation component that generates a multi-dimensional model of a component of the object based on the multi-dimensional point cloud representation.

Abstract: Attributes of graphics objects are processed in a plurality of graphics processing pipelines. A streaming multiprocessor (SM) retrieves a first set of parameters associated with a set of graphics objects from a first set of buffers. The SM performs a first set of operations on the first set of parameters according to a first phase of processing to produce a second set of parameters stored in a second set of buffers. The SM performs a second set of operations on the second set of parameters according to a second phase of processing to produce a third set of parameters stored in a third set of buffers. One advantage of the disclosed techniques is that work is redistributed from a first phase to a second phase of graphics processing without having to copy the attributes to and retrieve the attributes from the cache or system memory, resulting in reduced power consumption.

Abstract: A method, implemented by a computer system, and a system of organizing data of a wide area motion imagery frame and a method and a system of retrieving objects that match a user defined AOI from an image in a WAMI frame in a WAMI collection are described. The method of organizing includes dividing, by the computer system, an image of a WAMI frame into a plurality of tiles, each tile in the plurality of tiles comprising a plurality of pixels and having a pixel width and a pixel height; storing, by the computer system, the plurality of tiles as objects in an OSD, each object having an object identifier (OID); collecting, by the computer system, object identifiers (OIDs) of the objects; and storing, by the computer system, the OIDs in the OSD.

Abstract: The embodiment of the present disclosure discloses an image processing method, apparatus, electronic device and computer readable storage medium. The image processing method includes identifying a first object in a first video frame image and a second object located in the first object; in accordance with a position of the first object in the first video frame image, overlaying a third object as a foreground image on the first video frame image to obtain a second video frame image; wherein the third object overlays the first object in the second video frame image; in accordance with a position of the second object in the first video frame image, overlapping the second object as a foreground image on the third object of the second video frame image to obtain a third video frame image.

Abstract: Various implementations disclosed herein include devices, systems, and methods for controlling motion of CGR objects. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, a method includes determining, by a first animation controller, values for a first set of animation parameters associated with a first animation for a computer-generated reality (CGR) object. In some implementations, the CGR object is associated with a plurality of joints. In some implementations, the method includes generating, by a motion controller, respective joint movements for the plurality of joints based on the values for the first set of animation parameters. In some implementations, the method includes manipulating the CGR object in accordance with the respective joint movements for the plurality of joints in order to provide an appearance that CGR object is moving within a degree of similarity to the first animation.

Abstract: In one embodiment, a medical system includes a catheter including electrodes, and configured to be inserted into a chamber of a heart and maneuvered among sampling sites to sample electrical activity, a display, and processing circuitry to receive signals provided by the catheter, and compute, for each sampling site, a sampling position of the catheter and respective electrode positions of the catheter electrodes, render to the display a 3D representation of the chamber including respective sampling-site markers indicating the computed sampling position of the catheter at respective ones of the sampling sites, receive a user input selecting one sampling-site marker, and update the 3D representation to include electrode markers indicating the respective electrode positions of the respective catheter electrodes while the catheter was sampling the electrical activity of the tissue at the sampling site corresponding to the selected sampling-site marker.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately and flexibly generating modified digital images utilizing a novel swapping autoencoder that incorporates scene layout. In particular, the disclosed systems can receive a scene layout map that indicates or defines locations for displaying specific digital content within a digital image. In addition, the disclosed systems can utilize the scene layout map to guide combining portions of digital image latent code to generate a modified digital image with a particular textural appearance and a particular geometric structure defined by the scene layout map. Additionally, the disclosed systems can utilize a scene layout map that defines a portion of a digital image to modify by, for instance, adding new digital content to the digital image, and can generate a modified digital image depicting the new digital content.

Abstract: Unveiling of chimeric biomolecule sequences and applications thereof are described. Generally, systems comprising statistical analysis are performed to unveil chimeric biomolecule sequences from sequencing data sets. Bloom filters and hierarchical bloom filter tree data structures can be constructed such that chimeric sequence unveiling systems are more efficient. Finally, chimeric sequences are used to develop research tools, diagnostics, and medicaments.

Abstract: Processes for reviewing and editing a computer-generated animation are provided. In one example process, multiple images representing segments of a computer-generated animation may be displayed. In response to a selection of one or more of the images, geometry data associated with the corresponding segment(s) of computer-generated animation may be accessed. An editable geometric representation of the selected segment(s) of computer-generated animation may be displayed based on the accessed geometry data. In some examples, previously rendered representations and/or geometric representations of the same or other segments of the computer-generated animation may be concurrently displayed adjacent to, overlaid with, or in any other desired manner with the displayed geometric representation of the selected segment's) of computer-generated animation.

Abstract: A camera tracking system is disclosed for computer assisted navigation during surgery. The camera tracking system is configured to identify a reference array tracked by a set of tracking cameras attached to an extended reality (XR) headset, and determine whether the reference array is registered as being paired with characteristics of one of a plurality of surgical tools defined in a surgical tool database. The camera tracking system is further configured to, based on the reference array being determined to not be registered and receiving user input, register the reference array to be paired with characteristics of one of the plurality of surgical tools selected based on the user input. The camera tracking system is further configured to provide a representation of the characteristics to a display device of the XR headset for display to the user.

Abstract: A viewing system or imaging system is disclosed that includes optical pieces for viewing a subject. The viewing system may include features that allow an augmented mixed view through eyepieces of the viewing system. The mixed view may include graphical representations that are acquired or determined with information separate from the viewing system.

Abstract: A Head-Mounted Display (HMD) is provided which comprises a camera configured to capture a video of a real-world scene with a first field-of-view (FoV), a network interface circuit configured to stream video to a receiving display device, and processing means which is operative to generate a 3D model of the real-world scene, and to generate a video from the 3D model using a second FoV which is wider than the first FoV. The processing means is further operative to estimate a motion of the camera, and to stream the generated video to the receiving display device if the estimated motion of the camera satisfies one or more conditions indicative of rapid motion, else stream the captured video to the receiving display device.

Abstract: An electronic device and method for generating an augmented image. The device includes an image sensor and an electronic processor. The electronic processor is configured to receive an image, retrieve a set of keywords, and identify a first set of features within the image corresponding to at least one keyword from the set of keywords, producing first metadata. The electronic processor is configured to compress the image, identify a second set of features within the compressed image, producing second metadata, and determine missing metadata between the first metadata and the second metadata. The electronic processor is configured to generate an augmented image by associating the missing metadata to the compressed image and perform at least one selected from the group consisting of transmitting the augmented image to another device and decompressing the augmented image to create a decompressed image and presenting the decompressed image including the missing metadata.

Abstract: A method includes tagging, by at least one processor, one or more three-dimensional assets with a unique identifier and storing the one or more three-dimensional assets in a database, creating, by the at least one processor, a three-dimensional model based on the one or more three-dimensional assets and loading the three-dimensional model in a simulator, generating, by the at least one processor, a two-dimensional image that is a representation of the three-dimensional model in the simulator, the two-dimensional image comprising metadata that includes each unique identifier for each three-dimensional asset of the three-dimensional model displayed in the two-dimensional image, and assigning, by the at least one processor, the two-dimensional image with a unique identifier and storing each unique identifier for each three-dimensional asset of the three-dimensional model displayed in the two-dimensional image in metadata for the two-dimensional image.