Abstract: Methods and systems are disclosed for generating AR experiences. The methods and systems access a first component of a plurality of components implemented by the messaging application, the plurality of components comprising an AR experience, each of the plurality of components being configured to be separately launched by the messaging application. The methods and systems store a first state of the first component in a data structure that is shared across the plurality of components; launching. The methods and system launch, by the messaging application, a second component of the plurality of components in response to determining that an interaction has been performed using the first component; and configure a second state of the second component based on the interaction that has been performed using the first component.

Abstract: An image processing system includes a computing platform having a hardware processor and a system memory storing an image augmentation software code, a three-dimensional (3D) shapes library, and/or a 3D poses library. The image processing system also includes a two-dimensional (2D) pose estimation module communicatively coupled to the image augmentation software code. The hardware processor executes the image augmentation software code to provide an image to the 2D pose estimation module and to receive a 2D pose data generated by the 2D pose estimation module based on the image. The image augmentation software code identifies a 3D shape and/or a 3D pose corresponding to the image using an optimization algorithm applied to the 2D pose data and one or both of the 3D poses library and the 3D shapes library, and may output the 3D shape and/or 3D pose to render an augmented image on a display.

Abstract: Various implementations disclosed herein include devices, systems, and methods that generate floorplans and measurements using a three-dimensional (3D) representation of a physical environment generated based on sensor data.

Abstract: A method for providing augmented reality content includes identifying a customer at a customer interaction location, retrieving customer-specific interaction data, determining locations of a customer service representative in an area adjacent to a first side of a transparent panel and the customer in an area adjacent to a second side of the transparent panel, and projecting an augmented reality element to the first side of a transparent panel, the augmented reality element displaying the customer-specific interaction data on the first side of the transparent panel.

Abstract: An augmented reality customer interaction system includes a transparent panel having a first side and a second side that is opposite to the first side, and a camera device configured to capture visual data from an area adjacent to the second side of the transparent panel. The visual data includes identifying features of a customer located in the area with respect to the second side of the transparent panel. The system further includes a projection system configured to project information on the first side of the transparent panel. The information projected on the first side of the transparent panel may include customer interaction data retrieved from a data store based on the identifying features of the customer.

Abstract: Techniques related to performing object or person association or correspondence in multi-view video are discussed. Such techniques include determining correspondences at a particular time instance based on separately optimizing correspondence sub-matrices for distance sub-matrices based on two-way minimum distance pairs between frame pairs, generating and fusing tracklets across time instances, and adjusting correspondence, after such tracklet processing, via elimination of outlier object positions and rearrangement of object correspondence.

Abstract: In a ray tracer, to prevent any long-running query from hanging the graphics processing unit, a traversal coprocessor provides a preemption mechanism that will allow rays to stop processing or time out early. The example non-limiting implementations described herein provide such a preemption mechanism, including a forward progress guarantee, and additional programmable timeout options that can be time or cycle based. Those programmable options provide a means for quality of service timing guarantees for applications such as virtual reality (VR) that have strict timing requirements.

Abstract: Systems, methods, and apparatus are provided for developing and applying a metaverse enabled digital cognitive twin. Customer communications may be secured at a data layer using multi-cloud object storage. A first multi-modal AI system may generate segmented customer activity data from the customer communications and output the segmented customer activity data to a set of decentralized streaming caches. At an extended reality platform, a second multi-modal AI system may generate immersive content from a real time customer input and the segmented customer activity data for viewing in an XR environment. The system may train an XR avatar based at least in part on the customer communications. The XR avatar may interact with customers and agents and may present a video together with customized supplementary information. The immersive video and the XR avatar may be generated by a plug-in application configured to adapt a variety of XR platforms.

Abstract: Systems and methods for four-dimensional analysis of a patient's coronary arteries and myocardial wall. An example method includes accessing angiographic x-ray images of one or more arteries, with the x-ray images depicting the arteries from respective angles, with each x-ray image being associated with a cardiac phase of cardiac phases, and with the cardiac phases being included in a cardiac cycle. A three-dimensional model of the arteries is generated for each cardiac phase based on a subset of the x-ray images which are associated with the cardiac phase. A four-dimensional representation of the arteries is generated throughout the cardiac cycle based on the three-dimensional models for the cardiac phase. Information associated with the four-dimensional presentation is presented.

Abstract: Aspects of the disclosure provide methods and apparatuses for mesh coding (e.g., compression and decompression). In some examples, an apparatus for mesh coding includes processing circuitry. The processing circuitry decodes an array of attributes from a bitstream carrying a three dimensional (3D) mesh frame that includes a plurality of patches. The array of attributes corresponds to vertices of the 3D mesh frame. The vertices of the 3D mesh frame are ordered into subsets respectively belonging to the plurality of patches. The processing circuitry determines a first portion of the array of attributes corresponding to a first subset of the vertices of the 3D mesh frame. The first subset belongs to a first patch in the plurality of patches. The processing circuitry determines first connectivity information of the first subset of the vertices, and reconstructs the first patch of the 3D mesh frame based on the first portion of the array of attributes and the first connectivity information.

Abstract: A method and a system of generating a smooth spline surface from a quadrilateral mesh representing a physical object, is described. Edge points are added to the quadrilateral mesh to preserve a feature or a boundary. The edge points are added to an edge of the quadrilateral mesh having one or more irregular nodes representing a feature edge of the physical object and/or the edge points are added to an edge of the quadrilateral mesh extending between the feature edge and an irregular node. Knot interval vectors are extracted for each edge point and used to evaluate an irregular element having the edge points to generate the smooth spline surface. The smooth spline surface is highly continuous and can be displayed to model the physical object, modify a design of the physical object, or used directly in a simulation to evaluate the physical object. Other embodiments are also described and claimed.

Abstract: A method of generating a high dynamic range (HDR) image is provided that includes capturing a long exposure image and a short exposure image of a scene, computing a merging weight for each pixel location of the long exposure image based on a pixel value of the pixel location and a saturation threshold, and computing a pixel value for each pixel location of the HDR image as a weighted sum of corresponding pixel values in the long exposure image and the short exposure image, wherein a weight applied to a pixel value of the pixel location of the short exposure image and a weight applied to a pixel value of the pixel location in the pixel long exposure image are determined based on the merging weight computed for the pixel location and responsive to motion in a scene of the long exposure image and the short exposure image.

Abstract: Augmented reality (AR) systems, devices, media, and methods are described for generating AR experiences including interactions with virtual or physical prop objects. The AR experiences are generated by capturing images of a scene with a camera system, identifying an object receiving surface and corresponding surface coordinates within the scene, identifying an AR primary object and a prop object (physical or virtual), establishing a logical connection between the AR primary object and the prop object, generating AR overlays including actions associated with the AR primary object responsive to commands received via a user input system that position the AR primary object adjacent the object receiving surface responsive to the primary object coordinates and the surface coordinates within the scene and that position the AR primary object and the prop object with respect to one another in accordance with the logical connection, and presenting the generated AR overlays with a display system.

Abstract: Apparatuses including general-purpose graphics processing units having on chip dense memory for temporal buffering are disclosed. In one embodiment, a graphics multiprocessor includes a plurality of compute engines to perform first computations to generate a first set of data, cache for storing data, and a high density memory that is integrated on chip with the plurality of compute engines and the cache. The high density memory to receive the first set of data, to temporarily store the first set of data, and to provide the first set of data to the cache during a first time period that is prior to a second time period when the plurality of compute engines will use the first set of data for second computations.

Abstract: Systems and methods for device integration in augmented reality environments are disclosed. For example, prior to an AR session being initiated, smart devices within a physical environment where the AR session is to be utilized may be identified and selected based on the functionality of the smart devices and the capabilities of an AR application associated with the AR session. Location information about the smart devices may also be determined and this information may be utilized to generate configuration data, which may be used by the AR application to cause device state transitions on the smart devices in response to events that occur in an AR environment of the AR session.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving, by a client device associated with a first user, a communication from a second user; retrieving, from the communication, a movement vector representing three-dimensional (3D) movement of a set of skeletal joints of the second user; receiving, by the client device associated with the first user, input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the 3D movement of the set of skeletal joints of the second user.

Abstract: An App image includes a display target area displayed on a cylindrical screen, a left margin area, and a right margin area. When a particle comes into contact with a boundary of the display target area and the right margin area, a display apparatus arranges, in the left margin area, a particle in the same mode as the mode of the particle such that the particle comes into contact with a boundary of the display target area and the left margin area. The display apparatus generates a plurality of images such that as the particle moves out to the right margin area from the display target area, the particle enters the display target area from the left margin area.

Abstract: Disclosed embodiments relate to a smart video conference environment. A live video of a conference participant can be segmented into a foreground, including the participant, and a background that excludes the participant. The background can be replaced by a virtual background determined based on one or more factors. The factors can include context data acquired from a calendar, content based on the context data, and transaction history. Further, interaction amongst conference participants can be monitored and utilized to update the background in one instance based on topics of conversation. Interactive content presented in the virtual background permits interaction by participants with the background. Furthermore, content can also be overlaid on the participant and the background in one instance.

Abstract: A system and method for helping a user carrying a smart device to maintain safe distances from other persons during an epidemic or a pandemic. A portable smart device measures the approximate distance to persons in the vicinity of the user, and notifies the user whenever he or she is too close to other persons. The portable smart device may overlay augmented reality graphics (such as arcs, lines, text, numbers, or other graphics) over images captured by the smart device's camera, to indicate safe distances. The graphics serve to inform and/or warn the user that he or she may be getting too close to other persons.

Abstract: Windows including sunroofs of a car may be enabled to display cinematic video, still pictures, opaque content, or picturesque content such as the countryside to simulate various environments while driving. On the outside of the autonomous vehicle advertising content may be shown on digital displays to pedestrians, bystanders, and other vehicle, autonomous vehicle or semi-autonomous vehicle passengers. Advertising revenue may offset vehicle leasing, maintenance, fuel, and ridesharing costs. Ad networks may send local offers content for presentation on the vehicle, autonomous vehicle or semi-autonomous vehicle's windows. Passengers may order food and interact with ads on the car window. The car windows may be multi-touch enabled to allow for various gestures and interactivity with the vehicle, autonomous vehicle or semi-autonomous vehicle. A ridesharing program may allow a passenger to enable ads on the window of the car during their trip to defray the cost of the trip.