Abstract: Method, system, and computer-readable storage media for image conversion. A first image in a raster format is preprocessed to form a second image. Further, the second image is converted into grayscale to create a third image. Furthermore, the third image is denoised and smoothened to create a fourth image. A fifth image is created based on the fourth image by at least adding borders to objects in the third image. Further, a layering of the objects is first determined within the fifth image. Also, the objects in the fifth image are highlighted to create a sixth image. A graph schema is generated based on the fifth and/or sixth image. Based on the graph schema, edges of the objects within the sixth image are identified. Further, the sixth image is ungrouped based on the identified edges of the objects, the ungrouping generates an individual vector image for each of the objects.

Abstract: Methods and systems are disclosed for generating video by applying a template to various content items. The methods and systems select, by an interaction application, a video generation template comprising instructions for combining a set of content items into a video using one or more augmented reality (AR) elements. The methods and systems identify a subset of content items from a plurality of previously captured content items and modify one or more content items of the identified subset of content items based on the AR elements of the video generation template. The methods and systems generate a video comprising a collection of content items including the identified subset of content items and the modified one or more content items based on the instructions of the video generation template.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generates a vectorized digital image of a raster image according to at least one gradient fill function. In particular, the disclosed systems generate a segmentation map of a raster digital image by using a segmentation model to cluster pixel values while minimizing a number of boundaries. Moreover, the disclosed systems generate one or more closed connected partitions that include locally smooth pixel values within the raster digital image according to the boundaries of the segmentation map. Further, the disclosed systems fit one or more fill function to the closed connected partition(s), where the one or more fill function includes at least one gradient fill function for a closed connected partition. The disclosed systems generate the vectorized digital image according to the at least one gradient fill function for the closed connected partition.

Abstract: The present disclosure provides an image rendering method and apparatus, a device, and a medium. The method including: in response to acquiring an interactive operation instruction from a user to control movement of a target rendering object, updating depth information of a first node; determining target coordinates of the first node in a world coordinate system, according to the depth information and screen coordinates of a movement trajectory corresponding to the interactive operation instruction; and based on the target coordinates and world coordinate system coordinates of a plurality of nodes, concurrently updating world coordinate system coordinates of the plurality of nodes, and controlling the plurality of nodes to rotate according to a preset model node rotation strategy to render the target rendering object.

Abstract: Provided are methods, systems, devices, apparatuses, and tangible non-transitory computer readable media for generating avatars in a virtual environment. The disclosed technology can detect a plurality of inputs to control an avatar that is represented in a virtual environment. Based on one or more states of the virtual environment that are modified by the plurality of inputs, an interactive context associated with one or more states of the avatar in the virtual environment can be determined. Based on the one or more states of the virtual environment and the interactive context, a plurality of traits associated with a representation of the avatar in the virtual environment can be generated. Based on the plurality of traits, one or more modifications to the one or more states of the avatar can be generated. The one or more modifications can comprise modifying a visual representation of the avatar in the virtual environment.

Abstract: Apparatuses, systems, and techniques to store information within one or more non-uniform memory access (NUMA) storages. In at least one embodiment, one or more circuits are to perform an application programming interface (API) to cause information to be stored within one or more NUMA storages or one or more graphics processor unit (GPU) physical storages based, at least in part, on one or more indicators to be indicated by one or more users of the API.

Abstract: Techniques are disclosed to add augmented reality to a sub-view of a high resolution central video feed. In various embodiments, a central video feed is received from a first camera on a first recurring basis and time-stamped position information is received from a tracking system on a second recurring basis. The central video feed is calibrated against a spatial region encompassed by the central video feed. The received time-stamped position information and a determined plurality of tiles associated with at least one frame of the central video feed are used to define a first sub-view of the central video feed. The first sub-view and a homography defining placement of augmented reality elements on the at least one frame of the central video feed are provided as output to a device configured to use the first sub-view and the homography display the first sub-view.

Abstract: An image processing apparatus includes a data acquisition unit that acquires first sensing data that is image sensing data and second sensing data that is sensing data of a type different from the first sensing data and a display processing unit that performs a display process for displaying an augmented reality space formed by augmenting a real space with use of the first sensing data and the second sensing data. The display processing unit performs, by using the second sensing data, a display process for superimposing a virtual object on a real object recognized as an object present in the real space.

Abstract: A firearm system includes a firearm and a computer. Electronics in the firearm determine data that includes a pathway between different points of aim of the firearm as the firearm moves. The computer receives this data and builds an image of the pathway between the different points of aim of the firearm.

Abstract: The embodiments of the disclosure provide a method for rendering a virtual object, a host, and a computer readable storage medium. The method includes: determining a plurality of regions in an environment; determining lighting information of each of the plurality of regions; obtaining a to-be-rendered virtual object and selecting at least one candidate region corresponding to the to-be-rendered virtual object among the plurality of regions; determining a reference lighting information based on the lighting information of each of the at least one candidate region; and rendering the to-be-rendered virtual object based on the reference lighting information.

Abstract: A metaverse application receives a first frame of a video. The metaverse application determines facial landmarks of the user in the first frame. The metaverse application generates an animation frame that includes an avatar and a background based on the facial landmarks and the first frame. The metaverse application determines a head orientation of the user in the first frame based on the facial landmarks. The metaverse application maps an orientation of the mobile device to the head orientation of the user. For each additional frame of the video subsequent to the first frame, the metaverse application updates the orientation of the mobile device. The metaverse application generates subsequent animation frames that include the avatar and the background based on the updated orientation of the mobile device in relation to the head orientation.

Abstract: A request to add an overlay at a pixel located at (x, y) coordinates in images is received. Waypoints in a three-dimensional space are identified with respective two-dimensional projections onto the images falling inside a circle with a given radius r and centered at (x, y). An overlay z-coordinate is determined for the overlay as a weighted sum of respective z coordinates of the waypoints. The overlay is assigned a location (x, y, overlay z-coordinate).

Abstract: Disclosed is a method for enabling exposure-guided three-dimensional (3D) reconstruction, including (i) receiving Low Dynamic Range (LDR) input image captured by camera; (ii) rendering High Dynamic Range (HDR) image corresponding to input image, using HDR 3D reconstruction model pre-trained for HDR image reconstruction of 3D environment; (iii) applying HDR to LDR tone-mapping operator on HDR image, for producing tone-mapped LDR image; (iv) determining first loss function (FLF) between input image and tone-mapped LDR image, FLF comprising weighted pixel value differences between pixels of input image and corresponding pixels of tone-mapped LDR image; (v) determining whether input image has saturated pixel(s), saturated pixel(s) comprises: highlight saturated pixel, shadow saturated pixel; (vi) de-weighting pixel value difference corresponding to saturated pixel in FLF; (vii) back-propagating gradient of FLF with respect to model parameters, through differentiable render function of HDR 3D reconstruction model,

Abstract: A device may one or more memories storing the frontal view image. A device may one or more processors coupled to the one or more memories and configured to: obtain, based on the frontal view image and via an implicit field engine in a geometry pathway, a depth map, obtain, based on the frontal view image, a masked image, generate, based on the masked image and via a semantic pathway, a reconstructed image, train, based on the depth map and the reconstructed image, a model; and finetune the model using a portion of task-specific labels to obtain a finetuned model that performs semantic view mapping on input images.

Abstract: The present disclosure relates to an image transmission system including a plurality of cameras and a communication device including processing circuitry. The processing circuitry is configured to execute the following processes. The first process is sequentially acquiring captured image data from each of the plurality of cameras. The second process is generating composite image data by combining the captured image data last acquired from each of the plurality of cameras, each time acquiring the captured image data from a main camera that is one of the plurality of cameras. The third process is transmitting the composite image data to a target terminal.

Abstract: A system to perform operations that include: generating, at a client device, a scan request that comprises image data, the image data comprising a depiction of a coded image that comprises a reference to a media repository; determining a set of coordinates that indicate a position and orientation of the coded image within a three-dimensional (3D) Euclidean space responsive to the scan request; defining a reference point at the client device based on the set of coordinates that indicate the position and orientation of the coded image within the 3D Euclidean space; accessing media content from within the media repository based on the reference to the media content associated with the coded image, wherein the media content may include AR content; and causing display of a presentation of the media content at the client device based on the reference point.

Abstract: The present disclosure relates to augmented-reality systems and methods, and more specifically to systems and methods of providing automated support instructions to patients during medical device unboxing and installation via an augmented reality-enabled device. While adoption of remote patient monitoring and remote patient care (e.g., telehealth) has greatly accelerated, most medical devices are not designed for usage by laypersons. Thus, the systems and methods of the present disclosure provide easy and accessible guidance to patients now tasked with unboxing and installation complex medical devices without the support of a trained healthcare professional.

Abstract: An electronic device for obtaining image data representing a hand gesture, the electronic device includes: a memory to store a default joint value of a preset joint, among joint values for a plurality of joints constituting a hand pose; and a processor configured to: obtain the default joint value from the memory, determine whether to generate a joint value, generate random joint values of joints other than the preset joint, obtain a pose vector corresponding to a key image frame by using the obtained default joint value and the generated random joint values, obtain a plurality of pose vectors by performing interpolation by using the obtained pose vector, and obtain a plurality of image frames representing the hand gesture by rendering a three-dimensional character image by using the plurality of obtained pose vectors.

Abstract: An information processing apparatus according to the present invention is a client apparatus connected to a network, and includes: a receiver configured to receive first information, which is information on a virtual object, via the network; and a controller configured to acquire second information, which is information on environment of surrounding of the client apparatus, generate an image of the virtual object on a basis of the first information and the second information, and control so that the generated image of the virtual object is displayed on a display.

Abstract: A computer server receives requests from a plurality of devices for digital content for rendering in a virtual computer environment. Based on geographic locations of the plurality of devices, the computer server groups the plurality of devices into at least one group. For a group in the at least one group, the computer server designate a device in the group as a local server, shares information associated with the device designated as the local server with other devices in the group, and transfers the digital content to the device designated as the local server for the device designated as the local server to share the digital content with the other devices in the group.