Abstract: Embodiments of the systems and methods described herein provide a dynamic animation generation system that can apply a real-life video clip with a character in motion to a first neural network to receive rough motion data, such as pose information, for each of the frames of the video clip, and overlay the pose information on top of the video clip to generate a modified video clip. The system can identify a sliding window that includes a current frame, past frames, and future frames of the modified video clip, and apply the modified video clip to a second neural network to predict a next frame. The dynamic animation generation system can then move the sliding window to the next frame while including the predicted next frame, and apply the new sliding window to the second neural network to predict the following frame to the next frame.

Abstract: A system including an avatar generation engine (AGE) (607) and a method for automatically generating an avatar with pronounced features are provided. The AGE (607) extracts a primary image of a primary component, for example, a face component, and a secondary image of a secondary component, for example, a hair component, from an input image of a target object. The AGE (607) normalizes and processes the primary image for extracting a feature image corresponding to a feature indicating a distinct characteristic of the target object. The AGE (607) processes the extracted feature image for graphically pronouncing the features. The AGE (607) generates a primary canvas including a predicted tone of the primary component. The AGE (607) generates an avatar with pronounced features by merging a primary graphical image generated by merging the primary canvas with the graphically pronounced features, with a secondary graphical image of the secondary component.

Abstract: Systems and methods for reducing the dimensionality of a blendshape deformation matrix. A plurality of blendshapes can be stored in an input deformation matrix. Principal components of the input deformation matrix can be determined. One or more principal components of the input deformation matrix can be omitted, leaving one or more remaining principal components. An output deformation matrix can be generated using one or more blendshapes associated with the remaining principal component(s).

Abstract: A user may create an avatar and/or animated sequence illustrating a particular object or living being performing a certain activity, using images of portions of the object or living being extracted from a still image or set of still images of the object or living being.

Abstract: There is provided an information processing apparatus including an operation unit acquiring an input operation for a message composed of at least one of text and an image, a recording control unit recording the message in accordance with the acquired input operation, and a reproduction control unit reproducing the recorded message to display the message on a display unit.

Abstract: Apparatus and method for non-local means filtering using a media processing block of a graphics processor. For example, one embodiment of a processor comprises: ray tracing circuitry to execute a first set of one or more commands to traverse rays through a bounding volume hierarchy (BVH) to identify BVH nodes and/or primitives intersected by the ray; shader execution circuitry to execute one or more shaders responsive to a second set of one or more commands to render a sequence of image frames based on the BVH nodes and/or primitives intersected by the ray; and a media processor comprising motion estimation circuitry to execute a third set of one or more commands to perform non-local means filtering to remove noise from the sequence of image frames based on a mean pixel value collected across the sequence of image frames.

Abstract: An automatic threat recognition system and method is disclosed for scanning the x-ray CT image of an article to identify the objects of interest (OOIs) contained within the article, which are otherwise not always quickly apparent or discernable to an individual. The system uses a computer to receive information from two-dimensional (2D) image slices from a reconstructed computed tomography (CT) scan image and to produce a plurality of voxels for each slice of the 2D image. The computer analyzes the voxels to create a likelihood map (LM) representing likelihoods that voxels making up the CT image are associated with a material of interest (MOI). The computer further analyzes the LM to construct neighborhoods of voxels within the LM, and classifies each voxel neighborhood based on its features, thereby decluttering the LM to facilitate the process of connecting voxels of a like MOI together to form segments.

Abstract: Apparatus and method for efficient BVH construction. For example, one embodiment of an apparatus comprises: a memory to store graphics data for a scene including a plurality of primitives in a scene at a first precision; a geometry quantizer to read vertices of the primitives at the first precision and to adaptively quantize the vertices of the primitives to a second precision associated with a first local coordinate grid of a first BVH node positioned within a global coordinate grid, the second precision lower than the first precision; a BVH builder to determine coordinates of child nodes of the first BVH node by performing non-spatial-split binning or spatial-split binning for the first BVH node using primitives associated with the first BVH node, the BVH builder to determine final coordinates for the child nodes based, at least in part, on an evaluation of surface areas of different bounding boxes generated for each of the child node.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing point cloud data using dynamic voxelization. When deployed within an on-board system of a vehicle, processing the point cloud data using dynamic voxelization can be used to make autonomous driving decisions for the vehicle with enhanced accuracy, for example by combining representations of point cloud data characterizing a scene from multiple views of the scene.

Abstract: Bordering pixels delineating a texture hole region are identified in a target image. Depth values of the bordering pixels are automatically clustered into two depth value clusters. A specific estimation direction is selected from multiple candidate estimation directions for a texture hole pixel in a texture hole region. A depth value of the texture hole pixel is estimated by interpolating depth values of two bordering background pixels in the specific estimation direction. The estimated depth value is used to warp the texture hole pixel into a reference view represented by a temporal reference image. A pixel value of the texture hole pixel is predicted based on a reference pixel value of a reference pixel from the reference image to which the texture hole pixel is warped using the estimated depth value.

Abstract: Systems and methods for rendering three-dimensional (3D) scenes having improved visual characteristics from a pair of 2D images having different viewpoints. The 3D scene is created by obtaining a first two-dimensional (2D) image of a scene object from a first viewpoint, obtaining a second 2D image of the scene object from a second viewpoint that is different than the first viewpoint, creating a depth map from the first and second 2D images, creating a 3D scene from the depth map and the first and second 2D images, detecting regions of the initial 3D scene with incomplete image information, reconstructing the detected regions of the 3D scene, determining replacement information and modify the reconstructed regions, and rendering the 3D scene with the modified reconstructed regions from a plurality of viewpoints.

Abstract: Systems, apparatuses and methods may provide for technology that selects an anti-aliasing mode for a vertex of a primitive based on a parameter associated with the vertex and generates a coverage mask based on the selected anti-aliasing mode. Additionally, one or more pixels corresponding to the vertex may be shaded based at least partly on the coverage mask, wherein the selected anti-aliasing mode varies across a plurality of vertices in the primitive.

Abstract: Various disclosed embodiments are directed to image-to-material translation based on delighting an input image, thereby allowing proper capturing of the color and geometry properties of the input image for generating a visual rendering. This, among other functionality described herein, improves the inaccuracies, user experience, and computing resource consumption of existing technologies.

Abstract: A virtual viewpoint foreground image generating unit generates a virtual viewpoint foreground image, which is an image of a foreground object seen from a virtual viewpoint without a shadow, based on received multi-viewpoint images and a received virtual viewpoint parameter. A virtual viewpoint background image generating unit generates a virtual viewpoint background image, which is an image of a background object seen from the virtual viewpoint, based on the received multi-viewpoint images and virtual viewpoint parameter. A shadow mask image generating unit generates shadow mask images from the received multi-viewpoint images. A shadow-added virtual viewpoint background image generating unit renders a shadow in the virtual viewpoint background image based on the received virtual viewpoint background image, shadow mask images, and virtual viewpoint parameter.

Abstract: One embodiment provides for a graphics processing unit comprising a processing cluster to perform coarse pixel shading and output shaded coarse pixels for processing by a pixel processing pipeline and a render cache to store coarse pixel data for input to or output from a pixel processing pipeline.

Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for generating a three-dimensional (3D) geometry of a room from a panorama image of the room. An apparatus includes processing circuitry that determine two-dimensional (2D) positions of wall corner points of the room in the panorama image based on a user input. Each wall corner point is in one of a floor plane or a ceiling plane of the room. The processing circuitry calculates 3D positions of the wall corner points based on the 2D positions of the wall corner points, a size of the panorama image, and a distance between the floor plane and a capture position of a device capturing the panorama image, determines a room layout based on an order of the wall corner points, and generates the 3D geometry based on the room layout and the 3D positions of the wall corner points.

Abstract: The scale of modeled building objects from collected imagery is determined by identifying architectural elements within building object imagery, determining a scale of the identified architectural elements by matching them to known industry standard architectural element based on dimensional ratio comparisons and deriving an average scaling factor based on scale of the identified architectural elements. A three dimensional model of the building object is scaled according to the average scaling. Scaled architecture elements within a relative error can be used for scaling the model according to an updated scale factor.

Abstract: The embodiments herein provide a system and method for integrating objects in monocular simultaneous localization and mapping (SLAM). State of art object SLAM approach use two popular threads. In first, instance specific models are assumed to be known a priori. In second, a general model for an object such as ellipsoids and cuboids is used. However, these generic models just give the label of the object category and do not give much information about the object pose in the map. The method and system disclosed provide a SLAM framework on a real monocular sequence wherein joint optimization is performed on object localization and edges using category level shape priors and bundle adjustment. The method provides a better visualization incorporating object representations in the scene along with the 3D structure of the base SLAM system, which makes it useful for augmented reality (AR) applications.

Abstract: A method and apparatus for rendering a computer-generated image using a stencil buffer is described. The method divides an arbitrary closed polygonal contour into first and higher level primitives, where first level primitives correspond to contiguous vertices in the arbitrary closed polygonal contour and higher level primitives correspond to the end vertices of consecutive primitives of the immediately preceding primitive level. The method reduces the level of overdraw when rendering the arbitrary polygonal contour using a stencil buffer compared to other image space methods. A method of producing the primitives in an interleaved order, with second and higher level primitives being produced before the final first level primitives of the contour, is described which improves cache hit rate by reusing more vertices between primitives as they are produced.

Abstract: Disclosed are editing tools for manipulating a three-dimensional (“3D”) data file or point cloud. An editing application may generate a visualization of the 3D data file or point cloud, and a user may invoke an editing tool over a particular region of the visualization that is rendered based on the positional and non-positional values of a first data point set and a second data point set from the 3D data file or point cloud. The editing tool may differentiate the first data point set from the second data point set based on unique commonality in the positional and/or non-positional values of the first data point set, and may edit less than all of the particular region by adjusting one or more of the positional and/or non-positional values of the first data point set while retaining the positional and non-positional values of the second data point set.

Abstract: Various implementations of the present application set forth a method comprising receiving, by a remote device from a host device, geometry data representing a physical space that is remote to a location of the remote device, where the geometry data comprises a set of vertices, a set of faces comprising edges between pairs of vertices, and texture data, constructing, based on the geometry data, an adaptable three-dimensional (3D) representation of the physical space for display at the location of the remote device, receiving, by the remote device, an input representing an interaction with at least one portion of the adaptable 3D representation, and transmitting, to the host device, data corresponding to the interaction.

Abstract: Described are systems and methods that enable users to virtually experience an environment at a destination location from their own user device, control their experience and even interact with others that are physically located within the environment. Likewise, the user's experience may even be improved with the inclusion of enhancements that are presented to the user as the user experiences the environment. Users may interact with the enhancements to obtain additional enhancements, interact with others physically located within the environment, interact with and direct a guide that is physically located within the environment, and receive near real-time video and audio that is transmitted from a guide device located within the environment.

Abstract: Disclosed is a system and associated methods for generating a mutable tree to efficiently access data within a three-dimensional (“3D”) environment. The system generates the mutable tree with a root node defined at a root node position, a first branch with nodes for each of a first set of subdivided regions that are a first distance from the root node position, and a second branch with nodes for each of a second set of subdivided regions that are a second distance from the root node position. The system sorts the mutable tree in response to a request to access data from a first position within the 3D environment so that the first node in the first branch is the first subtree node that is closest to the first position, and the first node in the second branch is the second subtree node that is closest to the first position.

Abstract: The invention relates to non-destructive imaging of the internal structure for safe and intuitive operator work. In the context of the invented method, electronic scanning first creates a virtual image of the surface of the object (5) whose internal structure is the subject of research. Part of the surface of the object (5) and the angle of scanning are set by voice or by movement of the operator's body (9). The virtual image of the surface of the object (5) is subsequently projected in the stereoscopic glasses (7), followed by creation of the virtual image of the internal structure of the object (5) for the same angle of scanning. The virtual image of the internal structure is projected in the virtual image of the surface of the object (5), or replaces the virtual image of the object (5).

Abstract: A ride system includes eyewear configured to be worn by a user. The eyewear includes a display having a stereoscopic feature configured to permit viewing of externally projected stereoscopically displayed images. The ride system includes a computer graphics generation system communicatively coupled to the eyewear, and configured to generate streaming media of a real world environment based on image data captured via the camera of the eyewear, generate one or more virtual augmentations superimposed on the streaming media of the real world environment, and to transmit the streaming media of the real world environment along with the one or more superimposed virtual augmentations to be displayed on the display of the eyewear, and project stereoscopic images into the real world environment.

Abstract: An example method for estimating an emotion based upon a facial expression of a user can include: receiving one or more captured facial expressions from the user at a visual computing device; comparing the one or more captured facial expressions to one or more known facial expressions; and assigning an emotion to the plurality of captured facial expressions based upon the comparing.

Abstract: Methods, systems, and computer program products are described for obtaining, from a first tracking system, an initial three-dimensional (3D) position of an electronic device in relation to image features captured by a camera of the electronic device and obtaining, from a second tracking system, an orientation associated with the electronic device. Responsive to detecting a movement of the electronic device, obtaining, from the second tracking system, an updated orientation associated with the detected movement of the electronic device, generating and providing a query to the first tracking system, the query corresponding to at least a portion of the image features and including the updated orientation and the initial 3D position of the electronic device, generating, for a sampled number of received position changes, an updated 3D position for the electronic device and generating a 6-DoF pose using the updated 3D positions and the updated orientation for the electronic device.

Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.

Abstract: The present disclosure relates to a visual display system for manipulating images of a real scene using augmented reality. In one implementation, the system may include at least one processor in communication with a first mobile device; and a storage medium storing instructions that, when executed, configure the at least one processor to perform operations. The operations may include receiving a request from a mobile device to access an account of a user, receiving a first image depicting a real scene from an image sensor of the mobile device, receiving a selection of a virtual object, receiving an augmented reality image comprising the virtual object overlaid on the first image, comparing the augmented reality image to one or more stored augmented reality images, authenticating the user based on the comparison, and authorizing access to the user account based on the authentication.

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.

Abstract: Methods, systems, and storage media for auto-generating an artificial reality environment based on access to personal user content are disclosed. Exemplary implementations may: receive consent from a user to access user content on a user device, the user content comprising digital media; generate a user profile based at least in part on the user content; determine user preferences based at least in part on the user profile; generate an artificial reality environment based at least in part on the user preferences; and share the artificial reality environment with contacts of the user.

Abstract: Systems and methods for generating augmented reality prerenderings can provide the benefit of an augmented reality rendering without requiring the use of user data. Template images can be used instead of user data to protect the user's privacy while enabling the user to see an object or product rendered onto a preferred template image or a variety of template images.

Abstract: One or more disclosed techniques comprise generating an extended reality (XR) template at a first location, where the XR template represents a virtual space in an XR environment that is associated with a real-world object at a second location, and generating a template object that represents the real-world object, wherein the template object is included in the XR template. The techniques further comprise modifying the template object to include a marker that corresponds to a real-world marker associated with the real-world object, generating a first template XR object that corresponds a first XR object to be displayed in the XR environment, where the first template XR object is positioned within the XR template relative to the marker included on the template object, and assigning the XR template to the real-world marker.

Abstract: An electronic device that reprojects two-dimensional (2D) images to three-dimensional (3D) images includes a memory configured to store instructions, and a processor configured to execute the instructions to: propagate an intensity for at least one pixel of an image based on a depth guide of neighboring pixels of the at least one pixel, wherein the at least one pixel is considered a hole during 2D to 3D image reprojection; propagate a color for the at least one pixel based on an intensity guide of the neighboring pixels of the at least one pixel; and compute at least one weight for the at least one pixel based on the intensity and color propagation.

Abstract: A method includes detecting presence of a handheld device in proximity of a touch enabled device and negotiating communication capabilities between the handheld device and a digitizer system of the touch enabled device. At least one of the handheld device and the digitizer system is configured to match a defined communication capability of the other of the at least one of the handheld device and digitizer system. Input from the handheld device is tracked via an electrostatic communication channel between the handheld device and the digitizer system based on the defined communication configuration.

Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.

Abstract: An example embodiment includes: a determination unit that, based on an image including an eye of a recognition subject, determines whether or not a colored contact lens is worn; and a matching unit that, when it is determined by the determination unit that the colored contact lens is worn, performs matching of the iris by using a feature amount extracted from a region excluding a predetermined range including an outer circumference of the iris out of a region of the iris included in the image.

Abstract: An information processing apparatus includes a receiving unit, an obtaining unit, and a translating unit. The receiving unit receives a document as a target to be translated. The obtaining unit obtains a non-target region from the document, the non-target region being a region that is not a target to be translated. The translating unit does not perform translation on the non-target region but performs translation on a portion other than the non-target region.

Abstract: An image processing apparatus and an image processing method for estimating a region of interest based on information of interest learned by a data recognition model satisfying a certain condition from among a plurality of data recognition models and for setting a focus are provided. The image processing apparatus includes estimating a region of interest by using a rule-based algorithm or an artificial intelligence (AI) algorithm. When estimating a region of interest by using an AI algorithm, the image processing apparatus may estimate a region of interest by using a machine learning algorithm, a neural network algorithm, or a deep learning algorithm.

Abstract: The present application relates to the field of computer software technologies, and in particular, to a face spoofing attack detection method and system. The suggested method comprises capturing an image; determining a context of the captured image; highlighting a part of the captured image to generate an image with the highlighted part, wherein the highlighted part is a potential spoofing region determined based on the context of the captured image; combining the captured image with the image with the highlighted part to generate a summarized image; performing face spoofing attack detection in the summarized image, wherein only the highlighted part has priority in the face spoofing attack detection, generating a general spoofing score as a result of the face spoofing attack detection; comparing the general spoofing score result with a threshold for face liveness detection.

Abstract: The present invention discloses a cloud-edge-end cooperative control method of a 5G networked UAV for security rescue, including: an image acquisition step: performing, by a single-chip microcomputer, attitude resolution on data acquired by a detection sensor, to obtain image data; a sparse landmark map building step: performing, by a control platform, front-end feature point matching, local map building and optimization, loopback detection, and frame resolution on the image data, to generate a sparse landmark map; a three-dimensional dense map building step: generating, by an edge cloud, a three-dimensional dense map based on a key frame pose and key frame observation data of the sparse landmark map; a high-precision semantic map building step: obtaining a high-precision semantic map; and a UAV movement step: adjusting, by the driving mechanism, a pose of the UAV according to the three-dimensional dense map or the high-precision semantic map.

Abstract: In accordance with implementations of the subject matter described herein, a solution for fine-grained image recognition is proposed. This solution includes extracting a global feature of an image using a first sub-network of a first learning network; determining a first attention region of the image based on the global feature using a second sub-network of the first learning network, the first attention region including a discriminative portion of an object in the image; extracting a first local feature of the first attention region using a first sub-network of a second learning network; and determining a category of the object in the image based at least in part on the first local feature. Through this solution, it is possible to localize an image region at a finer scale accurately such that a local feature at a fine scale can be obtained for object recognition.

Abstract: A system identifies anomalies in an image of an object. An input image of the object containing zero or more anomalies is supplied to an image encoder. The image encoder generates an image model. The image model is applied to an image decoder that forms a substitute non-anomalous image of the object. Differences between the input image and the substitute non-anomalous image identify zero or more areas of the input image that contain the zero or more the anomalies. The system implements a flow-based model and has been trained using (a) a set of augmented anomaly-free images of the object applied at the image encoder and (b) a reconstruction loss calculated based on a norm of differences between each augmented anomaly-free image of the object and a corresponding output image from the image decoder.

Abstract: A method and system is provided for detection of carbonate core features from core images. An input carbonate core image is separated into a plurality of first blocks, each of the plurality of first blocks having a first block size. An image of each of the separated plurality of first blocks is input into an artificial intelligence (AI) model. The AI model being trained to predict for each first block, one of a plurality of carbonate core features and a corresponding confidence value indicating a confidence of the predicted carbonate core feature being imaged in the first block. Any bounding boxes of a first set of bounding boxes are detected in the input core image based on the predicted one of the plurality of carbonate core features and the corresponding confidence values for each first block.

Abstract: A method for determining whether or not a transparent protective cover of a video camera comprising a lens-based optical imaging system is partly covered by a foreign object is disclosed. The method comprises: obtaining (402) a first captured image frame captured by the video camera with a first depth of field; obtaining (404) a second captured image frame captured by the video camera with a second depth of field which differs from the first depth of field; and determining (406) whether or not the protective cover is partly covered by the foreign object by analysing whether or not the first and second captured image frames are affected by presence of the foreign object on the protective cover such that the difference between the first depth of field and the second depth of field results in a difference in a luminance pattern of corresponding pixels of a first image frame and a second image frame.

Abstract: An intention of a road user to traverse a passage between a first vehicle and a second vehicle is determined. A required width of the passage is determined based on a nature of the road user. A current width of the passage is determined. Upon determining the current width of the passage is less than the required width of the passage, a drive of at least one of the first vehicle or the second vehicle is actuated to increase the current width of the passage at least to the required width of the passage.

Abstract: Techniques are provided for increasing the accuracy of automated classifications produced by a machine learning engine. Specifically, the classification produced by a machine learning engine for one photo-realistic image is adjusted based on the classifications produced by the machine learning engine for other photo-realistic images that correspond to the same portion of a 3D model that has been generated based on the photo-realistic images. Techniques are also provided for using the classifications of the photo-realistic images that were used to create a 3D model to automatically classify portions of the 3D model. The classifications assigned to the various portions of the 3D model in this manner may also be used as a factor for automatically segmenting the 3D model.

Abstract: Aspects of the technology described herein relate to techniques for guiding an operator to use an ultrasound device. Thereby, operators with little or no experience operating ultrasound devices may capture medically relevant ultrasound images and/or interpret the contents of the obtained ultrasound images. For example, some of the techniques disclosed herein may be used to identify a particular anatomical view of a subject to image with an ultrasound device, guide an operator of the ultrasound device to capture an ultrasound image of the subject that contains the particular anatomical view, and/or analyze the captured ultrasound image to identify medical information about the subject.

Abstract: This disclosure relates to method and system for visual inspection of rotating components. The method includes representing rotation cycles of a rotating component as spatial features based on video or image frames, ascertaining and/or evolving Hidden Markov Model (HMM) chains for the cycles, ascertaining a count of the rotating component in the frames and/or labelling the frames with ascertained states of the HMM chains.

Abstract: Systems and methods for analyzing image data to assess property damage are disclosed. According to certain aspects, a server may analyze segmented digital image data of a roof of a property using a convolutional neural network (CNN). The server may extract a set of features from a set of regions output by the CNN. Additionally, the server may analyze the set of features using an additional image model to generate a set of outputs indicative of a confidence level that actual hail damage is depicted in the set of regions.