Abstract: Device, system, and method of generating a reduced-size volumetric dataset. A method includes receiving a plurality of three-dimensional volumetric datasets that correspond to a particular object; and generating, from that plurality of three-dimensional volumetric datasets, a single uniform mesh dataset that corresponds to that particular object. The size of that single uniform mesh dataset is less than ¼ of the aggregate size of the plurality of three-dimensional volumetric datasets. The resulting uniform mesh is temporally coherent, and can be used for animating that object, as well as for introducing modifications to that object or to clothing or garments worn by that object.

Abstract: The technology disclosed herein is an information processing apparatus comprising: one or more memories storing instructions; and one or more processors executing the instructions to function as: an obtaining unit configured to obtain information for specifying a position of an object included in multi-viewpoint image data obtained by image capturing using a plurality of imaging apparatuses; and a generation unit configured to generate a virtual viewpoint path data to generate virtual viewpoint image data by inputting the information obtained by the obtaining unit to an output unit which is a learned model learned from the virtual viewpoint path data to be training data and at least information for specifying a position of an object to be input data corresponding to the virtual viewpoint path data and is configured to output virtual viewpoint data by receiving input of information for specifying a position of an object.

Abstract: A system involves determining visually relevant design differences between a first three-dimensional model and a second three-dimensional model. The system has: a model receiving unit configured to receive the first three-dimensional model and the second three-dimensional model; a viewpoint defining unit configured to define one or more viewpoints from which the first three-dimensional model and the second three-dimensional model can be viewed; and a difference determining unit configured to determine visually relevant design differences between the first three-dimensional model and the second three-dimensional model from the one or more viewpoints.

Abstract: Embodiments of the present disclosure provide an image processing method, apparatus, and device. The method includes: obtaining a scene image in a scene to be displayed; obtaining a three-channel color value and a metallicity coefficient of each pixel point in the scene image; and performing diffuse reflection processing on the scene image according to the three-channel color value and the metallicity coefficient of each pixel point. The method in the embodiments of the present disclosure improves the authenticity of the scene to be displayed, which is more realistic and natural.

Abstract: An electronic apparatus performs a method of customizing a standard face of an avatar in a game using a two-dimensional (2D) facial image of a real-life person that includes: identifying a set of real-life keypoints in the 2D facial image; transforming the set of real-life keypoints into a set of game-style keypoints associated with the avatar in the game; generating a set of control parameters of the standard face of the avatar in the game by applying the set of game-style keypoints to a keypoint to parameter (K2P) neural network model; and deforming the standard face of the avatar in the game based on the set of control parameters, wherein the deformed face of the avatar has the facial features of the 2D facial image.

Abstract: Embodiments of the systems and methods described herein provide a virtual object aging system. The virtual object aging system can utilize artificial intelligence to modify virtual objects within a video game to age and/or deteriorate for a certain time period. The virtual object aging system can be used to determine erosion, melting ice, and/or other environmental effects on virtual objects within the game. The virtual object aging system can apply aging, rust, weathering, and/or other effects that cause persistent change to object meshes and textures.

Abstract: In one embodiment, a method includes accessing one or more surfaces of an artificial reality scene. The one or more surfaces are generated based on one or more images of the artificial reality scene rendered at a first rate and based on a first viewing position. The method includes generating subframes at a second rate higher than the first rate. Each of the subframes is generated by determining a second viewing position, determining a visibility of the one or more surfaces of the artificial reality scene from the second viewing position, generating, based on the determined visibility of the one or more surfaces, color values of the subframe corresponding to output positions of a display, and providing the color values of the subframe for display.

Abstract: A method and system for facilitating the placement of a dental implant device using augmented reality, and simultaneously capturing the result of the placement for subsequent planning procedures. By planning a desired dental implant location using one or more preoperative images of a patient and overlaying the planned dental implant location and the one or more preoperative images on the patient through virtual reality means, a clinician may be provided with an awareness of the positional relationship between the preoperative images and the planned implant position.

Abstract: Estimating a three-dimensional (3D) pose and shape of an articulated body mesh is useful for many different applications including health and fitness, entertainment, and computer graphics. A set of estimated 3D keypoint positions for a human body structure are processed to compute parameters defining the pose and shape of a parametric human body mesh using a set of geometric operations. During processing, 3D keypoints are extracted from the parametric human body mesh and a set of rotations are computed to align the extracted 3D keypoints with the estimated 3D keypoints. The set of rotations may correctly position a particular 3D keypoint location at a “joint”, but an arbitrary number of rotations of the “joint” keypoint may produce a twist in a connection to a child keypoint. Rules are applied to the set of rotations to resolve ambiguous twists and articulate the parametric human body mesh according to the computed parameters.

Abstract: Examples of the present disclosure relate to a method for packing three dimensional (3D) models. The method comprises identifying a plurality of sections of each 3D model according to curvature profiles of the sections; associating a build material layer thickness to each section of the plurality of sections, whereby each associated build material layer thickness is one of a set of pre-established build material layer thicknesses; packing the plurality of 3D models according to each associated build material layer thickness, whereby packing comprises spatially arranging at least some 3D models in the 3D virtual build volume according to one or more criteria, such that at least some of the sections of different 3D models associated to a same build material layer thickness are arranged in a same region of the 3D virtual build volume.

Abstract: Disclosed are systems and methods for improving interactions with and between computers in content providing, searching and/or hosting systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide a novel framework for performing automatic detection of surfaces in video frames resulting in the creation of a seamless in-video ad experience for viewing users. The disclosed framework operates by leveraging available surfaces in videos to show advertisements in compliance with publisher protection, compliance and policy in a fully automatic, end-to-end solution. The disclosed framework evidences a streamlined, automatic and computationally efficient process(es) that modifies digital content at the surface level within the frames of the content in compliance with the digital rights of the owners of the content being merged via the disclosed augmentation.

Abstract: A system and a method are disclosed that optimizes a graphics driver. The system may be embodied as a computing device that includes a storage that is internal to the computing device, a graphic processing unit that includes a driver and a controller. The controller may be configured to run a daemon process that optimizes a shader and/or a shader pipeline for an application that is resident on the computing device when the computing device is not running the application and stores at least one optimization for the shader in the storage. The at least one optimization may be based on the application. The daemon process may further receive a request from the driver of the GPU for an optimization for the shader/shader pipeline during a runtime compilation of the shader and provide the at least one optimization to the driver of the GPU from the storage.

Abstract: A method for processing scan data which are recorded by a measuring device with a scan functionality, wherein a reduced scan data record is created from a recorded scan data record with a first scan data density by selecting individual scan data points. Here, the selection represents an adaptation to a reduced scan data density, which is less than the first scan data density of the recorded scan data record. The reduced scan data density depends on a predetermined display resolution for displaying scan data. The reduced scan data record is transmitted to an external data processing device and displayed by the latter by means of a display, depending on the predetermined display resolution.

Abstract: The invention is a method and system for creating an interactive virtual tour. The invention performs consecutive shooting sessions for capturing angularly spaced images of a place or property using a mobile terminal. Each session is performed by rotation of the terminal at a different location of the property, the terminal collects its orientation when capturing the first image of each session and generates for each session a panorama projection (P1-Pn) by automatically assembling captured images. After the first session each further session is performed by directing the terminal so that the first image of the session is substantially centered on a previous location. The collected orientation at the direction is used to create a linking vector between the first images of the further and previous sessions. The vectors are used to create interactive browsing capability upon assembly of the projections within an interactive virtual tour.

Abstract: Techniques for interacting with virtual environments. For example, a virtual reality application outputs a three-dimensional virtual reality scene. The application receives a creation of a slicing volume that is positioned within the three-dimensional virtual space. The slicing volume includes virtual elements of an object within the scene. The application projects the slicing volume onto a two-dimensional view. The application displays the two-dimensional view within the three-dimensional virtual reality scene. The application associates a surface of a physical object with the two-dimensional view. The application receives an interaction with the surface of the physical object, and based on the interaction, selects one or more virtual elements.

Abstract: A system that enables real-time recognition of a real-space environment in a mixed-reality environment includes a server, a portable display device including a display unit for displaying a virtual object to a user and a photographing unit that photographs a real space, and image acquisition devices that acquire images individually from a plurality of fixed points where it is possible to photograph a region in a predetermined real space, the system making it possible to render the virtual object in a superimposed fashion on a real space or a photographed image of the real space, viewed by the user via the display unit, the server or the display device including a three-dimensional-space-data storage part, a table storage part, a color-information determining part, a color-information updating part, a user-environment determining part, a virtual-illumination-information generating part, and a rendering part.

Abstract: Techniques for performing automatic interactive animation by automatically matching objects between multiple artboards, allowing an animator to link multiple artboards in a temporal sequence using time as a trigger and allowing an animator to preview an animation using intuitive drag controls via an input device such as a mouse or touch screen. An automatic animation process is performed by matching objects/nodes between artboards by determining a ranking of similarity between objects based upon a distance metric computed for a set of one or more attributes associated with each object in the artboards. If sufficient match is found, the matched objects can be treated as a single entity to be animated. In another embodiment, dominant direction of movement with respect to the matched objects is determined, and receipt of a drag event (mouse input or touch screen gesture input) in said dominant direction causes a preview of animation of that entity.

Abstract: Systems and methods for generating a customized virtual animal character are disclosed. A system may obtain video data or other media depicting a real animal, and then may provide the obtained media to one or more machine learning models configured to learn visual appearance and behavior information regarding the particular animal depicted in the video or other media. The system may then generate a custom visual appearance model and a custom behavior model corresponding to the real animal, which may subsequently be used to render, within a virtual environment of a video game, a virtual animal character that resembles the real animal in appearance and in-game behavior.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by one or more processors that implement a messaging application, a video feed from a camera of a user device; detecting, by the messaging application, a face in the video feed; in response to detecting the face in the video feed, retrieving a three-dimensional (3D) caption; modifying the video feed to include the 3D caption at a position in 3D space of the video feed proximate to the face; and displaying a modified video feed that includes the face and the 3D caption.

Abstract: A method of operating a graphics processor that executes a graphics processing pipeline that can generate a render output using different shading rates is disclosed. First and second input shading rates are combined prior to rasterisation, and a combined shading rate may be propagated through the pipeline instead of the first and second input shading rates. The combined shading rate may then be combined with a third input shading rate at or after the rasterisation stage. This can reduce bandwidth, hardware and energy requirements.