Abstract: Machine assisted system and method for changing the shape of a faceted surface using points that move in their local coordinate system collectively are described. The method can include receiving a model having a predefined faceted geometry, the model representing a physical structure that is designed or simulated in a data processing system; generating points surrounding the predefined faceted geometry to be morphed; automatically assigning each of the generated points a respective local coordinate system; selecting a control point among the generated points for controlling a movement of the generated points; and displacing the selected control point in a local coordinate system assigned to the selected control point to cause each point to move based on movement of the selected control point according to the assigned local coordinate system, wherein the displacement of the selected control point guides a morphing of the predefined faceted geometry in the model.

Abstract: A method and apparatus for outputting a three-dimensional (3D) image are provided. To output a 3D image, a stereo image is generated based on viewpoints of a user and rendered into a 3D image. Since the stereo image is generated based on the viewpoints of the user, the user views a different side of an object appearing in the 3D image depending on a viewpoint of the user.

Abstract: Systems, methods, and computer program products are described that include obtaining, at a processor, a first image from an image capture device onboard a computing device, detecting, using the processor and at least one sensor, a device orientation of the computing device associated with capture of the first image, determining, based on the device orientation and a tracking stack associated with the computing device, a rotation angle in which to rotate the first image, rotating the first image to the rotation angle to generate a second image, and generating neural network based estimates associated with the first image and the second image.

Abstract: An extended reality (XR) system includes an extended reality application executing on a processor within the XR system. The XR system receives, via a client device, a selection of an extended reality (XR) object located within an XR environment. The XR system receives, via the client device, a request to move the selected XR object within the XR environment. The XR system calculates a first distance between a first feature of the XR object and a first plane associated with a first physical object within the XR environment. The XR system determines that the first distance is within a particular distance. In response to determining that the first distance is within the particular distance, the XR system positions the first feature within the XR environment such that the first feature is coplanar with the first plane.

Abstract: An animation system wherein a machine learning model is adopted to generate animated facial actions based on parameters obtained from a live actor. Specifically, the anatomical structure such as a facial muscle topology and a skull surface that are specific to the live actor may be used. A skull surface that is specific to a live actor based on facial scans of the live actor and generic tissue depth data. For example, the facial scans of the live actor may provide a skin surface topology of the live actor, based on which the skull surface underneath the skin surface can be derived by “offsetting” the skin surface with corresponding soft tissue depth at different sampled points on the skin surface.

Abstract: A method and system of augmenting display content in a graphical user interface environment. Content produced by a graphical user interface is augmented with additional content before the content is displayed. In an example, a security marker may be rendered on top of an existing display content using the method described to protect high-value or sensitive information.

Abstract: A method of managing access to a physical memory formed of n memory page frames using a set of virtual address spaces having n virtual address spaces each formed of a plurality p of contiguous memory pages. The method includes receiving a write request to write a block of data to a virtual address within a virtual address space i of the n virtual address spaces, the virtual address defined by the virtual address space i, a memory page j within that virtual address space i and an offset from the start of that memory page j; translating the virtual address to an address of the physical memory using a virtual memory table having n by p entries specifying mappings between memory pages of the virtual address spaces and memory page frames of the physical memory, wherein the physical memory address is defined by: (i) the memory page frame mapped to the memory page j as specified by the virtual memory table, and (ii) the offset of the virtual address; and writing the block of data to the physical memory address.

Abstract: A method of tracking a point of interest (POI) in an electronic three-dimensional (3D) viewing environment, comprising: capturing via an optical sensor and recording motions of an onsite user, wherein each motion comprises an image surrounding and a pose of the onsite user; displaying a snapshot to a remote user, wherein the snapshot is one of the recorded motions; receiving a POI indicator in the snapshot from the second user; estimating a 3D position of the POI in the electronic 3D viewing environment using the POI indicator data, a moving trajectory from each of the recorded motions to the snapshot, and an estimation of distance between the optical sensor to the POI center; and rendering and superimposing the POI indicator in the electronic 3D viewing environment to be displayed to the onsite user using the estimated 3D position of the POI, the moving trajectory, and the recorded motions.

Abstract: Systems and methods for generating synthetic video are disclosed. For example, a system may include a memory unit and a processor configured to execute the instructions to perform operations. The operations may include receiving video data, normalizing image frames, generating difference images, and generating an image sequence generator model. The operations may include training an autoencoder model using difference images, the autoencoder comprising an encoder model and a decoder model. The operations may include identifying a seed image frame and generating a seed difference image from the seed image frame. The operations may include generating, by the image sequence generator model, synthetic difference images based on the seed difference image. In some aspects, the operations may include using the decoder model to synthetic normalized image frames from the synthetic difference images. The operations may include generating synthetic video by adding background to the synthetic normalized image frames.

Abstract: A server is disclosed. A server for providing a content to a user terminal device providing a virtual reality service comprises: a communication unit for performing communication with at least one source device and the user terminal device; and a processor for, when a content transmission request for a preconfigured location is received from the user terminal device, receiving a content photographed in a real time from a source device of the preconfigured location on the basis of location information received from at least one source device, and providing the content to the user terminal device.

Abstract: Provided are a method and apparatus for allocating differential bandwidth for each screen region by using image complexity information. According to an embodiment, a method and apparatus for receiving streaming data request a server for information relating to content to differentially determine quality of a plurality of regions divided from a predetermined frame of the content according to a network state; among at least one segment for each region encoded with at least one quality for each of the plurality of regions, receive a segment for each region encoded according to the quality for each region determined based on the information relating to the content from the server over a network; generate a reconstruction image for each region by decoding the segment for each region; and merge and render the reconstruction image for each region.

Abstract: A method is provided for modifying an image. The method comprises displaying an image, the image comprising a portion of an object; and determining if an edge of the object is in a location within the portion. The method further comprises detecting movement, in a member direction, of an operating member with respect to the edge. The method still further comprises moving, if the edge is not in the location, the object in an object direction corresponding to the detected movement; and modifying, if the edge is in the location, the image in response to the detected movement, the modified image comprising the edge in the location.

Abstract: Systems, methods, and computer-readable media for a jewelry generation service are provided.

Abstract: Systems and methods described herein are directed towards controlling a level of detail for geostreaming data. In some examples, an identifying event data that includes location information. A polygon may be defined that comprises points on a map corresponding to the event data. A first level of detail may be determined and a fidelity of the polygon may be changed based at least in part on the first level of detail. Second event data may be received that identifies a location of an object. It may be identified whether the object is within the location information and a user interface may be prepared that presents whether the object is in an affected area.

Abstract: An example preprocessor circuit for formatting image data into a plurality of streams of image samples includes: a plurality of memory banks configured to store the image data; multiplexer circuitry coupled to the memory banks; a first plurality of registers coupled to the multiplexer circuitry; a second plurality of registers coupled to the first plurality of registers, outputs of the second plurality of registers configured to provide the plurality of streams of image samples; bank address and control circuitry coupled to control inputs of the plurality of memory banks, the multiplexer circuitry, and the first plurality of registers; output control circuitry coupled to control inputs of the second plurality of registers; and a control state machine coupled to the bank address and control circuitry and the output control circuitry.

Abstract: Systems and methods of using augmented reality (AR) with object recognition (OR) in a physical environment to advance a narrative may be provided. For example, the system may access narrative data representing the narrative. The system may, for a first node of the one or more nodes: generate a user interface associated with the narrative for the first node and access a first decision rule specifying a first physical object to be recognized to advance past the first node in the narrative. The system may further perform image recognition on an image of the physical environment, determine that the first physical object is in the physical environment based on the image recognition, transition from the first node in the narrative based on the first decision rule and the determination, and update the user interface to a second node in the narrative based on the transition from the first node.

Abstract: A Virtual Reality (VR) system and method are provided that facilitates diagnosing and solving problems associated with a terminal. A VR session is established and a VA room rendered for participants. Files describing and program instructions for interactively manipulating the terminal are loaded into the VR room. At least one component piece of the SST is manipulated based on direction provided by a VR input device operated by a participant during the VR session.

Abstract: Provided is an image processing apparatus that: acquires a depth map that includes information that indicates a distance up to a subject in an actual space, the depth map including, for each of one or a plurality of areas in the depth map, information regarding the distance up to a subject portion that appears in the area and regarding a color component of the subject portion; and generates a composite image in which a virtual object is arranged in a scene image that represents a scene of the actual space. The image processing apparatus determines a display color of the virtual object on the basis of the distance up to the subject portion that appears in the depth map and the color component thereof.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for optimizing three-dimensional models. One of the methods includes determining, for a three-dimensional model of an object to be optimized, a plurality of points on the object that each have at least a threshold likelihood of being a focal point, the object having two or more regions each of which include one or more textures, one or more meshes, or both; identifying, from the two or more regions, one or more non-focal regions that i) each do not include any of the plurality of points, and ii) are a proper subset of the two or more regions; generating, using the one or more non-focal regions, an optimized three-dimensional model for the object with a smaller size less than a larger size of the three-dimensional model; and storing the optimized three-dimensional model in a non-volatile memory.

Abstract: Described herein are systems and methods that place a known color monitor (known by unique serial number or SKU) into a desired state for displaying digital pathology image data. Using an application programming interface, any color monitor that implements MCCS can be calibrated and characterized immediately before each display of digital pathology image data and can also be periodically reset (if needed) during display of digital pathology image data.