Abstract: In various examples, systems and methods are disclosed that relate to data augmentation for training/updating perception models in autonomous or semi-autonomous systems and applications. For example, a system may receive data associated with a set of frames that are captured using a plurality of cameras positioned in fixed relation relative to the machine; generate a panoramic view based at least on the set of frames; provide data associated with the panoramic view to a model to cause the model to generate a high dynamic range (HDR) panoramic view; determine lighting information associated with a light distribution map based at least on the HDR panoramic view; determine a virtual scene; and render an asset and a shadow on at least one of the frames, based at least on the virtual scene and the light distribution map, the shadow being a shadow corresponding to the asset.

Abstract: In an embodiment, operations include receiving a graph dataset including a set of graphs. The operations further include generating, by a task scheduler, a set of task queues configured to process the received graph dataset in parallel. The operations further include determining, by the set of task queues, a set of graph attributes for each graph of the set of graphs. The operations further include receiving, by a web service, one or more graph attributes of the determined set of graph attributes. The operations further include transmitting, by the web service, attribute information including the received one or more graph attributes to a client browser. The client browser is configured to determine a set of graph views based on the transmitted attribute information. The operations further include controlling rendering of the determined set of graph views on the client browser.

Abstract: An interface display method and an electronic device are provided. The method includes: performing screen-on interception in response to a screen wakeup operation performed by a user on an electronic device, to prevent a screen from being lit up; drawing an interface adapted to a screen orientation; and after the interface is drawn, disabling screen-on interception, and displaying the interface based on the screen orientation. The electronic device may collect and report data in real time through a sensor, and calculate a current screen orientation in real time, so that the drawn interface adapts to the current screen orientation.

Abstract: An avatar generation system includes an acquisition unit, an execution unit, a detection unit, and an output unit. The acquisition unit acquires setting data for bones and meshes of an avatar. The execution unit executes processing of changing a posture of the avatar based on the setting data and a defined movement. The detection unit detects a state of penetration between the meshes constituting the avatar based on data in which the posture of the avatar has been changed. The output unit outputs a result of the detection.

Abstract: An improved algorithm and technique for use in interactive graphics is disclosed. The new algorithm works by keeping three values in fast, memoryless pixel local storage for coverage counting (store the current coverage count at the pixel being covered), original framebuffer color (stores the color that was in the framebuffer at the pixel being covered immediately before the current path starts rendering), and the path ID (stores the unique ID of the last path to be drawn at the current pixel). The framebuffer is accessed from a fourth, texture-backed, pixel local storage plane.

Abstract: An image display method and apparatus are provided. The method includes: determining a target display position of a target object in an original image and a first size of a display region of an ink screen (102); generating a monochrome image with the first size according to the original image, where color values of pixel points in the monochrome image include at least one standard color value, and the target object is located at a target display position in the monochrome image (104); sending the monochrome image to the ink screen, so that the monochrome image is displayed by the ink screen in the display region (106). This method can improve the definition of the monochrome image displayed by the ink screen.

Abstract: Generating a three-dimensional virtual representation of a three-dimensional physical object can be based on capturing or receiving a capture bundle or a set of images. In some examples, generating the virtual representation of the physical object can be facilitated by user interfaces for identifying a physical object and capturing a set of images of the physical object. Generating the virtual representation can include previewing or modifying a set of images. In some examples, generating the virtual representation of the physical object can include generating a first representation of the physical object (e.g., a point cloud) and/or generating a second three-dimensional virtual representation of the physical object (e.g., a mesh reconstruction). In some examples, a visual indication of the progress of the image capture process and/or the generation of the virtual representation of the three-dimensional object can be displayed, such as in a capture user interface.

Abstract: Distributed real-time rendering is a cutting-edge solution to address the ever-increasing demands for realistic and immersive visual experiences, such as provided by augmented or artificial reality applications. Embodiments of the present specification provide a method and a system for distributed real-time rendering of a scene. The rendering is distributed among a root instance and a plurality of node instances. The root instance receives the scene to render, segments it into a plurality of objects, computes lighting parameters, assigns rendering tasks associated with objects to node instances, and communicates object metadata and the lighting parameters to the assigned node instance. The node instances render objects and create point clouds and u, v maps, which are then used by the root instance to render the scene for real-time display. The method and system can be used by end devices that include position sensors, processors, communication means and a display to provide immersive experiences.

Abstract: Disclosed is a circuit and a method for video data conversion and a display device. The circuit comprises: a pixel splicing module, to sequentially receive each group of pixel data in each frame of image data in input video data, to perform pixel splicing on the received pixel data, and to output spliced pixel data; a data conversion module, to perform data processing on the spliced pixel data to convert each frame of image data into first image data representing a first part of the corresponding frame of image and second image data representing a second part of the corresponding frame of image. The first part at least comprises a left half part of the frame of image, the second part at least comprises a right half part of the frame of image. Data throughput requirements can be met while dynamic contrast and sharpening processing is performed.

Abstract: In one embodiment, a method includes accessing, by a computing device, a natural-language input comprising a description of an avatar and generating, from the natural-language input and by a trained avatar-creation model, a set of avatar-attribute feature vectors. The method further includes determining, by a trained avatar-attribute classifier, one or more avatar attributes from the set of avatar-attribute feature vectors; and generating the avatar based on the determined one or more avatar attributes for presentation on a display of a computing device.

Abstract: A method for generating a set of adversarial patches for an image. The method includes segmenting the image into a plurality of regions; selecting a set of target regions that satisfies an attacking criterion by discretely searching of the plurality of regions; and generating a set of adversarial patches by using the set of target regions.

Abstract: A method for labeling a road element includes: obtaining a sequence of road geometry line points of a first road in a three-dimensional map, the sequence of road geometry line points including a plurality of location points for drawing an outline of a road geometry of the first road; segmenting the first road based on the sequence of road geometry line points, to obtain a plurality of road segments of the first road, a road surface of a road segment being drawn as a plane; and determining, in response to that a target road element spans a boundary line of two adjacent road segments in the first road, a joint point located on the boundary line, the joint point being configured as a label to divide the target road element to two sections that are respectively placed on the road surfaces of the two adjacent road segments.

Abstract: In various embodiments, a dubbing application performs three-dimensional (3D) tracking of (1) the face of an actor within video frames of a first media content item to generate 3D geometry representing the face of the actor, and (2) the face of a dubber within video frames of a second media content item to generate 3D geometry representing the face of the dubber. The dubbing application also tracks the texture and lighting of the face of the actor in the first media content item. The dubbing application aligns the 3D geometry of the face of the dubber with the 3D geometry of the face of the actor. Then, the dubbing application performs neural rendering to generate dubbed video frames using a trained machine learning model, the aligned 3D geometry of the dubber, the texture and lighting of the face of the actor, and the video frames of the first media content.

Abstract: A method and system for manipulating visual effects in a drawing or art software application are provided. The method includes receiving a user input initiated by a user on a canvas of the drawing or art software application, the user input including a request for creating a text or non-text object; detecting a presence of one of a predefined set of commands in the user input; determining one or more of a type, subject, and content for a to-be-created object by examining the detected command and one or more words before the detected command; and automatically creating the text or non-text object corresponding to the determined one or more of a type, subject, and content without requiring the user to select a text or drawing tool from tool sections of the drawing or art software application.

Abstract: An image rendering method includes the steps below. A model of an environmental object is rendered to obtain an image of the environmental object in a target perspective. An image of a target object in the target perspective and a model of the target object are determined according to a neural radiance field of the target object. The image of the target object is fused and rendered into the image of the environmental object according to the model of the target object.

Abstract: Embodiments of the present disclosure provide an information processing method and device, the method includes: in response to detecting first change information that a three dimensional map is changed, determining second change information of an anchor point based on the first change information, the anchor point being pre-associated with a first image frame of the three dimensional map; adjusting a pose of the anchor point based on the second change information. According to the method in the present disclosure, when the three dimensional map is changed, the anchor point of the three dimensional map can change with the change of the first image frame with which the anchor point is associated, so that the display of the anchor point remains relatively stable, and the problem that the display of the anchor point is stagger when the three dimensional map is changed is avoided.

Abstract: Embodiments relate to techniques for real-time and post-scan visualization of intraoral scan data, which may include 3D images, 3D scans, 3D surfaces and/or 3D models. In one embodiment, an intraoral scanning system comprises a plurality of image sensors to periodically generate a set of intraoral two-dimensional (2D) images, wherein for each set of intraoral 2D images each image sensor of the plurality of image sensors is to generate an intraoral 2D image, and wherein relative positions and orientations of the plurality of image sensors are known. The intraoral scanning system further comprises a computing device, wherein the computing device is to perform the following for each set of intraoral 2D images: generate a combined intraoral image based on merging the set of intraoral 2D images together during scanning; and output the combined intraoral image to a display.

Abstract: Devices, systems, and methods for three-dimensional (3D) evaluation point (3DEP) identification; wherein a method can include receiving a first conjugate point of a first real two-dimensional (2D) image, receiving a second conjugate point of a second real 2D image, the first and second conjugate points corresponding to a same geographical location, determining a first set of points of a 3D point set that project to within a specified distance of the first conjugate point in the first real 2D image, determining a second set of points of the 3D point set that project to within the specified distance of the second conjugate point in the second real 2D image, identifying a common point in both the first set of points and the second set of points that satisfies a specified heuristic relative to all other points in both the first set of points and the second set of points, and using the point as the 3DEP.

Abstract: In one implementation, a method of rendering a scene including a portal is performed by a device including one or more processors and non-transitory memory. The method includes obtaining a rendering of first content having a plurality of first pixels at respective pixel locations having respective first pixel color values. The method includes obtaining a portal count map having a plurality of portal count pixels at the respective pixel locations having respective pixel portal count values indicating whether the corresponding pixel location corresponds to a portal. The method includes obtaining a rendering of second content having a plurality of second pixels at the respective pixel locations having respective second pixel color values. The method includes obtaining a portal cross map having a plurality of portal cross pixels at the respective pixel locations having respective pixel portal cross values indicating whether the corresponding pixel location corresponds to second content outside the portal.

Abstract: A method incudes receiving multiple tags along an ablation curve that covers a partial circumference over an inner wall of a cardiac chamber of a heart of patient. Using the tags, the ablation curve is completed to a full circumference over the inner wall to eliminate a conduction gap in the ablation curve.