Abstract: Embodiments of the present application provide a data processing method and an electronic device. The data processing method includes: determining whether a current collection scene satisfies a condition for enabling a high-dynamic range (HDR) collection function; automatically enabling the HDR collection function in response to the current collection scene satisfying the condition for enabling the HDR collection function; and collecting at least two two-dimensional images with different exposures within a collection time of one frame of three-dimensional video data based on the HDR collection function; wherein the at least two two-dimensional images are configured to enable a mobile edge computing (MEC) server to build a three-dimensional video.

Abstract: Embodiments of this application provide a virtual scene display method performed at a computing device. The method includes: obtaining animation data and video data; displaying an animation interface corresponding to the animation data in an animation display area of a display interface, the animation interface including a first virtual scene including a plurality of animation elements; and playing a video clip in the video data in response to an operation on the animation elements in the animation interface, the video clip presenting a picture of transformation from the first virtual scene to a second virtual scene. A virtual scene display solution provided in the embodiments of this application can reduce resource consumption of an intelligent device and reduce picture stutter.

Abstract: An electronic device includes a display and an image capture device electronically capturing one or more images of a subject performing an activity. A wireless communication device can electronically transmit the one or more images to a remote electronic device across a network after a Procrustes superimposition operation is performed to compare the subject to a standard. The wireless communication device can electronically receive one or more electronically altered images identifying differences between one or more standard reference locations situated at one or more predefined features of the standard performing the activity and one or more corresponding subject reference locations situated at one or more predefined features of the subject performing the activity. These electronically altered images can be presented on the display of the electronic device to provide corrective feedback to the subject as how to better perform the activity.

Abstract: Mechanisms for generating compressed images are provided. More particularly, methods, systems, and media for capturing, reconstructing, compressing, and rendering view-dependent immersive light field video with a layered mesh representation are provided.

Abstract: Described are systems and method directed to generation of a dimensionally accurate three-dimensional (“3D”) body model of a body, such as a human body, based on two-dimensional (“2D”) images of that body. A user may use a 2D camera, such as a digital camera typically included in many of today's portable devices (e.g., cell phones, tablets, laptops, etc.) and obtain a series of 2D body images of their body from different directions with respect to the camera. The 2D body images may then be used to generate a plurality of predicted body parameters corresponding to the body represented in the 2D body images. Those predicted body parameters may then be further processed to generate a dimensionally accurate 3D model of the body of the user.

Abstract: The present disclosure is directed to a software tool that facilitates the presentation of a three-dimensional view of a construction project as well as the generation of various types of two-dimensional technical drawings based on this three-dimensional view. In one implementation, the software tool causes a computing device to engage in the following operations. The computing device may receive a user input identifying at least one first mesh and at least one second mesh, determine portions of each identified mesh that intersect with a two-dimensional plane, and generate a two-dimensional drawing including a display of relevant dimensioning information based on the determined portions.

Abstract: A head-mounted device (HMD) of a first user has a transparent display. The HMD determines location information of a second user relative to the HMD of the first user. The second user is located within a predefined distance of the HMD. The location information identifies a distance and a direction of the second user relative to the HMD. The HMD receives audio content from the second user, generates augmented reality (AR) content based on the audio content, and displays the AR content in the transparent display based on the location information of the second user. The AR content appears coupled to the second user.

Abstract: A method for generating an output image from an input image and an input text instruction that specifies a location and a modification of an edit applied to the input image using a neural network is described. The neural network includes an image encoder, an image decoder, and an instruction attention network. The method includes receiving the input image and the input text instruction; extracting, from the input image, an input image feature that represents features of the input image using the image encoder; generating a spatial feature and a modification feature from the input text instruction using the instruction attention network; generating an edited image feature from the input image feature, the spatial feature and the modification feature; and generating the output image from the edited image feature using the image decoder.

Abstract: A system, apparatus, and method for predicting a camera lens attribute using a neural network are presented. The predicted camera lens parameter may be used to produce a 3D model of an object from one or more 2D images of the object.

Abstract: Methods and apparatus for generating a data structure for storing primitive data for a number of primitives and vertex data for a plurality of vertices, wherein each primitive is defined with reference to one or more of the plurality of vertices. The vertex data comprises data for more than one view, such as a left view and a right view, with vertex parameter values for a first group of vertex parameters being stored separately for each view and vertex parameter values for a second, non-overlapping group of vertex parameters being stored only once and used when rendering either or both views.

Abstract: Embodiments are directed to neural network processing for multi-object three-dimensional (3D) modeling. An embodiment of a computer-readable storage medium includes executable computer program instructions for obtaining data from multiple cameras, the data including multiple images, and generating a 3D model for 3D imaging based at least in part on the data from the cameras, wherein generating the 3D model includes one or more of performing processing with a first neural network to determine temporal direction based at least in part on motion of one or more objects identified in an image of the multiple images or performing processing with a second neural network to determine semantic content information for an image of the multiple images.

Abstract: User interfaces, systems, methods, devices, media, and instructions are described for a client/contractor management and communication system with augmented reality (AR) and/or virtual reality (VR) interface elements. In one embodiment, a device receives finish and inspiration information associated with a home improvement project from a client and structures this information into finish pin data with associated project context information and 3D model data. The device uses this information to automatically generate and update a project chart for the project, along with 3D models for various subproject positions within a project chart. This information is then presented to the client and associated contractors as part of a user interface for a client/contractor system. A project chart interface enables access to 3D models in an AR or VR interface to display models of the project and various project data associated with different positions in a project chart.

Abstract: Real time ray tracing-based adaptive multi frequency shading. For example, one embodiment of an apparatus comprising: rasterization hardware logic to process input data for an image in a deferred rendering pass and to responsively update one or more graphics buffers with first data to be used in a subsequent rendering pass; ray tracing hardware logic to perform ray tracing operations using the first data to generate reflection ray data and to store the reflection ray data in a reflection buffer; and image rendering circuitry to perform texture sampling in a texture buffer based on the reflection ray data in the reflection buffer to render an output image.

Abstract: Education curricula materials include encoded indicia such as a QR code that contains information related to identifying requested augmented reality image data from a server over a network. By scanning the QR code, a computer uses its decoding software to create a data set for transmitting to the server. The data set may include an identifier for selected augmented reality image data associated with the user's curriculum, information about the curriculum at issue, the academic level of the user, and any other data necessary to ensure that the most appropriate augmented reality image data is transmitted back to the computer. The server transmits comprehensive augmented reality image data back to the computer for viewing on a computerized display accessible by a student. Part of the content may include an interactive pedagogical agent that helps the student with a part of the instruction related to a portion of the curriculum.

Abstract: Examples of the disclosed systems and methods may provide for improved and more realistic rendering of virtual characters and a more realistic interaction between a user and virtual characters. For example, the systems and methods describe techniques for mathematically generating a map used for animating facial expressions in a multidimensional animation blendspace. As another example, the systems and methods describe a transition system for dynamically transitioning facial expressions across a face of the virtual character. As another example, realistic physical movements can be added to a virtual character's facial expressions to provide interactivity with other virtual characters.

Abstract: One embodiment provides a method comprising determining metadata corresponding to an input image, determining a black level of a display device and a peak luminance value of the display device, and determining a tone mapping function that adaptively compensates for the black level of the display device based on the metadata, the black level of the display device, and the peak luminance value of the display device. The metadata comprises a distribution of luminance values in the input image. The black level of the display device and the peak luminance value of the display device represent a lowest luminance value and a highest luminance value, respectively, achievable on the display device. The method further comprises applying the tone mapping function to the input image to generate a tone-mapped image that adaptively compensates for the black level of the display device and provided to the display device for presentation.

Abstract: An decoding device, an encoding device and a method for point cloud encoding is disclosed. The method includes generating, from a three-dimensional point cloud, multiple two-dimensional frames, the two-dimensional frames including at least a first frame representing a geometry of points in the three-dimensional point cloud and a second frame representing texture of points in the three-dimensional point cloud. The method also includes generating an occupancy map indicating locations of pixels in the two-dimensional frames that represent points in the three-dimensional point cloud. The method further includes encoding the two-dimensional frames and the occupancy map to generate a compressed bitstream. The method also includes transmitting the compressed bitstream.

Abstract: A medical image processing apparatus according to an embodiment includes processing circuitry. The processing circuitry is configured to obtain a measurement value related to the shape of a heart valve in medical image data. The processing circuitry is configured to cause a display to display a numerical value related to the shape of an artificial valve to be placed for the heart valve.

Abstract: Disclosed is an approach for generating interactive visualizations for multi-nodal transfers that may involve terminal nodes and multiple transitional nodes by using various protocols to acquire data from computing systems or devices associated with each node. A first visualization layer comprising a set of geographic or physical indicators in a multi-nodal transfer route (which comprises a set of three or more nodes) may be generated. API protocols (and/or non-API protocols) corresponding to each node in the transfer route may be identified. The protocols may be executed to obtain, from computing systems and devices associated with the nodes, data packets used to generate a second visualization layer, which may comprise graphics that visually depict details of a transfer along the transfer route. An overlay of visualization layers may be displayed such that the graphics are displayed in association with multiple nodes.

Abstract: Even if a generated wide-field image includes residual local misalignment, this charged particle microscope device can prompt for user input to correct such local misalignment, and can regenerate, on the basis of the user input, a wide-field image that includes little misalignment even in local areas of the overlap regions thereof.