Abstract: Techniques are disclosed for real-time mapping in a movable object environment. A real-time mapping system can include at least an unmanned aerial vehicle (UAV), comprising a propulsion system, a main body coupled to the propulsion system and a payload assembly coupled to the main body via a payload port, wherein the payload assembly is configured to couple to the payload port and support a scanning sensor and a positioning sensor.

Abstract: A method for generating an effect video, an apparatus for generating an effect video, an electronic device, and a storage medium are provided by embodiments of the present disclosure. The method includes: obtaining, in response to detecting that an effect generation condition is met, at least two video frames to be processed which are associated with a current moment; generating a target face dynamic image based on a face image of a target object in the at least two video frames to be processed, and blending the target face dynamic image into a target effect to obtain a target effect image; and determining an effect video frame in a target effect video based on the target effect image and a video frame to be processed which corresponds to the current moment.

Abstract: In a first area in a virtual space, an example of an information processing system renders a first shadow positioned in a first direction from an object, and a second shadow positioned in a second direction from the object. The information processing system renders a third shadow positioned in the second direction from the object, in a second area darker than a first reference area corresponding to a range in the first area. The information processing system renders the third shadow such that a color difference between a color in a second reference area corresponding to a range, in the second area, in which the third shadow is not positioned, and a color in the area of the third shadow is greater than a color difference between a color in the first reference area and a color in the area of the second shadow.

Abstract: A virtual object display method, a non-transitory computer-readable storage medium and an electronic device. The virtual object display method includes operations as follows. Localization is performed on the first device to determine a pose of the first device in a target coordinate system; a pose of a second device in the target coordinate system is determined, where the second device is configured to play audio; a virtual object corresponding to the audio is determined, and a pose of the virtual object in the target coordinate system is determined based on the pose of the second device in the target coordinate system; and in response to the second device is playing the audio, the virtual object is displayed on a display interface of the first device according to the pose of the first device in the target coordinate system and the pose of the virtual object in the target coordinate system.

Abstract: The present disclosure provides an asynchronous rendering method and apparatus, a device and a storage medium. The asynchronous rendering method is applied to a rendering engine, the rendering engine includes a synchronous rendering process and an asynchronous rendering process. The method includes: grouping primitives in an interface to be rendered to a plurality of primitive groups based on functions corresponding to each primitive of the primitives; determining rendering flags corresponding to each of the plurality of primitive groups, wherein the rendering flags include a synchronous rendering flag and an asynchronous rendering flag; and rendering primitive groups based on the rendering flags corresponding to each of the plurality of primitive groups, wherein a primitive group with the synchronous rendering flag is rendered by the synchronous rendering process, and a primitive group with the asynchronous rendering flag is rendered by the asynchronous rendering process.

Abstract: A system and a method of volumetric data processing include receiving volumetric data corresponding to a digital asset, the digital asset including a plurality of frames; creating a file to represent the volumetric data in a flat file format, the flat file format representing the plurality of frames arranged in a plurality of buffers in the file, each of the plurality of buffers being assigned with a fixed number of frames; and providing the file to a client device for a rendering of the digital asset.

Abstract: Aspects of the present disclosure involve a system for performing ray tracing between augmented reality (AR) and real-world objects. The system accesses, by the mobile device, a video depicting a first object. The system obtains, by the mobile device, a three-dimensional (3D) model of the first object. The system applies, by the mobile device, a ray tracing process to the 3D model of the first object to estimate an optical effect on a portion of the first object relative to a second object that is depicted in the video. The system modifies a visual property of the portion of the first object based on the optical effect relative to the second object.

Abstract: Disclosed are an image content extraction method and an image content extraction apparatus, a terminal, and a storage medium. The image content extraction method includes acquiring an image to be processed. Performing high-contrast retention on the image to be processed to obtain a high-contrast image of the image to be processed. Performing image fusion on the image to be processed and the high-contrast image to obtain a fused image. Performing linear light enhancement on the fused image to obtain a linear light-enhanced image. And using first pixel points, having pixel values located within a preset pixel value range, in the linear light-enhanced image as an image content of the image to be processed. The present disclosure can improve the integrity of image content extraction.

Abstract: A loop shape representing a floor plan is extracted from an imperfect or incomplete floor plan scan by applying building construction techniques to fill in missing information. The floor plan is shown to the user during all stages of assembly, allowing the user to make a purposeful mark on the display, changing how the incomplete scan is interpreted. Whenever a marking is placed the floor plan is regenerated.

Abstract: A wearable device can have a field of view through which a user can perceive real or virtual objects. The device can display a visual aura representing contextual information associated with an object that is outside the user's field of view. The visual aura can be displayed near an edge of the field of view and can dynamically change as the contextual information associated with the object changes, e.g., the relative position of the object and the user (or the user's field of view) changes.

Abstract: Provided are a computer program, a method, and a server in which a possibility that a load on display control increases is reduced, compared to the related art. According to an exemplary embodiment of such a configuration, first data relevant to a first position in a virtual space in which a first avatar manipulated by using a first terminal of a first user exists is acquired, whether or not a first condition is satisfied is determined, second data is received in a case where it is determined that the first condition is satisfied, control data for controlling a display unit of the first terminal such that at least the virtual object is displayed on the display unit of the first terminal is decided on the basis of the second data, and the display unit is controlled on the basis of the control data.

Abstract: Methods and systems are disclosed for generating AR experiences on a messaging platform. The methods and systems perform operations including: detecting a real-world object depicted in a first image captured by a first camera of a client device, the client device comprising a second camera; extracting one or more textures from the real-world object depicted in the first image; selecting a target object depicted in a second image captured by the second camera, the second image being captured by the second camera simultaneously with the first image captured by the first camera; generating an augmented reality (AR) element comprising the target object modified based on the one or more textures extracted from the real-world object depicted in the first image; and causing display of the AR element within the second image.

Abstract: The subject technology retrieves, by a client device from a storage device, first image data captured by the client device at a previous time. The subject technology receiving first metadata corresponding to a selected image processing operation. The subject technology generates second image data based on the first metadata and the image processing operation performed on the first image data. The subject technology generates second metadata comprising information related to the image processing operation, the second metadata including a first identifier associated with the first image data, and second identifier associated with the second image data. The subject technology generates a message comprising the second metadata, the second image data, and the first image data.

Abstract: A system receives image data associated with an item, where the image data comprising a view of the item from two or more angles; determines physical attributes of the item; generates a base model of the item; samples the base model to generate one or more sampled models, each of the one or more sampled models comprising a subset of the geometric data, the subset of the geometric data determined based on one or more device characteristics of one or more user devices that interface with the system; receives device characteristics of a user device associated with a request from the user device for the item; selects, based on the received device characteristics, a sampled model of the item; and transmits a data object comprising the selected sampled model to the user device to cause the user device to generate a three-dimensional rendering of the item.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately and flexibly generating modified digital images utilizing a novel swapping autoencoder that incorporates scene layout. In particular, the disclosed systems can receive a scene layout map that indicates or defines locations for displaying specific digital content within a digital image. In addition, the disclosed systems can utilize the scene layout map to guide combining portions of digital image latent code to generate a modified digital image with a particular textural appearance and a particular geometric structure defined by the scene layout map. Additionally, the disclosed systems can utilize a scene layout map that defines a portion of a digital image to modify by, for instance, adding new digital content to the digital image, and can generate a modified digital image depicting the new digital content.

Abstract: Content distribution systems for displaying a virtual space to user terminals, content distribution methods executed by a content distribution system including at least one processor, and non-transitory computer-readable media storing a content distribution program are disclosed. An example system according to the disclosure includes at least one processor that detects when an avatar corresponding to a first user performs a predetermined action in a virtual space, and displays a content image of the virtual space on a user terminal of a second user among the plurality of user terminals. The predetermined action is invisible in the content image when the processor detects that the avatar performs the predetermined action.

Abstract: In the present invention, date and time are set in a horizontal direction and blood pressure is set in a vertical direction on a display screen, and a change in a blood pressure value over a display target period is displayed as a bar graph with vertical bars each formed by connecting SBP and DBP for each time and arranged in the horizontal direction. When a position corresponding to a vertical bar at a specific time on the display screen is designated with a pointing device, blood pressure value data measured for each day at the specific time are averaged over the display target period to obtain a systolic blood pressure average value and/or a diastolic blood pressure average value, according to the position designated. The obtained systolic blood pressure average value and/or diastolic blood pressure average value is displayed together with the bar graph on the display screen.

Abstract: Embodiments include systems and methods for generating 2D and 3D layouts from a physical 3D space captured by a capturing device, the layouts having an identical scale to the physical 3D space, and estimating measurements of the physical 3D space from the layouts. The capturing device captures a point cloud or 3D mesh of the physical 3D space, from which one or more planes are identified. These one or more planes can then be used to create a virtual 3D reconstruction of the captured 3D space. In other embodiments, one plane may be identified as a floor plane, and features from the point cloud or 3D mesh that are above the floor plane may be projected onto the floor plane to create a top down view and 2D layout. Other embodiments are described.

Abstract: The disclosed method encompasses registering an augmented reality device such as augmented reality glasses with a tracking coordinate system associated with a position tracking system. This may be effected by different approaches, for example by using a distance measurement unit (depth sensor) of the augmented reality device to determine a position of the augmented reality device relative to an object in a medical environment such as in surgery or radiotherapy/radiosurgery. The object may additionally be tracked by the position tracking system so that on the basis of the distance measurement, a relative position between the augmented reality device and the tracking coordinate system can be determined in order to register the augmented reality device with the position tracking system. This registration allows displaying augmentation information in a desired context and/or at a desired location in the image of the medical environment captured by the augmented reality device.

Abstract: Embodiments of the present disclosure provide methods, apparatus, devices, and media for publishing video. In one exemplary method, acquiring an image and music; presenting the image on a canvas; determining a color of the canvas based on a color in the image; and generating the video for publishing by compositing the image, the canvas, and the music, wherein the video has the music as a soundtrack and statically presents the image on the canvas. In this way, users can freely edit an image and generate a high-quality video according to the edited image, which is beneficial to increase the user's enthusiasm for participating in short video creation and improve the user's viscosity.