Abstract: Current techniques for rendering content using data on multiple devices are generally ineffective and/or inefficient. This disclosure provides more effective and/or efficient techniques for rendering such content. The techniques optionally complement or replace other methods for rendering content.

Abstract: Embodiments of this application provide a picture content enhancement method and system, and an electronic device, and relate to the field of computer vision and video content enhancement technologies. The method includes: recognizing and tracking at least one first target object based on a picture video stream, to obtain attribute information and real-time position information of the first target object; obtaining status data associated with the first target object; and for any first target object, generating a corresponding information buoy by using the real-time position information as a spatial anchor, and overlaying and rendering the information buoy onto a corresponding frame of the picture video stream, where visual content of the information buoy dynamically reflects the status data. The method is used to improve interaction.

Abstract: Aspects of the present disclosure include methods for label-free particle sorting. Methods according to certain embodiments include measuring light from a sample having label-free particles in a flow stream, generating an image of one or more of the particles from the measured light, calculating image parameters from the generated image of the one or more particles and generating a particle sort decision based on the calculated image parameters. In some embodiments, sorting gates are determined based on image parameters calculated from the particle and ground-truth image classification parameters. Systems and integrated circuit devices (e.g., a field programmable gate array) for practicing the subject methods are also described. Non-transitory computer readable storage medium are also provided.

Abstract: Systems and methods for updating remote memory side caches in a multi-GPU configuration are disclosed herein. In one embodiment, a graphics processor for a multi-tile architecture includes a first graphics processing unit (GPU) having a first memory, a first memory side cache memory, a first communication fabric, and a first memory management unit (MMU). The graphics processor includes a second graphics processing unit (GPU) having a second memory, a second memory side cache memory, a second memory management unit (MMU), and a second communication fabric that is communicatively coupled to the first communication fabric. The first MMU is configured to control memory requests for the first memory, to update content in the first memory, to update content in the first memory side cache memory, and to determine whether to update the content in the second memory side cache memory.

Abstract: The present disclosure provides immersive content displaying method and display device. The display device includes front camera, processor and display panel. The immersive content displaying method includes: by the processor, obtaining first pose of the display device and second pose of the display device, wherein the first pose is corresponding to first timestamp at which the front camera captures frame image, and the second pose is corresponding to second timestamp at which the processor receives the frame image; by the processor, generating predicted movement of the display device after the second timestamp according to the first pose and the second pose; by the processor, processing partial area of the frame image according to the predicted movement, to generate base image; and by the display panel, displaying the base image to provide immersive content.

Abstract: A digital human generation method, an electronic device and a storage medium are disclosed. The solution relates to the fields of augmented reality technologies, virtual reality technologies, computer vision technologies, deep learning technologies, or the like, and can be applied to scenarios, such as metaverse, a virtual digital human, or the like. An implementation includes: acquiring a corresponding target object model based on a picture of a to-be-generated digital human; acquiring a corresponding point cloud of a head key feature in the picture from a pre-configured feature library based on the head key feature; and fusing the point cloud of the head key feature in the target object model to obtain a digital human figure.

Abstract: Techniques are described for an autoregressive user input-to-video (e.g., text-to-video or image-to-video) generation. Using these approaches, a video of unlimited length and without temporal inconsistencies is generated based on the user input. In an implementation, the system receives user input, having particular content, to generate a sequence of video frames, having the same content. The system generates an output sequence of video frames, having the same particular content, by iteratively denoising the frames and conditioning the generation based on the user input. The system may additionally integrate initial anchor frame features with the user input when conditioning the generation of the output sequence of frames. The system may additionally condition each denoising iteration of the output sequence of video frames based on the features of the previous sequence of output video frames.

Abstract: Provided are an image processing method and apparatus, and an electronic device and a computer-readable storage medium, which relate to the technical field of image processing. The method is applied to a terminal, and the terminal comprises a first photographing apparatus and a second photographing apparatus. The method comprises: collecting a first video image by means of a first photographing apparatus, and displaying the first video image on a screen; and when it is detected that a display object in the first video image meets a pre-set switching condition, switching to collecting a second video image by means of a second photographing apparatus, and displaying the second video image on the screen. By means of the embodiments of the present disclosure, the automatic switching of a photographing apparatus can be realized on the basis of a display object in an image collected by the photographing apparatus.

Abstract: A method for generating a traffic event video includes the following. Map alignment of a set of moving trajectory coordinates corresponding to a moving video with an electronic map is performed, and a set of trajectory map information corresponding to the moving trajectory coordinates is obtained from the electronic map. At least one event map information conforming to an event trajectory model from the set of trajectory map information and a plurality of image frame information of the moving video corresponding to the image frame information of the trajectory map information are obtained, and a plurality of location information of a virtual object is generated according to the event trajectory model. A video segment is extracted from the moving video based on the image frame information, and the virtual object and the video segment are synthesized based on the location information to generate a traffic event video corresponding to the event trajectory model.

Abstract: An extended reality (XR) platform may determine one or more parameters for displaying XR content. The XR platform may receive a request to display the XR content from an XR device associated with a user. The XR platform may determine the one or more display parameters based on a context associated with the XR device and/or the user of the XR device.

Abstract: Methods and/or apparatus provide for virtual sickness reduction by carrying out actions, including: positioning a headband of a head-mounted display to wrap around a user's head; causing a display section, coupled to the headband, to be positioned in front of the user when the head-mounted display is worn by the user, and to display a moving image representing a state viewed from a point of view; and controlling whether or not to rock a rocking section, which is located at a front of the headband, depending on an acceleration status of the point of view in the moving image displayed on the display section.

Abstract: Various embodiments of the invention pertain to an augmented reality interface for facilitating identification of an arriving vehicle and/or a passenger that improve upon some or all of the above-described deficiencies. According to some embodiments of the invention, a mobile device may be used by a passenger to scan scenery. The mobile device may determine whether and where a requested vehicle is located and display an indicator of the requested vehicle on the mobile device. Similarly, a mobile device may be used by a driver to scan scenery. The mobile device may determine whether and where a passenger is located and display an indicator of the requesting passenger on the mobile device.

Abstract: A method, apparatus, non-transitory computer readable medium, and system for data processing include obtaining a text prompt and generating a first intermediate noise state based on the text prompt, retrieving a second intermediate noise state based on the text prompt and the first intermediate noise state, and generating a synthetic image based on the text prompt and the second intermediate noise state.

Abstract: A technique for performing ray tracing operations is provided. The technique includes, in a first iteration of a ray traversal technique, traversing to an instance node of a bounding volume hierarchy; in a second iteration of the ray traversal technique that is subsequent to the first iteration, transforming a ray based on an instance transform of the instance node to generate a transformed ray; and in the second iteration, performing a ray-box intersection test for box node data of the instance node based on the transformed ray.

Abstract: A control apparatus includes a display having a display area for displaying images, an imager configured to capture an image of a plurality of users around the display area, and a controller configured to raise or lower a position of the display area to a height corresponding to a representative eye height of the plurality of users based on the image captured by the imager.

Abstract: An input coupling grating (ICG) for a waveguide-based display comprises an input region that receives light and a plurality of unit cells. Each unit cell includes photonic structures arranged at a pitch. The photonic structures of at least one first unit cell have at least one different structural characteristic than the photonic structures of at least one second unit cell.

Abstract: An augmented reality method for monitoring an event in space includes acquisition of a plurality of images of space having at least two landmarks by a camera of a portable device. Space being associated with a three-dimensional reference frame and the portable device being associated with a two-dimensional reference frame. A three-dimensional position and orientation of the space in relation to the camera is determined. The instantaneous position, within the reference frame of the space, of a mobile element moving in the space is received. The position of the mobile element in the two-dimensional reference frame is calculated from transformation parameters calculated from the three-dimensional position and orientation of the space in relation to the camera. An overlay at a predetermined distance in relation to the position of the mobile element in the two-dimensional reference frame is displayed on the screen. Also, a portable electronic device implements the method.

Abstract: A cached cloud rendering system for saving power and rendering time, which reduces motion to photon time. The cached cloud rendering system may utilize a cloud server to render and cache frames requested by a mobile computing device, which distributes the processing workload to a server system and results in increased battery life of the mobile computing device. Distributing the processing workload to the server system provides an additional benefit of reducing workload on the Graphics Processing Unit (GPU) of the mobile computing device.

Abstract: A method and an apparatus for processing a 3D scene are presented. Techniques are disclosed for determining light source locations, including tracking a current viewpoint of a camera capturing object(s) in a 3D scene and determining a reference viewpoint relative to the current viewpoint of the camera. According to aspects, a light source location is determined by obtaining a registered map of real cast shadows of the object(s) from an input image captured by the camera, registered with respect to the reference viewpoint. Then, for candidates of light sources, obtaining respective maps of virtual shadows of the object(s) created with respect to the reference viewpoint, and determining the location of the light source based on the candidates of light sources with respective maps of virtual shadows that match the registered map of real cast shadows.

Abstract: One variation of a method for detecting and visualizing objects within a space includes: retrieving a map of the space annotated with known locations of target anchor objects and regions in the space; accessing a set of images annotated with object types and locations of objects captured by a set of sensor blocks; projecting the set of images onto the map to form a visualization representing objects in the space based on known locations of the set of sensor blocks; isolating a target anchor object at a known location in a region of the visualization; detecting a mutable object at a location in the region; calculating an offset distance between the location and the known location; and, in response to the offset distance exceeding an offset distance threshold, highlighting the mutable object in the visualization as a deviation; and generating a notification to investigate the mutable object in the region.