Abstract: The video data processing device includes at least one first functional module that performs first processing preset for each first processing unit data, at least one second functional module that performs second processing preset for each second processing unit data smaller than the first processing unit data, and a control unit that controls the execution order of pipeline processing for the first processing unit data by controlling the timing at which the first function module and the second function module operate. The control unit controls the subsequent stage so that the first function module and the second module are started in response to the completion of the respective processing in accordance with the end of the pre-stage.

Abstract: When generating a graphics processing output by assembling a sequence of one or more of primitives to be processed from a set of vertex indices provided for the output based on primitive configuration information provided for the output, one or more vertex packets are generated using the vertex indices for the assembled primitives, each vertex packet comprising a plurality of vertices of the assembled primitives. After a threshold number of vertices have been allocated to a vertex packet, vertex attribute processing for the vertices of the vertex packet is triggered, to thereby generate a vertex packet comprising processed vertex attributes for the vertices of the vertex packet. The assembled primitives and the generated vertex packets are then provided to later stages of the graphics processing pipeline for processing.

Abstract: A cockpit display system for an aircraft including an off-board graphics rendering gateway system providing additional cockpit display and other functionality. The cockpit display system includes a cockpit display subsystem having a display, a subsystem processor and integrated modular avionics (IMA) with user applications and cockpit display software. The cockpit display system also includes an off-board processor for processing aircraft functionality applications that are not available on the cockpit display subsystem, where the off-board processor provides graphical data over fiber optics to the cockpit display subsystem to be displayed by the cockpit display subsystem.

Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for a high-performance and low-latency implementation of a wavelet-based image compression scheme. A processor may generate, in a single pass for each of a plurality of horizontal and vertical divisions of an image frame, a set of wavelet coefficients for the image frame based on a DWT. The processor may select a set of bits associated with the set of wavelet coefficients to remove based on an entropy coding process. The processor may serialize the set of wavelet coefficients, where the set of serialized wavelet coefficients do not include the set of bits. The processor may output, for a second device, a bitstream including the set of serialized wavelet coefficients.

Abstract: An object is to make it possible to provide an appropriate image. A background combined image that takes, as a foreground, an image corresponding to a virtual viewpoint that is set in an image capturing space and a background combined image that takes, as a foreground, part of a captured image captured from a specific viewpoint among a plurality of captured images are generated. Then, the configuration is designed so that it is possible to selectively output one of the background combined images.

Abstract: In one implementation, a method of displaying an animation is performed by a device including a display, one or more processors, and non-transitory memory. The method includes executing a 2D animation system process, executing a 3D animation system process, and executing a 3D animation application process including a 3D animation definition defining an animation changing a target property of a 2D layer of an entity from a first value at a first time to a second value at a second time. Executing the 3D animation application process includes generating a 2D animation definition defining the animation, providing the 2D animation definition to the 2D animation system process for generating 2D display data, and providing the 3D animation definition to the 3D animation system process for generating 3D display data. The method further includes displaying the animation on the display based on the 2D display data and the 3D display data.

Abstract: A device compiler and linker is configured to optimize program code of a co-processor enabled application by resolving generic memory access operations within that program code to target specific memory spaces. In situations where a generic memory access operation cannot be resolved and may target constant memory, constant variables associated with those generic memory access operations are transferred to reside in global memory.

Abstract: The present disclosure relates to system architectures for real-time processing and displaying of medical imaging data with no or reduced latency. An exemplary system for generating a video of a surgery can comprise: a processor configured to execute a plurality of instructions for a machine-learning model stored on a memory and a programmable circuit communicatively coupled with the processor. The programmable circuit is programmed to: receive surgical video data comprising a current frame; provide data related to the current frame to the processor; receive overlay data generated by the machine-learning model based on a previous frame captured before the current frame; generate, by a mixer of the programmable circuit, a composite frame based on the current frame and the overlay data; and output the composite frame for display as a part of the video of the surgery.

Abstract: Systems and methods for an emergency response system (ERS) to provide an augmented reality overlay on a real-world scene through the heads-up display (HUD) of an emergency responder. In addition to displaying information known to the ERS, an emergency responder terminal of the ERS can detect propagated signals from devices not registered with the ERS. The source and location of the propagated signal can be determined, and a generic display object can be generated representing the location of the propagated signal. The generic display object can be displayed on the HUD when the location of the source of the propagated signal falls within the field of view of a camera component of the emergency responder terminal.

Abstract: In an example method, a first data stream and a second data stream are obtained. Each of the first data stream and the second data stream includes one or more chunks. Further, a third data stream is generated. The third data stream includes the first data stream and the second data stream. Generating the third data stream includes inserting, in the third data stream, at least a portion of a first chunk of the second data stream between a beginning and an end of a second chunk of the first data stream. Further, the third data stream is provided for transmission or storage.

Abstract: A method is proposed for detecting an object in a 3D scene, including obtaining a detecting model that describes an association relationship between a plurality of base classes of a plurality of objects and 3D data of the plurality of objects. A plurality of open classes of a plurality of candidate objects to be detected in a 3D scene are received, the plurality of open classes comprise the plurality of base classes and at least one novel class not in the plurality of base classes. A 3D portion is detected in 3D data of the 3D scene based on the detecting model and the plurality of open classes, the 3D portion corresponds to a target candidate object in the plurality of candidate objects. With this method, objects that belong to a novel class, not annotated in training data of the detecting model, may be detected from the 3D data.

Abstract: A method of producing surface data from electronic polygonal data is disclosed. The method includes accessing the polygonal data with a computer, the polygonal data defining a mesh of polygonal data points and including a plurality of vertices, and where the polygonal data describes an object. The method also includes generating a plurality of bounded areas, each including one or more vertices of the polygonal data, expanding a plurality of the bounded areas by adding a plurality of vertices thereto, generating a surface for each of the expanded bounded areas based on the vertices of the expanded bounded areas, generating the surface data based at least in part on the surfaces, and storing the surface data in a computer readable data storage.

Abstract: This specification describes systems and methods for generating a mapping of a physical space from point cloud data for the physical space. The methods can include receiving the point cloud data for the physical space, filtering the point cloud data to, at least, remove sparse points from the point cloud data, aligning the point cloud data along x, y, and z dimensions that correspond to an orientation of the physical space, and classifying the points in the point cloud data as corresponding to one or more types of physical surfaces. The methods can also include identifying specific physical structures in the physical space based, at least in part, on classifications for the points in the point cloud data, and generating the mapping of the physical space to identify the specific physical structures and corresponding contours for the specific physical structures within the orientation of the physical space.

Abstract: A processing device and a method of tiled rendering of an image for display is provided. The processing device includes memory and a processor. The processor is configured to receive the image comprising one or more three dimensional (3D) objects, divide the image into tiles, execute coarse level tiling for the tiles of the image and execute fine level tiling for the tiles of the image. The processing device also includes same fixed function hardware used to execute the coarse level tiling and the fine level tiling. The processor is also configured to determine visibility information for a first one of the tiles. The visibility information is divided into draw call visibility information and triangle visibility information for each remaining tile of the image.

Abstract: In one embodiment, a method includes accessing a magnetic map of an area that includes magnetic-field values for locations in the area. The method also includes accessing an image file that includes pixels that correspond to the locations and include components. The image file also includes a first matrix with elements that each include color values. The components of the pixels include links to elements in the first matrix. The method also includes embedding portions of the magnetic map into the image file by generating a second matrix for the image file including elements that represent the magnetic-field values and, for the locations in the area, writing to the components of the pixels corresponding to the locations links to elements of the second matrix. The method also includes communicating the image file, with the portions of the magnetic map embedded in it, to computing devices for navigation or localization.

Abstract: According to aspects of the disclosed subject matter, a multi-view framework (MVF) is presented. Advantageously and according to aspects of the disclosed subject matter, an MVF operates as an executable service and provides a single user experience (UX) and application programming interface (API) for concurrent viewing and interaction with two or more digital twins, each digital twin being generated by a third-party content display generator unrelated to the MVF and other content display generators providing display content to the MVF for concurrent display. Still further, an MVF may be advantageously incorporated into a consumer software package and/or packaged as a consumer software package or provided as an online service.

Abstract: A method of operating a graphics processor to process sets of geometry to generate an output. Each set of geometry is associated with lower level geometry including vertex data to be used when rendering the geometry as well a separate higher level representation of the geometry. The higher level representations of the geometry can be obtained by the graphics processor independently of the other, lower level geometry and used to determine which sets of geometry should be processed for which regions of the output. Once this determination is made, the regions can be rendered by obtaining and processing the lower level geometry accordingly.

Abstract: A system and method for automated video generation for training machine and deep learning algorithms in aviation environments generates photorealistic digital human characters and an aviation environment according to a desired scenario, including fixtures, free objects, lighting and physics configurations, and camera views. Character actions in the desired scenario are mapped to pose sequences which may be manually generated or transferred from image sequences of human activities, including both main character activities specified by the scenario, characters responding to the main characters, and background character actions. A video automation pipeline animates character actions performed by the digital human characters into video datasets with annotation files incorporating detailed pixel and depth information for each frame. Video datasets may include variant video datasets differentiated from the primary dataset by changes in domain variants (e.g.

Abstract: A virtual reality (VR) and/or augmented reality (AR) display system is configured to control a display using control information that is embedded in or otherwise included with imagery data to be presented through the display. The control information can indicate depth plane(s) and/or color plane(s) to be used to present the imagery data, depth plane(s) and/or color plane(s) to be activated or inactivated, shift(s) of at least a portion of the imagery data (e.g., one or more pixels) laterally within a depth plane and/or longitudinally between depth planes, and/or other suitable controls.

Abstract: Systems and methods for super sampling and viewport shifting of non-real time 3D applications are disclosed. In one embodiment, a graphics processing unit includes a processing resource to execute graphics commands to provide graphics for an application, a capture tool to capture the graphics commands, and a data generator to generate a dataset including at least one frame based on the captured graphics commands and to modify viewport settings for each frame of interest to generate a conditioned dataset.