Abstract: Methods and ray tracing units are provided for performing intersection testing for use in rendering an image of a 3-D scene. A hierarchical acceleration structure may be traversed by: traversing one or more upper levels of nodes of the hierarchical acceleration structure according to a first traversal technique, the first traversal technique being a depth-first traversal technique; and traversing one or more lower levels of nodes of the hierarchical acceleration structure according to a second traversal technique, the second traversal technique not being a depth-first traversal technique. Results of traversing the hierarchical acceleration structure are used for rendering the image of the 3-D scene. The upper levels of the acceleration structure may be defined according to a spatial subdivision structure, whereas the lower levels of the acceleration structure may be defined according to a bounding volume structure.

Abstract: A system configured to provide a three-dimensional representation of a physical environment. The three-dimensional representation including annotation data associated with particular objects and/or viewpoints of the three-dimensional representation. In some cases, the viewpoints may be rendered using image data associated with a photograph captured from a corresponding viewpoint within the physical environment.

Abstract: A method of operating a computing system to generate a model of an environment represented by a mesh is provided. The method allows to update 3D meshes to client applications in real time with low latency to support on the fly environment changes. The method provides 3D meshes adaptive to different levels of simplification requested by various client applications. The method provides local update, for example, updating the mesh parts that are changed since last update. The method also provides 3D meshes with planarized surfaces to support robust physics simulations. The method includes segmenting a 3D mesh into mesh blocks. The method also includes performing a multi-stage simplification on selected mesh blocks. The multi-stage simplification includes a pre-simplification operation, a planarization operation, and a post-simplification operation.

Abstract: An input system for a 3D display device includes a pen, and a tablet computing device to receive input via interaction with the pen. The tablet computing device including a display dock to dock the 3D display device and a pen dock to dock the pen, wherein docking of the 3D display device in the display dock facilitates a determination of a display position of a visual representation of the tablet computing device on the 3D display device.

Abstract: A display method, a display device, an electronic equipment, and a computer readable storage medium are disclosed. The display method is suitable for a display device, and the display device is configured to display in a first display mode and in a second display mode. The display method includes: obtaining user image information; determining whether a user is currently in a fatigue state based on the user image information; and switching the display device from the second display mode to the first display mode and allowing the display device to display in the first display mode if the user is currently in the fatigue state. The first display mode is different from the second display mode.

Abstract: Systems and methods are described for generating models of three-dimensional objects using an identified template from a library of reference objects. An object may be scanned using a 3D scanner or other computing device, which may generate scan data including a “point cloud” of geometric points corresponding to the surface of the object. The point cloud or other scan data may be used to identify a reference object that corresponds to the scanned object, and a normalized point cloud may be obtained for the reference object. The normalized point cloud may then be deformed to more accurately fit the shape of the scanned object, and a 3D model may be generated based on the deformed point cloud. Multiple templates may be used to generate a normalized point cloud for an object that partially corresponds to more than one reference object, and images, meshes, wireframes, or other representations may be generated.

Abstract: An augmented reality eyewear device to operate augmented reality applications and provides a wide-angle field view, is disclosed. The eyewear device comprises a frame which is associated with a processor, a sensor assembly, a camera assembly, and a user interface control assembly coupled to the processor. The sensor assembly coupled to the processor comprises at least two inertial measurement unit (IMU) sensor to transmit raw IMU data of at least one IMU sensor and an android connected IMU data of at least one IMU sensor. The camera assembly coupled to the processor comprises at least two wide angle cameras synchronized with one another is configured to transmit camera feed data from the camera assembly to the processor. The processor is configured to dually synchronize raw IMU Data and android connected IMU data with the camera feed data providing a seamless display of 3D content of the augmented reality applications.

Abstract: A mediated-reality system for surgical applications incorporates pre-operative images and real-time captured images of a surgical site into a visualization presented on a head-mounted display worn by a surgeon during a surgical procedure. The mediated-reality system tracks the surgeon's head position and generates real-time images of the surgical site from a virtual camera perspective corresponding to the surgeon's head position to mimic the natural viewpoint of the surgeon. The mediated-reality system furthermore aligns the pre-operative images with the real-time images from the virtual camera perspective and presents a mediated-reality visualization of the surgical site with the aligned pre-operative three-dimensional images or a selected portion thereof overlaid on the real-time images representing the virtual camera perspective.

Abstract: Computer-implemented method and an optimized implant site simulation system which performs a simulation of a damaged oral cavity of a patient and defines an implant site adapted to receive a dental implant to repair the damage observed. The invention further describes the optimized implant site simulated (SI) and a dental implant (ID) couplable to the optimized implant site (SI) simulated. The invention further describes a computer program to perform the steps of the method and an optimized implant site (SI) simulation system.

Abstract: A three-dimensional (3D) display method and system for #D display, the method including detecting a viewing angle of a user for a display screen, determining an angle of 3D projection based on the viewing angle, and performing, based on the angle of 3D projection, 3D display of content that needs to be displayed.

Abstract: If the picture complexity is low then the number of pixels in a frame may be reduced. For example, pixel-to-pixel variation in terms of RGB color values can be used to determine the complexity of the frame. Frames can be characterized, in one embodiment, as non-complex frames with less pixel variation and complex frames with very high pixel variation. The high PPI may be used only for complex frames while non-complex frames can use low PPI. This method reduces memory fetching and pixel processing within the display engine and thereby saves power.

Abstract: Images are rendered from deeply learned raytracing parameters. Active learning, via a machine learning (ML) model (e.g., implemented by a deep neural network), is used to automatically determine, infer, and/or predict optimized, or at least somewhat optimized, values for parameters used in raytracing methods. Utilizing deep learning to determine optimized, or at least somewhat optimized, values for raytracing parameters is in contrast to conventional methods, which require users to rely of heuristics for parameter value setting. In various embodiments, one or more parameters regarding the termination and splitting of traced light paths in stochastic-based (e.g., Monte Carlo) raytracing are determined via active learning. In some embodiments, one or more parameters regarding the sampling rate of shadow rays are also determined.

Abstract: Embodiments of the disclosure provide methods and systems for updating a HAD map using a plurality of terminals. The system may include a communication interface configured to communicate with the plurality of terminals via a network. The system may further include a storage configured to store the HAD map. The system may also include at least one processor. The at least one processor may be configured to identify a target region including at least one changing object. The at least one processor may be further configured to instruct the plurality of terminals to acquire data of the target region at varying view positions, and receive the acquired data from the plurality of terminals. The at least one processor may be further configured to construct a three-dimensional model for the at least one changing object from the acquired data, and update the HAD map based on the three-dimensional model.

Abstract: A system configured to provide a three-dimensional representation of a physical environment. The three-dimensional representation including annotation data associated with particular objects and/or viewpoints of the three-dimensional representation. In some cases, the viewpoints may be rendered using image data associated with a photograph captured from a corresponding viewpoint within the physical environment.

Abstract: A system is provided that allows a user to visualize data. A dataset that includes a plurality of data items arranged in a two-dimensional (2D) format is received. A request to visualize the dataset in three dimensions is then received. A three-dimensional (3D) visualization of the dataset is then generated based on this request. This 3D visualization adds a third dimension to the 2D arrangement of data items, where the extent of the third dimension is commensurate with the type and value of the data items. This 3D visualization includes an initial depiction of the dataset which is generated from a point of view that is specified by this request. The initial depiction of the dataset is then displayed on a display device of the system in lieu of the dataset itself.

Abstract: An augmented reality story-telling system is disclosed. The system is intended to work with mobile computing devices, and utilizes proprietary software to display augmented-reality enhanced stories in a physical environment. Contemplated for use in children's books and educational materials, the system is designed to enhance user interaction with the information in the stories so as to improve user literacy and vocabulary. The system may be made available in a personal or a classroom edition, and either format may include features that both teach and quiz a user on the story and the language used. The system may also incorporate analytics and metrics to assess and track user progress over time. Stories for the system may be stored locally on the user's device or may be downloaded from a central database through the proprietary software.

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A closed-loop color conversion process is used to improve compression while taking into consideration distortion introduced throughout the point cloud compression process.

Abstract: Provided are systems and methods for single image-based body animation. An example method includes receiving a input image, the input image including a body of a person, segmenting the input image into a body portion and a background portion, wherein the body portion includes pixels corresponding to the body of the person, fitting a model to the body portion, wherein the model is configured to receive pose parameters representing a pose of the body and generate an output image including an image of the body adopting the pose, receiving a series of further pose parameters, each of the series of further pose parameters representing one of further poses of the body, providing each of the series of further pose parameters to the model to generate a series of output images of the body adopting the further poses, and generating, based on the series of output images, an output video.

Abstract: Embodiments for analyzing images by one or more processors are described. An image is received. An object appearing in the image is detected. A scene graph is generated for the object. At least one transformational matrix is determined for the object. The at least one transformational matrix is associated with rendering the object as the object appears in the image based on the scene graph.

Abstract: A system for facilitating display of cardiac information includes a display device configured to present a cardiac map; and a processing unit configured to: receive electrical signals and indications of measurement locations corresponding to the electrical signals; generate, based on the electrical signals, the cardiac map, which includes annotations representing cardiac signal features; and determine a set of interesting cardiac signal features. The processing unit also may determine, based on the set of interesting cardiac signal features, a region of interest; and facilitate display, via the display device, of the cardiac map and a representation of the region of interest. The representation of the region of interest includes a first display parameter value that is different from a second display parameter value, where the second display parameter value is associated with at least one cardiac signal feature that is not included within the region of interest.