Abstract: A method is performed at a computing device coupled with a display. The method includes displaying a graphical user interface that includes a data visualization in a first state, including a plurality of visual marks. Each of the plurality of visual marks is displayed in a corresponding first position. The method includes receiving user input in the graphical user interface to specify an action that triggers an animated transition of the data visualization from the first state to a second state. The data visualization in the second state includes one or more of the plurality of visual marks in corresponding second positions. The method includes, in response to the user input, triggering the animated transition of the data visualization from the first to the second state. The animated transition is configured by three or more visual parameters, including: an animation mode, an animation speed, and an animation emphasis.

Abstract: A method of point cloud geometry padding is described herein. The method searches for a reconstruction point in a compressed occupancy map to perform the geometry padding instead of using an uncompressed occupancy map.

Abstract: There is provided an image processing apparatus and an image processing method that enable selection of viewpoints of depth images suitable for creation of a 3D model. A viewpoint determination unit determines that a candidate viewpoint be a viewpoint of a depth image of a 3D model on the basis of the 3D model projected on a screen from the candidate viewpoint. The present disclosure can be applied to, for example, an encoding device or the like that generates and encodes color images and depth images from predetermined viewpoints, from color images and depth images from a plurality of viewpoints of a 3D model of a subject.

Abstract: Systems, methods, and devices relating to dynamic virtual element positioning in an augmented reality (AR) environment are described herein. In a method, a viewport may be output by a computing device and may comprise a virtual element and at least a portion of a scene captured by a camera associated with the computing device. A movement of the at least a portion of the scene in the viewport may be determined. An offset focal point along at least a portion of an axis of the virtual element may be determined that is the closest to a viewport focal point at the vertical and horizontal center of the viewport. The virtual element may be positioned in the viewport based on the movement of the at least a portion of the scene in the viewport and a distance between the offset focal point and the viewport focal point.

Abstract: The present disclosure relates to a method and a device for editing a virtual scene, and a non-transitory computer-readable storage medium. The method includes determining a second location, in the virtual scene played on a terminal, corresponding to a first location of the terminal in a real space; generating one or more virtual objects editable within a predetermined range of the second location in the virtual scene; detecting an edit request for the virtual object; displaying an edit option in the virtual scene in response to the edit request; detecting an operation on the edit option; editing the virtual scene based on the operation on the edit option; and displaying the edited virtual scene.

Abstract: An electronic device, method, and computer program product enable orienting a user interface on a display device to a detected orientation of a face. The display device presents the user interface in a default display orientation. An image capture device captures an image. A memory contains a display orientation application. A controller is communicatively coupled to the display device, the image capture device, and the memory. The controller executes the display orientation application to enable the electronic device to provide functionality of orienting the user interface. The image captured by the image capture device is received and a face is identified within the image. An orientation of the face is determined relative to the default display orientation of the display device. At least a portion of the user interface is presented on the display device in a second display orientation that correlates to the orientation of the face.

Abstract: A method assigns weights to physical imager pixels in order to generate photorealistic images for virtual perspectives in real-time. The imagers are arranged in three-dimensional space such that they sparsely sample the light field within a scene of interest. This scene is defined by the overlapping fields of view of all the imagers or for subsets of imagers. The weights assigned to imager pixels are calculated based on the relative poses of the virtual perspective and physical imagers, properties of the scene geometry, and error associated with the measurement of geometry. This method is particularly useful for accurately rendering numerous synthesized perspectives within a digitized scene in real-time in order to create immersive, three-dimensional experiences for applications such as performing surgery, infrastructure inspection, or remote collaboration.

Abstract: Described herein is a merged data path unit that has elements that are configurable to switch between different instruction types. The merged data path unit is a pipelined unit that has multiple stages. Between different stages lie multiplexor layers that are configurable to route data from functional blocks of a prior stage to a subsequent stage. The manner in which the multiplexor layers are configured for a particular stage is based on the instruction type executed at that stage. In some implementations, the functional blocks in different stages are also configurable by the control unit to change the operations performed. Further, in some implementations, the control unit has sideband storage that stores data that “skips stages.” An example of a merged data path used for performing a ray-triangle intersection test and a ray-box intersection test is also described herein.

Abstract: Systems, devices, and methods are disclosed for compositing real-time, real-world video with virtual objects. An electronic device includes circuitry coupled to a memory storing instructions that, when executed, cause the circuitry to receive video of a given video capture region. The circuitry is caused to receive location information and camera information from the unmanned vehicle. The circuitry is caused to obtain a representation of a location of interest corresponding to the location of the unmanned vehicle. The circuitry is caused to display the representation. The circuitry is caused to obtain virtual objects. The circuitry is caused to place the virtual objects into the representation. The circuitry is caused to render the virtual objects and the video to generate a rendered video including rendered virtual objects in at least one frame of the video. The circuitry is caused to send the rendered video.

Abstract: In some embodiments, a synthetic (virtual) orthopedic treatment device (e.g. a virtual external fixator representing a physical fixator attachable to a patients anatomic structure) is displayed concurrently in two views (e.g. anterior-posterior and lateral) along corresponding digital medical images (e.g. X-rays), and rotation/translation user input received along one of the images is used to concurrently control both displays of the orthopedic treatment device to reflect the rotation/translation user input.

Abstract: A method for improving performance of generation of digitally represented graphics. The method comprises: receiving a first representation of a base primitive; providing a set of instructions associated with vertex position determination; executing said retrieved set of instructions on said first representation of said base primitive using bounded arithmetic for providing a second representation of said base primitive, and subjecting said second representation of said base primitive to a culling process. A corresponding apparatus and computer program product are also presented.

Abstract: In some embodiments, a method comprises obtaining a video stream of a portion of a geographic area, the video stream comprising a plurality of video frames, each of the plurality of video frames captured at a respective first time. Contextual metadata is obtained, the contextual metadata associated with one or more objects located in the portion of the geographic area at a second time, the second time being before each of the respective first times. The contextual metadata is inserted into one or more of the plurality of video frames, thereby causing the contextual metadata associated with the one or more objects to be overlaid on one or more corresponding portions of the one or more of the plurality of video frames.

Abstract: Embodiments herein disclose a method for modifying content in an electronic device. The method may include classifying a plurality of regions in the content, wherein at least one of a lightness factor or a brightness factor is defined for each of the regions. The method may further include obtaining at least one of a candidate lightness span or a candidate brightness span for each of the classified region from a predefined lightness span database or a predefined brightness database and identifying a current brightness level of a display of the electronic device. The method further may further include identifying at least one of an optimal lightness span or an optimal brightness span by adjusting the candidate lightness span and candidate brightness span based on the current brightness level and modifying the content corresponding to each of the classified region using at least one of the optimal lightness span and the optimal brightness span.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real-world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real-world through utilization of a redundant tracking system comprising multiple tracking sub-systems. Virtual object rendering can be with respect to a reference surface in a real-world three-dimensional space depicted in a camera view of a mobile computing device.

Abstract: A processor receives input video data of a video dynamic range and input dynamic metadata. It also receives: input graphics data of a graphics dynamic range and input static metadata, display identification data from a target display over a video interface, and a blending priority map characterizing a per-pixel priority of output pixels in an image generated by blending the input video data and the input graphics data. A video mapping function and a graphics mapping function which map data from the input video and graphics dynamic ranges to the target dynamic range are generated based on the dynamic and static metadata. Then, the input and graphics data are blended based on the blending priority map and a per-pixel decision to map pixels to the target dynamic range using either the video mapping function or the graphics mapping function.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Abstract: Eye data is recorded and a visual impairment of an eye viewing a screen is determined. A correction value is determined based on the visual impairment, and a display connected to a personal computing device is adjusted based on the correction value.

Abstract: The present disclosure is directed to presenting a more realistic augmented reality view on a video see-through display of a device by configuring the device such that the displayed image of the real world substantially matches what would be perceived by the user if the display were not present. This may be implemented by determining one or more of: a distance from the user's eyes to the display of the device, and an angular offset between the optical axis of a rear camera of the device and the user's visual field, and using the determined distance and/or angular offset to adjust the image that is displayed to the user. The image that is displayed to the user may be adjusted by optically or digitally zooming the rear camera of the device. It may also be adjusted by tilting the rear camera or by digitally translating the displayed video feed.

Abstract: An enhanced multimodal interface and various enhanced tools are provided to enable a user to create 3-D augmented reality (AR) sketches using a mobile device. Mobile device can comprise a sketch generator component (SGC) that can integrate multiple sources of inputs with enhanced tools, comprising enhanced 3-D snapping and proxy creation tools. The inputs comprise touch screen data, motion data, and image data from a camera. SGC can provide the interface, which can support absolute and relative drawing. Via the interface, the user can select and use desired enhanced tools to create a 3-D AR sketch that augments visual content of a real-world environment captured by the camera with drawing content added by the user using the enhanced tools. SGC enables a user to create desired strokes, planar or curved surface proxies, snapping points, or other sketch features, wherein proxies can align with real-world surfaces.

Abstract: A table of time series sequences is displayed, in which plural resources serve as base points. The table is a matrix including one or more first lines and plural second lines. The first lines extend parallel to each other in a first direction, and the second lines extend parallel to each other in a second direction perpendicular to the first direction; and each of the lines comprises time series sequence objects. Plural base point resources are respectively associated with the second lines. Metric types corresponding to the resources related to the base point resources are respectively associated with the first lines. The time series sequence object associated with both the mth first line and the nth second line represents a time series sequence of metric values of the mth first line and that are exhibited by a resource related to the base point resource associated with the nth second line.