Abstract: A method and device for distorted compression of images displayed over a head mounted display (HMD) are provided. The method includes receiving, at a sink device, an image from a source device over a transport medium; determining, based on the optical means of the HMD, a circumscribed circle of the received image; determining a compression ratio based on at least radial attributes of the received image; and compressing, using a compression process, pixels inside the circumscribed circle of the received image, wherein the compression is based on the determined compression ratio.

Abstract: A method of image conversion for signage, displaying an image on a display surface, includes determining (1) a shape model of a three-dimensional object, determining (2) geometric properties of a display surface including a position and orientation of the display surface in a space, determining (3) a position of a viewpoint in the space, determining (4) a position and orientation of the shape model in the space, and computing (6) an inverse perspective projection onto the display surface based on the position of the viewpoint, for example the camera position in space, to generate a display image, wherein the display image, when displayed on the display surface and viewed through the viewpoint, appears to show the three-dimensional object with a position and orientation according to the position and orientation of the shape model in the space.

Abstract: System, method and software for producing imagery with enhanced 3D effects that is viewed on a display medium. The imagery contains elements that appear, at least in part to extend vertically above, or in front of the surface of the display medium. To create the imagery with enhanced 3D effects, a light field camera images a scene that contains at least one subject. At a given moment in time, the subject is positioned in an initial orientation. Upon imaging, the light field camera produces light field image data that represents the scene. The light field image data is edited to add enhanced 3D effects. Once edited, the enhanced image data is played on a display medium, where the added 3D effects cause the subject to appear, at least in part, to extend vertically above, or in front of, the display medium.

Abstract: Systems and methods for navigating a user in a three-dimensional model of a property are disclosed. An exemplary system includes a storage device configured to store data associated with a plurality of point positions. Each point position corresponds to a camera position at which images of the property are captured by the camera. The system further includes at least one processor configured to determine connectivity among the point positions and determine a plurality of candidate routes connecting a first introduction position and a second introduction position. Each candidate route links a subset of the point positions based on the connectivity. The at least one processor is further configured to select a route from the candidate routes and sequentially display views corresponding to the point positions on the selected route. The views at each point position are rendered from the images captured at the camera position corresponding to the point position.

Abstract: A virtual reality or augmented reality experience of a scene may be decoded for playback for a viewer through a combination of CPU and GPU processing. A video stream may be retrieved from a data store. A first viewer position and/or orientation may be received from an input device, such as the sensor package on a head-mounted display (HMD). At a processor, the video stream may be partially decoded to generate a partially-decoded bitstream. At a graphics processor, the partially-decoded bitstream may be further decoded to generate viewpoint video of the scene from a first virtual viewpoint corresponding to the first viewer position and/or orientation. The viewpoint video may be displayed on a display device, such as screen of the HMD.

Abstract: The present disclosure discloses a system and a method for inputting a gesture in a 3D scene. The system comprises a gesture acquiring unit configured to simultaneously acquire at least two channels of video stream data in real time at different angles for a user's gesture; a gesture recognizing unit configured to recognize a gesture shape varying in real time from the at least two channels of video stream data; a gesture analyzing unit configured to analyze the gesture shape varying in real time to obtain corresponding gesture motion; and a gesture displaying unit configured to process the gesture motion into a 3D image and display the 3D image in the 3D scene in real time. The technical solutions of the present disclosure can display the user's real gesture in the 3D scene, thereby enhancing the real effect of the system and improving the user's usage experience.

Abstract: Systems and methods of rendering a three-dimensional (3D) virtual environment rendering are disclosed. The system comprises a central processing device, a plurality of user devices in data communication with the central processing device, a plurality of application servers in data communication with the central processing device, and software executing on the central processor. The software creates and renders a 3D virtual environment, receives user data from each of the plurality of user devices, renders the user data received from each of the user devices in the 3D virtual environment, receives application data from each of the application servers, renders the application data received from each of the application servers in the 3D virtual environment, and outputs the rendered 3D virtual environment to each of the user devices. The 3D virtual environment serves as a direct user interface with the Internet by allowing users to visually navigate the world wide web.

Abstract: Methods and systems for modeling infrastructure elements in three dimensions are disclosed. An example method can comprise a computer receiving information from a database. The received information can comprise structural information describing a form of a structure and condition information describing a condition of the structure. The computer can create a graphical model of the structure based on the structural information. The computer can further determine, based on the condition information, a condition of one or more portions of the structure, and can color the one or more portions of the structure based on the determined condition.

Abstract: Embodiments disclosed herein include virtual apparel fitting systems configured to perform methods comprising generating a first virtual garment carousel the includes images of garments. In operation, a user scrolling through the virtual garment carousel causes a graphical user interface to display images of the garments in the carousel superposed over an image of the user, thereby enabling the user to see how the garments would look on him or her, where virtual fit points of each garment image align with virtual fit points on the image of the user.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Abstract: Encoding pixel information for pixels of an image. A method includes accessing information defining high-frequency image data correlated with pixels. The method further includes for each pixel, identifying if a vertex from the high-frequency image data is located in that pixel based on analysis of the high-frequency data correlated with the pixel. The method further includes, for one or more pixels in which a vertex is located, identifying the location of the vertex. The method further includes encoding the vertex location into image pixel data.

Abstract: A system for modifying a user interface in a multi-display device environment described herein can include a processor and a memory storing instructions that cause the processor to detect a number of display screens coupled to the system. The plurality of instructions can also cause the processor to split an image to generate sub-images based on the number of display screens and a bezel size corresponding to each of the display screens, the sub-images to exclude portions of the image corresponding to the bezel size of each of the display screens. Additionally, the plurality of instructions can cause the processor to resize each of the sub-images based on a display size of each of the display screens and display the image by transmitting the sub-images to the display screens.

Abstract: A video stream for a scene for a virtual reality or augmented reality experience may be stored and delivered to a viewer. The video stream may be divided into a plurality of units based on time segmentation, viewpoint segmentation, and/or view orientation segmentation. Each of the units may be divided into a plurality of sub-units based on a different segmentation from the units, via time segmentation, viewpoint segmentation, and/or view orientation segmentation. At least a portion of the video stream may be stored in a file that includes a plurality of the units. Each unit may be a group of pictures that is a sequence of successive frames in time. Each sub-unit may be a vantage defining a viewpoint from which the scene is viewable. Each vantage may be further divided into tiles, each of which is part of the vantage, limited to one or more particular view orientations.

Abstract: A method for visualizing a 3D dental restoration on a 2D image of the mouth of a patient includes obtaining a 3D dental model of at least a part of the patient's oral cavity, designing the 3D dental restoration, obtaining the 2D image of the mouth of the patient, estimating a virtual camera including at least one virtual camera property corresponding to at least one physical camera property of the physical camera used to obtain the 2D image, viewing the 3D dental restoration using the virtual camera, determining the visible area of the 3D dental restoration, which is not overlapped by surrounding anatomic features when viewed with the virtual camera, imaging the visible area of the 3D dental restoration with the 2D image. This advantageously provides an image which with high accuracy gives the dentist and the patient a visual presentation of the final result of a dental treatment.

Abstract: The present invention relates to a method of streaming interactive computer graphics from a server to a client device. The method includes the steps of: intercepting graphics instructions transmitted from an application destined for a graphical processing unit (GPU) at the server; processing the graphics instructions to generate graphics data at the server; generating index information for, at least, some of the graphics data at the server; transmitting the index information in place of the graphics data to a client device; extracting corresponding graphics data stored at the client device utilizing the index information; and rendering computer graphics at a graphical processing unit (GPU) at the client device using the corresponding graphics data. A system for streaming interactive computer graphics is also disclosed.

Abstract: Certain aspects of the present disclosure relate to a technique for generating simultaneous zoom in windows on a touch sensitive device. A first portion of the user content is zooming into by touching the display screen in a proximity of the first portion using the touch input device while retaining an original zoom size of a first remaining portion of the user content. A second portion of the user content from the first remaining portion is zoomed into by touching the display screen in a proximity of the second portion using the touch input device while retaining a zoomed in first portion and an original zoom size of a second remaining portion of the of the first remaining portion, the original zoom size of the first and the second remaining portions being the same.

Abstract: A system and method for geometric warping correction in projection mapping is provided. A lower resolution mesh is applied to A mesh model, at least in a region of the mesh model misaligned with a corresponding region of a real-world object. One or more points of the lower resolution mesh are moved. In response, one or more corresponding points of the mesh model are moved to increase alignment between the region of the mesh model and the corresponding region of the real-world object. An updated mesh model is stored in a memory. And one or more projectors are controlled to projection map images corresponding to the updated mesh model onto the real-world object.

Abstract: Examples described herein generally relate to prioritizing portions of images for rendering in a computing device. A probability field for prioritizing portions of an image of a scene for processing can be determined, where the probability field includes a set of values each corresponding to a likelihood of a rendering parameter acquiring an altered value between a render time at which at least a portion of the image is rendered and a display time at which the image is displayed. A shaped probability field can be generated based at least in part on applying the probability field to an original target shape associated with a display. The shaped probability field can be provided to a downstream node for prioritizing, based at least in part on one or more of the set of values in the probability field, a portion of the image in processing the image.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.