Abstract: A method for generating a hybrid reality environment includes receiving data of a first user and a second user at different locations. The method also includes generating a scene of an augmented reality (AR) based environment that includes the first user and a virtual object related to the second user; and generating a scene of an augmented virtuality (AV) based environment that includes the virtual object related to the second user and a virtual object related to the first user. The method further includes sending signals for displaying the scene of the AR based environment to the first user and displaying the scene of the AV based environment to the second user such that the first user can interact with the virtual object related to the second user in real time and the second user can interact with the virtual object related to the first user in real time.

Abstract: The present disclosure describes systems and techniques relating to generating three dimensional (3D) models from range sensor data. According to an aspect, frames of range scan data captured using one or more three dimensional (3D) sensors are obtained, where the frames correspond to different views of an object or scene; point clouds for the frames are registered with each other by maximizing coherence of projected occluding boundaries of the object or scene within the frames using an optimization algorithm with a cost function that computes pairwise or global contour correspondences; and the registered point clouds are provided for use in 3D modeling of the object or scene. Further, the cost function, which maximizing contour coherence, can be used with more than two point clouds for more than two frames at a time in a global optimization framework.

Abstract: A portion of a simulated element of a graphical simulation available for modification is identified in view of a cursor location associated with a user input device. The identified portion of the simulated element is selected for modification. The selected portion of the simulated element is then modified according to a direct manipulation of a display of the selected portion of the simulated element by a user using the user input device.

Abstract: The power consumption of processor-based devices may be reduced by reducing the consumption of power during graphics processing. In some embodiments, the precision of pixel shading in parts of images where artifacts are less objectionable may be reduced. For example, in areas the user is not directly looking at, precision may be reduced to save power. At the same time, because a person is not focusing on those regions, even if usually perceptible artifacts occur because of the reduced precision, an overall pleasing depiction may be achieved.

Abstract: Techniques are disclosed for suppressing access to a depth processing unit associated with a graphics processing pipeline. The method includes receiving a graphics primitive from a first pipeline stage associated with the graphics processing pipeline. The method further includes determining that the graphics primitive is visible over one or more graphics primitives previously rendered to a frame buffer, and determining that the depth buffer is in a read-only mode. The method further includes suppressing an operation to transmit the graphics primitive to the depth processing unit. One advantage of the disclosed technique is that power consumption is reduced within the GPU by avoiding unnecessary accesses to the depth processing unit.

Abstract: A display apparatus and a method for providing a font effect thereof are provided. The method includes obtaining character information and font information of a character; determining an attribute value of a font effect according to at least one of characteristics of the character and characteristics of the display apparatus; rendering the font effect based on the determined attribute value and applying the rendered font effect to the character; and outputting the character to which the font effect is applied.

Abstract: In scenarios involving the capturing of an environment, it may be desirable to remove temporary objects (e.g., vehicles depicted in captured images of a street) in furtherance of individual privacy and/or an unobstructed rendering of the environment. However, techniques involving the evaluation of visual images to identify and remove objects may be imprecise, e.g., failing to identify and remove some objects while incorrectly omitting portions of the images that do not depict such objects. However, such capturing scenarios often involve capturing a lidar point cloud, which may identify the presence and shapes of objects with higher precision. The lidar data may also enable a movement classification of respective objects differentiating moving and stationary objects, which may facilitate an accurate removal of the objects from the rendering of the environment (e.g., identifying the object in a first image may guide the identification of the object in sequentially adjacent images).

Abstract: A method for operating a computing system is provided. The method includes at a local computing device and while an ink input is occurring, rendering a local uncommitted ink stroke on a local display based on the ink input and sending uncommitted ink data corresponding to the uncommitted ink stroke to a remote computing device, the uncommitted ink data including an uncommitted ink stroke path and a global unique identifier differentiating the uncommitted ink data from other uncommitted ink data corresponding to different computing devices and ink inputs. The method further includes responsive to receiving an ink stroke commitment input, rendering a local committed ink stroke on the local display and sending committed ink data including an ink commitment command and the global unique identifier associated with the uncommitted ink stroke path to the remote computing device.

Abstract: An apparatus includes a housing and a fixing mechanism configured to attach the housing to an object. The housing includes a display device and at least one processor configured to receive measurement data in a measurement mode during a physical exercise, to process the received measurement data, thus generating exercise data characterizing the exercise, and to display the exercise data through the display device during the physical exercise. The display device is configured to provide a plurality of display view orientations associated with different rotation angles between a first display view orientation, defined by attachment of the fixing mechanism to the object, and a 90-degree rotation from the first display view orientation. At least one function of the processor is associated with the rotation of the display view.

Abstract: Provided is an image processing apparatus for fitting a model to image data. The image processing apparatus determines a final parameter set and a final inlier scale of a first model by iteratively performing a model estimation process and an inlier scale estimation process, wherein the model estimation process determines a model parameter set, and the inlier scale estimation process determines an inlier scale by using the determined model parameter set.

Abstract: A display method includes steps of: receiving, by the controller, a first frame and a second frame from an input data; up-converting, by the controller, a frame rate of the input data to produce a third frame based on the first frame and the second frame; identifying, by the controller, a static image content of the third frame according to a comparison of the first frame and the second frame; controlling, by the controller, the driver circuit not to update data of pixels within a static display area of the display panel corresponding to the static image content during the period of time that the third frame is displayed by the display panel.

Abstract: A method for creating a plane panorama from point cloud data using Hough transformations is disclosed. The method involves converting the three-dimensional point cloud into a two-dimensional histogram with bins grouping neighboring points, and performing a Hough transformation on the histogram. The resulting transformed data is segmented and the method searches the segments iteratively for a major line, followed by lines that are orthogonal, diagonal, or parallel to the major line, and discards outlying data in each bin as lines are identified. The detected lines are connected to form planes, and the planes are assembled into a hole- and gap-filled panorama. The method may also use an algorithm such as a Random Sample Consensus (RANSAC) algorithm to detect a ground plane.

Abstract: In an information display system, an information apparatus includes a target information storage section that stores target information to be published by the information apparatus and an extraction section that extracts the target information from the target information storage section on the basis of user information that is information regarding a user of a head mounted display device, and the head mounted display device includes an information generating section that generates information for additional presentation for providing the augmented reality to the user using the target information acquired from the information apparatus and an image display section that enables the user to view the generated information for additional presentation as a virtual image.

Abstract: Systems and methods are presented for recording and viewing images of objects with specular highlights. In some embodiments, a computer-implemented method may include accessing a first plurality of images, each of the images in the first plurality of images including an object recorded from a first position, and a reflection of light on the object from a light source located at a different location than in each of the other images in the first plurality of images. The method may also include generating a first composite image of the object, the first composite image comprising a superposition of the first plurality of images, and wherein each of the images in the first plurality of images is configured to change in a degree of transparency within the first composite image and in accordance with a first input based on a degree of tilt.

Abstract: Provided are a method and apparatus for automatically splitting an object and a method, apparatus, and system for registering a file. The method for splitting an object includes receiving the data of a stereolithography (STL) file representing a 3D image, tagging vertex coordinates corresponding to objects included in the 3D image so that the vertex coordinates are classified for each object, and splitting each of the objects included in the 3D image based on the tagged vertex coordinates.

Abstract: Methods of generating one or more abstractions of a three-dimensional (3D) input model by performing volumetric manipulations on one or more volumetric abstractions of the 3D input model. In some embodiments, volumetric manipulations are made to a volumetric shell abstraction of a 3D input model in a successive and iterative manner to generate an abstraction hierarchy composed of a set of volumetric abstractions having differing levels of abstraction based on containing differing amounts of geometric detail from the 3D input model. In one example of geometric manipulation, one or more fitted subvolumes corresponding to geometric detail of the 3D input model are identified based on a current level of abstraction and the 3D input model, and each fitted subvolume is added to or subtracted from the current level of abstraction to generate a next, finer level of abstraction. In some embodiments, the disclosed methods are embodied in suitable software.

Abstract: A method of determining a coverage area of a pixel covered by a scalable path definition for a character, is disclosed. An edge direction for each edge of the scalable path definition intersecting the pixel is received. A fragment area is determined for each of the intersecting edges, each of the fragment areas representing an area of the pixel located to a side of a corresponding edge. The side of the corresponding edge is selected according to a direction of the corresponding edge. The coverage area of the pixel is determined based on a sum of the fragment areas, the sum of the fragment areas having a value greater than a total area of the pixel.

Abstract: An information processing method and an apparatus thereof are provided, which are applicable to a head-mounted device with a display unit. The information processing method includes: determining a virtual vision area for a user in a case that the user wears the head-mounted device; searching an environment space for a first object which is located in the virtual vision area and satisfies a predetermined condition; determining a first display area of the display unit which matches the first object; and outputting first display content in the first display area, such that when the user watches the display unit, the user sees that the first display content is presented on the first object in the virtual vision area. Display effect of the head-mounted device is improved according to the embodiments of the disclosure.

Abstract: A display device includes a display panel including a display region and a driver driving each pixel of the display region in response to input image data. The driver calculates area characterization data indicating feature quantities of an image displayed in each of areas defined in the display region for each of the areas, based on the input image data and generates pixel-specific characterization data associated with each pixel by applying filtering to the area characterization data associated with the area in which each pixel is located and with areas adjacent to the area in which each pixel is located. The driver generates output image data associated with each pixel by performing a correction on the input image data associated with each pixel in response to the pixel-specific characterization data associated with each pixel and drives each pixel in response to the output image data associated with each pixel.

Abstract: A cloud network server system, a method, and a software program product for experiencing a three-dimensional (3D) model are provided. 3D model data associated with a 3D video game is uploaded to the cloud network server system. The system is used to design for example a computer game that renders non-spatial characteristics such as, smell, reflection and/or refraction of light, wind direction, sound reflection, etc., along with spatial and visibility information associated with 3D objects displayed in the 3D video game. Different versions of the 3D model are created based on memory, streaming bandwidth, and/or processing power requirements of different user terminal computers. Based on a virtual location of a user in the 3D model, parts of at least one version of the 3D model are rendered to the user.