Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.

Abstract: An image generation apparatus 200 includes a distortion information storage section 234 that stores, as distortion information, information for deforming and distorting an image, and a distortion rendering section 232 that renders a distorted image by rasterization processing using the distortion information without generating a non-distorted image in a memory. The distortion rendering section 232 renders the distorted image by executing the rasterization processing on a distorted triangle obtained by transforming a triangle to be rasterized on the basis of the distortion information such that the processing is executed upward and downward from positions of vertices of the distorted triangle.

Abstract: A graphics processing system has a rendering space which is divided into tiles. Primitives within the tiles are processed to perform hidden surface removal and to apply texturing to the primitives. The graphics processing system includes a plurality of depth buffers, thereby allowing a processing module to process primitives of one tile by accessing one of the depth buffers while primitive identifiers of another, partially processed tile are stored in another one of the depth buffers. This allows the graphics processing system to have “multiple tiles in flight”, which can increase the efficiency of the graphics processing system.

Abstract: Position based media pipeline systems and methods for volumetric displays provide content to a volumetric display having at least two pixels arranged in a 3D coordinate space. A three-dimensional (3D) pixel position dataset and a 3D animation are provided and a first volume representation based on the 3D animation is created. A second volume is created based on the first volume and including color data. A texture atlas is assembled based on the second volume and volumetric image data is generated based on the texture atlas. The position based media pipeline outputs the volumetric image data to one or more graphic controllers. The volumetric image data can be output whereby a user can preview the volumetric image data in addition to output to the volumetric display.

Abstract: A method and system for rendering an augmented reality scene on a mobile computing device tracks a real-world scene and/or a viewpoint of a user with one or more event-based vision sensors and blends an augmented reality scene displayed on the mobile computing device based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors. Event-based vision sensors offer many advantages, mainly by intrinsically compressing the data stream and thus reducing the amount of data that a processing unit needs to perform. Furthermore, the event-based vision sensor pixels continuously sense the visual changes in the scene and report them with a very low latency. This makes the event-based vision sensor an ideal sensor for always-on tasks such as visual tracking and smart sensor control or data enhancement of secondary sensing modalities.

Abstract: An information processing apparatus includes a processor configured to: display, in a virtual space recognized by a user, a first object at a position corresponding to a first coordinate system that is independent of the user's head movement; display, in the virtual space, a second object at a position corresponding to a second coordinate system that is dependent on the user's head movement; and change the first object to the second object in response to an operation performed by the user on the first object.

Abstract: Recurrent blurring may be used to render frames of a virtual environment, where the radius of a filter for a pixel is based on a number of successfully accumulated frames that correspond to that pixel. To account for rejections of accumulated samples for the pixel, ray-traced samples from a lower resolution version of a ray-traced render may be used to increase the effective sample count for the pixel. Parallax may be used to control the accumulation speed along with an angle between a view vector that corresponds to the pixel. A magnitude of one or more dimensions of a filter applied to the pixel may be based on an angle of a view vector that corresponds to the pixel to cause reflections to elongate along an axis under glancing angles. The dimension(s) may be based on a direction of a reflected specular lobe associated with the pixel.

Abstract: A three-dimensional object for which three orthogonal object axes are set is disposed in a virtual space. One or two of the three object axes are determined as an enlargement/reduction axis, based on an orientation of the three-dimensional object in the virtual space. A user's operation input is associated with the enlargement/reduction axes. The three-dimensional object is at least enlarged or reduced based on the association of the user's operation input with the enlargement/reduction axes.

Abstract: Methods and apparatuses are described for user authentication in a three-dimensional (3D) alternative reality software application. A computing device coupled to an alternative reality viewing device generates a 3D virtual environment for display in the alternative reality viewing device, the 3D virtual environment comprising a plurality of 3D objects. The computing device identifies a subset of the plurality of 3D objects selected by the user of the alternative reality viewing device. The computing device captures a first set of actions of the user with respect to the subset of 3D objects, including recording a sequence of the first set of actions. The computing device generates a multidimensional authentication credential for the user based upon the first set of actions and stores the multidimensional authentication credential in a database.

Abstract: With respect to a video display apparatus, a technology capable of improving the operability and usability for a user in relation to a generated image such as AR (Augmented Reality) is provided. An HMD as a video display apparatus displays an AR image on a display screen, configures an ID image including identification information (ID) for supporting an operation of a user to the AR image, detects a sight line direction of the user to set a sight line region, and displays the ID image so as to be associated with the AR image when the AR image falls within a range of the sight line region. The HMD receives an operation to select the ID image from the user, selects the AR image associated with the ID image when receiving the operation to select the ID image, and executes a predetermined process associated with the AR image.

Abstract: A three-dimensional data encoding method includes: generating a bitmap indicating which of pieces of three-dimensional data a three-dimensional point belongs to, the three-dimensional point being included in a unit space; generating a conversion code using a look-up table and the bitmap generated; and generating encoded data including duplicated point information indicating a total number of three-dimensional points included in the unit space, and conversion code information indicating the conversion code. The generating of the conversion code includes: generating the conversion code from the bitmap when the total number of the three-dimensional points included in the unit space is less than or equal to a predetermined threshold value; and generating the conversion code from an inverted bitmap when the total number of the three-dimensional points included in the unit space is greater than the predetermined threshold value, the inverted bitmap being obtained by inverting 0 and 1 included in the bitmap.

Abstract: Provided are a medical image processing apparatus, a medical image processing method, a program, and a diagnosis support apparatus that report a region of interest without hindering observation of the boundary between the region of interest and a region of non-interest in a medical image. A medical image processing apparatus includes a superimposition processing unit that superimposes, on a medical image, a figure for reporting a region of interest included in the medical image. The superimposition processing unit superimposes the figure on an inside of the region of interest such that at least part of a boundary between the region of interest and a region of non-interest is not superimposed with the figure, thereby reporting the region of interest without hindering observation of the boundary between the region of interest and the region of non-interest.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for providing video communications with dynamic virtual backgrounds within a communication platform. Based on the contextual information of a meeting, the system selects a virtual background to be used for the meeting. During, a video meeting, the system generates for display, on one or more client devices, a composite video depicting the imagery of the user overlaid on imagery of the selected virtual background.

Abstract: A lighting emulation system accesses an image that is captured by an imaging device and that depicts an operational scene illuminated by close-range light. The lighting emulation system accesses a depth map of the operational scene that includes depth data corresponding to each pixel in the image. Based on the depth map, the lighting emulation system determines a far-range lighting coefficient for each pixel in the image. Specifically, the far-range lighting coefficient for each respective pixel is determined based on the corresponding depth data included in the depth map for that respective pixel. Based on the image and the far-range lighting coefficient for each pixel in the image, the lighting emulation system generates a processed image depicting the operational scene as illuminated by far-range lighting, and provides the processed image for presentation on a display screen.

Abstract: Ultrasound images are adjusted according to the size of the display area available to display them, so that image detail is displayed with a large enough physical size to discern comfortably. A translation ratio is determined for translating the physical distance traversed by the ultrasound signals of an ultrasound images to a corresponding physical distance on a screen of the display device. If the ratio is not below a threshold, the image is displayed in full. If the ratio is below the threshold, the image is cropped, optionally scaled, and displayed in the available area. Scaling and cropping may be based on window size and threshold window size. The parameters of the ultrasound scan may be controlled based on the scaling, cropping, or available screen size. User interface features may be displayed on the screen depending on how much area is available when the image is displayed.

Abstract: A system and method are disclosed for image analysis of supply chain planning problems modeled as a linear programming (LP) problems. Embodiments include receiving an LP matrix representing constraints and variables of at least a portion of a supply chain planning problem, generating a sorted variable index for the variables of the LP matrix, generating a sorted constraint index for the constraints of the LP matrix, identifying functions of the variables and the constraints, selecting one or more colors of pixels of a supply chain problem image based, at least in part, on the identified functions of the variables and constraints, selecting locations of the pixels, and displaying a visualization of the supply chain problem image.

Abstract: An image lighting method includes: determining a convolutional neural network corresponding to a lighting operation type of an initial image; obtaining local feature information and global feature information of initial image according to convolutional neural network; obtaining fusion feature information of initial image according to convolutional neural network based on local feature information and global feature information; obtaining a maximum pooling result map and a minimum pooling result map according to convolutional neural network based on a luminance component map of initial image; obtaining a bilateral grid matrix of initial image based on fusion feature information, maximum pooling result map, and minimum pooling result map; and performing affine transformation on initial image according to bilateral grid matrix to obtain a target image, the target image being an image obtained after lighting initial image according to lighting operation type.

Abstract: A display module (102) comprises light-emitting elements (106) coupled to one or more mounting structures and grouped into a pixels in a pixel array on a display face to display textual, graphical, or video information, with each pixel comprising a grouping of one or more light-emitting elements. A face cover (100) is mounted to the mounting structure and is positioned in front of at least a portion of the display face. The face cover comprises a plurality of moguls (110) arranged in a mogul array with each mogul positioned in front of and proximate to a corresponding one of the pixels so that the mogul covers at least a portion of the corresponding pixel, and one or more light-emitting openings (112) in each mogul, each positioned relative to one or more corresponding light-emitting element of the pixel to permit light emitted from the corresponding one or more light-emitting elements to pass through the mogul.

Abstract: To make it possible to obtain a natural virtual viewpoint image in which a structure or the like existing within an image capturing scene is represented three-dimensionally so as to be the same as a real one while suppressing a network load at the time of transmission of multi-viewpoint image data. The generation device according to the present invention generates a virtual viewpoint image based on three-dimensional shape data corresponding to an object, three-dimensional shape data corresponding to a structure, background data corresponding to a background different at least from the object and the structure, and information indicating a virtual viewpoint.

Abstract: Provided are an edge data network for streaming a virtual reality (VR) image and a device for displaying a VR image. An example method, performed by the edge data network, of streaming a VR image includes receiving gaze information of a user viewing the VR image from a device, determining at least a partial region among all of regions of the VR image as an artificial intelligence (AI) scaling target region of the VR image, based on the gaze information, determining an AI scaling change level for the AI scaling target region, performing a scaling change on a region corresponding to the AI scaling target region among the regions of the VR image obtained from a media server, according to the AI scaling change level, generating VR image data including the AI scaling target region, and streaming the VR image data to the device.