Abstract: A peripheral video generation device includes: a video input unit that inputs peripheral video data captured by a plurality of cameras; a video composition unit that composites the peripheral video data to generate a composite video as viewed from a predetermined viewpoint; a three-dimensional shape estimation unit that estimates a three-dimensional shape of a peripheral object based on the peripheral video data; a shielded area estimation unit that uses an estimation result of the three-dimensional shape to estimate a shielded area not visible from the predetermined viewpoint in the composite video; an inference unit that infers a video of the shielded area using deep learning; and a video superimposition unit that superimposes the video inferred by the inference unit on the shielded area in the composite video.

Abstract: In an image processing device, an information processing section performs information processing according to an instruction input by a user. An alpha buffer generating block of an image processing section generates an alpha buffer representing, in an image plane, the alpha value of each pixel when designated objects formed by a plurality of objects are collectively regarded as one object. A rendering block reads each piece of model data from an image data storage section, and renders an image also including other objects than the designated objects. A shading processing block approximately calculates degrees of occlusion of ambient light on the image plane, and subjects the rendered image to shading processing on a basis of a result of the calculation.

Abstract: An image processing device includes a photon map generator that constructs a virtual three-dimensional space as a rendering target and generates a photon map by distributing photons used for a photon mapping method, a low-luminance region identifying unit that identifies a low-luminance region estimated to have low luminance when the virtual three-dimensional space is projected onto a screen corresponding to a viewpoint by a method different from the photon mapping method, and a rendering part that collects photons corresponding to all pixels based on the photon map with reduction in the collection rate of photons corresponding to a pixel included in the low-luminance region compared with the other region, and calculates radiance to decide a pixel value and generate a display image.

Abstract: An image processing device includes a photon map generator that constructs a virtual three-dimensional space as a rendering target and generates a photon map by distributing photons used for a photon mapping method, a low-luminance region identifying unit that identifies a low-luminance region estimated to have low luminance when the virtual three-dimensional space is projected onto a screen corresponding to a viewpoint by a method different from the photon mapping method, and a rendering part that collects photons corresponding to all pixels based on the photon map with reduction in the collection rate of photons corresponding to a pixel included in the low-luminance region compared with the other region, and calculates radiance to decide a pixel value and generate a display image.

Abstract: In an image processing device, an information processing section performs information processing according to an instruction input by a user. An alpha buffer generating block of an image processing section generates an alpha buffer representing, in an image plane, the alpha value of each pixel when designated objects formed by a plurality of objects are collectively regarded as one object. A rendering block reads each piece of model data from an image data storage section, and renders an image also including other objects than the designated objects. A shading processing block approximately calculates degrees of occlusion of ambient light on the image plane, and subjects the rendered image to shading processing on a basis of a result of the calculation.

Abstract: The basic image specifying unit specifies the basic image of a character representing a user of the information processing device. The facial expression parameter generating unit converts the degree of the facial expression of the user to a numerical value. The model control unit determines an output model of the character for respective points of time. The moving image parameter generating unit generates a moving image parameter for generating animated moving image frames of the character for respective points of time. The command specifying unit specifies a command corresponding to the pattern of the facial expression of the user. The playback unit outputs an image based on the moving image parameter and the voice data received from the information processing device of the other user. The command executing unit executes a command based on the identification information of the command.

Abstract: A calculation unit (58) references texture data (62) in a storage unit (60) and acquires texel information of index color formal An integral look-up table (64) has a structure containing a plurality of color look-up tables based on the detail degree (LOD) of the area to be plotted A look-up table reference unit (70) selectively references the color look-up table based on the LOD stored in the integral look-up table (64) according to the LOD value of the texel obtained by the LOD calculation unit (68), acquires color information corresponding to the index value of the texel, and outputs it to the calculation unit (58). The calculation unit (58) performs filter processing such as bi-linear interpolation according to the texel color information and outputs the texel information after the processing.

Abstract: The basic image specifying unit specifies the basic image of a character representing a user of the information processing device. The facial expression parameter generating unit converts the degree of the facial expression of the user to a numerical value. The model control unit determines an output model of the character for respective points of time. The moving image parameter generating unit generates a moving image parameter for generating animated moving image frames of the character for respective points of time. The command specifying unit specifies a command corresponding to the pattern of the facial expression of the user. The playback unit outputs an image based on the moving image parameter and the voice data received from the information processing device of the other user. The command executing unit executes a command based on the identification information of the command.

Abstract: A frame difference computation unit of a texture unit identifies a prediction macroblock, by evaluating sums of absolute differences between a target macroblock in a first frame image and a candidate for prediction macroblock in a second frame image, and determines a motion vector. The frame difference computation unit supplies information on motion vector for the macroblocks and image difference data to a shader unit, in addition to a frame image that serves as a reference for motion compensation. A frame encoding processing unit performs interframe compression encoding using data from the texture data, so as to generate encoded image data.

Abstract: An image rendering apparatus is provided to reduce the amount of data communicated between a shader and a texture unit. The texture unit performs a texture mapping operation for mapping a texture to an object in a three-dimensional space. An input unit receives a single texture address parameter from the shader unit. A coordinate generation unit generates a plurality of texel coordinates based on the texture address parameter. A retrieval unit retrieves a plurality of texel values corresponding respectively to the plurality of generated texel coordinates in a texture cache or in an external texture buffer. An output unit outputs the retrieved texel values to the shader unit in a batch. Since a plurality of texel values are read from a single texture address parameter input, the bandwidth for communications from the shader to the texture unit may be saved.

Abstract: A calculation unit (58) references texture data (62) in a storage unit (60) and acquires texel information of index color formal An integral look-up table (64) has a structure containing a plurality of color look-up tables based on the detail degree (LOD) of the area to be plotted A look-up table reference unit (70) selectively references the color look-up table based on the LOD stored in the integral look-up table (64) according to the LOD value of the texel obtained by the LOD calculation unit (68), acquires color information corresponding to the index value of the texel, and outputs it to the calculation unit (58). The calculation unit (58) performs filter processing such as bi-linear interpolation according to the texel color information and outputs the texel information after the processing.

Abstract: An image rendering apparatus is provided to reduce the amount of data communicated between a shader and a texture unit. The texture unit performs a texture mapping operation for mapping a texture to an object in a three-dimensional space. An input unit receives a single texture address parameter from the shader unit. A coordinate generation unit generates a plurality of texel coordinates based on the texture address parameter. A retrieval unit retrieves a plurality of texel values corresponding respectively to the plurality of generated texel coordinates in a texture cache or in an external texture buffer. An output unit outputs the retrieved texel values to the shader unit in a batch. Since a plurality of texel values are read from a single texture address parameter input, the bandwidth for communications from the shader to the texture unit may be saved.

Abstract: A texture unit is provided for performing texture mapping. A computation unit provides a separation unit with a texel value of a texture given by an index form. The separation unit takes an index value and an alpha value separately out of the texel value in the index form, and provides the index value to a lookup table reference unit and the alpha value to a synthesizing unit. Referring to a lookup table, the lookup table reference unit obtains an RGB value corresponding to the index value and provides the RGB value to the synthesizing unit. The synthesizing unit attaches the alpha value to the RGB value so as to generate color information of the texel and provides the color information to the computation unit. The computation unit performs a filtering processing such as bi-linear interpolation on the texture data based on the color information of the texel.

Abstract: A frame difference computation unit of a texture unit identifies a prediction macroblock, by evaluating sums of absolute differences between a target macroblock in a first frame image and a candidate for prediction macroblock in a second frame image, and determines a motion vector. The frame difference computation unit supplies information on motion vector for the macroblocks and image difference data to a shader unit, in addition to a frame image that serves as a reference for motion compensation. A frame encoding processing unit performs interframe compression encoding using data from the texture data, so as to generate encoded image data.