Patents by Inventor Nobuaki Izumi

Nobuaki Izumi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11825066
    Abstract: There is provided a video reproduction apparatus, a reproduction method, and a program that can suppress a decline in the degree of immersion of a viewer. A video generation apparatus of the present disclosure acquires a first 3D shape video generated from a plurality of viewpoint videos obtained by capturing images of a subject from different viewpoints, and a second 3D shape video being a video different from the first 3D shape video, and switches a frame to be reproduced, from a frame of the first 3D shape video to a frame of the second 3D shape video on the basis of a state of a viewer viewing the first 3D shape video. The present disclosure may be applied, for example, to a video generation apparatus, a video processing apparatus, a video reproduction apparatus, or the like.
    Type: Grant
    Filed: December 12, 2019
    Date of Patent: November 21, 2023
    Assignee: SONY CORPORATION
    Inventors: Yuichi Araki, Yuichi Hasegawa, Nobuaki Izumi
  • Publication number: 20230084376
    Abstract: A first-layer depth map generation unit (131) (distance acquisition unit) of an encoding device (40a) (information processing device) acquires a first distance (d1) between a projecting point (Q) and a first point (P1) at which a straight line extending from the projecting point (Q) to a subject (90) comes into contact with the subject (90), on the basis of a 3D shape of a surface of the subject (90). Furthermore, on the basis of the 3D shape of the surface of the subject (90), a second-layer depth map generation unit (132) (distance acquisition unit) acquires a second distance (d2) between the projecting point (Q) and a second point (P2) from which the straight line extending through the inside of the subject (90) from the first point (P1) passes to the outside of the subject (90).
    Type: Application
    Filed: March 16, 2021
    Publication date: March 16, 2023
    Applicant: SONY GROUP CORPORATION
    Inventor: Nobuaki IZUMI
  • Publication number: 20220343583
    Abstract: When an operation detection unit (31) (detection unit) of a mobile terminal (30a) (information processing apparatus) detects an operation instruction given when observing a 3D model (90M) (3D object), a texture information selection unit (33) (decision unit) selects which texture information (Ta or Tb) that expresses the texture of the 3D model (90M) in a plurality of different formats acquired by a 3D model acquisition unit (32) to use when drawing the 3D model (90M) according to the operation instruction detected by the operation detection unit (31). Then, a rendering processing unit (34) (drawing unit) renders the texture information (Ta or Tb) selected by the texture information selection unit (33) on the 3D model (90M) reconstructed on the basis of mesh information (M) (shape information) so as to draw the 3D model (90M).
    Type: Application
    Filed: August 17, 2020
    Publication date: October 27, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Hisako SUGANO, Yoichi HIROTA, Nobuaki IZUMI, Junji OI
  • Patent number: 11317082
    Abstract: An information processing apparatus that includes a receiving unit that receives a request including load information regarding a load and a sending unit that sends a data set in accordance with the request. The data set includes three-dimensional shape data, and left-eye texture data and right-eye texture data. The three-dimensional shape data has a vertex count corresponding to the load information. The left-eye texture data and the right-eye texture data correspond to the three-dimensional shape data.
    Type: Grant
    Filed: October 25, 2018
    Date of Patent: April 26, 2022
    Assignee: SONY CORPORATION
    Inventor: Nobuaki Izumi
  • Publication number: 20220084300
    Abstract: The present technology relates to an image processing apparatus and an image processing method that allow for a reduction in processing load of drawing processing. The image processing apparatus includes a determination unit that determines whether or not a subject is captured in texture images corresponding to captured images captured one by each one of a plurality of imaging devices, and an output unit that adds a result of the determination by the determination unit to 3D shape data of a 3D model of the subject and then outputs the result of the determination. The present technology can be applied to, for example, an image processing apparatus that generates data of a 3D model of an object.
    Type: Application
    Filed: February 26, 2020
    Publication date: March 17, 2022
    Inventor: NOBUAKI IZUMI
  • Patent number: 11270413
    Abstract: There is provided a playback apparatus and method, and generation apparatus and method capable of performing enlargement/reduction display of an image while preventing an occurrence of motion sickness. In a case where enlargement/reduction of omnidirectional image is selected, the playback apparatus includes a vertex data transformer that generates a 3D model for enlargement/reduction. The present disclosure can be applied, for example, to a playback apparatus and the like that generates an image obtained by perspective-projecting an omnidirectional image as a display image according to the viewer/listener's line-of-sight direction.
    Type: Grant
    Filed: October 5, 2018
    Date of Patent: March 8, 2022
    Assignee: SONY CORPORATION
    Inventor: Nobuaki Izumi
  • Publication number: 20220060672
    Abstract: There is provided a video reproduction apparatus, a reproduction method, and a program that can suppress a decline in the degree of immersion of a viewer. A video generation apparatus of the present disclosure acquires a first 3D shape video generated from a plurality of viewpoint videos obtained by capturing images of a subject from different viewpoints, and a second 3D shape video being a video different from the first 3D shape video, and switches a frame to be reproduced, from a frame of the first 3D shape video to a frame of the second 3D shape video on the basis of a state of a viewer viewing the first 3D shape video. The present disclosure may be applied, for example, to a video generation apparatus, a video processing apparatus, a video reproduction apparatus, or the like.
    Type: Application
    Filed: December 12, 2019
    Publication date: February 24, 2022
    Applicant: SONY CORPORATION
    Inventors: Yuichi ARAKI, Yuichi HASEGAWA, Nobuaki IZUMI
  • Patent number: 11134235
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A drawing section generates a display image of a given viewpoint using a first layer image including a texture image and a depth image of an omnidirectional image at a first viewpoint and a second layer image including a texture image and a depth image at a second viewpoint different from the first viewpoint in an occlusion region at a viewpoint of the first layer image. The present disclosure can be applied, for example, to a home server that generates a display image of a predetermined viewpoint from an omnidirectional image or the like.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: September 28, 2021
    Assignee: SONY CORPORATION
    Inventor: Nobuaki Izumi
  • Patent number: 11069120
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate an image using texture images and depth images of two viewpoints that represent a three-dimensional structure of a greater number of regions. A selection section selects a quantization method of a depth image of each viewpoint from among a first quantization method that quantizes a reciprocal 1/r of a distance r between a viewpoint corresponding to the depth image and the polygon for each pixel, a second quantization method that quantizes the distance r, and a third quantization method that quantizes a reciprocal 1/r? of a distance r? between the other viewpoint that configures the two viewpoints together with the viewpoint corresponding to the depth image and the polygon in each pixel. The present disclosure can be applied, for example, to a display apparatus and the like.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: July 20, 2021
    Assignee: Sony Corporation
    Inventors: Hiroshi Oryoji, Nobuaki Izumi
  • Patent number: 10950029
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method which make it possible to generate an image using texture images and depth images of two viewpoints that represent a three-dimensional structure of a greater number of regions. A drawing section generates a texture image of a predetermined viewpoint using a texture image obtained by perspectively projecting, to a perspective projection face perpendicular to a sight line direction heading from each of two viewpoints which are opposed to each other across a center of a polygon, toward the center of the polygon, a rear face of the polygon and a depth image corresponding to the texture image of each of the viewpoints. The present disclosure can be applied, for example, to a display apparatus and the like.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: March 16, 2021
    Assignee: SONY CORPORATION
    Inventors: Nobuaki Izumi, Hiroshi Oryoji
  • Patent number: 10943373
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A drawing section generates a display image of a given viewpoint using a first layer image including a texture image and a depth image of an omnidirectional image and a second layer image including a texture image and a depth image in an occlusion region at a viewpoint of the first layer image. The present disclosure can be applied to, for example, a home server that generates a display image of a predetermined viewpoint from an omnidirectional image or the like.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: March 9, 2021
    Assignee: SONY CORPORATION
    Inventor: Nobuaki Izumi
  • Patent number: 10911781
    Abstract: There is provided an image processing device and an image processing method for instantaneously displaying an image of a user's field of view. An encoder encodes a celestial sphere image of a cube formed by images of multiple planes generated from omnidirectional images, the encoding being performed plane by plane at a high resolution, to generate a high-resolution encoded stream corresponding to each of the planes. The encoder further encodes, at a low resolution, the celestial sphere image to generate a low-resolution encoded stream. The present disclosure may be applied, for example, to image display systems that generate a celestial sphere image so as to display an image of the user's field of view derived therefrom.
    Type: Grant
    Filed: February 19, 2016
    Date of Patent: February 2, 2021
    Assignee: SONY CORPORATION
    Inventor: Nobuaki Izumi
  • Patent number: 10846916
    Abstract: There is provided an image processing apparatus and an image processing method that can follow a fast movement of a virtual point to change a high-precision image. A position correction unit corrects a three-dimensional position of a point of a boundary of an occlusion area among a plurality of points, the three-dimensional position being included in three-dimensional data including three-dimensional positions and color information of the plurality of points, the three-dimensional data being generated from color image data and depth image data from a predetermined viewpoint. The present disclosure can be applied to, for example, an image processing apparatus or the like that generates color image data from a virtual viewpoint on the basis of color image data and depth image data from a predetermined viewpoint.
    Type: Grant
    Filed: November 21, 2016
    Date of Patent: November 24, 2020
    Assignee: SONY CORPORATION
    Inventors: Yuichi Araki, Nobuaki Izumi, Junichiro Enoki
  • Publication number: 20200359007
    Abstract: [Overview] [Problem to be Solved] To provide an information processing apparatus and an information processing method. [Solution] An information processing apparatus including: a receiving unit that receives a request including load information regarding a load; and a sending unit that sends a data set in accordance with the request. The data set includes three-dimensional shape data, and left-eye texture data and right-eye texture data. The three-dimensional shape data has a vertex count corresponding to the load information. The left-eye texture data and the right-eye texture data correspond to the three-dimensional shape data.
    Type: Application
    Filed: October 25, 2018
    Publication date: November 12, 2020
    Inventor: NOBUAKI IZUMI
  • Publication number: 20200342568
    Abstract: The present disclosure relates to an information processing apparatus and a method capable of more easily providing a higher-quality image while reducing a drop of encoding efficiency. Generated is a file which includes information associated with projection extension as an extension method of a projection system for mapping, on a single plane, a three-dimensional structure image as an image projected on a three-dimensional structure. For example, the present disclosure is applicable to an information processing apparatus, an image processing apparatus, an image encoding apparatus, a file generation apparatus, a file transmission apparatus, a distribution apparatus, a file reception apparatus, an image decoding apparatus, a reproduction apparatus, or the like.
    Type: Application
    Filed: December 28, 2018
    Publication date: October 29, 2020
    Inventors: RYOHEI TAKAHASHI, MITSUHIRO HIRABAYASHI, NOBUAKI IZUMI
  • Publication number: 20200334788
    Abstract: There is provided a playback apparatus and method, and generation apparatus and method capable of performing enlargement/reduction display of an image while preventing an occurrence of motion sickness. In a case where enlargement/reduction of omnidirectional image is selected, the playback apparatus includes a vertex data transformer that generates a 3D model for enlargement/reduction. The present disclosure can be applied, for example, to a playback apparatus and the like that generates an image obtained by perspective-projecting an omnidirectional image as a display image according to the viewer/listener's line-of-sight direction.
    Type: Application
    Filed: October 5, 2018
    Publication date: October 22, 2020
    Applicant: SONY CORPORATION
    Inventor: Nobuaki IZUMI
  • Publication number: 20200320747
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A drawing section generates a display image of a given viewpoint using a first layer image including a texture image and a depth image of an omnidirectional image and a second layer image including a texture image and a depth image in an occlusion region at a viewpoint of the first layer image. The present disclosure can be applied to, for example, a home server that generates a display image of a predetermined viewpoint from an omnidirectional image or the like.
    Type: Application
    Filed: July 14, 2017
    Publication date: October 8, 2020
    Applicant: SONY CORPORATION
    Inventor: Nobuaki IZUMI
  • Patent number: 10762597
    Abstract: There is provided a generation apparatus, a generation method, a reproduction apparatus, and a reproduction method by which a display image generated by use of an omnidirectional image is made approximately uniform in image quality in all visual line directions. A down-conversion part down-converts an omnidirectional image. A perspective projection part generates multiple images by projecting on multiple two-dimensional planes the omnidirectional image mapped onto a 3D model. This disclosure may be applied, for example, to generation apparatuses that generate an omnidirectional image from captured images in six directions so as to generate low- and high-resolution streams of the omnidirectional image.
    Type: Grant
    Filed: April 28, 2017
    Date of Patent: September 1, 2020
    Assignee: SONY CORPORATION
    Inventor: Nobuaki Izumi
  • Patent number: 10757463
    Abstract: There is provided an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: August 25, 2020
    Assignee: SONY CORPORATION
    Inventors: Mitsuhiro Hirabayashi, Yoichi Yagasaki, Nobuaki Izumi, Mitsuru Katsumata
  • Patent number: 10701508
    Abstract: A sound source setting section and a listening setting section are each configured to have a parameter setting section, a display section, and an arrangement relocation section on a placing surface of a placing table in real space, the arrangement relocation section allowing the source setting and listening sections to relocate on the placing surface. A reflecting member to which a reflecting characteristic is assigned is configured to be placeable on the placing table. A mixing process section performs a mixing process and also generates an image at the position, in a virtual space, of the sound source setting section relative to the listening setting section, the image having a texture indicative of a sound source assigned to the sound source setting section. Sound mixing with respect to a free listening point is thus performed easily.
    Type: Grant
    Filed: June 23, 2017
    Date of Patent: June 30, 2020
    Assignee: SONY CORPORATION
    Inventors: Toshiya Hamada, Nobuaki Izumi, Yukara Ikemiya