Patents by Inventor Hisako Sugano

Hisako Sugano has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11842453
    Abstract: A subject feature detection unit (53) (detection unit) of a mobile terminal (80) (information processing device) detects a line-of-sight direction (E) (feature) of a subject (92) displayed simultaneously with a 3D model (90M) in a captured image (I). Then, the display control unit (54) (control unit) changes a line-of-sight direction (F) (display mode) of the 3D model (90M) so that the 3D model (90M) faces the camera (84) in accordance with the line-of-sight direction (E) of the subject (92) detected by the subject feature detection unit (53).
    Type: Grant
    Filed: June 19, 2020
    Date of Patent: December 12, 2023
    Assignee: SONY GROUP CORPORATION
    Inventor: Hisako Sugano
  • Publication number: 20230288622
    Abstract: There is provided an imaging processing system and a three-dimensional (3D) model generation method capable of generating a more accurate 3D model.
    Type: Application
    Filed: July 2, 2021
    Publication date: September 14, 2023
    Applicant: Sony Group Corporation
    Inventors: Hisako SUGANO, Hisayuki TATENO, Yoichi HIROTA
  • Publication number: 20230224428
    Abstract: In a subject emphasizing device (20a) (information processing device), a visible-light moving image acquisition unit (31) (first acquisition unit) acquires a moving image including a subject (92) and a background, and a subject region extraction unit (33) extracts a region of the subject (92) from the moving image. Then, a background drawing unit (37) draws background information (94), in a region other than the region of the subject (92) in the moving image. An effect application unit (36) applies a visual effect to the region of the subject (92), on the basis of an intensity of the visual effect to be applied to the region of the subject (92), determined by an effect intensity calculation unit (35) according to a distance from a camera to the subject (92) (information about environment of acquiring the moving image).
    Type: Application
    Filed: April 14, 2021
    Publication date: July 13, 2023
    Inventors: HISAKO SUGANO, YOICHI HIROTA
  • Patent number: 11653023
    Abstract: There is provided an encoding device, an encoding method, a decoding device, and a decoding method capable of generating a more accurate three-dimensional model. A three-dimensional model generating unit generates three-dimensional model information representing a three-dimensional model of a subject on the basis of a plurality of captured images and active depth information, and a conversion processing unit converts the three-dimensional model represented by the three-dimensional model information into a plurality of two-dimensional images by projecting the three-dimensional model from a plurality of directions, and generates depth information representing a depth from an arbitrary viewpoint to the three-dimensional model by using the plurality of two-dimensional images. Then, transmit data including the plurality of two-dimensional images, the depth information, and the active depth information is transmitted to the decoding device.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: May 16, 2023
    Assignee: SONY CORPORATION
    Inventor: Hisako Sugano
  • Publication number: 20230068731
    Abstract: There is provided an image processing device and a moving image data generation method capable of easily searching for 3D model data. The image processing device includes: a storage unit that stores a plurality of 3D models and a plurality of 3D model feature amounts respectively corresponding to the plurality of 3D models; a search unit that searches for a 3D model having a feature amount similar to an input feature amount of a subject on the basis of the feature amount of the subject and the 3D model feature amounts stored in the storage unit; and an output unit that outputs the 3D model searched by the search unit. The present technology can be applied to, for example, an image processing device that searches for a 3D model.
    Type: Application
    Filed: March 3, 2021
    Publication date: March 2, 2023
    Applicant: SONY GROUP CORPORATION
    Inventors: Hisako SUGANO, Junichi TANAKA, Yoichi HIROTA
  • Publication number: 20220394231
    Abstract: The present technology relates to an information processing device, an information processing method, a program, and an information processing system capable of providing a user who views a free viewpoint moving image with better user experience.
    Type: Application
    Filed: November 25, 2020
    Publication date: December 8, 2022
    Applicant: SONY GROUP CORPORATION
    Inventor: Hisako SUGANO
  • Patent number: 11508123
    Abstract: Image processing apparatus responsive to successive groups of images of an object captured at the same time by two or more spaced apart image capturing devices and to depth information indicating a three-dimensional location of the object relative to at least one distance measuring device includes: a frame selecting unit configured to select a set of the successive image groups; a model generating unit configured to generate a three dimensional model, for each image group in the set of image groups, from images captured at the same time by the two or more spaced apart image capturing devices and from the depth information, and to map a texture to the generated three dimensional model; and a composition unit configured to generate a stroboscopic image, with respect to a stroboscopic image viewpoint, by superposing the three dimensional models generated by the model generating unit on a predetermined background.
    Type: Grant
    Filed: July 23, 2018
    Date of Patent: November 22, 2022
    Assignee: SONY CORPORATION
    Inventors: Hisako Sugano, Junichi Tanaka
  • Publication number: 20220358724
    Abstract: A subject feature detection unit (53) (detection unit) of a mobile terminal (80) (information processing device) detects a line-of-sight direction (E) (feature) of a subject (92) displayed simultaneously with a 3D model (90M) in a captured image (I). Then, the display control unit (54) (control unit) changes a line-of-sight direction (F) (display mode) of the 3D model (90M) so that the 3D model (90M) faces the camera (84) in accordance with the line-of-sight direction (E) of the subject (92) detected by the subject feature detection unit (53).
    Type: Application
    Filed: June 19, 2020
    Publication date: November 10, 2022
    Applicant: SONY GROUP CORPORATION
    Inventor: Hisako SUGANO
  • Publication number: 20220343583
    Abstract: When an operation detection unit (31) (detection unit) of a mobile terminal (30a) (information processing apparatus) detects an operation instruction given when observing a 3D model (90M) (3D object), a texture information selection unit (33) (decision unit) selects which texture information (Ta or Tb) that expresses the texture of the 3D model (90M) in a plurality of different formats acquired by a 3D model acquisition unit (32) to use when drawing the 3D model (90M) according to the operation instruction detected by the operation detection unit (31). Then, a rendering processing unit (34) (drawing unit) renders the texture information (Ta or Tb) selected by the texture information selection unit (33) on the 3D model (90M) reconstructed on the basis of mesh information (M) (shape information) so as to draw the 3D model (90M).
    Type: Application
    Filed: August 17, 2020
    Publication date: October 27, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Hisako SUGANO, Yoichi HIROTA, Nobuaki IZUMI, Junji OI
  • Publication number: 20220329770
    Abstract: A score map generation unit (83) (image quality prediction unit) included in an information processing apparatus (10a) predicts, for a 3D model (90M) (3D object), a relationship between a position of a virtual viewpoint (V) from which the 3D model (90M) is viewed and image quality of a virtual image (J) obtained when the 3D model (90M) is viewed from the position of the virtual viewpoint (V).
    Type: Application
    Filed: July 9, 2020
    Publication date: October 13, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Hisako SUGANO, Yoichi HIROTA
  • Patent number: 11468653
    Abstract: An image processing device includes circuitry configured to perform an effect process on at least one 3D model of a plurality of 3D models generated from a plurality of viewpoint images captured from a plurality of viewpoints at different times.
    Type: Grant
    Filed: November 6, 2019
    Date of Patent: October 11, 2022
    Assignee: SONY CORPORATION
    Inventor: Hisako Sugano
  • Publication number: 20220014722
    Abstract: An image processing device includes circuitry configured to generate a stroboscopic model including 3D models of a subject arranged in a three-dimensional space, the 3D models being generated from a plurality of viewpoint images captured from a plurality of viewpoints at a plurality of times, and set camerawork of a virtual camera in accordance with a state of the 3D models arranged in the stroboscopic model, the camerawork being set for capturing the stroboscopic model by the virtual camera to generate a stroboscopic image.
    Type: Application
    Filed: November 29, 2019
    Publication date: January 13, 2022
    Applicant: SONY CORPORATION
    Inventors: Hisako SUGANO, Yoichi HIROTA, Hiroaki TAKAHASHI
  • Publication number: 20210383617
    Abstract: An image processing device includes circuitry configured to perform an effect process on at least one 3D model of a plurality of 3D models generated from a plurality of viewpoint images captured from a plurality of viewpoints at different times.
    Type: Application
    Filed: November 6, 2019
    Publication date: December 9, 2021
    Applicant: SONY CORPORATION
    Inventor: Hisako SUGANO
  • Publication number: 20210368206
    Abstract: There is provided an encoding device, an encoding method, a decoding device, and a decoding method capable of generating a more accurate three-dimensional model. A three-dimensional model generating unit generates three-dimensional model information representing a three-dimensional model of a subject on the basis of a plurality of captured images and active depth information, and a conversion processing unit converts the three-dimensional model represented by the three-dimensional model information into a plurality of two-dimensional images by projecting the three-dimensional model from a plurality of directions, and generates depth information representing a depth from an arbitrary viewpoint to the three-dimensional model by using the plurality of two-dimensional images. Then, transmit data including the plurality of two-dimensional images, the depth information, and the active depth information is transmitted to the decoding device.
    Type: Application
    Filed: November 16, 2018
    Publication date: November 25, 2021
    Applicant: SONY CORPORATION
    Inventor: Hisako SUGANO
  • Patent number: 11138784
    Abstract: Provided are an image processing apparatus and an image processing method that make it possible to reduce a storage capacity necessary for an omnidirectional image. Of a plurality of images generated by perspectively projecting an omnidirectional image mapped to a 3D model onto a plurality of two-dimensional planes, an image corresponding to a viewing direction of a user and an omnidirectional image reduced in resolution are accepted, and a drawing block generates a display image on the basis of at least one of the accepted image and the accepted omnidirectional image reduced in resolution. A viewing direction acquisition block acquires viewing direction information related with the viewing direction of the user, and a sending block sends a viewing direction log recorded on the basis of the acquired viewing direction information.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: October 5, 2021
    Assignee: SONY CORPORATION
    Inventor: Hisako Sugano
  • Publication number: 20210134049
    Abstract: There is provided an image processing apparatus and an image processing method that enable transmission of a three-dimensional model of a subject and shadow information of the subject in a separate manner. A generator of an encoding system generates two-dimensional image data and depth data on the basis of a three-dimensional model generated from each of viewpoint images of a subject. The viewpoint images are captured through imaging from a plurality of viewpoints and subjected to a shadow removal process. A transmitter of the encoding system transmits the two-dimensional image data, the depth data, and information related to a shadow of the subject to a decoding system. The present technology is applicable to a free-viewpoint image transmission system.
    Type: Application
    Filed: July 26, 2018
    Publication date: May 6, 2021
    Applicant: SONY CORPORATION
    Inventor: Hisako SUGANO
  • Patent number: 10889061
    Abstract: An information processing apparatus that acquires default design information of a product and target information of a target to which the product is to be adapted. The information processing apparatus further generates design information adapted to the target from the default design information on a basis of the target information.
    Type: Grant
    Filed: July 15, 2016
    Date of Patent: January 12, 2021
    Assignee: SONY CORPORATION
    Inventors: Hisako Sugano, Kohei Miyamoto
  • Publication number: 20200410754
    Abstract: Image processing apparatus responsive to successive groups of images of an object captured at the same time by two or more spaced apart image capturing devices and to depth information indicating a three-dimensional location of the object relative to at least one distance measuring device includes: a frame selecting unit configured to select a set of the successive image groups; a model generating unit configured to generate a three dimensional model, for each image group in the set of image groups, from images captured at the same time by the two or more spaced apart image capturing devices and from the depth information, and to map a texture to the generated three dimensional model; and a composition unit configured to generate a stroboscopic image, with respect to a stroboscopic image viewpoint, by superposing the three dimensional models generated by the model generating unit on a predetermined background.
    Type: Application
    Filed: July 23, 2018
    Publication date: December 31, 2020
    Applicant: SONY CORPORATION
    Inventors: Hisako SUGANO, Junichi TANAKA
  • Patent number: 10852131
    Abstract: An information processing apparatus includes a first acquisition unit that acquires three-dimensional shape information indicating a result of measurement of a three-dimensional shape of an object, a second acquisition unit that acquires information indicating a motion of the object corresponding to the three-dimensional shape information acquired by the first acquisition unit, and a processing unit that processes the three-dimensional shape information acquired by the first acquisition unit, on a basis of the information indicating the motion of the object acquired by the second acquisition unit.
    Type: Grant
    Filed: June 28, 2016
    Date of Patent: December 1, 2020
    Assignee: Sony Corporation
    Inventors: Kohei Miyamoto, Hisako Sugano, Motohiko Watanabe, Honglei Sun
  • Patent number: 10636384
    Abstract: An image processing apparatus, an image processing method, and a program with which image data displayed in a display area of a terminal at a still position can be processed are provided. The image processing apparatus includes a still position detection section and a display control section. The still position detection section detects a still position of a terminal including a display area. The display control section controls a display form of image data that can be displayed from the display area based on the still position.
    Type: Grant
    Filed: February 16, 2015
    Date of Patent: April 28, 2020
    Assignee: SONY CORPORATION
    Inventors: Hisako Sugano, Junichiro Enoki