Patents by Inventor Akio Ohba

Akio Ohba has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10885656
    Abstract: [Object] To perform more stable and highly accurate attitude estimation. [Solution] The attitude optimization unit optimizes the articulation position, the angle, the number of articulations, and the like which are attitude parameters of a human body model (tree structure) by a plurality of optimization techniques so as to match a region in which a human body can exist, and switches among a plurality of optimization techniques and uses an optimum technique. Note that optimization techniques include 1. initial value, 2. algorithm, and 3, restriction, and optimization is performed by switching among these three. For example, it is possible to apply the present disclosure to an image processing device that performs image processing of optimizing the articulation position and angle of a human body model.
    Type: Grant
    Filed: September 29, 2016
    Date of Patent: January 5, 2021
    Assignees: Sony Corporation, Sony Interactive Entertainment Inc.
    Inventors: Atsushi Kimura, Daisuke Tahara, Hiroyuki Segawa, Tetsugo Inada, Akio Ohba, Hirofumi Okamoto
  • Patent number: 10869010
    Abstract: A mat for an image pickup apparatus, where the image pickup apparatus operates to recognize a real object, the mat includes: a play field that defines a bottom region of a space in which the real object is placed; and a calibration chart located in the space and having a plurality of color regions in which respective luminances thereof differ from one another, where: the image pickup apparatus: (i) obtains data of a picked up image of the space in which the real object is located; and (ii) evaluates the picked up image and adjusts at least one of an image pickup condition in which the picked up image of the space is taken, and a processing condition in which the data are analyzed to recognize the real object, and at least one of the image pickup condition and the processing condition are adjusted based on color information in the data of the picked up image resulting from the plurality of color regions of the calibration chart.
    Type: Grant
    Filed: October 7, 2019
    Date of Patent: December 15, 2020
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Hidehiko Ogasawara, Norio Nagatsuka, Naoki Numaguchi, Hiroyuki Segawa, Akio Ohba
  • Publication number: 20200342636
    Abstract: An input information acquiring section accepts a user's operation. A texture region acquiring section acquires a region of a display image to be presented by use of a texture. A velocity acquiring section acquires for each pixel a movement velocity vector of the texture on a plane of the display image. A texture referencing section adjusts a reference range in an axial direction of the velocity vector in keeping with a magnitude of the movement velocity, before sampling texel values. A pixel value determining section determines a pixel value on the basis of the texel values. An output section outputs the display image.
    Type: Application
    Filed: January 30, 2018
    Publication date: October 29, 2020
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Akio Ohba, Takayuki Shinohara, Shinya Wada, Akihiko Sugawara, Takayuki Ishida, Hiroyuki Segawa
  • Patent number: 10805528
    Abstract: An image data generating block 72 of an image capturing apparatus 12 generates polarized images having two or more resolutions from luminance of polarization in two or more directions acquired by a luminance data acquiring block 70. A pixel value converting block 74 generates new image data with a predetermined parameter being a pixel value on the basis of the polarized luminance in two or more directions. A transmission image generating block 76 connects image data of two or more types on a predetermined pixel line basis and then crops the requested data, thereby stream-transferring the cropped data from a communication block 78. A target object recognizing block 80 of an information processing apparatus 10 recognizes the state of a target object by use of the transmitted data and an output data generating block 82 generates output data by use of the recognized state.
    Type: Grant
    Filed: September 27, 2017
    Date of Patent: October 13, 2020
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Akio Ohba, Hidehiko Ogasawara, Akihiko Sugawara, Hiroyuki Segawa
  • Patent number: 10803652
    Abstract: There are provided an image generating apparatus, an image generating method, and a program for generating an image that allows each of the users sharing a virtual space to see what the ether users are looking at. A virtual space managing section (126) arranges a fixation point object indicative of a fixation point at a position away from a first viewpoint in a first visual line direction passing through the first viewpoint arranged in a virtual space, the first visual line direction corresponding to the attitude of a first head-mounted display. A frame image generating section (128) generates an image indicating how things look from a second viewpoint in a second visual line direction corresponding to the attitude of a second head-mounted display, the second viewpoint being arranged in the virtual space in which the fixation point object is arranged.
    Type: Grant
    Filed: February 13, 2017
    Date of Patent: October 13, 2020
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Akio Ohba, Taeko Sanada
  • Publication number: 20200273205
    Abstract: In a calibration apparatus, a captured image acquisition unit acquires data of an image of a calibration chart captured by a fish-eye imaging apparatus. A distortion correction unit makes an assumption of a parameter of the imaging apparatus, takes into account a projection system to make a correction, and adjusts the parameter until an image of the original chart is obtained. A pseudo image drawing unit uses model data of a chart to draw a pseudo captured image. A point-of-view adjustment unit compares the pseudo image and the captured image and adjusts a point-of-view position of a virtual camera according to a difference between positions of markers or intervals of patterns to specify a position of the imaging apparatus.
    Type: Application
    Filed: May 9, 2018
    Publication date: August 27, 2020
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Noriyuki Yamashita, Akio Ohba
  • Publication number: 20200114520
    Abstract: A feeling deduction unit 100 deduces a user's feeling. An internal state management unit 110 manages an internal state of an object and an internal state of a user on the basis of the deduced user's feeling. An action management unit 120 determines an action of the object on the basis of the internal state of the object. An output processing unit 140 causes the object to perform the action determined by the action management unit 120.
    Type: Application
    Filed: April 25, 2018
    Publication date: April 16, 2020
    Inventors: Shinichi HONDA, Akio OHBA, Hiroyuki SEGAWA
  • Publication number: 20200090403
    Abstract: In an information processing device, a photographed image acquiring unit acquires an image which has been photographed by a camera attached to a head mount display. A region determining unit predicts a region which a user gazes at in a display image. An image analyzing unit has a first fineness processing unit and a second fineness processing unit, with the former analyzing a region corresponding to the gaze region in the photographed image with a higher fineness than the latter. An information processing unit performs information processing by using the result of analysis. An image generating unit has a first fineness processing unit and a second fineness processing unit, with the former generating a display image on the gaze region with a higher fineness than the latter. An output unit sends data of the display image to the head mount display.
    Type: Application
    Filed: February 21, 2017
    Publication date: March 19, 2020
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Takayuki Ishida, Akio Ohba, Akihiko Sugawara, Yasuhiro Watari, Akira Suzuki
  • Patent number: 10580192
    Abstract: Regions 150 and 152 on a texture image plane 140 that correspond individually to pixels 146 and 148 representing an image on a texture image mapping target surface 144 in a screen plane 142 on which to define a display image are determined using predetermined transformation equations. The number of sampling points and their distribution are determined for the determined region in accordance with its shape and its size. Texel values in the determined region are then sampled. An average of the sampled values is acquired as the value of each of the original pixels 146 and 148.
    Type: Grant
    Filed: November 11, 2016
    Date of Patent: March 3, 2020
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventor: Akio Ohba
  • Publication number: 20200050833
    Abstract: A captured image acquisition section 50 acquires, from an imaging apparatus 12, data of a polarized image obtained by capturing a target object and stores the data into an image data storage section 52. A region extraction section 60 of a target object recognition section 54 extracts a region in which a figure of the target object is included in the polarized image. A normal line distribution acquisition section 62 acquires a distribution of normal line vectors on a target object surface in regard to the extracted region. A model adjustment section 66 adjusts a three-dimensional model of the target object stored in a model data storage section 64 in a virtual three-dimensional space such that the three-dimensional model conforms to the distribution of the normal line vectors acquired from the polarized image to specify a state of the target object.
    Type: Application
    Filed: August 31, 2017
    Publication date: February 13, 2020
    Inventors: Hidehiko OGASAWARA, Akio OHBA, Hiroyuki SEGAWA
  • Publication number: 20200045284
    Abstract: A mat for an image pickup apparatus, where the image pickup apparatus operates to recognize a real object, the mat includes: a play field that defines a bottom region of a space in which the real object is placed; and a calibration chart located in the space and having a plurality of color regions in which respective luminances thereof differ from one another, where: the image pickup apparatus: (i) obtains data of a picked up image of the space in which the real object is located; and (ii) evaluates the picked up image and adjusts at least one of an image pickup condition in which the picked up image of the space is taken, and a processing condition in which the data are analyzed to recognize the real object, and at least one of the image pickup condition and the processing condition are adjusted based on color information in the data of the picked up image resulting from the plurality of color regions of the calibration chart.
    Type: Application
    Filed: October 7, 2019
    Publication date: February 6, 2020
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Hidehiko Ogasawara, Norio Nagatsuka, Naoki Numaguchi, Hiroyuki Segawa, Akio Ohba
  • Patent number: 10477175
    Abstract: An image of a block or the like entering a space above a play mat is picked up by an image pickup apparatus, and an information processing apparatus detects and recognizes the block on the basis of a picture of the block in a picked up image and performs information processing. The play mat includes a play field that defines a detection space for the block, and a calibration chart including at least a plurality of regions of colors of different luminances. The image pickup apparatus adjusts an exposure time period, a gain value for each color component and a correction rule upon gamma correction on the basis of the picture of the calibration chart in the picked up image.
    Type: Grant
    Filed: January 29, 2016
    Date of Patent: November 12, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Hidehiko Ogasawara, Norio Nagatsuka, Naoki Numaguchi, Hiroyuki Segawa, Akio Ohba
  • Patent number: 10474876
    Abstract: Disclosed herein is an image processing apparatus including: a priority degree setting section configured to set a degree of priority for each of surrounding regions of a plurality of people detected from an input image; and a pose estimation section configured to estimate poses of human body models for human body regions extracted from the input image one after another, on the basis of the surrounding regions of one or more of the people selected using the degrees of priority set by the priority degree setting section.
    Type: Grant
    Filed: November 17, 2016
    Date of Patent: November 12, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Hiroyuki Segawa, Tetsugo Inada, Akio Ohba, Hirofumi Okamoto, Atsushi Kimura, Daisuke Tahara
  • Patent number: 10469829
    Abstract: An information processor acquires a stereo image from an imaging device. A detection plane definition portion defines a detection plane in a three-dimensional space of a camera coordinate system of a first camera. A feature quantity calculation portion generates feature point image of left and right images. A parallax correction area derivation portion derives an area as a parallax correction area, which is obtained by moving, to a left, an area of the right image identical to the detection area of the left image. A matching portion performs matching for the feature point images of each area, thus deriving a highly rated feature point. A position information output portion generates information to be used by an output information generation section based on the matching result.
    Type: Grant
    Filed: April 11, 2013
    Date of Patent: November 5, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Akio Ohba, Hiroyuki Segawa, Tetsugo Inada
  • Patent number: 10438365
    Abstract: An imaging device includes a filter, imaging elements, and an image processing section. The filter has a plurality of regions transmitting different light components. The imaging elements detect a luminance distribution of polarization components in a plurality of directions of light transmitted by the filter. The image processing section analyzes the detected luminance distribution based on correlation between the components, thereby generating a plurality of items of information about a subject.
    Type: Grant
    Filed: September 8, 2017
    Date of Patent: October 8, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Yoshihiro Myokan, Akio Ohba, Hidehiko Ogasawara, Shinya Wada, Akihiko Sugawara, Hiroyuki Segawa
  • Publication number: 20190295286
    Abstract: An operation object includes a polyhedron. The polyhedron includes characteristic surfaces formed by cutting each vertex of a cube at different angles. An information processing apparatus acquires a normal vector of each surface from a polarized image thereof. Further, the information processing apparatus identifies the characteristic surface by defining, as a characteristic amount, an angle formed by an average vector Na of normal vectors N1, N2, and N3 of reference surfaces that orthogonally intersect each other and a normal vector N0 of the characteristic surface surrounded by the reference surfaces. The specification result and the normal vectors thereof are used to acquire the position and orientation of the operation object.
    Type: Application
    Filed: August 15, 2017
    Publication date: September 26, 2019
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Takayuki Ishida, Akio Ohba, Tetsugo Inada
  • Patent number: 10404911
    Abstract: An image pickup apparatus includes an image data production unit which produces data of images of a plurality of resolutions, from an image frame obtained by picking up an image of a target object as a moving picture for each pixel string which configures a row, and an image sending unit which extracts, from the data of the images of the plurality of resolutions, pixel strings of a region requested from a host terminal and connect the extracted pixel strings for each number of pixels determined in accordance with a given rule to produce a stream and then transmit the stream to the host terminal. The image sending unit adjusts a connection pixel number of data of an image of a particular resolution such that, where N is an integer, data for 1/(N+1) frame are transmitted with respect to one frame of data of an image of the other resolution.
    Type: Grant
    Filed: January 11, 2018
    Date of Patent: September 3, 2019
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Akio Ohba, Hidehiko Ogasawara
  • Publication number: 20190230281
    Abstract: An image data generating block 72 of an image capturing apparatus 12 generates polarized images having two or more resolutions from luminance of polarization in two or more directions acquired by a luminance data acquiring block 70. A pixel value converting block 74 generates new image data with a predetermined parameter being a pixel value on the basis of the polarized luminance in two or more directions. A transmission image generating block 76 connects image data of two or more types on a predetermined pixel line basis and then crops the requested data, thereby stream-transferring the cropped data from a communication block 78. A target object recognizing block 80 of an information processing apparatus 10 recognizes the state of a target object by use of the transmitted data and an output data generating block 82 generates output data by use of the recognized state.
    Type: Application
    Filed: September 27, 2017
    Publication date: July 25, 2019
    Inventors: Akio Ohba, Hidehiko Ogasawara, Akihiko Sugawara, Hiroyuki Segawa
  • Publication number: 20190213739
    Abstract: A captured image acquisition section 50 acquires, from an imaging apparatus 12, data of a polarized image obtained by capturing a target object and stores the data into an image data storage section 52. A normal line distribution acquisition section 362 of a region segmentation section 310 acquires a distribution of normal line vectors of a subject surface using the polarized image. A region decision section 312 evaluates the distribution of normal line vectors with a predetermined criterion indicating stability such as a dispersion and determines a region in which the stability is high as a region of a figure of a subject to segment the image. An output data generation section 56 carries out various processes using a result of the segmentation to generate output data.
    Type: Application
    Filed: August 31, 2017
    Publication date: July 11, 2019
    Inventors: Akio OHBA, Hidehiko OGASAWARA, Hiroyuki SEGAWA
  • Patent number: 10275021
    Abstract: The present disclosure provides a display apparatus of front-of-the-eye mounted type having a camera configured to image portions around the mouth of a user. The display apparatus of front-of-the-eye mounted type includes an around-the-mouth imaging camera arranged at a position where it is practicable to image a mouth movement of a user; and a display control unit configured to display an image based on input information of the user estimated from the mouth movement imaged by the around-the-mouth imaging camera.
    Type: Grant
    Filed: May 16, 2016
    Date of Patent: April 30, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Akio Ohba