Patents by Inventor Hirofumi Okamoto

Hirofumi Okamoto has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10210629
    Abstract: A detection area is set in a three-dimensional space in which a subject exists. When an actual hand enters the detection area, coordinate points (white and black dots) represented by pixels making up a silhouette of the hand in a depth image enter the detection area. In the detection area, a reference vector is set that shows the direction which the hand should face relative to the shoulder as a reference point. Then, an inner product between two vectors, a vector from the reference point to each of coordinate points and the reference vector, is calculated, followed by comparison between the inner products. Positions of coordinate points whose inner products are ranked high are acquired as the position of tips of the hand.
    Type: Grant
    Filed: December 1, 2014
    Date of Patent: February 19, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Akio Ohba, Hiroyuki Segawa, Tetsugo Inada, Hidehiko Ogasawara, Hirofumi Okamoto
  • Publication number: 20180361240
    Abstract: As a user guide, the state of overlooking a real space including an imaging device and a user is presented by one of two images: an image in reference to the position of the imaging device, or an image in reference to the user's direction. In both images, a rectangle indicative of the imaging device and a circle representative of the user are presented in a manner reflecting the actual positional relations and directions involved. Also presented are an area denoting a play area in the horizontal direction determined by a camera angle of view for example, and an arrow pointing to the direction in which the user is to move.
    Type: Application
    Filed: January 13, 2017
    Publication date: December 20, 2018
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Shoichi IKENOUE, Tatsuo TSUCHIE, Tetsugo INADA, Masaki UCHIDA, Hirofumi OKAMOTO
  • Publication number: 20180322651
    Abstract: [Object] To perform more stable and highly accurate attitude estimation. [Solution] The attitude optimization unit optimizes the articulation position, the angle, the number of articulations, and the like which are attitude parameters of a human body model (tree structure) by a plurality of optimization techniques so as to match a region in which a human body can exist, and switches among a plurality of optimization techniques and uses an optimum technique. Note that optimization techniques include 1. initial value, 2. algorithm, and 3, restriction, and optimization is performed by switching among these three. For example, it is possible to apply the present disclosure to an image processing device that performs image processing of optimizing the articulation position and angle of a human body model.
    Type: Application
    Filed: September 29, 2016
    Publication date: November 8, 2018
    Applicants: Sony Corporation, Sony Interactive Entertainment Inc.
    Inventors: Atsushi Kimura, Daisuke Tahara, Hiroyuki Segawa, Tetsugo Inada, Akio Ohba, Hirofumi Okamoto
  • Patent number: 10063838
    Abstract: An information processor includes: a similarity data generation portion generating similarity data that represents the calculated similarity to the image in the reference block in association with a position within the search range; a result evaluation portion detecting a position with a maximum similarity value for each piece of the similarity data and screening the detection result by making a given evaluation of the similarity; a depth image generation portion finding a parallax for each of the reference blocks using the detection result validated as a result of screening, calculating a position of a subject in a depth direction on a basis of the parallax, and generating a depth image by associating the position of the subject in the depth direction with an image plane; and an output information generation section performing given information processing on a basis of the subject position in a three-dimensional space using the depth image and outputting the result of information processing.
    Type: Grant
    Filed: July 17, 2015
    Date of Patent: August 28, 2018
    Assignees: Sony Corporation, Sony Interactive Entertainment Inc.
    Inventors: Hiroyuki Segawa, Akio Ohba, Tetsugo Inada, Hirofumi Okamoto, Atsushi Kimura, Takashi Kohashi, Takashi Itou
  • Publication number: 20180189975
    Abstract: An image acquisition block of an information processing apparatus acquires stereo images taken by a first camera and a second camera that make up an imaging apparatus. An input information acquisition block accepts a user manipulation. A first positional information acquisition block of a positional information generation block identifies an approximate position of an object to be imaged through predetermined means. A second positional information acquisition block determines an estimated distance range of a target on the basis of the identified approximate position of the object to be imaged, detects corresponding points by executing block matching on stereo images thorough only a search range corresponding to the determined estimated distance range, and obtains a position of the target with high resolution and accuracy. An output information generation block generates output data on the basis of the position of that target and outputs the generated output data.
    Type: Application
    Filed: August 19, 2016
    Publication date: July 5, 2018
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Tetsugo Inada, Hirofumi Okamoto
  • Publication number: 20180167607
    Abstract: An information processing device causes an information processing section to perform information processing of a game for example, based on a user's operation received by an input information acquiring section and on images acquired by a stereo camera and obtained through an acquired image obtaining section. The information processing device causes an output data generating section to output the result of the information processing to a display device. At this point, a tracking processing section detects corresponding marker images from stereoscopic images and, based on a parallax therebetween, obtains position information about a target object. In accordance with vertical position misalignment between the detected marker images, a calibration determining section determines whether camera calibration is needed and requests the output data generating section to notify the user of the determined need.
    Type: Application
    Filed: May 13, 2016
    Publication date: June 14, 2018
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Hirofumi Okamoto, Shoichi Ikenoue
  • Patent number: 9785854
    Abstract: An information processor includes: a similarity data generation portion generating, for a position within the search range, similarity data that represents the calculated similarity to the image in the reference block in association with the position within the search range; a similarity correction portion smoothing the similarity data in a direction of space on a basis of similarity data; a result evaluation portion detecting a position with a maximum similarity value in each piece of the smoothed similarity data; a depth image generation portion generating a depth image by associating the position of the subject in the depth direction with an image plane; and an output information generation section performing given information processing on a basis of the subject position in a three-dimensional space using the depth image and outputting the result of information processing.
    Type: Grant
    Filed: July 17, 2015
    Date of Patent: October 10, 2017
    Assignees: SONY CORPORATION, SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Hiroyuki Segawa, Akio Ohba, Tetsugo Inada, Hirofumi Okamoto, Atsushi Kimura, Takashi Kohashi, Takashi Itou
  • Publication number: 20170161547
    Abstract: Disclosed herein is an image processing apparatus including: a priority degree setting section configured to set a degree of priority for each of surrounding regions of a plurality of people detected from an input image; and a pose estimation section configured to estimate poses of human body models for human body regions extracted from the input image one after another, on the basis of the surrounding regions of one or more of the people selected using the degrees of priority set by the priority degree setting section.
    Type: Application
    Filed: November 17, 2016
    Publication date: June 8, 2017
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Hiroyuki Segawa, Tetsugo Inada, Akio Ohba, Hirofumi Okamoto, Atsushi Kimura, Daisuke Tahara
  • Publication number: 20170148172
    Abstract: Disclosed herein is an image processing device including a background model creation section adapted to create a plurality of background models based on statistical distribution of a plurality of image frame sets, the image frame sets differing in length of time, and each of the image frame sets including a plurality of input frames; and a background image creation section adapted to create a background image by referring to the plurality of background models.
    Type: Application
    Filed: November 15, 2016
    Publication date: May 25, 2017
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Hiroyuki Segawa, Tetsugo Inada, Akio Ohba, Hirofumi Okamoto, Atsushi Kimura, Daisuke Tahara
  • Patent number: 9619868
    Abstract: An imaging device includes a first camera and a second camera and shoots the same object under different shooting conditions. A shot-image data acquirer of an image analyzer acquires data of two images simultaneously shot from the imaging device. A correcting section aligns the distributions of the luminance value between the two images by carrying out correction for either one of the two images. A correction table managing section switches and generates a correction table to be used according to the function implemented by the information processing device. A correction table storage stores the correction table showing the correspondence relationship between the luminance values before and after correction. A depth image generator performs stereo matching by using the two images and generates a depth image.
    Type: Grant
    Filed: July 22, 2013
    Date of Patent: April 11, 2017
    Assignees: Sony Corporation, Sony Interactive Entertainment Inc.
    Inventors: Akio Ohba, Hiroyuki Segawa, Tetsugo Inada, Hidehiko Ogasawara, Hirofumi Okamoto
  • Patent number: 9587658
    Abstract: A hydraulic cylinder system 1 is provided with a plurality of cylinders 3a and 3b, valves 4a and 4b provided at each of the cylinders 3a and 3b for adjusting amounts of operating fluid into and out of the cylinders 3a and 3b, driving systems 5a and 5b having motors 6a and 6b provided at each of the valves 4a and 4b for driving the valves 4a and 4b, and a connecting member 8 for connecting the motors 6a and 6b of the driving systems 5a and 5b in a manner capable of interlocking with each other.
    Type: Grant
    Filed: November 10, 2011
    Date of Patent: March 7, 2017
    Assignee: MITSUBISHI HEAVY INDUSTRIES, LTD
    Inventors: Hirofumi Okamoto, Masayoshi Okuda
  • Publication number: 20170011519
    Abstract: A detection area 112 is set in a three-dimensional space in which a subject exists. When an actual hand enters the detection area 112, coordinate points (white and black dots) represented by pixels making up a silhouette 114 of the hand in a depth image enter the detection area 112. In the detection area 112, a reference vector 126 is set that shows the direction which the hand should face relative to the shoulder as a reference point 122. Then, an inner product between two vectors, a vector from the reference point 122 to each of coordinate points and the reference vector 126, is calculated, followed by comparison between the inner products. Positions of coordinate points whose inner products are ranked high are acquired as the position of tips of the hand.
    Type: Application
    Filed: December 1, 2014
    Publication date: January 12, 2017
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Akio Ohba, Hiroyuki Segawa, Tetsugo Inada, Hidehiko Ogasawara, Hirofumi Okamoto
  • Patent number: 9542755
    Abstract: An image acquisition section of an information processor acquires stereo images from an imaging device. An input information acquisition section acquires an instruction input from a user. A depth image acquisition portion of a position information generation section generates a depth image representing a position distribution of subjects existing in the field of view of the imaging device in the depth direction using stereo images. A matching portion adjusts the size of a reference template image in accordance with the position of each of the subjects in the depth direction represented by the depth image first, then performs template matching on the depth image, thus identifying the position of a target having a given shape and size in the three-dimensional space. An output information generation section generates output information by performing necessary processes based on the target position.
    Type: Grant
    Filed: July 18, 2013
    Date of Patent: January 10, 2017
    Assignees: Sony Corporation, Sony Interactive Entertainment Inc.
    Inventors: Akio Ohba, Hiroyuki Segawa, Tetsugo Inada, Hirofumi Okamoto
  • Patent number: 9460337
    Abstract: An image storage section 48 stores shot image data with a plurality of resolutions transmitted from an imaging device. Depth images 152 with a plurality of resolutions are generated using stereo images with a plurality of resolution levels from the shot image data (S10). Next, template matching is performed using a reference template image 154 that represents a desired shape and size, thus extracting a candidate area for a target picture having the shape and size for each distance range associated with one of the resolutions (S12). A more detailed analysis is performed on the extracted candidate areas using the shot image stored in the image storage section 48 (S14). In some cases, a further image analysis is performed based on the analysis result using a shot image with a higher resolution level (S16a and S16b).
    Type: Grant
    Filed: July 22, 2013
    Date of Patent: October 4, 2016
    Assignees: SONY CORPORATION, SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Akio Ohba, Hiroyuki Segawa, Tetsugo Inada, Hirofumi Okamoto
  • Publication number: 20160044297
    Abstract: An information processor includes: a similarity data generation portion generating similarity data that represents the calculated similarity to the image in the reference block in association with a position within the search range; a result evaluation portion detecting a position with a maximum similarity value for each piece of the similarity data and screening the detection result by making a given evaluation of the similarity; a depth image generation portion finding a parallax for each of the reference blocks using the detection result validated as a result of screening, calculating a position of a subject in a depth direction on a basis of the parallax, and generating a depth image by associating the position of the subject in the depth direction with an image plane; and an output information generation section performing given information processing on a basis of the subject position in a three-dimensional space using the depth image and outputting the result of information processing.
    Type: Application
    Filed: July 17, 2015
    Publication date: February 11, 2016
    Inventors: Hiroyuki SEGAWA, Akio OHBA, Tetsugo INADA, Hirofumi OKAMOTO, Atsushi KIMURA, Takashi KOHASHI, Takashi ITOU
  • Publication number: 20160042242
    Abstract: An information processor includes: a similarity data generation portion generating, for a position within the search range, similarity data that represents the calculated similarity to the image in the reference block in association with the position within the search range; a similarity correction portion smoothing the similarity data in a direction of space on a basis of similarity data; a result evaluation portion detecting a position with a maximum similarity value in each piece of the smoothed similarity data; a depth image generation portion generating a depth image by associating the position of the subject in the depth direction with an image plane; and an output information generation section performing given information processing on a basis of the subject position in a three-dimensional space using the depth image and outputting the result of information processing.
    Type: Application
    Filed: July 17, 2015
    Publication date: February 11, 2016
    Inventors: Hiroyuki SEGAWA, Akio OHBA, Tetsugo INADA, Hirofumi OKAMOTO, Atsushi KIMURA, Takashi KOHASHI, Takashi ITOU
  • Publication number: 20150339805
    Abstract: An imaging device includes a first camera and a second camera and shoots the same object under different shooting conditions. A shot-image data acquirer of an image analyzer acquires data of two images simultaneously shot from the imaging device. A correcting section aligns the distributions of the luminance value between the two images by carrying out correction for either one of the two images. A correction table managing section switches and generates a correction table to be used according to the function implemented by the information processing device. A correction table storage stores the correction table showing the correspondence relationship between the luminance values before and after correction. A depth image generator performs stereo matching by using the two images and generates a depth image.
    Type: Application
    Filed: July 22, 2013
    Publication date: November 26, 2015
    Applicant: Sony Computer Entertainment Inc.,
    Inventors: Akio Ohba, Hiroyuki Segawa, Tetsugo Inada, Hidehiko Ogasawara, Hirofumi Okamoto
  • Publication number: 20150302239
    Abstract: An image storage section 48 stores shot image data with a plurality of resolutions transmitted from an imaging device. Depth images 152 with a plurality of resolutions are generated using stereo images with a plurality of resolution levels from the shot image data (S10). Next, template matching is performed using a reference template image 154 that represents a desired shape and size, thus extracting a candidate area for a target picture having the shape and size for each distance range associated with one of the resolutions (S12). A more detailed analysis is performed on the extracted candidate areas using the shot image stored in the image storage section 48 (S14). In some cases, a further image analysis is performed based on the analysis result using a shot image with a higher resolution level (S16a and S16b).
    Type: Application
    Filed: July 22, 2013
    Publication date: October 22, 2015
    Applicant: Sony Computer Entrtainment Inc.
    Inventors: Akio OHBA, Hiroyuki SEGAWA, Tetsugo INADA, Hirofumi OKAMOTO
  • Publication number: 20150287215
    Abstract: An image acquisition section of an information processor acquires stereo images from an imaging device. An input information acquisition section acquires an instruction input from a user. A depth image acquisition portion of a position information generation section generates a depth image representing a position distribution of subjects existing in the field of view of the imaging device in the depth direction using stereo images. A matching portion adjusts the size of a reference template image in accordance with the position of each of the subjects in the depth direction represented by the depth image first, then performs template matching on the depth image, thus identifying the position of a target having a given shape and size in the three-dimensional space. An output information generation section generates output information by performing necessary processes based on the target position.
    Type: Application
    Filed: July 18, 2013
    Publication date: October 8, 2015
    Inventors: Akio Ohba, Hiroyuki Segawa, Tetsugo Inada, Hirofumi Okamoto
  • Publication number: 20130239797
    Abstract: A hydraulic cylinder system 1 is provided with a plurality of cylinders 3a and 3b, valves 4a and 4b provided at each of the cylinders 3a and 3b for adjusting amounts of operating fluid into and out of the cylinders 3a and 3b, driving systems 5a and 5b having motors 6a and 6b provided at each of the valves 4a and 4b for driving the valves 4a and 4b, and a connecting member 8 for connecting the motors 6a and 6b of the driving systems 5a and 5b in a manner capable of interlocking with each other.
    Type: Application
    Filed: November 10, 2011
    Publication date: September 19, 2013
    Applicants: MITSUBISHI HEAVY INDUSTRIES, LTD., SHIMADZU CORPORATION
    Inventors: Hirofumi Okamoto, Masayoshi Okuda