Patents by Inventor Takuro Noda

Takuro Noda has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230367393
    Abstract: To provide a line-of-sight detection device capable of further improving line-of-sight detection accuracy, achieving low latency, and achieving low power consumption. Provided is a line-of-sight detection device including: an imaging element having an event-driven function; a first mode generation unit that generates a Purkinje detection mode; a second mode generation unit that generates a pupil detection mode; and a third mode generation unit that generates an event-driven mode.
    Type: Application
    Filed: September 14, 2021
    Publication date: November 16, 2023
    Inventors: YUKI MAMISHIN, RYO OGAWA, TAKURO NODA
  • Publication number: 20230350197
    Abstract: A line-of-sight detection device capable of achieving further improvement in line-of-sight detection accuracy, achieving low latency, and achieving low power consumption is provided. There is provided a line-of-sight detection device including an imaging element, an illumination unit that illuminates an eyeball with a plurality of beams of illumination light, an optical element that guides respective beams of reflected light in a plurality of directions from the eyeball caused by the plurality of beams of illumination light to a direction of the imaging element, an optical system that causes the imaging element to non-selectively receive the beams of reflected light in the plurality of directions from the eyeball, and a calculation unit that converts, on the basis of the beams of reflected light in the plurality of directions from the eyeball received by the imaging element, the beams of reflected light into information of eyeball movement and/or positional information of a pupil.
    Type: Application
    Filed: September 2, 2021
    Publication date: November 2, 2023
    Inventors: RYO OGAWA, YUKI MAMISHIN, TAKURO NODA
  • Patent number: 11720178
    Abstract: An information processing device includes an eyeball information acquisition section, a sightline estimation section, a display control section, a gesture information acquisition section, and a mode switching section. The eyeball information acquisition section acquires position and posture information of eyeballs of a user from a first sensor. The sightline estimation section estimates a sightline vector on the basis of the position and posture information of the eyeballs. The display control section controls a display device in such a manner that the display device displays a guide image for showing a gaze state based on the sightline vector. The gesture information acquisition section acquires gesture information, which is different from the position and posture information of the eyeballs, from a second sensor.
    Type: Grant
    Filed: March 3, 2020
    Date of Patent: August 8, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Ryouhei Yasuda, Takuro Noda
  • Patent number: 11635806
    Abstract: An information processing apparatus capable of executing calibration for improving accuracy of gaze detection without causing a user to feel stress. The information processing apparatus, includes a marker control unit that changes, during calibration of an eyewear terminal, a display position of a point-of-regard marker displayed on a display unit of the eyewear terminal; a computational processing unit that computes an optical axis vector expressing a gaze direction of a user by a pupil-corneal reflection method, on a basis of a captured image that includes a user's eye imaged when the eye of the user wearing the eyewear terminal is irradiated with light from a light source, and the point-of-regard marker is displayed at a calibration point; and an evaluation unit that evaluates a variation of the optical axis vector computed for a plurality of the calibration points.
    Type: Grant
    Filed: July 24, 2019
    Date of Patent: April 25, 2023
    Assignee: SONY CORPORATION
    Inventors: Takuro Noda, Kazuyuki Yamamoto
  • Publication number: 20230047470
    Abstract: An information processing apparatus according to an embodiment of the present technology includes a line-of-sight estimator, a correction amount calculator, and a registration determination section. The line-of-sight estimator calculates an estimation vector obtained by estimating a direction of a line of sight of a user. The correction amount calculator calculates a correction amount related to the estimation vector on the basis of at least one object that is within a specified angular range that is set using the estimation vector as a reference. The registration determination section determines whether to register, in a data store, calibration data in which the estimation vector and the correction amount are associated with each other, on the basis of a parameter related to the at least one object within the specified angular range.
    Type: Application
    Filed: December 24, 2020
    Publication date: February 16, 2023
    Inventors: TAKURO NODA, RYOUHEI YASUDA
  • Patent number: 11490808
    Abstract: Provided is an information processing device including an arithmetic processing unit that executes arithmetic processing related to calibration of detection of a sight line toward a display unit. The arithmetic processing unit determines calibration executability for each of both eyes based on acquired sight line data and uses only the sight line data of an eye for which calibration is determined to be executable when executing calibration for the eye.
    Type: Grant
    Filed: May 22, 2018
    Date of Patent: November 8, 2022
    Assignee: SONY CORPORATION
    Inventor: Takuro Noda
  • Patent number: 11487368
    Abstract: There is provided an operation processing device including an input direction acquisition unit configured to acquire information indicating an input direction according to a direction generated in response to an operation indicating the direction which is performed on an input unit to which the operation is input, an output direction indication unit configured to indicate, to a display unit configured to display an image, an output direction that is a direction in which the image of the display unit is changed in response to the operation on the input unit, and a determination unit configured to determine an orientation of the output direction with respect to the input direction according to a relative position relationship between the input unit and the display unit.
    Type: Grant
    Filed: November 10, 2020
    Date of Patent: November 1, 2022
    Assignee: SONY CORPORATION
    Inventors: Hiroyuki Mizunuma, Takuro Noda, Ikuo Yamano
  • Patent number: 11487355
    Abstract: It is desired to provide a technology capable of controlling an object so as to improve user convenience. An information processing apparatus is provided. The information processing apparatus includes an object control unit that: suppresses a movement of a first object, on the basis of a first line-of-sight movement in which a gaze point of a user moves toward a first part of the first object or has moved to the first part; and moves the first object such that the first object leaves away from the gaze point of the user, on the basis of a second line-of-sight movement in which the gaze point of the user moves toward a second part of the first object different from the first part or has moved to the second part.
    Type: Grant
    Filed: March 4, 2019
    Date of Patent: November 1, 2022
    Assignee: SONY CORPORATION
    Inventors: Kenji Sugihara, Takuro Noda
  • Patent number: 11481179
    Abstract: Provided is an information processing apparatus that includes a movement history acquiring section that acquires a movement history, based on an absolute coordinate, of a gazing point of a first user that gazes at a display region, in which the absolute coordinate is in a three-dimensional space displayed in the display region. The information processing apparatus further includes a display controller that controls a display unit that displays the display region to visualize, to a second user, the movement history of the gazing point. This allows the gazing point of the first user to be shared with the second user without hiding a target object.
    Type: Grant
    Filed: June 26, 2019
    Date of Patent: October 25, 2022
    Assignee: SONY CORPORATION
    Inventor: Takuro Noda
  • Publication number: 20220291744
    Abstract: A display processing device includes a control unit (180) that causes a display device to display a spatial object indicating a virtual space. The control unit (180) determines movement of a user in a real space on the basis of a signal value of a first sensor, determines whether or not the user of the display device is gazing at the spatial object on the basis of a signal value of a second sensor, and controls the display device such that visibility of the virtual space indicated by the spatial object is changed on the basis of the determination that the user is gazing at the spatial object and the movement of the user toward the spatial object.
    Type: Application
    Filed: July 17, 2020
    Publication date: September 15, 2022
    Inventors: KENJI SUGIHARA, TAKURO NODA
  • Patent number: 11403806
    Abstract: There is provided an information processing apparatus that presents a virtual object useful for a user while suppressing a reduction in visibility of a real object. The information processing apparatus includes: an acquisition unit that acquires position information of a user and position information of a destination; and a display control unit that adds a first virtual object in association with a position of the destination within a visual field of the user on the basis of the position information of the user and the position information of the destination, in which the display control unit controls transparency of a predetermined virtual object within the visual field on the basis of the position information of the user.
    Type: Grant
    Filed: January 16, 2019
    Date of Patent: August 2, 2022
    Assignee: SONY CORPORATION
    Inventors: Miwa Ichikawa, Takuro Noda, Maki Imoto
  • Publication number: 20220236788
    Abstract: An information processing apparatus according to the present disclosure includes a display control unit that causes a display device to display a mark for a virtual object at an instruction position that is a position determined on the basis of a plurality of directions indicated by a user.
    Type: Application
    Filed: June 3, 2020
    Publication date: July 28, 2022
    Inventors: MIWA ICHIKAWA, JUN KIMURA, AI NAKADA, SOICHIRO INATANI, TAKURO NODA, KUNIHITO SAWAI, SHINGO UTSUKI, KENJI SUGIHARA
  • Publication number: 20220160214
    Abstract: There is provided an imaging control device, an imaging control method, a program, and an imaging system that enable easy change of a direction in which an image of a subject is captured in a case where imaging is performed using an optical member whose observation optical axis is inclined with respect to a central axis. The imaging control device includes: a rotation axis setting unit that sets a rotation axis on the basis of a pivot point and a point of interest on the subject, the pivot point serving as a fulcrum of the rod-shaped optical member whose observation optical axis is inclined with respect to the central axis and being not positioned on the observation optical axis; and a posture control unit that rotates the optical member around the rotation axis. The present technology can be applied to, for example, an endoscope system.
    Type: Application
    Filed: March 16, 2020
    Publication date: May 26, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Ryouhei YASUDA, Takuro NODA
  • Publication number: 20220129069
    Abstract: An information processing apparatus includes a detecting unit (12) that detects, based on line of sight information that indicates a line of sight of a user, a gaze point of a user on a plurality of key objects that are used to input information and that are displayed by a display unit (11); and a control unit (15) that controls the display unit (11) to display, by using a position of the detected gaze point as a reference, input candidate information that is associated with at least one of the plurality of key objects and that is selected based on the gaze point.
    Type: Application
    Filed: March 6, 2020
    Publication date: April 28, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Ryouhei YASUDA, Takuro NODA
  • Publication number: 20220129080
    Abstract: An information processing device includes an eyeball information acquisition section, a sightline estimation section, a display control section, a gesture information acquisition section, and a mode switching section. The eyeball information acquisition section acquires position and posture information of eyeballs of a user from a first sensor. The sightline estimation section estimates a sightline vector on the basis of the position and posture information of the eyeballs. The display control section controls a display device in such a manner that the display device displays a guide image for showing a gaze state based on the sightline vector. The gesture information acquisition section acquires gesture information, which is different from the position and posture information of the eyeballs, from a second sensor.
    Type: Application
    Filed: March 3, 2020
    Publication date: April 28, 2022
    Applicant: SONY GROUP CORPORATION
    Inventors: Ryouhei YASUDA, Takuro NODA
  • Patent number: 11314326
    Abstract: There is provided an information processing device, an information processing method, and a program are provided that enable displaying predetermined contents at the user-intended timing.
    Type: Grant
    Filed: November 8, 2018
    Date of Patent: April 26, 2022
    Assignee: SONY CORPORATION
    Inventors: Ryouhei Yasuda, Takuro Noda
  • Publication number: 20210349675
    Abstract: Provided is an information processing apparatus (100) that includes: a movement history acquiring section (110) that acquires a movement history, based on an absolute coordinate, of a gazing point of a first user that gazes at a display region, in which the absolute coordinate is in a three-dimensional space displayed in the display region; and a display controller (120) that controls a display unit that displays the display region to visualize, to a second user, the movement history of the gazing point. This allows the gazing point of the first user to be shared with the second user without hiding a target object.
    Type: Application
    Filed: June 26, 2019
    Publication date: November 11, 2021
    Inventor: TAKURO NODA
  • Patent number: 11151804
    Abstract: There is provided an information processing device for rotating an object relative to a viewpoint position of a user in further accordance with the user's desire, the information processing device including: a rotation center determination unit that determines a center of rotation based on a position of an object in a three-dimensional space and an instruction direction of a user in the three-dimensional space; and a rotation control unit that rotates the object relative to a viewpoint position of the user on the basis of the center of rotation.
    Type: Grant
    Filed: June 14, 2017
    Date of Patent: October 19, 2021
    Assignee: SONY CORPORATION
    Inventors: Ryouhei Yasuda, Takuro Noda, Seiji Wada, Takeshi Maeda, Kana Matsuura
  • Publication number: 20210232219
    Abstract: It is desired to provide a technology capable of controlling an object so as to improve user convenience. An information processing apparatus is provided. The information processing apparatus includes an object control unit that: suppresses a movement of a first object, on the basis of a first line-of-sight movement in which a gaze point of a user moves toward a first part of the first object or has moved to the first part; and moves the first object such that the first object leaves away from the gaze point of the user, on the basis of a second line-of-sight movement in which the gaze point of the user moves toward a second part of the first object different from the first part or has moved to the second part.
    Type: Application
    Filed: March 4, 2019
    Publication date: July 29, 2021
    Inventors: KENJI SUGIHARA, TAKURO NODA
  • Patent number: 11023038
    Abstract: Provided is an information processing device and a control method that can eliminate the need for an operation merely for line-of-sight detection calibration and can perform line-of-sight detection calibration in a normal user operation. An information processing device including a recognition unit to recognize a position of a target of gaze following a user operation, a line-of-sight detection unit to detect a line-of-sight position of a user during the user operation, and a line-of-sight detection adjustment unit to perform an adjustment to line-of-sight detection performed by the line-of-sight detection unit on the basis of the recognized position of the target of gaze and the line-of-sight position.
    Type: Grant
    Filed: November 25, 2015
    Date of Patent: June 1, 2021
    Assignee: SONY CORPORATION
    Inventors: Ryouhei Yasuda, Takuro Noda