Patents by Inventor Keith Resch

Keith Resch has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10451714
    Abstract: Multiple camera systems which use laser illumination for ranging benefit from a heartbeat to synchronize the timing of the individual lasers to eliminate collisions of multiple simultaneous laser emissions. An optical micromesh system provides for the dynamic entry and egress of mobile and stationary nodes. The optical communication between nodes may be controlled using time domain multiplexing (TDM) to avoid cross talk and communication collision due to overlapping laser illumination. By using an optical, laser based micromesh network, laser ranging can be used to dynamically map node location.
    Type: Grant
    Filed: December 6, 2016
    Date of Patent: October 22, 2019
    Assignees: Sony Corporation, Sony Interactive Entertainment Inc.
    Inventors: Peter Shintani, Jose Omar Gonzalez Hernandez, William Clay, Pablo Antonio Espinosa, Fred Ansfield, Bibhudendu Mohapatra, Keith Resch, Morio Usami
  • Publication number: 20190227166
    Abstract: Multiple independently movable devices are located upon a platform. On the platform is a directional microphone array. Each of the movable devices is assigned a unique audio signature, which may be a pulse train of chirps or a pseudo random signal or some other audio sequence that is unique to the respective device. Each movable device announces itself with its unique audio signature, and the platform's directional microphone system determines the location from which the unique audio signature comes from. For range, a difference between the time of flight (TOF) of the light relative to the sound signature is used. As another technique a unique audio signature may be an audio water mark concealed in normal audio which may be emitted by the movable device. The watermark provides the identifying information of each movable device.
    Type: Application
    Filed: January 19, 2018
    Publication date: July 25, 2019
    Inventors: Peter Shintani, Morio Usami, Keith Resch
  • Patent number: 10354651
    Abstract: A head-mounted device (HMD) that includes at least one speaker, at least one audio capturing device and circuitry is provided. The circuitry receives, via the at least one audio capturing device, a user input that corresponds to an audio input. The circuitry further determines a first location of a source of the received audio input, based on the received audio input. The circuitry further determines that the received audio input is enunciated from a wearer of the HMD in a worn state of the HMD, based on the determined first location of the source of the received audio input. The circuitry further controls at least a function of the HMD, based on the determination that the received audio input is enunciated from the wearer.
    Type: Grant
    Filed: September 10, 2018
    Date of Patent: July 16, 2019
    Assignee: SONY CORPORATION
    Inventors: Hyehoon Yi, David Young, Keith Resch, Gregory Carlsson, Bibhudendu Mohapatra
  • Patent number: 10292000
    Abstract: A networked speaker system automatically adjusts certain audio speaker system settings based on characteristics of the surface on which the speaker is disposed as measured during an initial frequency sweep of test tones emitted from a speaker.
    Type: Grant
    Filed: July 2, 2018
    Date of Patent: May 14, 2019
    Assignee: Sony Corporation
    Inventors: James R. Milne, Allison Joi Burgueno, Gregory Peter Carlsson, Keith Resch
  • Publication number: 20190132573
    Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.
    Type: Application
    Filed: October 31, 2017
    Publication date: May 2, 2019
    Inventors: Peter Shintani, Morio Usami, Kazuyuki Shikama, Keith Resch
  • Publication number: 20190049579
    Abstract: An acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking. The direction of the sound is then used to focus a laser-based time of flight (ToF) system to narrow the area of laser illumination, improving the signal to noise ratio because laser illumination is focused on the direction of the sound. The DoA system also provides elevation information pertaining to the source of the sound, to further narrow the required field of view of the laser ToF system.
    Type: Application
    Filed: August 9, 2017
    Publication date: February 14, 2019
    Inventors: PETER SHINTANI, MORIO USAMI, KEITH RESCH
  • Patent number: 10181089
    Abstract: To reduce the random noise in a depth map that is rendered using colors to convey the various depths, pattern recognition may be used to selectively apply noise reduction or to modulate the strength of the noise reduction. In this way, the potential adverse effect on the detail/sharpness of the image can be ameliorated. For example, in an image of a person, the skin does not have any sharp edges so noise reduction can be applied to such an image with little adverse consequence, whereas noise reduction applied to the image of a person's eye can cause loss of the detail of the iris, eyelashes, etc. Using pattern recognition on objects in the image, the appropriate level of noise reduction can be applied across an image while minimizing blurring/loss of detail.
    Type: Grant
    Filed: December 19, 2016
    Date of Patent: January 15, 2019
    Assignees: Sony Corporation, Sony Interactive Entertainment Inc.
    Inventors: Peter Shintani, Jose Omar Gonzalez Hernandez, William Clay, Pablo Antonio Espinosa, Fred Ansfield, Bibhudendu Mohapatra, Keith Resch, Morio Usami
  • Patent number: 10178370
    Abstract: Each of plural devices includes a laser emitter and a camera for detecting reflections of laser light emitted by the device, so that plural of the devices can generate their own depth maps showing images within the field of view of their cameras. The resulting 3D depth maps from multiple cameras at potentially arbitrary locations can be aggregated to create a more accurate 3D depth map of the area covered by all the individual cameras. Each device/camera may be assigned a unique identification such as a unique number and a mechanism to identify, either electronically or visually, devices in its field of view. Using this information, the relative locations of the cameras can be calculated for purposes of aggregating the multiple depth maps.
    Type: Grant
    Filed: December 19, 2016
    Date of Patent: January 8, 2019
    Assignees: Sony Corporation, Sony Interactive Entertainment Inc.
    Inventors: Peter Shintani, Jose Omar Gonzalez Hernandez, William Clay, Pablo Antonio Espinosa, Fred Ansfield, Bibhudendu Mohapatra, Keith Resch, Morio Usami
  • Publication number: 20180288385
    Abstract: Each of plural devices includes a laser emitter and a camera for detecting reflections of laser light emitted by the device, so that plural of the devices can generate their own depth maps showing images within the field of view of their cameras. The resolution of each depth map may be improved by accessing a data store of prior images of objects and combining the prior images using super-resolution with current images of the depth maps.
    Type: Application
    Filed: April 3, 2017
    Publication date: October 4, 2018
    Inventors: Peter Shintani, Jose Omar Gonzalez Hernandez, William Clay, Pablo Antonio Espinosa, Fred Ansfield, Bibhudendu Mohapatra, Keith Resch, Morio Usami
  • Publication number: 20180252815
    Abstract: Machine learning is applied to both 2D images from an infrared imager imaging laser reflections from an object and to the 3D depth map of the object that is generated using the 2D images and time of flight (TOF) information. In this way, the 3D depth map accuracy can be improved without increasing laser power or using high resolution imagers.
    Type: Application
    Filed: May 9, 2017
    Publication date: September 6, 2018
    Inventors: Peter Shintani, Morio Usami, Kissei Matsumoto, Kazuyuki Shikama, Bibhudendu Mohapatra, Keith Resch
  • Publication number: 20180231641
    Abstract: A micro mirror assembly widens the field of view (FOV) of a 3D depth map sensor, alleviating the limitation of limited laser illumination power and limitations on the resolution of the available imaging device.
    Type: Application
    Filed: February 14, 2017
    Publication date: August 16, 2018
    Inventors: Peter Shintani, Jose Omar Gonzalez Hernandez, William Clay, Pablo Antonio Espinosa, Fred Ansfield, Bibhudendu Mohapatra, Keith Resch, Morio Usami
  • Publication number: 20180176530
    Abstract: Each of plural devices includes a laser emitter and a camera for detecting reflections of laser light emitted by the device, so that plural of the devices can generate their own depth maps showing images within the field of view of their cameras. The resulting 3D depth maps from multiple cameras at potentially arbitrary locations can be aggregated to create a more accurate 3D depth map of the area covered by all the individual cameras. Each device/camera may be assigned a unique identification such as a unique number and a mechanism to identify, either electronically or visually, devices in its field of view. Using this information, the relative locations of the cameras can be calculated for purposes of aggregating the multiple depth maps.
    Type: Application
    Filed: December 19, 2016
    Publication date: June 21, 2018
    Inventors: Peter Shintani, Jose Omar Gonzalez Hernandez, William Clay, Pablo Antonio Espinosa, Fred Ansfield, Bibhudendu Mohapatra, Keith Resch, Morio Usami
  • Publication number: 20180173990
    Abstract: To reduce the random noise in a depth map that is rendered using colors to convey the various depths, pattern recognition may be used to selectively apply noise reduction or to modulate the strength of the noise reduction. In this way, the potential adverse effect on the detail/sharpness of the image can be ameliorated. For example, in an image of a person, the skin does not have any sharp edges so noise reduction can be applied to such an image with little adverse consequence, whereas noise reduction applied to the image of a person's eye can cause loss of the detail of the iris, eyelashes, etc. Using pattern recognition on objects in the image, the appropriate level of noise reduction can be applied across an image while minimizing blurring/loss of detail.
    Type: Application
    Filed: December 19, 2016
    Publication date: June 21, 2018
    Inventors: Peter Shintani, Jose Omar Gonzalez Hernandez, William Clay, Pablo Antonio Espinosa, Fred Ansfield, Bibhudendu Mohapatra, Keith Resch, Morio Usami
  • Publication number: 20180156900
    Abstract: Multiple camera systems which use laser illumination for ranging benefit from a heartbeat to synchronize the timing of the individual lasers to eliminate collisions of multiple simultaneous laser emissions. An optical micromesh system provides for the dynamic entry and egress of mobile and stationary nodes. The optical communication between nodes may be controlled using time domain multiplexing (TDM) to avoid cross talk and communication collision due to overlapping laser illumination. By using an optical, laser based micromesh network, laser ranging can be used to dynamically map node location.
    Type: Application
    Filed: December 6, 2016
    Publication date: June 7, 2018
    Inventors: Peter Shintani, Jose Omar Gonzalez Hernandez, William Clay, Pablo Antonio Espinosa, Fred Ansfield, Bibhudendu Mohapatra, Keith Resch, Morio Usami
  • Publication number: 20180160094
    Abstract: A camera based depth mapping system. Depth information is coded with colors to make a laser-generated 3D depth map easier to interpret. In the event that the laser illumination is not sufficient, the depth information can have a low signal to noise ratio, i.e., the depth map can be noisy. Color noise reduction techniques are used to alleviate this problem.
    Type: Application
    Filed: December 7, 2016
    Publication date: June 7, 2018
    Inventors: Peter Shintani, Jose Omar Gonzalez Hernandez, William Clay, Pablo Antonio Espinosa, Fred Ansfield, Bibhudendu Mohapatra, Keith Resch, Morio Usami
  • Patent number: 9984690
    Abstract: Range to a human speaker is determined using a laser-based time of flight (ToF) system, with the range then being used to adjust the gain of a microphone receiving the speaker's voice. If desired, an acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking, and the direction of the sound is then used to focus the area of laser illumination.
    Type: Grant
    Filed: August 9, 2017
    Date of Patent: May 29, 2018
    Assignees: Sony Corporation, SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Peter Shintani, Morio Usami, Keith Resch
  • Patent number: 9948118
    Abstract: An apparatus has connectors to receive batteries. A power multiplexer is connected to the connectors. A processor is connected to the power multiplexer to execute a battery charge protocol including the operations of selecting at least one battery for charging, where the at least one battery is in a fast charge state that allows for substantially linear charge performance. Direct current is applied to the battery until the fast charge state is terminated. The selecting and applying operations are repeated until the fast charge state is terminated in each of the batteries. Direct current is then directed to the batteries until a full charge state is reached for each of the batteries.
    Type: Grant
    Filed: September 11, 2015
    Date of Patent: April 17, 2018
    Assignee: Ampl Labs, Inc.
    Inventors: Michael Patton, Keith Resch, Rafael Calderon, Tomoko Nishioka-Patton
  • Patent number: 9699579
    Abstract: In a multi-speaker audio system for, e.g., a home entertainment system or other entertainment system, each networked-speaker (wired or wireless) is activated or deactivated as appropriate such that audio play follows a user as the user moves around the home.
    Type: Grant
    Filed: December 18, 2015
    Date of Patent: July 4, 2017
    Assignee: Sony Corporation
    Inventors: Gregory Peter Carlsson, Keith Resch, Oscar Manuel Vega
  • Publication number: 20160105754
    Abstract: In a multi-speaker audio system for, e.g., a home entertainment system or other entertainment system, each networked-speaker (wired or wireless) is activated or deactivated as appropriate such that audio play follows a user as the user moves around the home.
    Type: Application
    Filed: December 18, 2015
    Publication date: April 14, 2016
    Inventors: Gregory Peter Carlsson, Keith Resch, Oscar Manuel Vega
  • Patent number: 9232335
    Abstract: In a multi-speaker audio system for, e.g., a home entertainment system or other entertainment system, each networked-speaker (wired or wireless) is activated or deactivated as appropriate such that audio play follows a user as the user moves around the home.
    Type: Grant
    Filed: March 6, 2014
    Date of Patent: January 5, 2016
    Assignee: Sony Corporation
    Inventors: Gregory Peter Carlsson, Keith Resch, Oscar Manuel Vega