Patents by Inventor Dongeek Shin

Dongeek Shin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210074073
    Abstract: A method for guiding installation of smart-home devices may include capturing, by a camera of a mobile computing device, a view of an installation location for a smart-home device; identifying a wire in the view of the installation location for the smart-home device; determining an instruction for connecting the wire to the smart-home device; and displaying the view of the installation location for a smart-home device with the instruction for connecting the wire to the smart-home device.
    Type: Application
    Filed: November 16, 2020
    Publication date: March 11, 2021
    Applicant: Google LLC
    Inventors: Adam Mittleman, Jason Chamberlain, Jacobi Grillo, Daniel Biran, Mark Kraz, Lauren Chanen, Daniel Foran, David Fichou, William Dong, Bao-Tram Phan Nguyen, Brian Silverstein, Yash Modi, Alex Finlayson, Dongeek Shin
  • Publication number: 20210072378
    Abstract: An electronic device has memory, one or more processors, a speaker, and a microphone. The device sends a first set of ultrasound chirps at a first rate via the speaker. It receives, via the microphone, a first set of signals corresponding to the first set of ultrasound chirps and being reflected from a person. The device determines based on the first set of signals that the person is in proximity to the electronic device. In accordance with the determination that the person is in proximity to the electronic device, the device sends a second set of ultrasound chirps at a second rate, faster than the first rate. It receives, via the microphone, a second set of signals corresponding to the second set of ultrasound chirps, and identifies a gesture from the person based on the second set of signals.
    Type: Application
    Filed: November 18, 2020
    Publication date: March 11, 2021
    Inventors: Dongeek Shin, Rajeev Nongpiur, Wei Li, Jian Guo, Jennifer Yeelam Wong, Andrew Christopher Felch, James Paul Tobin, Lu Gao, Brian Silverstein
  • Patent number: 10942196
    Abstract: Systems and methods of detecting human movement with a sensor are provided, including generating a motion event signal in response to movement detected by the sensor, and generating a parameterized curve to represent the detected motion. The parameterized curve is fit to a predetermined window of sensor data captured by the sensor to filter the motion event signal. A noise magnitude estimate and a curve fit error is determined based on the fitted parameterized curve to the predetermined window. A detection threshold value is determined based on the curve fit error, a noise source signal estimate of known noise, and zero or more noise magnitudes from other sources. Human motion is determined by correlating a true motion event signal with human motion based on a comparison between a value of a point on the parameterized curve and the detection threshold value.
    Type: Grant
    Filed: August 14, 2017
    Date of Patent: March 9, 2021
    Assignee: GOOGLE LLC
    Inventors: Mark Rajan Malhotra, Gwendolyn van der Linden, Yash Modi, Dongeek Shin
  • Patent number: 10869003
    Abstract: A method generates depth maps at a camera having illuminators, a lens assembly, an image sensing element, a processor, and memory. The illuminators operate in a first mode to provide illumination, the lens assembly focuses incident light on the image sensing element, the memory stores programs for execution by the processor, and the processor executes the programs to control operation of the camera. The method reconfigures the illuminators to operate in a second mode, where each of a plurality of subsets of the illuminators provides illumination of a scene separately. For each subset, the process activates the illuminators in the subset without activating illuminators not in the subset and receives reflected illumination from the scene incident on the lens assembly and focused onto the image sensing element. The measured light intensity values of the received reflected illumination at the image sensing element are transmitted to a remote server for processing.
    Type: Grant
    Filed: August 19, 2019
    Date of Patent: December 15, 2020
    Assignee: GOOGLE LLC
    Inventors: Ghulam Ahmed Kirmani, Andrea Colaco, Dongeek Shin
  • Patent number: 10839608
    Abstract: A method for optimizing the placement of smart-home devices may include receiving, by a mobile computing device, a location for a smart-home device, where the mobile computing device comprises a display and a camera; rendering a view of a virtual object that represents a field-of-view of the smart-home device, where the view of the virtual object is rendered based on a position corresponding to a position of the mobile computing device; and displaying, by the mobile computing device, the view of a virtual object that represents a field-of-view of the smart-home device on the display of the mobile computing device.
    Type: Grant
    Filed: June 17, 2019
    Date of Patent: November 17, 2020
    Assignee: Google LLC
    Inventors: Adam Mittleman, Jason Chamberlain, Jacobi Grillo, Daniel Biran, Mark Kraz, Lauren Chanen, Daniel Foran, David Fichou, William Dong, Bao-Tram Phan Nguyen, Brian Silverstein, Yash Modi, Alex Finlayson, Dongeek Shin
  • Publication number: 20200300707
    Abstract: A method includes detecting, with a passive infrared sensor (PIR), a level of infrared radiation in a field of view (FOV) of the PIR, generating a signal based on detected levels over a period of time, the signal having values that exhibit a change in the detected levels, extracting a local feature from a sample of the signal, wherein the local feature indicates a probability that a human in the FOV caused the change in the detected levels, extracting a global feature from the sample of the signal, wherein the global feature indicates a probability that an environmental radiation source caused the change in the detected levels, determining a score based on the local feature and the global feature, and determining that a human motion has been detected in the FOV based on the score.
    Type: Application
    Filed: June 5, 2020
    Publication date: September 24, 2020
    Inventors: Yash Modi, Mark Rajan Malhotra, Gwendolyn van der Linden, Dongeek Shin, Michael Dixon
  • Patent number: 10712204
    Abstract: A method includes detecting, with a passive infrared sensor (PIR), a level of infrared radiation in a field of view (FOV) of the PIR, generating a signal based on detected levels over a period of time, the signal having values that exhibit a change in the detected levels, extracting a local feature from a sample of the signal, wherein the local feature indicates a probability that a human in the FOV caused the change in the detected levels, extracting a global feature from the sample of the signal, wherein the global feature indicates a probability that an environmental radiation source caused the change in the detected levels, determining a score based on the local feature and the global feature, and determining that a human motion has been detected in the FOV based on the score.
    Type: Grant
    Filed: February 10, 2017
    Date of Patent: July 14, 2020
    Assignee: GOOGLE LLC
    Inventors: Yash Modi, Mark Rajan Malhotra, Gwendolyn van der Linden, Dongeek Shin, Michael Dixon
  • Publication number: 20190387202
    Abstract: A method generates depth maps at a camera having illuminators, a lens assembly, an image sensing element, a processor, and memory. The illuminators operate in a first mode to provide illumination, the lens assembly focuses incident light on the image sensing element, the memory stores programs for execution by the processor, and the processor executes the programs to control operation of the camera. The method reconfigures the illuminators to operate in a second mode, where each of a plurality of subsets of the illuminators provides illumination of a scene separately. For each subset, the process activates the illuminators in the subset without activating illuminators not in the subset and receives reflected illumination from the scene incident on the lens assembly and focused onto the image sensing element. The measured light intensity values of the received reflected illumination at the image sensing element are transmitted to a remote server for processing.
    Type: Application
    Filed: August 19, 2019
    Publication date: December 19, 2019
    Inventors: Ghulam Ahmed Kirmani, Andrea Colaco, Dongeek Shin
  • Publication number: 20190385373
    Abstract: A method for optimizing the placement of smart-home devices may include receiving, by a mobile computing device, a location for a smart-home device, where the mobile computing device comprises a display and a camera; rendering a view of a virtual object that represents a field-of-view of the smart-home device, where the view of the virtual object is rendered based on a position corresponding to a position of the mobile computing device; and displaying, by the mobile computing device, the view of a virtual object that represents a field-of-view of the smart-home device on the display of the mobile computing device.
    Type: Application
    Filed: June 17, 2019
    Publication date: December 19, 2019
    Applicant: Google LLC
    Inventors: Adam Mittleman, Jason Chamberlain, Jacobi Grillo, Daniel Biran, Mark Kraz, Lauren Chanen, Daniel Foran, David Fichou, William Dong, Bao-Tram Phan Nguyen, Brian Silverstein, Yash Modi, Alex Finlayson, Dongeek Shin
  • Patent number: 10389954
    Abstract: A camera system includes non-volatile memory, a lens, an image sensor to capture images of a scene within view of the lens, an IR illuminator, and a processing system. The processing system transitions the camera system from day mode to night mode when the scene is dark, and in the night mode, two operations are performed. The first operation uses the IR illuminator, the image sensor, and the memory to capture a first IR image or video of the scene and store the first IR image or video in the non-volatile memory. The second operation uses the IR illuminator, the image sensor, and the memory to identify a specular surface in the scene. This includes capturing a second IR image or video, identifying a first region of low intensity pixels, and storing, in the non-volatile memory, position parameters of the first region and designating the first region as specular.
    Type: Grant
    Filed: June 5, 2017
    Date of Patent: August 20, 2019
    Assignee: GOOGLE LLC
    Inventors: Dongeek Shin, Michael Dixon
  • Patent number: 10389986
    Abstract: A method generates depth maps at a camera having illuminators, a lens assembly, an image sensing element, a processor, and memory. The illuminators operate in a first mode to provide illumination, the lens assembly focuses incident light on the image sensing element, the memory stores image data from the image sensing element, and the processor executes programs to control operation of the camera. The method reconfigures the illuminators to operate in a second mode, where each of a plurality of subsets of the illuminators provides illumination of a scene separately. For each subset, the process activates the illuminators in the subset without activating illuminators not in the subset and receives reflected illumination from the scene incident on the lens assembly and focused onto the image sensing element. The measured light intensity of the received reflected illumination at the image sensing element is stored in association with activation of the subset.
    Type: Grant
    Filed: February 20, 2018
    Date of Patent: August 20, 2019
    Assignee: GOOGLE LLC
    Inventors: Ghulam Ahmed Kirmani, Andrea Colaco, Dongeek Shin
  • Patent number: 10306157
    Abstract: A camera system includes memory, image sensors, illuminators, and a processor. The processor operates the illuminators and the image sensors in a first mode to capture a two-dimensional image of the scene using light transmitted by the illuminators and reflected from the scene. The processor operates in a second mode to capture a plurality of images of the scene, including capturing a first image of the scene while one or more of the illuminators are activated and capturing a second image of the scene is while none of the illuminators are activated. The images are transmitted to a remote cloud computing system. The remote system constructs a light intensity map for the scene using the first and second images, and identifies a first region in the light intensity map as a glass surface when the light intensity values for the first region are below a threshold value corresponding to glass.
    Type: Grant
    Filed: February 14, 2017
    Date of Patent: May 28, 2019
    Assignee: GOOGLE LLC
    Inventors: Dongeek Shin, Michael Dixon
  • Publication number: 20190049479
    Abstract: Systems and methods of detecting human movement with a sensor are provided, including generating a motion event signal in response to movement detected by the sensor, and generating a parameterized curve to represent the detected motion. The parameterized curve is fit to a predetermined window of sensor data captured by the sensor to filter the motion event signal. A noise magnitude estimate and a curve fit error is determined based on the fitted parameterized curve to the predetermined window. A detection threshold value is determined based on the curve fit error, a noise source signal estimate of known noise, and zero or more noise magnitudes from other sources. Human motion is determined by correlating a true motion event signal with human motion based on a comparison between a value of a point on the parameterized curve and the detection threshold value.
    Type: Application
    Filed: August 14, 2017
    Publication date: February 14, 2019
    Inventors: Mark Rajan Malhotra, Gwendolyn van der Linden, Yash Modi, Dongeek Shin
  • Publication number: 20180231419
    Abstract: A method includes detecting, with a passive infrared sensor (PIR), a level of infrared radiation in a field of view (FOV) of the PIR, generating a signal based on detected levels over a period of time, the signal having values that exhibit a change in the detected levels, extracting a local feature from a sample of the signal, wherein the local feature indicates a probability that a human in the FOV caused the change in the detected levels, extracting a global feature from the sample of the signal, wherein the global feature indicates a probability that an environmental radiation source caused the change in the detected levels, determining a score based on the local feature and the global feature, and determining that a human motion has been detected in the FOV based on the score.
    Type: Application
    Filed: February 10, 2017
    Publication date: August 16, 2018
    Inventors: Yash Modi, Mark Rajan Malhotra, Gwendolyn van der Linden, Dongeek Shin, Michael Dixon
  • Patent number: 10008003
    Abstract: A process generates a lookup table to estimate spatial depth in a visual scene. The process identifies subsets of illuminators of a camera system with image sensors and illuminators. The image sensors are associated with multiple pixels. For each pixel, and for each of multiple depths from the pixel, the process simulates a virtual surface at the depth. For each subset of the subsets of illuminators, the process simulates illumination of the virtual surface from the subset and determines an expected light intensity at the pixel from light reflected from the virtual surface due to the simulated illumination. The process forms intensity information from the expected light intensity determined for the pixel for each of the depths and each of the subsets. The process constructs a lookup table comprising the intensity information. The lookup table associates the intensity information for each pixel with the respective depth and the respective subset.
    Type: Grant
    Filed: April 30, 2017
    Date of Patent: June 26, 2018
    Assignee: GOOGLE LLC
    Inventors: Ghulam Ahmed Kirmani, Andrea Colaco, Dongeek Shin
  • Publication number: 20180176514
    Abstract: A method generates depth maps at a camera having illuminators, a lens assembly, an image sensing element, a processor, and memory. The illuminators operate in a first mode to provide illumination, the lens assembly focuses incident light on the image sensing element, the memory stores image data from the image sensing element, and the processor executes programs to control operation of the camera. The method reconfigures the illuminators to operate in a second mode, where each of a plurality of subsets of the illuminators provides illumination of a scene separately. For each subset, the process activates the illuminators in the subset without activating illuminators not in the subset and receives reflected illumination from the scene incident on the lens assembly and focused onto the image sensing element. The measured light intensity of the received reflected illumination at the image sensing element is stored in association with activation of the subset.
    Type: Application
    Filed: February 20, 2018
    Publication date: June 21, 2018
    Inventors: Ghulam Ahmed Kirmani, Andrea Colaco, Dongeek Shin
  • Patent number: 9900560
    Abstract: A process generates depth maps of a scene in the field of vision of a camera. The camera has a plurality of illuminators, a lens assembly, an image sensing element, a processor, and memory. The illuminators provide illumination using all of the illuminators. The lens assembly focuses incident light on the image sensing element. The memory stores image data from the image sensing element. The processor executes programs to control operation of the camera. The process operates in a second mode, where each of a plurality of subsets of the illuminators provides illumination separately from other subsets. The process sequentially activates each of the subsets to illuminate a scene and receives reflected illumination from the scene incident on the lens assembly and focused onto the image sensing element. The process measures light intensity values at the image sensing element and stores those measured light intensity values.
    Type: Grant
    Filed: June 15, 2015
    Date of Patent: February 20, 2018
    Assignee: GOOGLE INC.
    Inventors: Ghulam Ahmed Kirmani, Andrea Colaco, Dongeek Shin
  • Patent number: 9886620
    Abstract: A process estimates height and tilt of a camera having an image sensor array and IR illuminators. The process identifies multiple distinct subsets of the illuminators. For multiple heights and tilts, the process constructs dictionary entries that correspond to the camera having the height and tilt above a floor. Each entry includes light intensity values for pixels in images corresponding to activating each of the subsets of illuminators. For each of the subsets, the process receives an image of a scene captured while the subset is emitting light and the other illuminators are not. The process uses the captured images to identify a floor region corresponding to a floor in the scene. The process forms a vector including pixels from the captured images in the identified floor region and estimates the height and tilt of the camera by comparing the vector to the dictionary entries.
    Type: Grant
    Filed: June 12, 2015
    Date of Patent: February 6, 2018
    Assignee: GOOGLE LLC
    Inventors: Michael Dixon, Dongeek Shin
  • Publication number: 20170280068
    Abstract: A camera system includes non-volatile memory, a lens, an image sensor to capture images of a scene within view of the lens, an IR illuminator, and a processing system. The processing system transitions the camera system from day mode to night mode when the scene is dark, and in the night mode, two operations are performed. The first operation uses the IR illuminator, the image sensor, and the memory to capture a first IR image or video of the scene and store the first IR image or video in the non-volatile memory. The second operation uses the IR illuminator, the image sensor, and the memory to identify a specular surface in the scene. This includes capturing a second IR image or video, identifying a first region of low intensity pixels, and storing, in the non-volatile memory, position parameters of the first region and designating the first region as specular.
    Type: Application
    Filed: June 5, 2017
    Publication date: September 28, 2017
    Inventors: DONGEEK SHIN, MICHAEL DIXON
  • Publication number: 20170270681
    Abstract: A process generates a lookup table to estimate spatial depth in a visual scene. The process identifies subsets of illuminators of a camera system with image sensors and illuminators. The image sensors are associated with multiple pixels. For each pixel, and for each of multiple depths from the pixel, the process simulates a virtual surface at the depth. For each subset of the subsets of illuminators, the process simulates illumination of the virtual surface from the subset and determines an expected light intensity at the pixel from light reflected from the virtual surface due to the simulated illumination. The process forms intensity information from the expected light intensity determined for the pixel for each of the depths and each of the subsets. The process constructs a lookup table comprising the intensity information. The lookup table associates the intensity information for each pixel with the respective depth and the respective subset.
    Type: Application
    Filed: April 30, 2017
    Publication date: September 21, 2017
    Inventors: Ghulam Ahmed Kirmani, Andea A. Colaco, Dongeek Shin