Patents by Inventor Dongeek Shin

Dongeek Shin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240062890
    Abstract: A wearable device may be used to perform a health or medical assessment of a user. The wearable device may detect user movements of the user. The wearable device generates signal data representing the user movements. The signal data is input into a model to identify a feature set. The feature set is converted into a score that corresponds to a medical condition of the user.
    Type: Application
    Filed: August 22, 2022
    Publication date: February 22, 2024
    Inventors: Dongeek Shin, Ricardo John Campbell, Allison Yamanashi
  • Publication number: 20240045019
    Abstract: A method including retrieving a set of first ultra-wide band (UWB) data representing locations in a physical space and device locations in the physical space, the first UWB data representing the locations being tagged as associated with a device, generating a set of first coordinates based on the set of first UWB data, generating second UWB data representing a current location of the UWB tag device in the physical space, generating a second coordinate based on the second UWB data, generating a tiled set of coordinates by partitioning a plane associated with the physical space based on the set of first coordinates and the second coordinate, determining whether the UWB tag device is proximate to a tagged coordinate in the tiled set of coordinates, and in response to determining the UWB tag device is proximate to a tagged coordinate, initiating an action by the device associated with the tagged coordinate.
    Type: Application
    Filed: February 2, 2021
    Publication date: February 8, 2024
    Inventors: Dongeek Shin, Steven Benjamin Goldberg, Richard Lee Marks
  • Patent number: 11895079
    Abstract: Implementations set forth herein relate to rendering, at a message application, certain messages with a particular sorting scheme (e.g., a classification-based sorting scheme) based on the certain messages having transfer times that satisfy a transfer time threshold and, optionally, based on the certain messages being unread. Other messages rendered by the message application can be rendered with an alternative sorting scheme, such as chronologically. Utilization of the particular sorting scheme for the certain messages enables a user, viewing the messages, to review (e.g., reply-to, delete, and/or view) the certain messages with reduced latency, thereby allowing the certain messages to be more quickly reviewed and actioned when received.
    Type: Grant
    Filed: May 31, 2022
    Date of Patent: February 6, 2024
    Assignee: GOOGLE LLC
    Inventor: Dongeek Shin
  • Publication number: 20240031773
    Abstract: A method can include determining, by a correlation device, that a correlation event has occurred based on at least a first device and a second device having corresponding directional profiles, and responsive to occurrence of the correlation event, causing the first device to transfer a state of the first device by sending a state information message to the second device.
    Type: Application
    Filed: July 20, 2022
    Publication date: January 25, 2024
    Inventor: Dongeek Shin
  • Patent number: 11875659
    Abstract: Various arrangements for performing fall detection are presented. A smart-home device (110, 201), comprising a monolithic radar integrated circuit (205), may transmit radar waves. Based on reflected radar waves, raw waveform data may be created. The raw waveform data may be processed to determine that a fall by a person (101) has occurred. Speech may then be output announcing that the fall has been detected via the speaker (217) of the smart home device (110, 201).
    Type: Grant
    Filed: December 12, 2019
    Date of Patent: January 16, 2024
    Assignee: Google LLC
    Inventors: Dongeek Shin, Shwetak Patel, Rizwan Chaudhry, Chetan Bhole, Vaibhav Darbari, Todd Whitehurst, Anupam Pathak
  • Publication number: 20240004476
    Abstract: Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.
    Type: Application
    Filed: June 29, 2022
    Publication date: January 4, 2024
    Inventors: Dongeek Shin, Andrea Colaco, Stiven Guillaume Francois Morvan, Adam James Banfield, Shahram Izadi
  • Patent number: 11860038
    Abstract: A method includes detecting, with a passive infrared sensor (PIR), a level of infrared radiation in a field of view (FOV) of the PIR, generating a signal based on detected levels over a period of time, the signal having values that exhibit a change in the detected levels, extracting a local feature from a sample of the signal, wherein the local feature indicates a probability that a human in the FOV caused the change in the detected levels, extracting a global feature from the sample of the signal, wherein the global feature indicates a probability that an environmental radiation source caused the change in the detected levels, determining a score based on the local feature and the global feature, and determining that a human motion has been detected in the FOV based on the score.
    Type: Grant
    Filed: October 7, 2021
    Date of Patent: January 2, 2024
    Assignee: Google LLC
    Inventors: Yash Modi, Mark Rajan Malhotra, Gwendolyn van der Linden, Dongeek Shin, Michael Dixon
  • Publication number: 20230418369
    Abstract: A wearable device, such as a head-wearable display (HWD), identifies a device pose based on a combination of angle-of-arrival (AOA) data generated by, for example, an ultra-wideband (UWB) positioning module, and inertial data generated by an inertial measurement unit (IMU). The HWD fuses the AOA data with the inertial data using data integration techniques such as one or more of stochastic estimation (e.g., a Kalman filter), a machine learning model, and the like, or any combination thereof. A computer device associated with the HWD can employ the fused data to identify a pose of the HWD (e.g., a six degree of freedom (6 DoF) pose) and can use the identified pose to modify virtual reality or augmented reality content implemented by the computer device, thereby providing an immersive and enjoyable experience for a user.
    Type: Application
    Filed: December 30, 2020
    Publication date: December 28, 2023
    Inventors: Steven Benjamin Goldberg, Qiyue John Zhang, Dongeek Shin, Clayton Kimber
  • Publication number: 20230418386
    Abstract: A sensor on a wearable device may be further configured as a sensor for detecting and recognizing a gesture to control the wearable device. For example, light detected by a photoplethysmography (PPG) sensor of a smart watch may include (i) light back reflected from underneath the smart watch and (ii) light back reflected from a touch to a wrist adjacent to the smart watch. The detected light may be filtered to isolate the light back reflected from the touch. A waterfall image that includes information about how the isolated light changes with time and amplitude may be generated and used to detect and recognize gestures performed on the wrist, such as a touch. This additional touch area may help to supplement a touch area provided by a display to control the smart watch.
    Type: Application
    Filed: September 27, 2021
    Publication date: December 28, 2023
    Inventor: Dongeek Shin
  • Patent number: 11853474
    Abstract: A method including determining historical user data associated with an event occurring on a wearable device, determining a probability of interacting with an object on a display of the wearable device based on the historical user data, scaling a hitbox associated with the object to form a scaled hitbox, detecting a user input based on an eye tracking being within the scaled hitbox, and in response to detecting the user input, initiating an action corresponding to the object.
    Type: Grant
    Filed: May 5, 2022
    Date of Patent: December 26, 2023
    Assignee: Google LLC
    Inventors: Dongeek Shin, Ricardo John Campbell, Jingying Hu
  • Publication number: 20230403449
    Abstract: Improved techniques of generating photographs using a camera or other image capture device includes the use of “soft” indicators such as haptics, audio, heads-up display, and other modalities to warn the user of a potential occlusion before a user activates a shutter trigger.
    Type: Application
    Filed: June 14, 2023
    Publication date: December 14, 2023
    Inventor: Dongeek Shin
  • Publication number: 20230393665
    Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.
    Type: Application
    Filed: February 24, 2023
    Publication date: December 7, 2023
    Inventors: Dongeek Shin, Shahram Izadi, David Kim, Sofien Bouaziz, Steven Benjamin Goldberg, Ivan Poupyrev, Shwetak N. Patel
  • Patent number: 11832961
    Abstract: Various systems, devices, and methods for contactless sleep tracking are presented. Based on data received from a contactless sensor, such as a radar sensor, determine that a user has entered a sleep state. A transition time may be determined at which the user transitions from the sleep state to an awake state. An environmental event, based on data received from an environmental sensor, may be identified as occurring within a time period of the transition time. The user waking may be attributed to the environmental event based on the environmental event occurring within the time period of the transition time. An indication of the attributed environmental event as a cause of the user waking may be output.
    Type: Grant
    Filed: August 11, 2020
    Date of Patent: December 5, 2023
    Assignee: Google LLC
    Inventors: Dongeek Shin, Michael Dixon, Andrew William Goldenson
  • Publication number: 20230379630
    Abstract: Methods, systems, and media for identifying a plurality of sets of coordinates for a plurality of devices are provided. In some embodiments, the method comprises: identifying each device in a plurality of devices associated with a user account; instructing the plurality of devices to perform an audio sequence; receiving a plurality of transit times from the plurality of devices; determining a plurality of distances based on the plurality of transit times; determining a plurality of sets of coordinates based on the plurality of distances; associating to each of the plurality of devices a corresponding unique one of the plurality of sets of coordinates; and causing at least one of the plurality of devices to play spatial audio determined from the plurality of sets of coordinates.
    Type: Application
    Filed: July 31, 2023
    Publication date: November 23, 2023
    Inventors: Dongeek Shin, Gabriel Slotnick
  • Publication number: 20230371832
    Abstract: The techniques described herein relate to a head-mounted device that includes a frame, a motion sensor coupled to the frame, and a processor in communication with the motion sensor. The processor is configured by instructions to receive motion signals captured by the motion sensor, determine when to extract features from the motion signals, extract the features from the motion signals, generate a signal image from the features extracted from the motion signals, and process the signal image to output one or more health metrics.
    Type: Application
    Filed: May 19, 2022
    Publication date: November 23, 2023
    Inventors: Dongeek Shin, Shwetak N. Patel
  • Publication number: 20230379556
    Abstract: Methods and systems for crowd source-based time marking of media items at a platform are provided herein. A media item is provided to first client devices associated with first users of a platform. An indication is received from each of the first client devices of an interesting content segment of the media item as selected by a first user of the platform. At least one content segment of the media item to be associated with a bookmark for a timeline of the media item is determined. The at least one content segment is determined in view of the indication received from each of the first client devices. The media item and the indication of the bookmark is provided to a second client device for presentation to a second user of the platform.
    Type: Application
    Filed: May 17, 2022
    Publication date: November 23, 2023
    Inventor: Dongeek Shin
  • Publication number: 20230376125
    Abstract: Physical gestures may be performed by a user to interact with a head-mounted device. These physical gestures can be detected by other devices worn by the user. For example, a fitness tracker worn on a wrist of a user may be used to detect the movement of the wrist as a gesture and then communicate this gesture to the head-mounted device. This accessory-mediated gesture interaction may be interrupted when the accessory device loses power or otherwise stops tracking. In this condition, the disclosed head-mounted device may take-over gesture detection by monitoring distortions to a magnetic field caused by movement of the device. This form of gesture detection can be used when an active device has exhausted its battery. Further, this form of gesture detection can be used for electrically inactive objects that can cause detectable changes to the magnetic field when moved in the magnetic field.
    Type: Application
    Filed: May 18, 2022
    Publication date: November 23, 2023
    Inventors: Dongeek Shin, Ricardo John Campbell
  • Publication number: 20230377215
    Abstract: A method can include selecting an image from a set of images captured by a camera of a wearable device, identifying a region of interest in the image based on a position of an overlay display of the wearable device, determining a characteristic of the region of interest, determining a characteristic of content to be rendered on the overlay display, modifying the content based on the characteristic of the region of interest and the characteristic of the content, and rendering the modified content on the overlay display.
    Type: Application
    Filed: May 18, 2022
    Publication date: November 23, 2023
    Inventors: Dongeek Shin, Aveek Purohit
  • Publication number: 20230379520
    Abstract: Methods and systems for time marking of media items at a platform using machine learning are provided herein. A media item to be provided to users of a platform is identified. The media item includes two or more content segments. An indication of the identified media item is provided as input to a machine learning model. The machine learning model is trained using to predict, for a given media item, content segments of the given media item depicting an event of interest to the one or more users. One or more outputs of the machine learning model are obtained. The one or more obtained outputs include event data identifying each content segment of the media item and an indication of a level of confidence that each respective content segment depicts an event of interest. In response to determining that at least one content segment is associated with a level of confidence that satisfies a level of confidence criterion, the at least one content segment is associated with a bookmark for a timeline of the media item.
    Type: Application
    Filed: May 17, 2022
    Publication date: November 23, 2023
    Inventor: Dongeek Shin
  • Patent number: 11822736
    Abstract: Physical gestures may be performed by a user to interact with a head-mounted device. These physical gestures can be detected by other devices worn by the user. For example, a fitness tracker worn on a wrist of a user may be used to detect the movement of the wrist as a gesture and then communicate this gesture to the head-mounted device. This accessory-mediated gesture interaction may be interrupted when the accessory device loses power or otherwise stops tracking. In this condition, the disclosed head-mounted device may take-over gesture detection by monitoring distortions to a magnetic field caused by movement of the device. This form of gesture detection can be used when an active device has exhausted its battery. Further, this form of gesture detection can be used for electrically inactive objects that can cause detectable changes to the magnetic field when moved in the magnetic field.
    Type: Grant
    Filed: May 18, 2022
    Date of Patent: November 21, 2023
    Assignee: Google LLC
    Inventors: Dongeek Shin, Ricardo John Campbell