Patents by Inventor Shawn R. Scully

Shawn R. Scully has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250037033
    Abstract: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, sensor data for a first window of time and additional sensor data for a second window of time overlapping the first window of time. The sensor data and the additional sensor data are provided as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture, predicted gesture start time, and predicted gesture end time based on the sensor data. A predicted gesture is determined based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.
    Type: Application
    Filed: October 14, 2024
    Publication date: January 30, 2025
    Inventors: Charles MAALOUF, Shawn R. SCULLY, Christopher B. FLEIZACH, Tu K. NGUYEN, Lilian H. LIANG, Warren J. SETO, Julian QUINTANA, Michael J. BEYHS, Hojjat SEYED MOUSAVI, Behrooz SHAHSAVARI
  • Patent number: 12189865
    Abstract: The present disclosure generally relates to navigating user interfaces using hand gestures.
    Type: Grant
    Filed: February 14, 2023
    Date of Patent: January 7, 2025
    Assignee: Apple Inc.
    Inventors: Tu K. Nguyen, James N. Cartwright, Elizabeth C. Cranfill, Christopher B. Fleizach, Joshua R. Ford, Jeremiah R. Johnson, Charles Maalouf, Heriberto Nieto, Jennifer D. Patton, Hojat Seyed Mousavi, Shawn R. Scully, Ibrahim G. Yusuf, Joanna Arreaza-Taylor, Hannah G. Coleman, Yoonju Han
  • Patent number: 12118443
    Abstract: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.
    Type: Grant
    Filed: May 26, 2023
    Date of Patent: October 15, 2024
    Assignee: Apple Inc.
    Inventors: Charles Maalouf, Shawn R. Scully, Christopher B. Fleizach, Tu K. Nguyen, Lilian H. Liang, Warren J. Seto, Julian Quintana, Michael J. Beyhs, Hojjat Seyed Mousavi, Behrooz Shahsavari
  • Patent number: 11915460
    Abstract: A device implementing a system for providing predicted RGB images includes at least one processor configured to obtain an infrared image of a subject, and to obtain a reference RGB image of the subject. The at least one processor is further configured to provide the infrared image and the reference RGB image to a machine learning model, the machine learning model having been trained to output predicted RGB images of subjects based on infrared images and reference RGB images of the subjects. The at least one processor is further configured to provide a predicted RGB image of the subject based on output by the machine learning model.
    Type: Grant
    Filed: July 7, 2022
    Date of Patent: February 27, 2024
    Assignee: Apple Inc.
    Inventors: Carlos E. Guestrin, Leon A. Gatys, Shreyas V. Joshi, Gustav M. Larsson, Kory R. Watson, Srikrishna Sridhar, Karla P. Vega, Shawn R. Scully, Thorsten Gernoth, Onur C Hamsici
  • Publication number: 20230325719
    Abstract: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.
    Type: Application
    Filed: May 26, 2023
    Publication date: October 12, 2023
    Inventors: Charles MAALOUF, Shawn R. SCULLY, Christopher B. FLEIZACH, Tu K. NGUYEN, Lilian H. LIANG, Warren J. SETO, Julian QUINTANA, Michael J. BEYHS, Hojjat SEYED MOUSAVI, Behrooz SHAHSAVARI
  • Patent number: 11699104
    Abstract: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.
    Type: Grant
    Filed: July 20, 2022
    Date of Patent: July 11, 2023
    Assignee: Apple Inc.
    Inventors: Charles Maalouf, Shawn R. Scully, Christopher B. Fleizach, Tu K. Nguyen, Lilian H. Liang, Warren J. Seto, Julian Quintana, Michael J. Beyhs, Hojjat Seyed Mousavi, Behrooz Shahsavari
  • Publication number: 20230195237
    Abstract: The present disclosure generally relates to navigating user interfaces using hand gestures.
    Type: Application
    Filed: February 14, 2023
    Publication date: June 22, 2023
    Inventors: Tu K. NGUYEN, James N. CARTWRIGHT, Elizabeth C. CRANFILL, Christopher B. FLEIZACH, Joshua R. FORD, Jeremiah R. JOHNSON, Charles MAALOUF, Heriberto NIETO, Jennifer D. PATTON, Hojjat SEYED MOUSAVI, Shawn R. SCULLY, Ibrahim G. YUSUF
  • Publication number: 20230160922
    Abstract: Individual health related events (e.g., handwashing events) can be detected based on multiple sensors including motion and audio sensors. Detecting a qualifying handwashing event can include detecting a qualifying scrubbing event based on motion data (e.g., accelerometer data) and a qualifying rinsing event based on audio data. In some examples, power consumption can be reduced by implementing one or more power saving mitigations.
    Type: Application
    Filed: January 23, 2023
    Publication date: May 25, 2023
    Inventors: Gierad LAPUT, Jared LeVan ZERBE, William C. ATHAS, Andreas Edgar SCHOBEL, Shawn R. SCULLY, Brian H. TSANG, Kevin LYNCH, Charles MAALOUF, Shiwen ZHAO
  • Patent number: 11639944
    Abstract: Individual health related events (e.g., handwashing events) can be detected based on multiple sensors including motion and audio sensors. Detecting a qualifying handwashing event can include detecting a qualifying scrubbing event based on motion data (e.g., accelerometer data) and a qualifying rinsing event based on audio data. In some examples, power consumption can be reduced by implementing one or more power saving mitigations.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: May 2, 2023
    Assignee: Apple Inc.
    Inventors: Gierad Laput, Jared LeVan Zerbe, William C. Athas, Andreas Edgar Schobel, Shawn R. Scully, Brian H. Tsang, Kevin Lynch, Charles Maalouf, Shiwen Zhao
  • Patent number: 11561239
    Abstract: Individual health related events (e.g., handwashing events) can be detected based on multiple sensors including motion and audio sensors. Detecting a qualifying handwashing event can include detecting a qualifying scrubbing event based on motion data (e.g., accelerometer data) and a qualifying rinsing event based on audio data. In some examples, power consumption can be reduced by implementing one or more power saving mitigations.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: January 24, 2023
    Assignee: Apple Inc.
    Inventors: Gierad Laput, Jared LeVan Zerbe, William C. Athas, Andreas Edgar Schobel, Shawn R. Scully, Brian H. Tsang, Kevin Lynch, Charles Maalouf, Shiwen Zhao
  • Publication number: 20220414543
    Abstract: A device implementing a system for providing predicted RGB images includes at least one processor configured to obtain an infrared image of a subject, and to obtain a reference RGB image of the subject. The at least one processor is further configured to provide the infrared image and the reference RGB image to a machine learning model, the machine learning model having been trained to output predicted RGB images of subjects based on infrared images and reference RGB images of the subjects. The at least one processor is further configured to provide a predicted RGB image of the subject based on output by the machine learning model.
    Type: Application
    Filed: July 7, 2022
    Publication date: December 29, 2022
    Inventors: Carlos E. GUESTRIN, Leon A. GATYS, Shreyas V. JOSHI, Gustav M. LARSSON, Kory R. WATSON, Srikrishna SRIDHAR, Karla P. VEGA, Shawn R. SCULLY, Thorsten GERNOTH, Onur C HAMSICI
  • Publication number: 20220374085
    Abstract: The present disclosure generally relates to navigating user interfaces using hand gestures.
    Type: Application
    Filed: May 18, 2022
    Publication date: November 24, 2022
    Inventors: Tu K. NGUYEN, James N. CARTWRIGHT, Elizabeth C. CRANFILL, Christopher B. FLEIZACH, Joshua R. FORD, Jeremiah R. JOHNSON, Charles MAALOUF, Heriberto NIETO, Jennifer D. PATTON, Hojjat SEYED MOUSAVI, Shawn R. SCULLY, Ibrahim G. YUSUF
  • Publication number: 20220351086
    Abstract: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.
    Type: Application
    Filed: July 20, 2022
    Publication date: November 3, 2022
    Inventors: Charles MAALOUF, Shawn R. SCULLY, Christopher B. FLEIZACH, Tu K. NGUYEN, Lilian H. LIANG, Warren J. SETO, Julian QUINTANA, Michael J. BEYHS, Hojjat SEYED MOUSAVI, Behrooz SHAHSAVARI
  • Patent number: 11449802
    Abstract: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.
    Type: Grant
    Filed: July 23, 2020
    Date of Patent: September 20, 2022
    Assignee: Apple Inc.
    Inventors: Charles Maalouf, Shawn R. Scully, Christopher B. Fleizach, Tu K. Nguyen, Lilian H. Liang, Warren J. Seto, Julian Quintana, Michael J. Beyhs, Hojjat Seyed Mousavi, Behrooz Shahsavari
  • Patent number: 11386355
    Abstract: A device implementing a system for providing predicted RGB images includes at least one processor configured to obtain an infrared image of a subject, and to obtain a reference RGB image of the subject. The at least one processor is further configured to provide the infrared image and the reference RGB image to a machine learning model, the machine learning model having been trained to output predicted RGB images of subjects based on infrared images and reference RGB images of the subjects. The at least one processor is further configured to provide a predicted RGB image of the subject based on output by the machine learning model.
    Type: Grant
    Filed: December 6, 2019
    Date of Patent: July 12, 2022
    Assignee: Apple Inc.
    Inventors: Carlos E. Guestrin, Leon A. Gatys, Shreyas V. Joshi, Gustav M. Larsson, Kory R. Watson, Srikrishna Sridhar, Karla P. Vega, Shawn R. Scully, Thorsten Gernoth, Onur C Hamsici
  • Publication number: 20210142214
    Abstract: A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.
    Type: Application
    Filed: July 23, 2020
    Publication date: May 13, 2021
    Inventors: Charles MAALOUF, Shawn R. SCULLY, Christopher B. FLEIZACH, Tu K. NGUYEN, Lilian H. LIANG, Warren J. SETO, Julian QUINTANA, Michael J. BEYHS, Hojjat SEYED MOUSAVI, Behrooz SHAHSAVARI
  • Publication number: 20210063434
    Abstract: Individual health related events (e.g., handwashing events) can be detected based on multiple sensors including motion and audio sensors. Detecting a qualifying handwashing event can include detecting a qualifying scrubbing event based on motion data (e.g., accelerometer data) and a qualifying rinsing event based on audio data. In some examples, power consumption can be reduced by implementing one or more power saving mitigations.
    Type: Application
    Filed: August 14, 2020
    Publication date: March 4, 2021
    Inventors: Gierad LAPUT, Jared LeVan ZERBE, William C. ATHAS, Andreas Edgar SCHOBEL, Shawn R. SCULLY, Brian H. TSANG, Kevin LYNCH, Charles MAALOUF, Shiwen ZHAO
  • Publication number: 20200193328
    Abstract: A device implementing a system for providing predicted RGB images includes at least one processor configured to obtain an infrared image of a subject, and to obtain a reference RGB image of the subject. The at least one processor is further configured to provide the infrared image and the reference RGB image to a machine learning model, the machine learning model having been trained to output predicted RGB images of subjects based on infrared images and reference RGB images of the subjects. The at least one processor is further configured to provide a predicted RGB image of the subject based on output by the machine learning model.
    Type: Application
    Filed: December 6, 2019
    Publication date: June 18, 2020
    Inventors: Carlos E. GUESTRIN, Leon A. GATYS, Shreyas V. JOSHI, Gustav M. LARSSON, Kory R. WATSON, Srikrishna SRIDHAR, Karla P. VEGA, Shawn R. SCULLY, Thorsten GERNOTH, Onur C. HAMSICI
  • Patent number: 10396228
    Abstract: A solar concentrator module (80) employs a luminescent concentrator material (82) between photovoltaic cells (86) having their charge-carrier separation junctions (90) parallel to front surfaces (88) of photovoltaic material 84 of the photovoltaic cells (86). Intercell areas (78) covered by the luminescent concentrator material (82) occupy from 2 to 50% of the total surface area of the solar concentrator modules (80). The luminescent concentrator material (82) preferably employs quantum dot heterostructures, and the photovoltaic cells (86) preferably employ low-cost high-efficiency photovoltaic materials (84), such as silicon-based photovoltaic materials.
    Type: Grant
    Filed: December 5, 2016
    Date of Patent: August 27, 2019
    Assignee: OSRAM Opto Semiconductors GmbH
    Inventors: Alex C. Mayer, Shawn R. Scully, Juanita N. Kurtin, Alex R. Guichard, Steven M. Hughes, Oun-Ho Park, Paul-Emile B. Trudeau, Colin C. Reese, Manav Sheoran, Georgeta Masson
  • Publication number: 20170084768
    Abstract: A solar concentrator module (80) employs a luminescent concentrator material (82) between photovoltaic cells (86) having their charge-carrier separation junctions (90) parallel to front surfaces (88) of photovoltaic material 84 of the photovoltaic cells (86). Intercell areas (78) covered by the luminescent concentrator material (82) occupy from 2 to 50% of the total surface area of the solar concentrator modules (80). The luminescent concentrator material (82) preferably employs quantum dot heterostructures, and the photovoltaic cells (86) preferably employ low-cost high-efficiency photovoltaic materials (84), such as silicon-based photovoltaic materials.
    Type: Application
    Filed: December 5, 2016
    Publication date: March 23, 2017
    Inventors: Alex C. Mayer, Shawn R. Scully, Juanita N. Kurtin, Alex R. Guichard, Steven M. Hughes, Oun Ho Park, Paul-Emile B. Trudeau, Colin C. Reese, Manav Sheoran, Georgeta Masson