Patents by Inventor Srikrishna Sridhar
Srikrishna Sridhar has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11915460Abstract: A device implementing a system for providing predicted RGB images includes at least one processor configured to obtain an infrared image of a subject, and to obtain a reference RGB image of the subject. The at least one processor is further configured to provide the infrared image and the reference RGB image to a machine learning model, the machine learning model having been trained to output predicted RGB images of subjects based on infrared images and reference RGB images of the subjects. The at least one processor is further configured to provide a predicted RGB image of the subject based on output by the machine learning model.Type: GrantFiled: July 7, 2022Date of Patent: February 27, 2024Assignee: Apple Inc.Inventors: Carlos E. Guestrin, Leon A. Gatys, Shreyas V. Joshi, Gustav M. Larsson, Kory R. Watson, Srikrishna Sridhar, Karla P. Vega, Shawn R. Scully, Thorsten Gernoth, Onur C Hamsici
-
Patent number: 11907436Abstract: Systems and processes for operating an intelligent automated assistant are provided. An example process includes detecting input representing motion of an electronic device and sampling an audio input with a microphone of the electronic device. The example process further includes determining, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session. In accordance with a determination to initiate the virtual assistant session, the example process includes initiating the virtual assistant session. In accordance with a determination not to initiate the virtual assistant session, the example process includes forgoing initiating the virtual assistant session.Type: GrantFiled: September 16, 2022Date of Patent: February 20, 2024Assignee: Apple Inc.Inventors: Stephen O. Lemay, Michael R. Bastian, Roman Holenstein, Minwoo Jeong, Charles Maalouf, Brandon J. Newendorp, Heriberto Nieto, Timothy Paek, Joanna Peterson, Shawn Scully, Srikrishna Sridhar, Brandt M. Westing, Shiwen Zhao
-
Patent number: 11842460Abstract: Electronic devices, methods, and non-transitory program storage devices for leveraging machine learning to perform improved image fusion and/or noise reduction are disclosed. When a capture request is received, a neural network may be used to perform fusion and denoising operations on a first set of captured input images. According to some embodiments, the neural network's architecture comprises: a first plurality of network layers configured to compute optical flow information between the first set of input images; a second plurality of network layers configured to perform, at least in part, the fusion and denoising operations on the first set of input images; and a third plurality of skip connections between layers of the second plurality of network layers, wherein parameters for each skip connection of the third plurality of skip connections are warped based on at least part of the optical flow information computed by the first plurality of network layers.Type: GrantFiled: June 18, 2021Date of Patent: December 12, 2023Assignee: Apple Inc.Inventors: Chen Chen, Gustav M. Larsson, Jiangkun Liu, Srikrishna Sridhar, Abdelrahman Abdelhamed
-
Patent number: 11748655Abstract: The subject technology receives, in an application on an electronic device, a message, the message being associated with a user and including information in a header portion of the message. The subject technology determines, on the electronic device, a current state of messaging activity of the user based at least in part on a log of previous events associated with the user, where the log of previous events includes information that has been hashed using a cryptographic hash function. The subject technology determines, on the electronic device using a set of rules provided by a machine learning model, that the user is likely to view the message based on the current state of the messaging activity of the user. The subject technology sets, on the electronic device, an indication that the message is important based on the determining.Type: GrantFiled: September 25, 2019Date of Patent: September 5, 2023Assignee: Apple Inc.Inventors: Srikrishna Sridhar, Aaron B. Franklin, Marina Gray, Shayne R. Longpre, Shiwen Zhao, Torsten Becker
-
Patent number: 11614922Abstract: The subject technology transforms a machine learning model into a transformed machine learning model in accordance with a particular model specification when the machine learning model does not conform to the particular model specification, the particular model specification being compatible with an integrated development environment (IDE). The subject technology generates a code interface and code for the transformed machine learning model, the code interface including code statements in the object oriented programming language, the code statements corresponding to an object representing the transformed machine learning model. Further, the subject technology provides the generated code interface and the code for display in the IDE, the IDE enabling modifying of the generated code interface and the code.Type: GrantFiled: December 21, 2020Date of Patent: March 28, 2023Assignee: Apple Inc.Inventors: Alexander B. Brown, Michael R. Siracusa, Gaurav Kapoor, Elizabeth Ottens, Christopher M. Hanson, Zachary A. Nation, Vrushali Mundhe, Srikrishna Sridhar
-
Patent number: 11580444Abstract: The subject technology receives information associated with a machine learning model. The subject technology determines a set of metrics based at least in part on the information associated with the machine learning model, where the set of metrics corresponds to respective indicators of performance of the machine learning model based on input data from a data set, the set of metrics further including a number of errors produced by the machine learning model when applied to the input data from the data set. Further, the subject technology displays a user interface based at least in part on the set of metrics, where the user interface includes a set of graphical elements, and the set of graphical elements further includes representations of the set of metrics, and representations of the input data from the data set utilized by the machine learning model.Type: GrantFiled: August 2, 2019Date of Patent: February 14, 2023Assignee: Apple Inc.Inventors: Aaron B. Franklin, Kanit Wongsuphasawat, Naga Rama Abhishek Pratapa, Srikrishna Sridhar, Zachary A. Nation
-
Publication number: 20230040703Abstract: Systems and processes for operating an intelligent automated assistant are provided. An example process includes detecting input representing motion of an electronic device and sampling an audio input with a microphone of the electronic device. The example process further includes determining, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session. In accordance with a determination to initiate the virtual assistant session, the example process includes initiating the virtual assistant session. In accordance with a determination not to initiate the virtual assistant session, the example process includes forgoing initiating the virtual assistant session.Type: ApplicationFiled: September 16, 2022Publication date: February 9, 2023Inventors: Stephen O. LEMAY, Michael R. BASTIAN, Roman HOLENSTEIN, Minwoo JEONG, Charles MAALOUF, Brandon J. NEWENDORP, Heriberto NIETO, Timothy PAEK, Joanna PETERSON, Shawn SCULLY, Srikrishna SRIDHAR, Brandt M. WESTING, Shiwen ZHAO
-
Publication number: 20220414543Abstract: A device implementing a system for providing predicted RGB images includes at least one processor configured to obtain an infrared image of a subject, and to obtain a reference RGB image of the subject. The at least one processor is further configured to provide the infrared image and the reference RGB image to a machine learning model, the machine learning model having been trained to output predicted RGB images of subjects based on infrared images and reference RGB images of the subjects. The at least one processor is further configured to provide a predicted RGB image of the subject based on output by the machine learning model.Type: ApplicationFiled: July 7, 2022Publication date: December 29, 2022Inventors: Carlos E. GUESTRIN, Leon A. GATYS, Shreyas V. JOSHI, Gustav M. LARSSON, Kory R. WATSON, Srikrishna SRIDHAR, Karla P. VEGA, Shawn R. SCULLY, Thorsten GERNOTH, Onur C HAMSICI
-
Patent number: 11487364Abstract: Systems and processes for operating an intelligent automated assistant are provided. An example process includes detecting input representing motion of an electronic device and sampling an audio input with a microphone of the electronic device. The example process further includes determining, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session. In accordance with a determination to initiate the virtual assistant session, the example process includes initiating the virtual assistant session. In accordance with a determination not to initiate the virtual assistant session, the example process includes forgoing initiating the virtual assistant session.Type: GrantFiled: September 29, 2021Date of Patent: November 1, 2022Assignee: Apple Inc.Inventors: Stephen O. Lemay, Michael R. Bastian, Roman Holenstein, Minwoo Jeong, Charles Maalouf, Brandon J. Newendorp, Heriberto Nieto, Timothy Paek, Joanna Peterson, Shawn Scully, Srikrishna Sridhar, Brandt M. Westing, Shiwen Zhao
-
Patent number: 11386355Abstract: A device implementing a system for providing predicted RGB images includes at least one processor configured to obtain an infrared image of a subject, and to obtain a reference RGB image of the subject. The at least one processor is further configured to provide the infrared image and the reference RGB image to a machine learning model, the machine learning model having been trained to output predicted RGB images of subjects based on infrared images and reference RGB images of the subjects. The at least one processor is further configured to provide a predicted RGB image of the subject based on output by the machine learning model.Type: GrantFiled: December 6, 2019Date of Patent: July 12, 2022Assignee: Apple Inc.Inventors: Carlos E. Guestrin, Leon A. Gatys, Shreyas V. Joshi, Gustav M. Larsson, Kory R. Watson, Srikrishna Sridhar, Karla P. Vega, Shawn R. Scully, Thorsten Gernoth, Onur C Hamsici
-
Publication number: 20220019292Abstract: Systems and processes for operating an intelligent automated assistant are provided. An example process includes detecting input representing motion of an electronic device and sampling an audio input with a microphone of the electronic device. The example process further includes determining, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session. In accordance with a determination to initiate the virtual assistant session, the example process includes initiating the virtual assistant session. In accordance with a determination not to initiate the virtual assistant session, the example process includes forgoing initiating the virtual assistant session.Type: ApplicationFiled: September 29, 2021Publication date: January 20, 2022Inventors: Stephen O. LEMAY, Michael R. BASTIAN, Roman HOLENSTEIN, Minwoo JEONG, Charles MAALOUF, Brandon J. NEWENDORP, Heriberto NIETO, Timothy PAEK, Joanna PETERSON, Shawn SCULLY, Srikrishna SRIDHAR, Brandt M. WESTING, Shiwen ZHAO
-
Patent number: 11216431Abstract: The subject technology provides for generating a set of nodes representing a tree structure, each node comprising a feature index, a flag field indicating branch directions, an execution index storing locations related to the branch directions, and a feature value for comparing with the value stored in the input feature vector. The subject technology generates evaluation data, the evaluation data comprising a first array containing index values, and a second array containing evaluation values respectively corresponding to the index values, the evaluation data representing values of leaf nodes from the set of nodes. Further, the subject technology stores the set of nodes and the evaluation data as a contiguous block of data, where the set of nodes includes a first node and a second node, the second node corresponding to a likely execution path from the first node being physically stored adjacent to the first node.Type: GrantFiled: December 21, 2017Date of Patent: January 4, 2022Assignee: Apple Inc.Inventors: Hoyt A. Koepke, Srikrishna Sridhar
-
Patent number: 11169616Abstract: Systems and processes for operating an intelligent automated assistant are provided. An example process includes detecting input representing motion of an electronic device and sampling an audio input with a microphone of the electronic device. The example process further includes determining, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session. In accordance with a determination to initiate the virtual assistant session, the example process includes initiating the virtual assistant session. In accordance with a determination not to initiate the virtual assistant session, the example process includes forgoing initiating the virtual assistant session.Type: GrantFiled: September 25, 2020Date of Patent: November 9, 2021Assignee: Apple Inc.Inventors: Stephen O. Lemay, Michael R. Bastian, Roman Holenstein, Minwoo Jeong, Charles Maalouf, Brandon J. Newendorp, Heriberto Nieto, Timothy Paek, Joanna Peterson, Shawn Scully, Srikrishna Sridhar, Brandt M. Westing, Shiwen Zhao
-
Publication number: 20210109718Abstract: The subject technology transforms a machine learning model into a transformed machine learning model in accordance with a particular model specification when the machine learning model does not conform to the particular model specification, the particular model specification being compatible with an integrated development environment (IDE). The subject technology generates a code interface and code for the transformed machine learning model, the code interface including code statements in the object oriented programming language, the code statements corresponding to an object representing the transformed machine learning model. Further, the subject technology provides the generated code interface and the code for display in the IDE, the IDE enabling modifying of the generated code interface and the code.Type: ApplicationFiled: December 21, 2020Publication date: April 15, 2021Inventors: Alexander B. BROWN, Michael R. SIRACUSA, Gaurav KAPOOR, Elizabeth OTTENS, Christopher M. HANSON, Zachary A. NATION, Vrushali MUNDHE, Srikrishna SRIDHAR
-
Patent number: 10928970Abstract: The various embodiments described herein include methods, systems and/or devices used to visualize data. In one aspect, a method is performed by a computing system having one or more processors and memory. The method includes (1) receiving a request from a user to visualize data, the data stored in a graph dataflow processing system, and (2) in response to the request, invoking an interactive graphical user interface (GUI) for display to the user, the GUI including a first set of visualization data corresponding to a first subset of the data.Type: GrantFiled: July 20, 2015Date of Patent: February 23, 2021Assignee: Apple Inc.Inventors: Yucheng Low, Tim Muss, Zach Nation, Eric Wolfe, Brian Kent, Chris DuBois, Alice Zheng, Ping Wang, Srikrishna Sridhar, Carlos Guestrin
-
Patent number: 10928918Abstract: Systems and processes for operating an intelligent automated assistant are provided. An example process includes detecting input representing motion of an electronic device and sampling an audio input with a microphone of the electronic device. The example process further includes determining, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session. In accordance with a determination to initiate the virtual assistant session, the example process includes initiating the virtual assistant session. In accordance with a determination not to initiate the virtual assistant session, the example process includes forgoing initiating the virtual assistant session.Type: GrantFiled: July 11, 2018Date of Patent: February 23, 2021Assignee: Apple Inc.Inventors: Stephen O. Lemay, Michael R. Bastian, Roman Holenstein, Minwoo Jeong, Charles Maalouf, Brandon J. Newendorp, Heriberto Nieto, Timothy Paek, Joanna Peterson, Shawn Scully, Srikrishna Sridhar, Brandt M. Westing, Shiwen Zhao
-
Publication number: 20210011557Abstract: Systems and processes for operating an intelligent automated assistant are provided. An example process includes detecting input representing motion of an electronic device and sampling an audio input with a microphone of the electronic device. The example process further includes determining, based on the audio input and the input representing motion of the electronic device, whether to initiate a virtual assistant session. In accordance with a determination to initiate the virtual assistant session, the example process includes initiating the virtual assistant session. In accordance with a determination not to initiate the virtual assistant session, the example process includes forgoing initiating the virtual assistant session.Type: ApplicationFiled: September 25, 2020Publication date: January 14, 2021Inventors: Stephen O. LEMAY, Michael R. BASTIAN, Roman HOLENSTEIN, Minwoo JEONG, Charles MAALOUF, Brandon J. NEWENDORP, Heriberto NIETO, Timothy PAEK, Joanna PETERSON, Shawn SCULLY, Srikrishna SRIDHAR, Brandt M. WESTING, Shiwen ZHAO
-
Patent number: 10871949Abstract: The subject technology transforms a machine learning model into a transformed machine learning model in accordance with a particular model specification when the machine learning model does not conform to the particular model specification, the particular model specification being compatible with an integrated development environment (IDE). The subject technology generates a code interface and code for the transformed machine learning model, the code interface including code statements in the object oriented programming language, the code statements corresponding to an object representing the transformed machine learning model. Further, the subject technology provides the generated code interface and the code for display in the IDE, the IDE enabling modifying of the generated code interface and the code.Type: GrantFiled: June 3, 2019Date of Patent: December 22, 2020Assignee: Apple Inc.Inventors: Alexander B. Brown, Michael R. Siracusa, Gaurav Kapoor, Elizabeth Ottens, Christopher M. Hanson, Zachary A. Nation, Vrushali Mundhe, Srikrishna Sridhar
-
Publication number: 20200380408Abstract: The subject technology receives, in an application on an electronic device, a message, the message being associated with a user and including information in a header portion of the message. The subject technology determines, on the electronic device, a current state of messaging activity of the user based at least in part on a log of previous events associated with the user, where the log of previous events includes information that has been hashed using a cryptographic hash function. The subject technology determines, on the electronic device using a set of rules provided by a machine learning model, that the user is likely to view the message based on the current state of the messaging activity of the user. The subject technology sets, on the electronic device, an indication that the message is important based on the determining.Type: ApplicationFiled: September 25, 2019Publication date: December 3, 2020Inventors: Srikrishna SRIDHAR, Aaron B. FRANKLIN, Marina GRAY, Shayne R. LONGPRE, Shiwen ZHAO, Torsten BECKER
-
Publication number: 20200334570Abstract: The subject technology receives information associated with a machine learning model. The subject technology determines a set of metrics based at least in part on the information associated with the machine learning model, where the set of metrics corresponds to respective indicators of performance of the machine learning model based on input data from a data set, the set of metrics further including a number of errors produced by the machine learning model when applied to the input data from the data set. Further, the subject technology displays a user interface based at least in part on the set of metrics, where the user interface includes a set of graphical elements, and the set of graphical elements further includes representations of the set of metrics, and representations of the input data from the data set utilized by the machine learning model.Type: ApplicationFiled: August 2, 2019Publication date: October 22, 2020Inventors: Aaron B. FRANKLIN, Kanit WONGSUPHASAWAT, Naga Rama Abhishek PRATAPA, Srikrishna SRIDHAR, Zachary A. NATION