Patents by Inventor Darin Tay
Darin Tay has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20260195381Abstract: Described herein are systems and methods that detect and filter objects from media content. In particular, a detection system accesses classifiers that can detect objects when applied to a video. The detection system receives a text input from a user interface identifying filtering criteria for outputs of the classifiers and inputs the filtering criteria to a filtering language model that produces a filtering object. The detection system presents the filtering object at the user interface. In response to a user accepting the filtering object, the detection system applies the classifiers to the video, which produces a set of detected objects. The detection system applies the filtering object to the detected objects by removing a subset of the detected objects that do not satisfy the filtering criteria and presents the video with the filtered set of detected objects highlighted within the video.Type: ApplicationFiled: January 22, 2026Publication date: July 9, 2026Inventors: Huaijin Wang, Alexander Jordan Bildner, Amey Patel, Andrew Ellison, John Goddard, Ryan Wong, Darin Tay, Reza Bosagh Zadeh
-
Publication number: 20260195380Abstract: Described herein are systems and methods that highlight target objects in media content. The detection system trains a neural network to identify objects within an image. The detection system receives a text input requesting a search within the image and applies a search language model to the text input, which identifies a target object associated with the requested search. The detection system applies the neural network to the image to identify instances of the target object. The detection system modifies a user interface to include the image and modifies the image to highlight the identified instances of the target object. The detection system receives feedback that modifies the highlighted instances of the target object within the user interface and retrains the neural network based on the modified highlighted instances.Type: ApplicationFiled: March 4, 2026Publication date: July 9, 2026Inventors: Huaijin Wang, Alexander Jordan Bildner, Amey Patel, Andrew Ellison, John Goddard, Ryan Wong, Darin Tay, Reza Bosagh Zadeh
-
Publication number: 20260195958Abstract: Described herein are systems and methods that modify media content based on modification criteria extracted from text inputs. A detection system receives a text input that identifies a modification for a video stream and applies a modification language model to the text input, which extracts modification criteria from the text input. The detection system modifies a user interface to include a graphic object identifying the extracted modification criteria and modifies the video stream based on the extracted modification criteria to produce a modified video stream. The detection system modifies the user interface to include the modified video stream. A user may interact with the user interface to produce more graphic objects and further modify the modified video stream.Type: ApplicationFiled: January 7, 2025Publication date: July 9, 2026Inventors: Huaijin Wang, Alexander Jordan Bildner, Amey Patel, Andrew Ellison, John Goddard, Ryan Wong, Darin Tay, Reza Bosagh Zadeh
-
Patent number: 12664776Abstract: A media detection system receives a video corresponding to a fixed field of view. The media detection system may receive user input indicating one or more object types to identify or a subset of the video within which to identify objects. The media detection system applies one or more machine-learned classifiers to frames of the video and creates a summary video that includes the background of the video and identified instances for simultaneous playback within the fixed field of view. The media detection system may also identify instances of objects in a live video stream and use the identified instances to respond to user questions. The media detection system applies a language model to questions to identify the subject matter of the questions, identifies content within the live video stream associated with the subject matter, and uses the identified content to respond to the user's question.Type: GrantFiled: September 26, 2023Date of Patent: June 23, 2026Assignee: Matroid, Inc.Inventors: Reza Bosagh Zadeh, John Goddard, Ryan Wong, Darin Tay, Andrew Ellison, Huaijin Wang, Moussa Haidous, Alex Johnson, Sanil Pande, Anurag Katakkar
-
Patent number: 12591617Abstract: Described herein are systems and methods that highlight target objects in media content. The detection system trains a neural network to identify objects within an image. The detection system receives a text input requesting a search within the image and applies a search language model to the text input, which identifies a target object associated with the requested search. The detection system applies the neural network to the image to identify instances of the target object. The detection system modifies a user interface to include the image and modifies the image to highlight the identified instances of the target object. The detection system receives feedback that modifies the highlighted instances of the target object within the user interface and retrains the neural network based on the modified highlighted instances.Type: GrantFiled: January 7, 2025Date of Patent: March 31, 2026Assignee: Matroid, Inc.Inventors: Huaijin Wang, Alexander Jordan Bildner, Amey Patel, Andrew Ellison, John Goddard, Ryan Wong, Darin Tay, Reza Bosagh Zadeh
-
Publication number: 20260072161Abstract: A system accesses a first video stream from an internal scanning device (e.g., an X-ray scanner) that scans objects or individuals. It also accesses a second video stream from a capturing device that records a human operator reviewing and interacting with the first stream on a display to identify targeted subject matter. The system then identifies the targeted subject matter based on the operator's interactions and constructs a training dataset based on the identified targeted subject matter. Using this training dataset, the system trains a machine-learning model to identify the targeted subject matter in future video streams from scanning devices.Type: ApplicationFiled: September 6, 2024Publication date: March 12, 2026Inventors: Reza Zadeh, John Goddard, Ryan Wong, Darin Tay, Andrew Ellison, Huaijin Wang, Moussa Haidous, Sanil Pande
-
Patent number: 12568290Abstract: A media detection system receives a video corresponding to a fixed field of view. The media detection system may receive user input indicating one or more object types to identify or a subset of the video within which to identify objects. The media detection system applies one or more machine-learned classifiers to frames of the video and creates a summary video that includes the background of the video and identified instances for simultaneous playback within the fixed field of view. The media detection system may also identify instances of objects in a live video stream and use the identified instances to respond to user questions. The media detection system applies a language model to questions to identify the subject matter of the questions, identifies content within the live video stream associated with the subject matter, and uses the identified content to respond to the user's question.Type: GrantFiled: September 26, 2023Date of Patent: March 3, 2026Assignee: Matroid, Inc.Inventors: Reza Bosagh Zadeh, John Goddard, Ryan Wong, Darin Tay, Andrew Ellison, Huaijin Wang, Moussa Haidous, Alex Johnson, Sanil Pande, Anurag Katakkar
-
Patent number: 12567256Abstract: A media detection system receives a video corresponding to a fixed field of view. The media detection system may receive user input indicating one or more object types to identify or a subset of the video within which to identify objects. The media detection system applies one or more machine-learned classifiers to frames of the video and creates a summary video that includes the background of the video and identified instances for simultaneous playback within the fixed field of view. The media detection system may also identify instances of objects in a live video stream and use the identified instances to respond to user questions. The media detection system applies a language model to questions to identify the subject matter of the questions, identifies content within the live video stream associated with the subject matter, and uses the identified content to respond to the user's question.Type: GrantFiled: September 26, 2023Date of Patent: March 3, 2026Assignee: Matroid, Inc.Inventors: Reza Bosagh Zadeh, John Goddard, Ryan Wong, Darin Tay, Andrew Ellison, Huaijin Wang, Moussa Haidous, Alex Johnson, Sanil Pande, Anurag Katakkar
-
Patent number: 12554771Abstract: Described herein are systems and methods that detect and filter objects from media content. In particular, a detection system accesses classifiers that can detect objects when applied to a video. The detection system receives a text input from a user interface identifying filtering criteria for outputs of the classifiers and inputs the filtering criteria to a filtering language model that produces a filtering object. The detection system presents the filtering object at the user interface. In response to a user accepting the filtering object, the detection system applies the classifiers to the video, which produces a set of detected objects. The detection system applies the filtering object to the detected objects by removing a subset of the detected objects that do not satisfy the filtering criteria and presents the video with the filtered set of detected objects highlighted within the video.Type: GrantFiled: January 7, 2025Date of Patent: February 17, 2026Assignee: Matroid, Inc.Inventors: Huaijin Wang, Alexander Jordan Bildner, Amey Patel, Andrew Ellison, John Goddard, Ryan Wong, Darin Tay, Reza Bosagh Zadeh
-
Publication number: 20250104422Abstract: A media detection system receives a video corresponding to a fixed field of view. The media detection system may receive user input indicating one or more object types to identify or a subset of the video within which to identify objects. The media detection system applies one or more machine-learned classifiers to frames of the video and creates a summary video that includes the background of the video and identified instances for simultaneous playback within the fixed field of view. The media detection system may also identify instances of objects in a live video stream and use the identified instances to respond to user questions. The media detection system applies a language model to questions to identify the subject matter of the questions, identifies content within the live video stream associated with the subject matter, and uses the identified content to respond to the user's question.Type: ApplicationFiled: September 26, 2023Publication date: March 27, 2025Inventors: Reza Bosagh Zadeh, John Goddard, Ryan Wong, Darin Tay, Andrew Ellison, Huaijin Wang, Moussa Haidous, Alex Johnson, Sanil Pande, Anurag Katakkar
-
Publication number: 20250104427Abstract: A media detection system receives a video corresponding to a fixed field of view. The media detection system may receive user input indicating one or more object types to identify or a subset of the video within which to identify objects. The media detection system applies one or more machine-learned classifiers to frames of the video and creates a summary video that includes the background of the video and identified instances for simultaneous playback within the fixed field of view. The media detection system may also identify instances of objects in a live video stream and use the identified instances to respond to user questions. The media detection system applies a language model to questions to identify the subject matter of the questions, identifies content within the live video stream associated with the subject matter, and uses the identified content to respond to the user's question.Type: ApplicationFiled: September 26, 2023Publication date: March 27, 2025Inventors: Reza Bosagh Zadeh, John Goddard, Ryan Wong, Darin Tay, Andrew Ellison, Huaijin Wang, Moussa Haidous, Alex Johnson, Sanil Pande, Anurag Katakkar
-
Publication number: 20250106487Abstract: A media detection system receives a video corresponding to a fixed field of view. The media detection system may receive user input indicating one or more object types to identify or a subset of the video within which to identify objects. The media detection system applies one or more machine-learned classifiers to frames of the video and creates a summary video that includes the background of the video and identified instances for simultaneous playback within the fixed field of view. The media detection system may also identify instances of objects in a live video stream and use the identified instances to respond to user questions. The media detection system applies a language model to questions to identify the subject matter of the questions, identifies content within the live video stream associated with the subject matter, and uses the identified content to respond to the user's question.Type: ApplicationFiled: September 26, 2023Publication date: March 27, 2025Inventors: Reza Bosagh Zadeh, John Goddard, Ryan Wong, Darin Tay, Andrew Ellison, Huaijin Wang, Moussa Haidous, Alex Johnson, Sanil Pande, Anurag Katakkar
-
Publication number: 20250104428Abstract: A media detection system receives a video corresponding to a fixed field of view. The media detection system may receive user input indicating one or more object types to identify or a subset of the video within which to identify objects. The media detection system applies one or more machine-learned classifiers to frames of the video and creates a summary video that includes the background of the video and identified instances for simultaneous playback within the fixed field of view. The media detection system may also identify instances of objects in a live video stream and use the identified instances to respond to user questions. The media detection system applies a language model to questions to identify the subject matter of the questions, identifies content within the live video stream associated with the subject matter, and uses the identified content to respond to the user's question.Type: ApplicationFiled: September 26, 2023Publication date: March 27, 2025Inventors: Reza Bosagh Zadeh, John Goddard, Ryan Wong, Darin Tay, Andrew Ellison, Huaijin Wang, Moussa Haidous, Alex Johnson, Sanil Pande, Anurag Katakkar
-
Patent number: 10979854Abstract: A method comprising: receiving a radio map of an indoor venue using survey data collected by a survey device positioned throughout the venue, the radio map including a boundary; obtaining harvest data that correspond to locations that are outside of the boundary; filtering the harvest data; and extending the radio map using the survey data and the filtered harvest data, wherein the extended radio map is defined at least in part by an extension of the boundary.Type: GrantFiled: September 20, 2017Date of Patent: April 13, 2021Assignee: Apple Inc.Inventors: Wei Kong, Robert Mayor, Chun-Yuan Yang, Darin Tay
-
Patent number: 10545231Abstract: Embodiments are disclosed for compressing radio maps of fingerprint-based positioning systems using different compression models. In an embodiment, a method comprises: receiving, by a computing device, access point (AP) data from a plurality of mobile devices operating in a geographic region, the AP data including signal strength measurements of AP signals received at a plurality of reference locations in the geographic region and uncertainty measurements associated with the signal strength measurements; determining a level of accuracy with the first compression model; responsive to the determining, selecting one of the first compression model or a second compression model to compress the AP data, the second compression model being different than the first compression model; compressing the AP data using the selected compression model; and responsive to a request from a mobile device operating in the geographic region, sending a data packet including the compressed AP data to the mobile device.Type: GrantFiled: September 28, 2018Date of Patent: January 28, 2020Assignee: Apple Inc.Inventors: Wuzhou Zhang, Benjamin A. Detwiler, David Benjamin Millman, Jasvinder Singh, Anders M. Holtsberg, Darin Tay
-
Patent number: 10477609Abstract: A method comprising: receiving a harvest trace from a mobile device, the harvest trace including a plurality of location fixes each corresponding to a location at a venue, each location fix associated with data including one or more RSSI measurements of one or more wireless signals received from each of a plurality of wireless access points positioned at the venue, the plurality of location fixes including at least two location fixes that have a positional relationship with each other; comparing the data associated with one of the location fixes with data associated with a reference point identified in a radio map of the venue; and updating the radio map of the venue by updating the data associated with the reference point based on the data associated with the one of the location fixes.Type: GrantFiled: September 20, 2017Date of Patent: November 12, 2019Assignee: Apple Inc.Inventors: Chun-Yuan Yang, Darin Tay, Wei Kong
-
Publication number: 20190137621Abstract: Embodiments are disclosed for compressing radio maps of fingerprint-based positioning systems using different compression models. In an embodiment, a method comprises: receiving, by a computing device, access point (AP) data from a plurality of mobile devices operating in a geographic region, the AP data including signal strength measurements of AP signals received at a plurality of reference locations in the geographic region and uncertainty measurements associated with the signal strength measurements; determining a level of accuracy with the first compression model; responsive to the determining, selecting one of the first compression model or a second compression model to compress the AP data, the second compression model being different than the first compression model; compressing the AP data using the selected compression model; and responsive to a request from a mobile device operating in the geographic region, sending a data packet including the compressed AP data to the mobile device.Type: ApplicationFiled: September 28, 2018Publication date: May 9, 2019Applicant: Apple Inc.Inventors: Wuzhou Zhang, Benjamin A. Detwiler, David Benjamin Millman, Jasvinder Singh, Anders M. Holtsberg, Darin Tay
-
Patent number: 10151824Abstract: Embodiments are disclosed for compressing radio maps of fingerprint-based positioning systems. In an embodiment, a method comprises: receiving access point (AP) data from a plurality of mobile devices operating in a geographic region, the AP data including signal strength measurements of AP signals received at a plurality of reference locations in the geographic region; filtering the AP data to remove outlier AP data; fitting a surface to the AP data; projecting AP data at surface control points onto a two-dimensional image grid; determining a boundary surrounding locations of the AP data at the surface control points; encoding the boundary; encoding the AP data at the surface control points included within the boundary; generating compressed radio maps from the encoded AP data; and responsive to a request from a mobile device operating in the geographic region, sending a data packet including the compressed radio maps to the mobile device.Type: GrantFiled: September 29, 2017Date of Patent: December 11, 2018Assignee: Apple Inc.Inventors: David Benjamin Millman, Jasvinder Singh, Anders M. Holtsberg, Darin Tay
-
Publication number: 20180352585Abstract: A method comprising: receiving a harvest trace from a mobile device, the harvest trace including a plurality of location fixes each corresponding to a location at a venue, each location fix associated with data including one or more RSSI measurements of one or more wireless signals received from each of a plurality of wireless access points positioned at the venue, the plurality of location fixes including at least two location fixes that have a positional relationship with each other; comparing the data associated with one of the location fixes with data associated with a reference point identified in a radio map of the venue; and updating the radio map of the venue by updating the data associated with the reference point based on the data associated with the one of the location fixes.Type: ApplicationFiled: September 20, 2017Publication date: December 6, 2018Applicant: Apple Inc.Inventors: Chun-Yuan Yang, Darin Tay, Wei Kong
-
Publication number: 20180348334Abstract: Embodiments are disclosed for compressing radio maps of fingerprint-based positioning systems. In an embodiment, a method comprises: receiving access point (AP) data from a plurality of mobile devices operating in a geographic region, the AP data including signal strength measurements of AP signals received at a plurality of reference locations in the geographic region; filtering the AP data to remove outlier AP data; fitting a surface to the AP data; projecting AP data at surface control points onto a two-dimensional image grid; determining a boundary surrounding locations of the AP data at the surface control points; encoding the boundary; encoding the AP data at the surface control points included within the boundary; generating compressed radio maps from the encoded AP data; and responsive to a request from a mobile device operating in the geographic region, sending a data packet including the compressed radio maps to the mobile device.Type: ApplicationFiled: September 29, 2017Publication date: December 6, 2018Applicant: Apple Inc.Inventors: David Benjamin Millman, Jasvinder Singh, Anders M. Holtsberg, Darin Tay