Patents by Inventor Jeffrey Wayne Su
Jeffrey Wayne Su has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240087316Abstract: A location in a video may be specified and content related to the location may be accessed. A method for accessing the related content may include receiving a reference to a pixel location in a frame of a video feed of a filmed occurrence and accessing a spatio-temporal index corresponding to the filmed occurrence. The spatio-temporal index may index information relating to events or objects of the filmed occurrence and corresponding pixel locations at which the events or the objects are detected in the video feed. The method may further include querying the spatio-temporal index using the pixel location to determine particular information of an indexed event or an indexed object and receiving the particular information wherein the particular information indicates at least one of spatial and temporal alignment parameters for aligning the indexed event with a corresponding event in at least one other video feed of the filmed occurrence.Type: ApplicationFiled: November 15, 2023Publication date: March 14, 2024Inventors: Edward Shek CHAN, Yu-han CHANG, Rajiv Tharmeswaran MAHESWARAN, Jeffrey Wayne SU
-
Publication number: 20240020856Abstract: A system for processing video of a sporting activity is disclosed. The system comprises: a plurality of portable electronic devices, each of which comprises at least one camera for capturing video of the sporting activity; and one or more aggregated data processing devices. Each portable electronic device is configured to: generate, using its camera(s), video data representative of the sporting activity; perform processing of the video data to generate video analysis data; and transfer the video analysis data to the aggregated data processing device(s). The aggregated data processing device(s) are configured to perform processing of the video analysis data, so as to generate activity analysis data. Apparatus for holding a portable electronic device is also disclosed, which comprises a housing, within which the portable electronic device can be mounted and enclosed, and an active cooling system for cooling the portable electronic device.Type: ApplicationFiled: July 12, 2023Publication date: January 18, 2024Inventors: Kevin William KING, Rajiv Tharmeswaran MAHESWARAN, Tracey Chui Ping HO, Yu-Han CHANG, Alexa Chen Lan CHANG, Jeffrey Wayne SU
-
Patent number: 11861905Abstract: A location in a video may be specified and content related to the location may be accessed. A method for accessing the related content may include receiving a reference to a pixel location in a frame of a video feed of a filmed occurrence and accessing a spatio-temporal index corresponding to the filmed occurrence. The spatio-temporal index may index information relating to events or objects of the filmed occurrence and corresponding pixel locations at which the events or the objects are detected in the video feed. The method may further include querying the spatio-temporal index using the pixel location to determine particular information of an indexed event or an indexed object and receiving the particular information wherein the particular information indicates at least one of spatial and temporal alignment parameters for aligning the indexed event with a corresponding event in at least one other video feed of the filmed occurrence.Type: GrantFiled: April 23, 2021Date of Patent: January 2, 2024Assignee: Genius Sports SS, LLCInventors: Edward Shek Chan, Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su
-
Publication number: 20220335720Abstract: In various embodiments, a Data Processing System for Generating Interactive User Interfaces and Interactive Game Systems Based on Spatiotemporal Analysis of Video Content may be configured to: (1) enable a user to select one or more players participating in a substantially live (e.g., live) sporting or other event; (2) determine scoring data for each of the one or more selected players during the sporting or other event; (3) track the determined scoring data; (4) generate a custom (e.g., to the user) user interface that includes the scoring data; and (5) display the custom user interface over at least a portion of a display screen (e.g., on a mobile computing device) displaying one or more video feeds of the sporting or other event. In this way, the system may be configured to convert a video feed of a sporting event into an interactive game.Type: ApplicationFiled: July 1, 2022Publication date: October 20, 2022Inventors: Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su
-
Publication number: 20220327830Abstract: Data processing systems and methods are disclosed for combining video content with one or more augmentations to produce augmented video. Objects within video content may have associated bounding boxes that may each be associated with respective RGB values. Upon user selection of a pixel, the RGBA value of the pixel may be used to determine a bounding box associated with the RGBA value. The client may transmit an indicator of the determined bounding box to an augmentation system to request augmentation data for the object associated with the bounding box. The system then uses the indicator to determine the augmentation data and transmits the augmentation data to the client device.Type: ApplicationFiled: June 23, 2022Publication date: October 13, 2022Inventors: Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su, Emil Dotchevski, Jason Kent Simon
-
Patent number: 11380101Abstract: In various embodiments, a Data Processing System for Generating Interactive User Interfaces and Interactive Game Systems Based on Spatiotemporal Analysis of Video Content may be configured to: (1) enable a user to select one or more players participating in a substantially live (e.g., live) sporting or other event; (2) determine scoring data for each of the one or more selected players during the sporting or other event; (3) track the determined scoring data; (4) generate a custom (e.g., to the user) user interface that includes the scoring data; and (5) display the custom user interface over at least a portion of a display screen (e.g., on a mobile computing device) displaying one or more video feeds of the sporting or other event. In this way, the system may be configured to convert a video feed of a sporting event into an interactive game.Type: GrantFiled: July 10, 2020Date of Patent: July 5, 2022Assignee: Second Spectrum, Inc.Inventors: Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su
-
Patent number: 11373405Abstract: Data processing systems and methods are disclosed for combining video content with one or more augmentations to produce augmented video. Objects within video content may have associated bounding boxes that may each be associated with respective RGB values. Upon user selection of a pixel, the RGBA value of the pixel may be used to determine a bounding box associated with the RGBA value. The client may transmit an indicator of the determined bounding box to an augmentation system to request augmentation data for the object associated with the bounding box. The system then uses the indicator to determine the augmentation data and transmits the augmentation data to the client device.Type: GrantFiled: August 31, 2020Date of Patent: June 28, 2022Assignee: Second Spectrum, Inc.Inventors: Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su, Emil Dotchevski, Jason Kent Simon
-
Publication number: 20210240992Abstract: A location in a video may be specified and content related to the location may be accessed. A method for accessing the related content may include receiving a reference to a pixel location in a frame of a video feed of a filmed occurrence and accessing a spatio-temporal index corresponding to the filmed occurrence. The spatio-temporal index may index information relating to events or objects of the filmed occurrence and corresponding pixel locations at which the events or the objects are detected in the video feed. The method may further include querying the spatio-temporal index using the pixel location to determine particular information of an indexed event or an indexed object and receiving the particular information wherein the particular information indicates at least one of spatial and temporal alignment parameters for aligning the indexed event with a corresponding event in at least one other video feed of the filmed occurrence.Type: ApplicationFiled: April 23, 2021Publication date: August 5, 2021Inventors: Edward Shek Chan, Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su
-
Patent number: 11023736Abstract: Presenting event-specific video content that conforms to a user selection of an event type includes processing at least one video feed through at least one spatiotemporal pattern recognition algorithm that uses machine learning to develop an understanding of at least one event within the at least one video feed to determine at least one event type, wherein the at least one event type includes an entry in a relationship library at least detailing a relationship between two visible features of the at least one video feed, extracting the video content displaying the at least one event and associating the understanding with the video content in a video content data structure. A user interface is configured to permit a user to indicate a preference for at least one event type that is used to retrieve and provide corresponding extracted video content with the data structure in a new video feed.Type: GrantFiled: March 20, 2020Date of Patent: June 1, 2021Assignee: Second Spectrum, Inc.Inventors: Yu-Han Chang, Rajiv Maheswaran, Jeffrey Wayne Su, Noel Hollingsworth
-
Patent number: 10997425Abstract: A media system generally includes a memory device that stores an event datastore that stores a plurality of event records, each event record corresponding to a respective event and event metadata describing at least one feature of the event. The media system (a) receives a request to generate an aggregated clip comprised of one or more media segments, where each media segment depicts a respective event; (b) for each event record from at least a subset of the plurality of event records, determines an interest level of the event corresponding to the event record; (c) determines one or more events to depict in the aggregated clip based on the respective interest levels of the one or more events; (d) generates the aggregated clip based on the respective media segments that depict the one or more events; and (e) transmits the aggregated clip to a user device.Type: GrantFiled: September 17, 2019Date of Patent: May 4, 2021Assignee: Second Spectrum, Inc.Inventors: Edward Shek Chan, Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su
-
Publication number: 20200401809Abstract: Data processing systems and methods are disclosed for combining video content with one or more augmentations to produce augmented video. Objects within video content may have associated bounding boxes that may each be associated with respective RGB values. Upon user selection of a pixel, the RGBA value of the pixel may be used to determine a bounding box associated with the RGBA value. The client may transmit an indicator of the determined bounding box to an augmentation system to request augmentation data for the object associated with the bounding box. The system then uses the indicator to determine the augmentation data and transmits the augmentation data to the client device.Type: ApplicationFiled: August 31, 2020Publication date: December 24, 2020Inventors: Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su, Emil Dotchevski, Jason Kent Simon
-
Publication number: 20200342233Abstract: In various embodiments, a Data Processing System for Generating Interactive User Interfaces and Interactive Game Systems Based on Spatiotemporal Analysis of Video Content may be configured to: (1) enable a user to select one or more players participating in a substantially live (e.g., live) sporting or other event; (2) determine scoring data for each of the one or more selected players during the sporting or other event; (3) track the determined scoring data; (4) generate a custom (e.g., to the user) user interface that includes the scoring data; and (5) display the custom user interface over at least a portion of a display screen (e.g., on a mobile computing device) displaying one or more video feeds of the sporting or other event. In this way, the system may be configured to convert a video feed of a sporting event into an interactive game.Type: ApplicationFiled: July 10, 2020Publication date: October 29, 2020Inventors: Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su
-
Patent number: 10769446Abstract: Data processing systems and methods are disclosed for combining video content with one or more augmentations to produce augmented video. Objects within video content may have associated bounding boxes that may each be associated with respective RGB values. Upon user selection of a pixel, the RGBA value of the pixel may be used to determine a bounding box associated with the RGBA value. The client may transmit an indicator of the determined bounding box to an augmentation system to request augmentation data for the object associated with the bounding box. The system then uses the indicator to determine the augmentation data and transmits the augmentation data to the client device.Type: GrantFiled: February 20, 2020Date of Patent: September 8, 2020Assignee: Second Spectrum, Inc.Inventors: Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su, Emil Dotchevski, Jason Kent Simon
-
Patent number: 10762351Abstract: Presenting event-specific video content that conforms to a user selection of an event type includes processing at least one video feed through at least one spatiotemporal pattern recognition algorithm that uses machine learning to develop an understanding of at least one event within the at least one video feed to determine at least one event type, wherein the at least one event type includes an entry in a relationship library at least detailing a relationship between two visible features of the at least one video feed, extracting the video content displaying the at least one event and associating the understanding with the video content in a video content data structure. A user interface is configured to permit a user to indicate a preference for at least one event type that is used to retrieve and provide corresponding extracted video content with the data structure in a new video feed.Type: GrantFiled: September 5, 2019Date of Patent: September 1, 2020Assignee: Second Spectrum, Inc.Inventors: Yu-Han Chang, Rajiv Maheswaran, Jeffrey Wayne Su, Noel Hollingsworth
-
Patent number: 10755103Abstract: Interacting with a broadcast video content stream is performed with a machine learning facility that processes a video feed of a video broadcast through a spatiotemporal pattern recognition algorithm that applies machine learning on at least one event in the video feed in order to develop an understanding of the at least one event. Developing the understanding includes identifying context information relating to the at least one event and identifying an entry in a relationship library detailing a relationship between two visible features of the video feed. Interacting is further enabled with a touch screen user interface configured to permit at least one broadcaster to control a portion of the content of the video feed through interaction options that are based on the identified context information. Interacting is further enhanced through an interface configured to permit remote viewers to control the portion of the content.Type: GrantFiled: May 19, 2017Date of Patent: August 25, 2020Assignee: Second Spectrum, Inc.Inventors: Yu-Han Chang, Rajiv Maheswaran, Jeffrey Wayne Su, Noel Hollingsworth
-
Patent number: 10755102Abstract: Producing an event related video content data structure includes processing a video feed through a spatiotemporal pattern recognition algorithm that uses machine learning to develop an understanding of an event within the video feed. Developing the understanding includes identifying context information relating to the event and identifying an entry in a relationship library at least detailing a relationship between two visible features of the video feed. Content of the video feed that displays the event is automatically extracted by a computer and associated with the context information. A video content data structure that includes the context information is produced.Type: GrantFiled: May 19, 2017Date of Patent: August 25, 2020Assignee: Second Spectrum, Inc.Inventors: Yu-Han Chang, Rajiv Maheswaran, Jeffrey Wayne Su, Noel Hollingsworth
-
Patent number: 10748008Abstract: Providing enhanced video content includes processing at least one video feed through at least one spatiotemporal pattern recognition algorithm that uses machine learning to develop an understanding of a plurality of events and to determine at least one event type for each of the plurality of events. The event type includes an entry in a relationship library detailing a relationship between two visible features. Extracting and indexing a plurality of video cuts from the video feed is performed based on the at least one event type determined by the understanding that corresponds to an event in the plurality of events detectable in the video cuts. Lastly, automatically and under computer control, an enhanced video content data structure is generated using the extracted plurality of video cuts based on the indexing of the extracted plurality of video cuts.Type: GrantFiled: March 12, 2019Date of Patent: August 18, 2020Assignee: Second Spectrum, Inc.Inventors: Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su, Noel Hollingsworth
-
Patent number: 10713494Abstract: In various embodiments, a Data Processing System for Generating Interactive User Interfaces and Interactive Game Systems Based on Spatiotemporal Analysis of Video Content may be configured to: (1) enable a user to select one or more players participating in a substantially live (e.g., live) sporting or other event; (2) determine scoring data for each of the one or more selected players during the sporting or other event; (3) track the determined scoring data; (4) generate a custom (e.g., to the user) user interface that includes the scoring data; and (5) display the custom user interface over at least a portion of a display screen (e.g., on a mobile computing device) displaying one or more video feeds of the sporting or other event. In this way, the system may be configured to convert a video feed of a sporting event into an interactive game.Type: GrantFiled: November 6, 2019Date of Patent: July 14, 2020Assignee: Second Spectrum, Inc.Inventors: Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su
-
Publication number: 20200218902Abstract: Presenting event-specific video content that conforms to a user selection of an event type includes processing at least one video feed through at least one spatiotemporal pattern recognition algorithm that uses machine learning to develop an understanding of at least one event within the at least one video feed to determine at least one event type, wherein the at least one event type includes an entry in a relationship library at least detailing a relationship between two visible features of the at least one video feed, extracting the video content displaying the at least one event and associating the understanding with the video content in a video content data structure. A user interface is configured to permit a user to indicate a preference for at least one event type that is used to retrieve and provide corresponding extracted video content with the data structure in a new video feed.Type: ApplicationFiled: March 20, 2020Publication date: July 9, 2020Inventors: Yu-Han Chang, Rajiv Maheswaran, Jeffrey Wayne Su, Noel Hollingsworth
-
Publication number: 20200193163Abstract: Data processing systems and methods are disclosed for combining video content with one or more augmentations to produce augmented video. Objects within video content may have associated bounding boxes that may each be associated with respective RGB values. Upon user selection of a pixel, the RGBA value of the pixel may be used to determine a bounding box associated with the RGBA value. The client may transmit an indicator of the determined bounding box to an augmentation system to request augmentation data for the object associated with the bounding box. The system then uses the indicator to determine the augmentation data and transmits the augmentation data to the client device.Type: ApplicationFiled: February 20, 2020Publication date: June 18, 2020Inventors: Yu-Han Chang, Rajiv Tharmeswaran Maheswaran, Jeffrey Wayne Su, Emil Dotchevski, Jason Kent Simon