Patents by Inventor Aditya Cherukumudi

Aditya Cherukumudi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240095931
    Abstract: A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.
    Type: Application
    Filed: November 17, 2023
    Publication date: March 21, 2024
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Patent number: 11935247
    Abstract: A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.
    Type: Grant
    Filed: February 27, 2023
    Date of Patent: March 19, 2024
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Publication number: 20240087138
    Abstract: A system and method of generating trackable frames from a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a set of frames for classification using a principal component analysis model. The set of frames are a subset of the plurality of video frames. The computing system partitions each frame of the set of frames into a plurality of clusters. The computing system classifies each frame of the plurality of frames as trackable or untrackable. Trackable frames capture a unified view of the sporting event. The computing system compares each cluster to a predetermined threshold to determine whether each cluster comprises at least a threshold number of trackable frames. The computing system classifies each cluster that includes at least the threshold number of trackable frames as trackable.
    Type: Application
    Filed: November 20, 2023
    Publication date: March 14, 2024
    Applicant: Stats LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Publication number: 20240046483
    Abstract: A system and method of generating a player tracking prediction are described herein. A computing system retrieves a broadcast video feed for a sporting event. The computing system segments the broadcast video feed into a unified view. The computing system generates a plurality of data sets based on the plurality of trackable frames. The computing system calibrates a camera associated with each trackable frame based on the body pose information. The computing system generates a plurality of sets of short tracklets based on the plurality of trackable frames and the body pose information. The computing system connects each set of short tracklets by generating a motion field vector for each player in the plurality of trackable frames. The computing system predicts a future motion of a player based on the player's motion field vector using a neural network.
    Type: Application
    Filed: October 18, 2023
    Publication date: February 8, 2024
    Applicant: Stats LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Patent number: 11861848
    Abstract: A system and method of generating trackable frames from a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a set of frames for classification using a principal component analysis model. The set of frames are a subset of the plurality of video frames. The computing system partitions each frame of the set of frames into a plurality of clusters. The computing system classifies each frame of the plurality of frames as trackable or untrackable. Trackable frames capture a unified view of the sporting event. The computing system compares each cluster to a predetermined threshold to determine whether each cluster comprises at least a threshold number of trackable frames. The computing system classifies each cluster that includes at least the threshold number of trackable frames as trackable.
    Type: Grant
    Filed: July 1, 2022
    Date of Patent: January 2, 2024
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Patent number: 11861850
    Abstract: A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.
    Type: Grant
    Filed: February 17, 2023
    Date of Patent: January 2, 2024
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Patent number: 11830202
    Abstract: A system and method of generating a player tracking prediction are described herein. A computing system retrieves a broadcast video feed for a sporting event. The computing system segments the broadcast video feed into a unified view. The computing system generates a plurality of data sets based on the plurality of trackable frames. The computing system calibrates a camera associated with each trackable frame based on the body pose information. The computing system generates a plurality of sets of short tracklets based on the plurality of trackable frames and the body pose information. The computing system connects each set of short tracklets by generating a motion field vector for each player in the plurality of trackable frames. The computing system predicts a future motion of a player based on the player's motion field vector using a neural network.
    Type: Grant
    Filed: November 22, 2021
    Date of Patent: November 28, 2023
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Publication number: 20230377337
    Abstract: A computing system retrieves ball-by-ball data for a plurality of sporting events. The computing system generates a trained neural network based on ball-by-ball data supplemented with ball-by-ball data with ball-by-ball match context features and personalized embeddings based on a batsman and a bowler for each delivery. The computing system receives a target batsman and a target bowler for a pitch to be delivered in a target event. The computing system identifies target ball-by-ball data for a window of pitches preceding the to be delivered pitch. The computing system retrieves historical ball-by-ball data for each of the target batsman and the target bowler. The computing system generates personalized embeddings for both the target batsman and the target bowler based on the historical ball-by-ball data. The computing system predicts a shot type for the pitch to be delivered based on the target ball-by-ball data and the personalized embeddings.
    Type: Application
    Filed: July 31, 2023
    Publication date: November 23, 2023
    Applicant: STATS LLC
    Inventors: William Thomas Gurpinar-Morgan, Daniel Richard Dinsdale, Joe Dominic Gallagher, Aditya Cherukumudi, Paul David Power, Patrick Joseph Lucey
  • Publication number: 20230330485
    Abstract: A method of generating a player prediction is disclosed herein. A computing system retrieves data from a data store. The computing system generates a predictive model using an artificial neural network. The artificial neural network generates one or more personalized embeddings that include player-specific information based on historical performance. The computing system selects, from the data, one or more features related to each shot attempt captured in the data. The artificial neural network learns an outcome of each shot attempt based at least on the one or more personalized embeddings and the one or more features related to each shot attempt.
    Type: Application
    Filed: June 16, 2023
    Publication date: October 19, 2023
    Applicant: STATS LLC
    Inventors: Paul David Power, Aditya Cherukumudi, Sujoy Ganguly, Xinyu Wei, Long Sha, Jennifer Hobbs, Hector Ruiz, Patrick Joseph Lucey
  • Patent number: 11715303
    Abstract: A computing system retrieves ball-by-ball data for a plurality of sporting events. The computing system generates a trained neural network based on ball-by-ball data supplemented with ball-by-ball data with ball-by-ball match context features and personalized embeddings based on a batsman and a bowler for each delivery. The computing system receives a target batsman and a target bowler for a pitch to be delivered in a target event. The computing system identifies target ball-by-ball data for a window of pitches preceding the to be delivered pitch. The computing system retrieves historical ball-by-ball data for each of the target batsman and the target bowler. The computing system generates personalized embeddings for both the target batsman and the target bowler based on the historical ball-by-ball data. The computing system predicts a shot type for the pitch to be delivered based on the target ball-by-ball data and the personalized embeddings.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: August 1, 2023
    Assignee: STATS LLC
    Inventors: William Thomas Gurpinar-Morgan, Daniel Richard Dinsdale, Joe Dominic Gallagher, Aditya Cherukumudi, Paul David Power, Patrick Joseph Lucey
  • Publication number: 20230206465
    Abstract: A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.
    Type: Application
    Filed: February 27, 2023
    Publication date: June 29, 2023
    Applicant: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Publication number: 20230206464
    Abstract: A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.
    Type: Application
    Filed: February 17, 2023
    Publication date: June 29, 2023
    Applicant: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Patent number: 11679299
    Abstract: A method of generating a player prediction is disclosed herein. A computing system retrieves data from a data store. The computing system generates a predictive model using an artificial neural network. The artificial neural network generates one or more personalized embeddings that include player-specific information based on historical performance. The computing system selects, from the data, one or more features related to each shot attempt captured in the data. The artificial neural network learns an outcome of each shot attempt based at least on the one or more personalized embeddings and the one or more features related to each shot attempt.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: June 20, 2023
    Assignee: STATS LLC
    Inventors: Paul David Power, Aditya Cherukumudi, Sujoy Ganguly, Xinyu Wei, Long Sha, Jennifer Hobbs, Hector Ruiz, Patrick Joseph Lucey
  • Patent number: 11593581
    Abstract: A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: February 28, 2023
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Patent number: 11586840
    Abstract: A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: February 21, 2023
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Publication number: 20220343110
    Abstract: A system and method of generating trackable frames from a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a set of frames for classification using a principal component analysis model. The set of frames are a subset of the plurality of video frames. The computing system partitions each frame of the set of frames into a plurality of clusters. The computing system classifies each frame of the plurality of frames as trackable or untrackable. Trackable frames capture a unified view of the sporting event. The computing system compares each cluster to a predetermined threshold to determine whether each cluster comprises at least a threshold number of trackable frames. The computing system classifies each cluster that includes at least the threshold number of trackable frames as trackable.
    Type: Application
    Filed: July 1, 2022
    Publication date: October 27, 2022
    Applicant: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Patent number: 11379683
    Abstract: A system and method of generating trackable frames from a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a set of frames for classification using a principal component analysis model. The set of frames are a subset of the plurality of video frames. The computing system partitions each frame of the set of frames into a plurality of clusters. The computing system classifies each frame of the plurality of frames as trackable or untrackable. Trackable frames capture a unified view of the sporting event. The computing system compares each cluster to a predetermined threshold to determine whether each cluster comprises at least a threshold number of trackable frames. The computing system classifies each cluster that includes at least the threshold number of trackable frames as trackable.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: July 5, 2022
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Publication number: 20220092344
    Abstract: A system and method of generating a player tracking prediction are described herein. A computing system retrieves a broadcast video feed for a sporting event. The computing system segments the broadcast video feed into a unified view. The computing system generates a plurality of data sets based on the plurality of trackable frames. The computing system calibrates a camera associated with each trackable frame based on the body pose information. The computing system generates a plurality of sets of short tracklets based on the plurality of trackable frames and the body pose information. The computing system connects each set of short tracklets by generating a motion field vector for each player in the plurality of trackable frames. The computing system predicts a future motion of a player based on the player's motion field vector using a neural network.
    Type: Application
    Filed: November 22, 2021
    Publication date: March 24, 2022
    Applicant: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Publication number: 20220076054
    Abstract: A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.
    Type: Application
    Filed: November 15, 2021
    Publication date: March 10, 2022
    Applicant: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Patent number: 11182642
    Abstract: A system and method of generating a player tracking prediction are described herein. A computing system retrieves a broadcast video feed for a sporting event. The computing system segments the broadcast video feed into a unified view. The computing system generates a plurality of data sets based on the plurality of trackable frames. The computing system calibrates a camera associated with each trackable frame based on the body pose information. The computing system generates a plurality of sets of short tracklets based on the plurality of trackable frames and the body pose information. The computing system connects each set of short tracklets by generating a motion field vector for each player in the plurality of trackable frames. The computing system predicts a future motion of a player based on the player's motion field vector using a neural network.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: November 23, 2021
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi