Patents Assigned to STATS LLC
  • Publication number: 20240095874
    Abstract: A system and method of calibrating a broadcast video feed are disclosed herein. A computing system retrieves a plurality of broadcast video feeds that include a plurality of video frames. The computing system generates a trained neural network, by generating a plurality of training data sets based on the broadcast video feed and learning, by the neural network, to generate a homography matrix for each frame of the plurality of frames. The computing system receives a target broadcast video feed for a target sporting event. The computing system partitions the target broadcast video feed into a plurality of target frames. The computing system generates for each target frame in the plurality of target frames, via the neural network, a target homography matrix. The computing system calibrates the target broadcast video feed by warping each target frame by a respective target homography matrix.
    Type: Application
    Filed: November 20, 2023
    Publication date: March 21, 2024
    Applicant: Stats LLC
    Inventors: Long Sha, Sujoy Ganguly, Patrick Joseph Lucey
  • Patent number: 11935298
    Abstract: A system and method of predicting a team's formation on a playing surface are disclosed herein. A computing system retrieves one or more sets of event data for a plurality of events. Each set of event data corresponds to a segment of the event. A deep neural network, such as a mixture density network, learns to predict an optimal permutation of players in each segment of the event based on the one or more sets of event data. The deep neural network learns a distribution of players for each segment based on the corresponding event data and optimal permutation of players. The computing system generates a fully trained prediction model based on the learning. The computing system receives target event data corresponding to a target event. The computing system generates, via the trained prediction model, an expected position of each player based on the target event data.
    Type: Grant
    Filed: May 27, 2021
    Date of Patent: March 19, 2024
    Assignee: STATS LLC
    Inventors: Jennifer Hobbs, Sujoy Ganguly, Patrick Joseph Lucey
  • Patent number: 11935247
    Abstract: A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.
    Type: Grant
    Filed: February 27, 2023
    Date of Patent: March 19, 2024
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Publication number: 20240087138
    Abstract: A system and method of generating trackable frames from a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a set of frames for classification using a principal component analysis model. The set of frames are a subset of the plurality of video frames. The computing system partitions each frame of the set of frames into a plurality of clusters. The computing system classifies each frame of the plurality of frames as trackable or untrackable. Trackable frames capture a unified view of the sporting event. The computing system compares each cluster to a predetermined threshold to determine whether each cluster comprises at least a threshold number of trackable frames. The computing system classifies each cluster that includes at least the threshold number of trackable frames as trackable.
    Type: Application
    Filed: November 20, 2023
    Publication date: March 14, 2024
    Applicant: Stats LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Patent number: 11918897
    Abstract: A computing system retrieves historical event data for a plurality of games in a league. The historical event data includes (x,y) coordinates of players within each game and game context data. The computing system learns one or more attributes of each team in each game and each player on each team in each game. The computing system receives a request to simulate a play in a historical game. The request includes substituting a player that was in the play with a target player that was not in the play. The computing system simulates the play with the target player in place of the player based on the one or more attributes learned by the computing system. The computing system generates a graphical representation of the simulation.
    Type: Grant
    Filed: April 27, 2022
    Date of Patent: March 5, 2024
    Assignee: STATS LLC
    Inventor: Patrick Joseph Lucey
  • Patent number: 11922968
    Abstract: A boundary of a highlight of audiovisual content depicting an event is identified. The audiovisual content may be a broadcast, such as a television broadcast of a sporting event. The highlight may be a segment of the audiovisual content deemed to be of particular interest. Audio data for the audiovisual content is stored, and the audio data is automatically analyzed to detect one or more audio events indicative of one or more occurrences to be included in the highlight. Each audio event may be a brief, high-energy audio burst such as the sound made by a tennis serve. A time index within the audiovisual content, before or after the audio event, may be designated as the boundary, which may be the beginning or end of the highlight.
    Type: Grant
    Filed: February 25, 2022
    Date of Patent: March 5, 2024
    Assignee: STATS LLC
    Inventors: Mihailo Stojancic, Warren Packard
  • Publication number: 20240070770
    Abstract: A computing system generates a portal to be accessed by a plurality of users. The portal includes a representation of a game and a plurality of gamification elements. The computing system receives data related to the game represented in the portal. The computing system monitors the data to detect an event to occur within the game. Based on the monitoring, the computing system determines that the event has occurred within the game. Based on the determining, the computing system generates a graphic associated with the event. The computing system generates a non-fungible token corresponding to the event. The non-fungible token is linked to the graphic. The computing system broadcasts the non-fungible token to a blockchain.
    Type: Application
    Filed: August 21, 2023
    Publication date: February 29, 2024
    Applicant: STATS LLC
    Inventors: Christian Marko, Matjaz Ales, Lukas Marek, Shaun McMurray, Vadim Torosyan, Markus Klausmann
  • Publication number: 20240066355
    Abstract: A computing system receives historical match data associated with a plurality of tennis players. The computing system generates player rankings. The player rankings include a player ranking for each tennis player of the plurality of tennis players based on the historical match data. The computing system receives information associated with a tennis tournament. The information includes a subset of tennis players in the tournament and a seeding of each tennis player in the subset of tennis players. The computing system generates initial predictions based on the information associated with the tournament and the player rankings. The computing system identifies a trigger event that causes an update to the initial predictions. Responsive to identifying the trigger event, the computing system generates an updated predictions based on in-match data. The in-match data includes a change to a score in a match of the tournament. The computing system outputs the updated predictions.
    Type: Application
    Filed: August 23, 2023
    Publication date: February 29, 2024
    Applicant: STATS LLC
    Inventors: Robert Seidl, Peter McKeever, Ysabel Gonzalez-Rico
  • Patent number: 11908191
    Abstract: A computing system identifies broadcast video data for a game. The computing system generates tracking data for the game from the broadcast video data using computer vision techniques. The tracking data includes coordinates of players during the game. The computing system generates optical character recognition data for the game from the broadcast video data by applying one or more optical character recognition techniques to each frame of the plurality of frames to extract score and time information from a scoreboard displayed in each frame. The computing system detects a plurality of events that occurred in the game by applying one or more machine learning techniques to the tracking data. The computing system receives play-by-play data for the game. The computing system generates enriched tracking data. The generating includes merging the play-by-play data with one or more of the tracking data, the optical character recognition data, and the plurality of events.
    Type: Grant
    Filed: October 1, 2021
    Date of Patent: February 20, 2024
    Assignee: Stats LLC
    Inventors: Alex Ottenwess, Matthew Scott, Ken Rhodes, Patrick Joseph Lucey
  • Patent number: 11902603
    Abstract: A computing system receives a video stream of a game. The computing system generates tracking data corresponding to the video stream using one or more artificial intelligence models. The computing system generates interactive video data by combining the video stream of the game with the tracking data. The computing system causes a media player to render graphics corresponding to the tracking data over the video stream by sending the interactive video data to a client device executing the media player.
    Type: Grant
    Filed: August 19, 2022
    Date of Patent: February 13, 2024
    Assignee: STATS LLC
    Inventors: Sateesh Pedagadi, Johannes Kuehnel, Bradford Griffiths, Christian Marko, Raphael Reiners, Brian Orefice, Patrick Joseph Lucey
  • Patent number: 11900254
    Abstract: A method of generating a multi-modal prediction is disclosed herein. A computing system retrieves event data from a data store. The event data includes information for a plurality of events across a plurality of seasons. Computing system generates a predictive model using a mixture density network, by generating an input vector from the event data learning, by the mixture density network, a plurality of values associated with a next play following each play in the event data. The mixture density network is trained to output the plurality of values near simultaneously. Computing system receives a set of event data directed to an event in a match. The set of event data includes information directed to at least playing surface position and current score. Computing system generates, via the predictive model, a plurality of values associated with a next event following the event based on the set of event data.
    Type: Grant
    Filed: February 27, 2023
    Date of Patent: February 13, 2024
    Assignee: STATS LLC
    Inventors: Matthew Holbrook, Jennifer Hobbs, Patrick Joseph Lucey
  • Publication number: 20240046483
    Abstract: A system and method of generating a player tracking prediction are described herein. A computing system retrieves a broadcast video feed for a sporting event. The computing system segments the broadcast video feed into a unified view. The computing system generates a plurality of data sets based on the plurality of trackable frames. The computing system calibrates a camera associated with each trackable frame based on the body pose information. The computing system generates a plurality of sets of short tracklets based on the plurality of trackable frames and the body pose information. The computing system connects each set of short tracklets by generating a motion field vector for each player in the plurality of trackable frames. The computing system predicts a future motion of a player based on the player's motion field vector using a neural network.
    Type: Application
    Filed: October 18, 2023
    Publication date: February 8, 2024
    Applicant: Stats LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Publication number: 20240033600
    Abstract: A computing system retrieves historical hole-by-hole data for a plurality of holes for plurality of golf tournaments for a plurality of players. The computing system clusters the plurality of holes into a plurality of clusters of hole types. The computing system generates a strokes gained metric for each hole type of the hole-by-hole data for each player. The computing system adjusts the strokes gained metric for each hole type. The computing system generates a probability of player performance of each player for each hole in the target tournament based at least one the adjusted strokes gained metric. The probability of player performance includes a probability of each player achieving each possible score for each hole. The computing system generates a projected outcome of the tournament by simulating player performance using the probability of player performance of each player.
    Type: Application
    Filed: July 28, 2023
    Publication date: February 1, 2024
    Applicant: STATS LLC
    Inventors: Kyle Cunningham-Rhoads, Peter McKeever
  • Patent number: 11882345
    Abstract: Customized highlight shows for sporting events, entertainment events, and/or the like, having a narrative component, are generated and presented. The events can be sporting events, entertainment events, and/or the like. For example, in the context of sporting events, a determination is made as to what types of sports, teams, leagues, players, plays, and/or the like are of interest to the user. A customized highlight show is then generated and presented, containing those specific portions of the sporting events that are likely to be of interest, arranged in a manner that is likely to be entertaining and interesting to the user and that presents a cohesive narrative.
    Type: Grant
    Filed: February 9, 2023
    Date of Patent: January 23, 2024
    Assignee: STATS LLC
    Inventors: Warren Joseph Packard, Dennis Kanygin, Jordan Toor, Dan Lythcott-Haims, Alan Levin
  • Patent number: 11861806
    Abstract: A system and method of calibrating a broadcast video feed are disclosed herein. A computing system retrieves a plurality of broadcast video feeds that include a plurality of video frames. The computing system generates a trained neural network, by generating a plurality of training data sets based on the broadcast video feed and learning, by the neural network, to generate a homography matrix for each frame of the plurality of frames. The computing system receives a target broadcast video feed for a target sporting event. The computing system partitions the target broadcast video feed into a plurality of target frames. The computing system generates for each target frame in the plurality of target frames, via the neural network, a target homography matrix. The computing system calibrates the target broadcast video feed by warping each target frame by a respective target homography matrix.
    Type: Grant
    Filed: April 9, 2021
    Date of Patent: January 2, 2024
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Patrick Joseph Lucey
  • Patent number: 11863848
    Abstract: Customized highlight shows for sporting events, entertainment events, and/or the like, may be generated and presented. Source content with a representation of one or more events, such as sports events, may be obtained. A user may designate an attribute and/or a viewing length. A subset of the source content with highlights from within the source content may be selected such that the subset has the attribute and/or viewing length designated by the user. A customized highlight show including the subset may be generated and outputted to the user, for example, on a display screen. The attribute may include a team playing in the sporting events, a player playing in the sporting events, and/or a type of play occurring in the sporting events. The subset may optionally be generated based on teams and/or players in one or more fantasy sports teams.
    Type: Grant
    Filed: September 14, 2016
    Date of Patent: January 2, 2024
    Assignee: STATS LLC
    Inventors: Dan Lythcott-Haims, Warren Joseph Packard, Jordan Toor
  • Patent number: 11861850
    Abstract: A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.
    Type: Grant
    Filed: February 17, 2023
    Date of Patent: January 2, 2024
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Patent number: 11861848
    Abstract: A system and method of generating trackable frames from a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a set of frames for classification using a principal component analysis model. The set of frames are a subset of the plurality of video frames. The computing system partitions each frame of the set of frames into a plurality of clusters. The computing system classifies each frame of the plurality of frames as trackable or untrackable. Trackable frames capture a unified view of the sporting event. The computing system compares each cluster to a predetermined threshold to determine whether each cluster comprises at least a threshold number of trackable frames. The computing system classifies each cluster that includes at least the threshold number of trackable frames as trackable.
    Type: Grant
    Filed: July 1, 2022
    Date of Patent: January 2, 2024
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Publication number: 20230412900
    Abstract: A customized highlight sequence depicting multiple events, and based on a user's personal characteristics, interests, and/or preferences, is generated and presented. The events can be sporting events, entertainment events, and/or the like. For example, in the context of sporting events, a determination is made as to what types of sports, teams, leagues, players, plays, and/or the like are of interest to the user. In at least one embodiment, the amount of time available to the user can be obtained, so that the length of the highlight sequence can be tailored to the available time. A customized highlight sequence is then generated and presented, containing those specific portions of the sporting events that are likely to be of interest, arranged in a manner that is likely to be entertaining to the user and comports with the time restrictions.
    Type: Application
    Filed: August 31, 2023
    Publication date: December 21, 2023
    Applicant: STATS LLC
    Inventors: Warren Joseph PACKARD, Dan LYTHCOTT-HAIMS, Alan LEVIN
  • Publication number: 20230394728
    Abstract: A computing system receives a prompt to generate a data sticker for a sporting event. The data sticker includes one or more graphical representations of sports analytics data. The computing system parses the prompt to identify individual components of the prompt. The computing system generates, using a generative artificial intelligence model, the one or more graphical representations based on the individual components of the prompt. The computing system generates an image file comprising the data sticker.
    Type: Application
    Filed: June 1, 2023
    Publication date: December 7, 2023
    Applicant: STATS LLC
    Inventors: Kevin Allinson, Anthony Borsumato, Matthew Chamberlain, Jimmy Coverdale, Andrew Skweres, Patrick Joseph Lucey