Patents Assigned to STATS LLC
  • Publication number: 20220027631
    Abstract: Metadata for one or more highlights of a video stream may be extracted from one or more card images embedded in the video stream. The highlights may be segments of the video stream, such as a broadcast of a sporting event, that are of particular interest. According to one method, video frames of the video stream are stored. One or more information cards embedded in a decoded video frame may be detected by analyzing one or more predetermined video frame regions. Image segmentation, edge detection, and/or closed contour identification may then be performed on identified video frame region(s). Further processing may include obtaining a minimum rectangular perimeter area enclosing all remaining segments, which may then be further processed to determine precise boundaries of information card(s). The card image(s) may be analyzed to obtain metadata, which may be stored in association with at least one of the video frames.
    Type: Application
    Filed: October 4, 2021
    Publication date: January 27, 2022
    Applicant: STATS LLC
    Inventors: Mihailo Stojancic, Warren Packard, Dennis Kanygin
  • Publication number: 20210383123
    Abstract: A system and method of predicting a team's formation on a playing surface are disclosed herein. A computing system retrieves one or more sets of event data for a plurality of events. Each set of event data corresponds to a segment of the event. A deep neural network, such as a mixture density network, learns to predict an optimal permutation of players in each segment of the event based on the one or more sets of event data. The deep neural network learns a distribution of players for each segment based on the corresponding event data and optimal permutation of players. The computing system generates a fully trained prediction model based on the learning. The computing system receives target event data corresponding to a target event. The computing system generates, via the trained prediction model, an expected position of each player based on the target event data.
    Type: Application
    Filed: May 27, 2021
    Publication date: December 9, 2021
    Applicant: STATS LLC
    Inventors: Jennifer Hobbs, Sujoy Ganguly, Patrick Joseph Lucey
  • Publication number: 20210374419
    Abstract: A method and system of generating agent and actions prediction based on multi-agent tracking data are disclosed herein. A computing system retrieves tracking data from a data store. The computing system generates a trained neural network by generating a plurality of training data sets based on the tracking data by converting each frame of data into a matrix representation of the data contained in the frame and learning, by the neural network, a start frame and end frame of each action contained in the frame and its associated actor. The computing system receives target tracking data associated with an event. The target tracking data includes a plurality of actors and a plurality of actions. The computing system generates, via the trained neural network, a target start frame and a target end frame of each action identified in the tracking data and a corresponding actor.
    Type: Application
    Filed: May 27, 2021
    Publication date: December 2, 2021
    Applicant: STATS LLC
    Inventors: Xinyu Wei, Jennifer Hobbs, Long Sha, Patrick Joseph Lucey, Sujoy Ganguly
  • Patent number: 11182642
    Abstract: A system and method of generating a player tracking prediction are described herein. A computing system retrieves a broadcast video feed for a sporting event. The computing system segments the broadcast video feed into a unified view. The computing system generates a plurality of data sets based on the plurality of trackable frames. The computing system calibrates a camera associated with each trackable frame based on the body pose information. The computing system generates a plurality of sets of short tracklets based on the plurality of trackable frames and the body pose information. The computing system connects each set of short tracklets by generating a motion field vector for each player in the plurality of trackable frames. The computing system predicts a future motion of a player based on the player's motion field vector using a neural network.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: November 23, 2021
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Patent number: 11176411
    Abstract: A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: November 16, 2021
    Assignee: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Publication number: 20210322825
    Abstract: A system and method for predicting next pitch are disclosed herein. A computing system retrieves pitch-by-pitch information for a plurality of events and game context information associated with each pitch in the pitch-by-pitch information. The computing system converts the pitch-by-pitch information and the game context information into a plurality of graph-based representation. A graph neural network learns to generate a pitch type prediction for each pitch based on the plurality of graph-based representations. The computing system generates a trained graph neural network based on the learning. The computing system receives a current graph-based representation of current pitch-by-pitch information for a current pitcher and current game context information. The computing system predicts, via the trained graph neural network, a pitch type for the next pitch to be delivered from the current pitcher.
    Type: Application
    Filed: April 9, 2021
    Publication date: October 21, 2021
    Applicant: STATS LLC
    Inventors: Daniel Edison Marley, Matthew Thomas O'Connor, Alexander Nicholas Ottenwess, Aiman Sherani, Matthew Holbrook
  • Publication number: 20210319587
    Abstract: A system and method of calibrating a broadcast video feed are disclosed herein. A computing system retrieves a plurality of broadcast video feeds that include a plurality of video frames. The computing system generates a trained neural network, by generating a plurality of training data sets based on the broadcast video feed and learning, by the neural network, to generate a homography matrix for each frame of the plurality of frames. The computing system receives a target broadcast video feed for a target sporting event. The computing system partitions the target broadcast video feed into a plurality of target frames. The computing system generates for each target frame in the plurality of target frames, via the neural network, a target homography matrix. The computing system calibrates the target broadcast video feed by warping each target frame by a respective target homography matrix.
    Type: Application
    Filed: April 9, 2021
    Publication date: October 14, 2021
    Applicant: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Patrick Joseph Lucey
  • Patent number: 11138438
    Abstract: Metadata for one or more highlights of a video stream may be extracted from one or more card images embedded in the video stream. The highlights may be segments of the video stream, such as a broadcast of a sporting event, that are of particular interest. According to one method, video frames of the video stream are stored. One or more information cards embedded in a decoded video frame may be detected by analyzing one or more predetermined video frame regions. Image segmentation, edge detection, and/or closed contour identification may then be performed on identified video frame region(s). Further processing may include obtaining a minimum rectangular perimeter area enclosing all remaining segments, which may then be further processed to determine precise boundaries of information card(s). The card image(s) may be analyzed to obtain metadata, which may be stored in association with at least one of the video frames.
    Type: Grant
    Filed: May 14, 2019
    Date of Patent: October 5, 2021
    Assignee: STATS LLC
    Inventors: Mihailo Stojancic, Warren Packard, Dennis Kanygin
  • Publication number: 20210256265
    Abstract: A computing system retrieves ball-by-ball data for a plurality of sporting events. The computing system generates a trained neural network based on ball-by-ball data supplemented with ball-by-ball data with ball-by-ball match context features and personalized embeddings based on a batsman and a bowler for each delivery. The computing system receives a target batsman and a target bowler for a pitch to be delivered in a target event. The computing system identifies target ball-by-ball data for a window of pitches preceding the to be delivered pitch. The computing system retrieves historical ball-by-ball data for each of the target batsman and the target bowler. The computing system generates personalized embeddings for both the target batsman and the target bowler based on the historical ball-by-ball data. The computing system predicts a shot type for the pitch to be delivered based on the target ball-by-ball data and the personalized embeddings.
    Type: Application
    Filed: February 4, 2021
    Publication date: August 19, 2021
    Applicant: STATS LLC
    Inventors: William Thomas Gurpinar-Morgan, Daniel Richard Dinsdale, Joe Dominic Gallagher, Aditya Cherukumudi, Paul David Power, Patrick Joseph Lucey
  • Patent number: 11087095
    Abstract: The present invention is a system and method for optimizing the narrative text generated by one or more narrative frameworks that utilize data input from one or more data sources to drive the creation of a narrative text output. Narrative text is generated in accordance with sets of data that provide the scope of text to be generated. A Quality Assurance module presents the narrative text output to a user that reviews both the condition and the logic evaluation associated with the scope, and the quality of the generated text. A log of Quality Assurance items is created upon review of the generated text. These items are then later resolved by locating them in a narrative text generation data structure to resolve the identified issues.
    Type: Grant
    Filed: February 20, 2015
    Date of Patent: August 10, 2021
    Assignee: STATS LLC
    Inventors: Adam Long, Robert Allen, Anne Johnson
  • Publication number: 20210241145
    Abstract: A system and method for generating a role summary associated with one or more players are disclosed herein. A computing system retrieves event information for a plurality of teams for a plurality of events. The computing system generates a spatial output that describes each player. The computing system identifies a playing style associated with each team. The computing system identifies a subset of paths a player or team takes between two zones. The computing system identifies each player's involvement in a team's process. The computing system generates a score corresponding to a value of a player's involvement in a given play based on the event information. The computing system generates a score associated with each player's passing ability based on the event information. The computing system determines a shot style of each player based on the event information. The computing system identifies a role associated with each player.
    Type: Application
    Filed: February 4, 2021
    Publication date: August 5, 2021
    Applicant: STATS LLC
    Inventors: Paul David Power, William Thomas Gurpinar-Morgan, Daniel Richard Dinsdale, Joe Dominic Gallagher, Nils Sebastiaan Mackaij
  • Patent number: 11025985
    Abstract: Metadata for highlights of audiovisual content depicting a sporting event or other event are extracted from audiovisual content. The highlights may be segments of the content, such as a broadcast of a sporting event, that are of particular interest. Audio data for the audiovisual content is stored, and portions of the audio data indicating crowd excitement (noise) is automatically identified by analyzing an audio signal in the joint time and frequency domains. Multiple indicators are derived and subsequently processed to detect, validate, and render occurrences of crowd noise. Metadata are automatically generated, including time of occurrence, level of noise (excitement), and duration of cheering. Metadata may be stored, comprising at least a time index indicating a time, within the audiovisual content, at which each of the portions occurs. Periods of intense crowd noise may be used to identify highlights and/or to indicate crowd excitement during viewing of a highlight.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: June 1, 2021
    Assignee: STATS LLC
    Inventors: Mihailo Stojancic, Warren Packard
  • Publication number: 20210117735
    Abstract: A system is described for analyzing plays of a sporting event based on body-pose information in conjunction with real-world positional tracking data. The system permits segmentation of sporting event plays into discrete time periods and the labeling of appropriate body-pose characteristics for each period. The system allows for comparison and fine-grained analysis of plays with respect to either a series of body-pose vertices that exist in continuous space (i.e., skeleton) or map directly to attributes, using the positional tracking data and play information to account for contextual differences. To enable analysis for the former, the system performs a projection to 3D space, followed by a spatiotemporal alignment step. Through the system, the importance of particular body-pose motions or specific attributes to the success of particular sporting event plays is quantified.
    Type: Application
    Filed: November 2, 2020
    Publication date: April 22, 2021
    Applicant: STATS LLC
    Inventors: Panna FELSEN, Patrick LUCEY
  • Publication number: 20210097418
    Abstract: A computing system retrieves player tracking data for a plurality of players across a plurality of events. The player tracking data includes coordinates of player positions during each event. The computing system initializes the player tracking data based on an average position of each player in the plurality of events. The computing system learns an optimal formation of player positions based on the player tracking data using a Gaussian mixture model. The computing system aligns the optimal formation of player positions to a global template by identifying a distance between each distribution in the optimal formation and each distribution in the global template to generate a learned formation template. The computing system assigns a role to each player in the learned template.
    Type: Application
    Filed: September 25, 2020
    Publication date: April 1, 2021
    Applicant: STATS LLC
    Inventors: Jennifer Hobbs, Patrick Joseph Lucey
  • Publication number: 20200353311
    Abstract: A system and method for generating a play prediction for a team is disclosed herein. A computing system retrieves trajectory data for a plurality of plays from a data store. The computing system generates a predictive model using a variational autoencoder and a neural network by generating one or more input data sets, learning, by the variational autoencoder, to generate a plurality of variants for each play of the plurality of plays, and learning, by the neural network, a team style corresponding to each play of the plurality of plays. The computing system receives trajectory data corresponding to a target play. The predictive model generates a likelihood of a target team executing the target play by determining a number of target variants that correspond to a target team identity of the target team.
    Type: Application
    Filed: May 8, 2020
    Publication date: November 12, 2020
    Applicant: STATS LLC
    Inventors: Sujoy Ganguly, Long Sha, Jennifer Hobbs, Xinyu Wei, Patrick Joseph Lucey
  • Patent number: 10824918
    Abstract: A system is described for analyzing plays of a sporting event based on body-pose information in conjunction with real-world positional tracking data. The system permits segmentation of sporting event plays into discrete time periods and the labeling of appropriate body-pose characteristics for each period. The system allows for comparison and fine-grained analysis of plays with respect to either a series of body-pose vertices that exist in continuous space (i.e., skeleton) or map directly to attributes, using the positional tracking data and play information to account for contextual differences. To enable analysis for the former, the system performs a projection to 3D space, followed by a spatiotemporal alignment step. Through the system, the importance of particular body-pose motions or specific attributes to the success of particular sporting event plays is quantified.
    Type: Grant
    Filed: January 31, 2018
    Date of Patent: November 3, 2020
    Assignee: STATS LLC
    Inventors: Panna Felsen, Patrick Lucey
  • Patent number: 10817666
    Abstract: The present invention is a method and apparatus for narrative content generation using narrative frameworks by receiving a first phrase variation and a second phrase variation and displaying an error indication when the first phrase variation fails to satisfy a criterion relative to the second phrase variation. If there is an error indication, alternate phrase variations are received and compared against the first phrase variation until an alternate phrase variation is selected that has no error indication. Additionally, multiple sets of operators for updating one or more narrative phrases selected for inclusion in the narrative content framework may be utilized to update selected phrases after inclusion in the narrative framework but prior to finalizing the narrative content to be output.
    Type: Grant
    Filed: December 12, 2016
    Date of Patent: October 27, 2020
    Assignee: STATS LLC
    Inventors: Robert Allen, Joe Procopio, Robert C Rogers
  • Publication number: 20200276474
    Abstract: A method of generating a player prediction is disclosed herein. A computing system retrieves data from a data store. The computing system generates a predictive model using an artificial neural network. The artificial neural network generates one or more personalized embeddings that include player-specific information based on historical performance. The computing system selects, from the data, one or more features related to each shot attempt captured in the data. The artificial neural network learns an outcome of each shot attempt based at least on the one or more personalized embeddings and the one or more features related to each shot attempt.
    Type: Application
    Filed: February 28, 2020
    Publication date: September 3, 2020
    Applicant: STATS LLC
    Inventors: Paul David Power, Aditya Cherukumudi, Sujoy Ganguly, Xinyu Wei, Long Sha, Jennifer Hobbs, Hector Ruiz, Patrick Joseph Lucey
  • Publication number: 20200279115
    Abstract: A system and method of generating a player tracking prediction are described herein. A computing system retrieves a broadcast video feed for a sporting event. The computing system segments the broadcast video feed into a unified view. The computing system generates a plurality of data sets based on the plurality of trackable frames. The computing system calibrates a camera associated with each trackable frame based on the body pose information. The computing system generates a plurality of sets of short tracklets based on the plurality of trackable frames and the body pose information. The computing system connects each set of short tracklets by generating a motion field vector for each player in the plurality of trackable frames. The computing system predicts a future motion of a player based on the player's motion field vector using a neural network.
    Type: Application
    Filed: February 28, 2020
    Publication date: September 3, 2020
    Applicant: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi
  • Publication number: 20200279398
    Abstract: A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.
    Type: Application
    Filed: February 28, 2020
    Publication date: September 3, 2020
    Applicant: STATS LLC
    Inventors: Long Sha, Sujoy Ganguly, Xinyu Wei, Patrick Joseph Lucey, Aditya Cherukumudi