Abstract: A computer based method for an electronic marketing campaign from a customer to a contact receives a campaign having an email message body and a historic profile of a previous campaign by the customer. The email message body includes text and image data. The email message body is preprocessed based upon the campaign and the historic profile to produce campaign training data. A neural network learning model is trained with the campaign training data. The neural network provides a subject line recommendation inference, and named entity recognition is performed on the subject line recommendation.

Abstract: A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.

Abstract: A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.

Abstract: A method of generating a player prediction is disclosed herein. A computing system retrieves data from a data store. The computing system generates a predictive model using an artificial neural network. The artificial neural network generates one or more personalized embeddings that include player-specific information based on historical performance. The computing system selects, from the data, one or more features related to each shot attempt captured in the data. The artificial neural network learns an outcome of each shot attempt based at least on the one or more personalized embeddings and the one or more features related to each shot attempt.

Abstract: A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.

Abstract: A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.

Abstract: A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.

Abstract: A system and method of generating trackable frames from a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a set of frames for classification using a principal component analysis model. The set of frames are a subset of the plurality of video frames. The computing system partitions each frame of the set of frames into a plurality of clusters. The computing system classifies each frame of the plurality of frames as trackable or untrackable. Trackable frames capture a unified view of the sporting event. The computing system compares each cluster to a predetermined threshold to determine whether each cluster comprises at least a threshold number of trackable frames. The computing system classifies each cluster that includes at least the threshold number of trackable frames as trackable.

Abstract: A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.

Abstract: A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.

Abstract: A system and method for generating a play prediction for a team is disclosed herein. A computing system retrieves trajectory data for a plurality of plays from a data store. The computing system generates a predictive model using a variational autoencoder and a neural network by generating one or more input data sets, learning, by the variational autoencoder, to generate a plurality of variants for each play of the plurality of plays, and learning, by the neural network, a team style corresponding to each play of the plurality of plays. The computing system receives trajectory data corresponding to a target play. The predictive model generates a likelihood of a target team executing the target play by determining a number of target variants that correspond to a target team identity of the target team.

Abstract: A computer based method for an electronic marketing campaign from a customer to a contact receives a campaign having an email message body and a historic profile of a previous campaign by the customer. The email message body includes text and image data. The email message body is preprocessed based upon the campaign and the historic profile to produce campaign training data. A neural network learning model is trained with the campaign training data. The neural network provides a subject line recommendation inference, and named entity recognition is performed on the subject line recommendation.

Abstract: A system and method for generating a play prediction for a team is disclosed herein. A computing system retrieves trajectory data for a plurality of plays from a data store. The computing system generates a predictive model using a variational autoencoder and a neural network by generating one or more input data sets, learning, by the variational autoencoder, to generate a plurality of variants for each play of the plurality of plays, and learning, by the neural network, a team style corresponding to each play of the plurality of plays. The computing system receives trajectory data corresponding to a target play. The predictive model generates a likelihood of a target team executing the target play by determining a number of target variants that correspond to a target team identity of the target team.

Abstract: A unified framework for detecting perception anomalies in autonomous driving systems is described. The perception anomaly detection framework takes an input image from a camera in or on a vehicle and identifies anomalies as belonging to one of three categories. Lens anomalies are associated with poor sensor conditions, such as water, dirt, or overexposure. Environment anomalies are associated with unfamiliar changes to an environment. Finally, object anomalies are associated with unknown objects. After perception anomalies are detected, the results are sent downstream to cause a behavior change of the vehicle.

Abstract: A system and method for generating a play prediction for a team is disclosed herein. A computing system retrieves trajectory data for a plurality of plays from a data store. The computing system generates a predictive model using a variational autoencoder and a neural network by generating one or more input data sets, learning, by the variational autoencoder, to generate a plurality of variants for each play of the plurality of plays, and learning, by the neural network, a team style corresponding to each play of the plurality of plays. The computing system receives trajectory data corresponding to a target play. The predictive model generates a likelihood of a target team executing the target play by determining a number of target variants that correspond to a target team identity of the target team.

Abstract: A method and system of generating agent and actions prediction based on multi-agent tracking data are disclosed herein. A computing system retrieves tracking data from a data store. The computing system generates a trained neural network by generating a plurality of training data sets based on the tracking data by converting each frame of data into a matrix representation of the data contained in the frame and learning, by the neural network, a start frame and end frame of each action contained in the frame and its associated actor. The computing system receives target tracking data associated with an event. The target tracking data includes a plurality of actors and a plurality of actions. The computing system generates, via the trained neural network, a target start frame and a target end frame of each action identified in the tracking data and a corresponding actor.

Abstract: Techniques are described for performing an image processing on frames of a camera located on or in a vehicle. An example technique includes receiving, by a computer located in a vehicle, a first image and a second image from a camera; determining a first set of characteristics about a first set of pixels in the first image and a second set of characteristics about a second set of pixels in the second image; obtaining a motion information for each pixel in the second set by comparing the second set of characteristics with the first set of characteristics; generating, using the motion information for each pixel in the second set, a combined set of characteristics; determining attributes of a road using at least some of the combined set of characteristics; and causing the vehicle to perform a driving related operation in response to the determining the attributes of the road.

Abstract: Techniques are described for performing an image processing technique on frames of a camera located on or in a vehicle. An example technique includes receiving, by a computer located in a vehicle, a first image frame from a camera located on or in the vehicle; obtaining a first combined set of information by combining a first set of information about an object detected from the first image frame and a second set of information about a set of objects detected from a second image frame, where the set of objects includes the object; obtaining, by using the first combined set of information, a second combined set of information about the object from the first image frame and from the second image frame; and causing the vehicle to perform a driving related operation in response to determining a characteristic of the object using the second combined set of information.

Abstract: Techniques are described for performing image processing on images of cameras located on or in a vehicle. An example technique includes receiving a first set of images obtained by a first camera and a second set of images obtained by a second camera; determining, for each image in the first set, a first set of features of a first object; determining, for each image in the second set, a second set of features of a second object; obtaining a third set of features of an object by combining the first set of features and the second set of features; obtaining a fourth set of features of the object by including one or more features of a light signal of the object; determining characteristic(s) indicated by the light signal; and causing a vehicle to perform a driving related operation based on the characteristic(s) of the object.

Abstract: A method and system of generating agent and actions prediction based on multi-agent tracking data are disclosed herein. A computing system retrieves tracking data from a data store. The computing system generates a trained neural network by generating a plurality of training data sets based on the tracking data by converting each frame of data into a matrix representation of the data contained in the frame and learning, by the neural network, a start frame and end frame of each action contained in the frame and its associated actor. The computing system receives target tracking data associated with an event. The target tracking data includes a plurality of actors and a plurality of actions. The computing system generates, via the trained neural network, a target start frame and a target end frame of each action identified in the tracking data and a corresponding actor.