Abstract: The present invention is directed towards providing automated workflows for the identification of a reading order from text segments extracted from a document. Ordering the text segments is based on trained natural language models. In some embodiments, the workflows are enabled to perform a method for identifying a sequence associated with a portable document. The methods includes iteratively generating a probabilistic language model, receiving the portable document, and selectively extracting features (such as but not limited to text segments) from the document. The method may generate pairs of features (or feature pair from the extracted features). The method may further generate a score for each of the pairs based on the probabilistic language model and determine an order to features based on the scores. The method may provide the extracted features in the determined order.

Abstract: Provided is a face recognition method comprising acquiring a masked face image including a masked region and an un-masked region; obtaining an image feature from the masked face image; inputting the image feature to a pre-trained segmentation model to automatically estimate a feature of the masked region; and refining the image feature using the estimated feature of the masked region, wherein the refining step comprising focusing on a feature of the un-masked region and discarding the estimated feature of the masked region.

Abstract: Metric forecasting techniques and systems in a digital medium environment are described that leverage similarity of elements, one to another, in order to generate a forecast value for a metric for a particular element. In one example, training data is received that describes a time series of values of the metric for a plurality of elements. The model is trained to generate the forecast value of the metric, the training using machine learning of a neural network based on the training data. The training includes generating dimensional-transformation data configured to transform the training data into a simplified representation to determine similarity of the plurality of elements, one to another, with respect to the metric over the time series. The training also includes generating model parameters of the neural network based on the simplified representation to generate the forecast value of the metric.

Abstract: Provided is an encoder, system and method for metaphor detection in natural language processing. The system comprises an encoding module configured to convert words included in a sentence into BiLSTM representation vectors; a first encoder configured to generate a first entire representation vector of a WSD resolving task; a second encoder configured to generate a second entire representation vector of an MD task; and a multi-task learning module configured to perform knowledge transfer between the first and second encoders. Wherein, each of the first and second encoders includes a graph convolutional neural network (GCN) module configured to encode a link between a target word and a core word to generate GCN representation vectors; a control module configured to regulate the GCN representation vectors to generate an entire representation vector.

Abstract: Provided is a face recognition method comprising acquiring a masked face image including a masked region and an un-masked region; obtaining an image feature from the masked face image; inputting the image feature to a pre-trained segmentation model to automatically estimate a feature of the masked region; and refining the image feature using the estimated feature of the masked region, wherein the refining step comprising focusing on a feature of the un-masked region and discarding the estimated feature of the masked region.

Abstract: Provided is a Face-aware Offset Calculation (FOC) module and method for facial frame interpolation and enhancement and a face video deblurring system and method using the same. The system comprises: a facial frame enhancement device, including a FOC module, for enhancing a target frame; a facial frame interpolation device, including the FOC module, for interpolating the target frame; and a combination device for combining the enhanced target frame with the interpolated target frame.

Abstract: An image caption apparatus includes an encoder which encodes an input image; and a decoder which receives an output of the encoder. The decoder comprises a first long short-term memory (LSTM) configured to operate in cooperation with a second LSTM to respectively generate a first hidden vector and a second hidden vector, wherein the second hidden vector is used to generate a word for an output caption, a LSTM cell configured to be used for both the first LSTM and the second LSTM to generate the first hidden vector or the second hidden vector, wherein an personality embedding vector fed into the LSTM cell is employed to modulate an input signal of visual and language features of the internal gates of the LSTM cell, and a personality controller configured to decay the personality embedding vector at each word generation step before the personality embedding vector is fed into the LSTM cell.

Abstract: According to an exemplary embodiment, provided is a multi-scale segmentation system including a plurality of processing devices that correspond to multiple image scale levels, wherein the multi-scale segmentation system applies for having any number of image scale levels and wherein each processing device that corresponds to a specific image scale level is configured to receive a source image and one or more output segmentation maps generated from one or more previous processing devices, divide the received source image in association with the received one or more output segmentation maps into image patches wherein a size of image patches corresponds to a specific image scale level, and identify semantic objects in the image patches to generate an output segmentation map.

Abstract: Provided is an encoder, system and method for metaphor detection in natural language processing. The system comprises an encoding module configured to convert words included in a sentence into BiLSTM representation vectors; a first encoder configured to generate a first entire representation vector of a WSD resolving task; a second encoder configured to generate a second entire representation vector of an MD task; and a multi-task learning module configured to perform knowledge transfer between the first and second encoders. Wherein, each of the first and second encoders includes a graph convolutional neural network (GCN) module configured to encode a link between a target word and a core word to generate GCN representation vectors; a control module configured to regulate the GCN representation vectors to generate an entire representation vector.

Abstract: The present invention is directed towards providing automated workflows for the identification of a reading order from text segments extracted from a document. Ordering the text segments is based on trained natural language models. In some embodiments, the workflows are enabled to perform a method for identifying a sequence associated with a portable document. The methods includes iteratively generating a probabilistic language model, receiving the portable document, and selectively extracting features (such as but not limited to text segments) from the document. The method may generate pairs of features (or feature pair from the extracted features). The method may further generate a score for each of the pairs based on the probabilistic language model and determine an order to features based on the scores. The method may provide the extracted features in the determined order.

Abstract: Systems and methods provide for generating predictive models that are useful in predicting next-user-actions. User-specific navigation sequences are obtained, the navigation sequences representing temporally-related series of actions performed by users during navigation sessions. To each navigation sequence, a Recurrent Neural Network (RNN) is applied to encode the navigation sequences into user embeddings that reflect time-based, sequential navigation patterns for the user. Once a set of navigation sequences is encoded to a set of user embeddings, a variety of classifiers (prediction models) may be applied to the user embeddings to predict what a probable next-user-action may be and/or the likelihood that the next-user-action will be a desired target action.

Abstract: The present invention is directed towards providing automated workflows for the identification of a reading order from text segments extracted from a document. Ordering the text segments is based on trained natural language models. In some embodiments, the workflows are enabled to perform a method for identifying a sequence associated with a portable document. The methods includes iteratively generating a probabilistic language model, receiving the portable document, and selectively extracting features (such as but not limited to text segments) from the document. The method may generate pairs of features (or feature pair from the extracted features). The method may further generate a score for each of the pairs based on the probabilistic language model and determine an order to features based on the scores. The method may provide the extracted features in the determined order.

Abstract: Systems and methods provide for generating predictive models that are useful in predicting next-user-actions. User-specific navigation sequences are obtained, the navigation sequences representing temporally-related series of actions performed by users during navigation sessions. To each navigation sequence, a Recurrent Neural Network (RNN) is applied to encode the navigation sequences into user embeddings that reflect time-based, sequential navigation patterns for the user. Once a set of navigation sequences is encoded to a set of user embeddings, a variety of classifiers (prediction models) may be applied to the user embeddings to predict what a probable next-user-action may be and/or the likelihood that the next-user-action will be a desired target action.

Abstract: Systems and methods provide for generating predictive models that are useful in predicting next-user-actions. User-specific navigation sequences are obtained, the navigation sequences representing temporally-related series of actions performed by users during navigation sessions. To each navigation sequence, a Recurrent Neural Network (RNN) is applied to encode the navigation sequences into user embeddings that reflect time-based, sequential navigation patterns for the user. Once a set of navigation sequences is encoded to a set of user embeddings, a variety of classifiers (prediction models) may be applied to the user embeddings to predict what a probable next-user-action may be and/or the likelihood that the next-user-action will be a desired target action.

Abstract: Systems and methods provide for generating predictive models that are useful in predicting next-user-actions. User-specific navigation sequences are obtained, the navigation sequences representing temporally-related series of actions performed by users during navigation sessions. To each navigation sequence, a Recurrent Neural Network (RNN) is applied to encode the navigation sequences into user embeddings that reflect time-based, sequential navigation patterns for the user. Once a set of navigation sequences is encoded to a set of user embeddings, a variety of classifiers (prediction models) may be applied to the user embeddings to predict what a probable next-user-action may be and/or the likelihood that the next-user-action will be a desired target action.

Abstract: The present invention is directed towards providing automated workflows for the identification of a reading order from text segments extracted from a document. Ordering the text segments is based on trained natural language models. In some embodiments, the workflows are enabled to perform a method for identifying a sequence associated with a portable document. The methods includes iteratively generating a probabilistic language model, receiving the portable document, and selectively extracting features (such as but not limited to text segments) from the document. The method may generate pairs of features (or feature pair from the extracted features). The method may further generate a score for each of the pairs based on the probabilistic language model and determine an order to features based on the scores. The method may provide the extracted features in the determined order.

Abstract: Metric forecasting techniques and systems in a digital medium environment are described that leverage similarity of elements, one to another, in order to generate a forecast value for a metric for a particular element. In one example, training data is received that describes a time series of values of the metric for a plurality of elements. The model is trained to generate the forecast value of the metric, the training using machine learning of a neural network based on the training data. The training includes generating dimensional-transformation data configured to transform the training data into a simplified representation to determine similarity of the plurality of elements, one to another, with respect to the metric over the time series. The training also includes generating model parameters of the neural network based on the simplified representation to generate the forecast value of the metric.

Abstract: The present disclosure relates dialog states, which computers use to internally represent what users have in mind in dialog. A dialog state tracker employs various rules that enhance the ability of computers to correctly identify the presence of slot-value pairs, which make up dialog states, in utterances or conversational input of dialog. Some rules provide for identifying synonyms of values of slot-values pairs in utterances. Other rules provide for identifying slot-value pairs based on coreferences between utterances and previous utterances of dialog sessions. Rules are also provided for carrying over slot-value pairs from dialog states of previous utterances to a dialog state of a current utterance. Yet other rules provide for removing slot-value pairs from candidate dialog states, which are later used as dialog states of utterances.

Abstract: The present disclosure relates dialog states, which computers use to internally represent what users have in mind in dialog. A dialog state tracker employs various rules that enhance the ability of computers to correctly identify the presence of slot-value pairs, which make up dialog states, in utterances or conversational input of dialog. Some rules provide for identifying synonyms of values of slot-values pairs in utterances. Other rules provide for identifying slot-value pairs based on coreferences between utterances and previous utterances of dialog sessions. Rules are also provided for carrying over slot-value pairs from dialog states of previous utterances to a dialog state of a current utterance. Yet other rules provide for removing slot-value pairs from candidate dialog states, which are later used as dialog states of utterances.