Abstract: A method, system and computer program product for data deduplication in a travel and transportation data processing system includes loading into memory for comparison from a database of a multiplicity of multi-field records, a pair of two different multi-field records and submitting the pair to a similarity model that correlates a companion passenger with a specified individual so as to indicate a probability of duplication whenever the companion passenger appears in a pair of records submitted to the model for comparison. Thereafter, if the model produces a high probability, the pair is automatically merged into a single record without manual intervention, but if the model produces a medium probability, the pair is placed in a queue pending manual intervention and manual merging, and if the similarity model produces a low probability, the pair is omitted from consideration of merging. Finally, the process repeats for each other pair of different multi-field records in the database.

Abstract: A text classification method includes loading a corpus of text that different words organized as different collections of comments and concurrently submitting each of the comments to a topic modeler and a sentiment analysis engine, and receiving for each of the comments, a set of topics likely to be associated with a corresponding one of the comments and an associated sentiment. Then, a visualization is generated of each of the comments, and each of the comments are represented in the visualization with a respective graphical image. Groups of the graphical images are clustered according to topic common to associated ones of the comments, arranged by sentiment, and a corresponding common topic is displayed in connection with each clustered group. In response to an activation of one of the graphical images, at least a portion of a represented one of the comments are displayed in a window of the user interface.

Abstract: A method, system and computer program product for data deduplication in a travel and transportation data processing system includes loading into memory for comparison from a database of a multiplicity of multi-field records, a pair of two different multi-field records and submitting the pair to a similarity model that correlates a companion passenger with a specified individual so as to indicate a probability of duplication whenever the companion passenger appears in a pair of records submitted to the model for comparison. Thereafter, if the model produces a high probability, the pair is automatically merged into a single record without manual intervention, but if the model produces a medium probability, the pair is placed in a queue pending manual intervention and manual merging, and if the similarity model produces a low probability, the pair is omitted from consideration of merging. Finally, the process repeats for each other pair of different multi-field records in the database.