Abstract: Methods and systems for generating a plurality of matching items that match a reference item are disclosed. The method includes first determining reference attribute data for the reference item, where the reference attribute data is multimodal. Next, selecting a deep learning multimodal matching model from a plurality of candidate multimodal matching models. The selected deep learning multimodal matching model has a first deep learning neural network (DLNN) for processing data having a first data mode and a second DLNN analyzer for processing data having a second data mode. Then, matching a potential matching item to the reference item using the selected deep learning multimodal matching model to generate a match score, where the match score is computed based on the reference attribute data for the reference item and attribute data for the potential matching item. Finally, adding the potential matching item to the plurality of matching items based on the match score.

Abstract: Methods and systems for generating a plurality of matching items that match a reference item are disclosed. The method includes first determining reference attribute data for the reference item, where the reference attribute data is multimodal. Next, selecting a deep learning multimodal matching model from a plurality of candidate multimodal matching models. The selected deep learning multimodal matching model has a first deep learning neural network (DLNN) for processing data having a first data mode and a second DLNN analyzer for processing data having a second data mode. Then, matching a potential matching item to the reference item using the selected deep learning multimodal matching model to generate a match score, where the match score is computed based on the reference attribute data for the reference item and attribute data for the potential matching item. Finally, adding the potential matching item to the plurality of matching items based on the match score.

Abstract: Methods and systems for generating a list of products each matching a reference product are disclosed. A user query is first received, and multi-modal attribute data for the reference product are determined, with each data mode being a type of product characterization having a modality selected from a text data class, categorical data, a pre-compared engineered feature, audio, image, and video. Next, a first list of candidate products is determined based on a product match signature, and a second list of candidate products is generated from the first, wherein for at least one given candidate product, a deep learning multi-modal matching model is selected to determine whether a match is found. Lastly, the second list is filtered to remove outliers and to generate the list of matching products. Also disclosed are benefits of the new methods and systems, and alternative embodiments of the implementation.