Abstract: A method and system for maintaining tenant isolation in a messaging service are disclosed. The method includes receiving, in at least one source topic, records sent by a plurality of producer systems associated with a plurality of tenants, wherein each of the plurality of tenants is associated with a unique tenant identifier (ID); partitioning the received records into a plurality of partitions in an intermediate topic based on the respective tenant IDs of respective tenants that sourced the records; grouping, for each of the plurality of partitions in the intermediate topic, records within the partition into an isolated batch, wherein the records in each isolated batch belong to the same tenant; and placing the isolated batches in a destination topic to be consumed system by a consumer, wherein the isolated batches are placed in the destination topic in a round-robin manner.

Abstract: A system and method for generating LLM-based chatbot responses are provided. The method includes generating, using a first specific-trained language model (STLM), which returns a set of filters based on an input question, wherein the input question relates to at least one sales call; filtering a call dataset based on the set of filters, wherein the set of filters is applied to metadata included in the call dataset, wherein the call dataset further includes at least transcripts; embedding the input question into a vector representation; comparing the vector representation of the input question to vector representations of textual information stored in the call dataset to retrieve a target dataset; engineering a prompt to provide a single coherent command including information in the target dataset and the input question; and feeding the engineered prompt to a second STLM to retrieve an answer to the input question.

Abstract: A system and method for generating LLM-based chatbot responses are provided. The method includes generating, using a first specific trained language model (STLM), which returns a set of filters based on an input question, wherein the input question relates to at least one deal; filtering a deal dataset based on the set of filters, wherein the set of filters are applied to metadata included in the deal dataset, wherein the deal dataset further includes at least call transcripts related to sales deals; embedding the input question into a vector representation; comparing the vector representation of the input question to vector representations of textual information stored in the deal dataset to retrieve a target dataset; engineering a prompt to provide a single coherent command including information in the target dataset and the input question; and feeding the engineered prompt to a second STLM to retrieve an answer to the input question.

Abstract: A method and system for maintaining tenant isolation in a messaging service are disclosed. The method includes receiving, in at least one source topic, records sent by a plurality of producer systems associated with a plurality of tenants, wherein each of the plurality of tenants is associated with a unique tenant identifier (ID); partitioning the received records into a plurality of partitions in an intermediate topic based on the respective tenant IDs of respective tenants that sourced the records; grouping, for each of the plurality of partitions in the intermediate topic, records within the partition into an isolated batch, wherein the records in each isolated batch belong to the same tenant; and placing the isolated batches in a destination topic to be consumed system by a consumer, wherein the isolated batches are placed in the destination topic in a round-robin manner.