Abstract: A method and a system for processing multimodal input signals, wherein the system includes a merging unit which receives instruction messages from a sensor data evaluation device, which messages each indicate an instruction which can be executed by an application which can be coupled to the merging unit. For at least two of the instruction messages, the merging unit respectively generates a candidate object for the instruction message, the candidate object respectively indicating the instruction and respectively including a validity time specification of the candidate object. The merging unit also merges two of the candidate objects if the validity time specifications of these candidate objects indicate overlapping validity times and to forward an instruction to the application, which instruction is indicated by a candidate object which results from the merging operation.

Abstract: A method and a system for processing multimodal input signals, wherein the system includes a merging unit which receives instruction messages from a sensor data evaluation device, which messages each indicate an instruction which can be executed by an application which can be coupled to the merging unit. For at least two of the instruction messages, the merging unit respectively generates a candidate object for the instruction message, the candidate object respectively indicating the instruction and respectively including a validity time specification of the candidate object. The merging unit also merges two of the candidate objects if the validity time specifications of these candidate objects indicate overlapping validity times and to forward an instruction to the application, which instruction is indicated by a candidate object which results from the merging operation.