Abstract: Methods, computer systems, and computer-storage media are provided for generating natural language outputs. Sets of triples may be used to map voice queries and answers to sentence structures that may be used as an output answer to the voice query. Sentence structures are only appropriate with certain sets of triples. One or more constraints may be associated with the set of triples to make sure sentence structures are only applied in correct situations. In order to be a valid sentence structure, each constraint associated therewith must be satisfied. If each constraint is satisfied, the sentence structure is valid and may be used as the format for an output answer. If each constraint is not satisfied, additional sentence structures associated with the set of triples may be evaluated until a valid sentence structure is identified. If no sentence structure is valid, no output is generated.

Abstract: A probability distribution for a reference summary of a document is determined. The probability distribution for the reference summary is then used to generate a score for a machine-generated summary of the document.

Abstract: A probability distribution for a reference summary of a document is determined. The probability distribution for the reference summary is then used to generate a score for a machine-generated summary of the document.