Abstract: An example lexical analysis system may include lexical analyzer instructions and training instructions. The lexical analyzer instructions, when executed, may form a universal lexical analyzer that is to lexically analyze an input program by evaluating a function that maps an input tuple of lexemes to an output tuple of tokens based on input probability parameters. The universal lexical analyzer may be configurable for any programming language by inputting a set of probability parameters for the respective programming language as the input probability parameters of the function.
Type:
Grant
Filed:
December 8, 2016
Date of Patent:
January 1, 2019
Assignee:
ENTIT SOFTWARE LLC
Inventors:
Edo Nir, Albert Ribakovsky, Oren Gavriel, Gabi Shalev