Abstract: Each short reasoning data item can be automatically decomposed into a background and an inquiry on the background. A plurality of materials can be automatically generated based on the background. Each of the plurality of materials can indicate a key information point of the background. A long-context background can be automatically constructed by randomly embedding the plurality of materials into a set of irrelevant materials. A plurality of long reasoning data items can be automatically generated by combining the long-context background with the inquiry corresponding to each short reasoning data item.

Abstract: A method includes generating, via a virtual machine, a group of code traces, each code trace of the group of code traces corresponding to a respective algorithm, of a group of algorithms, and a corresponding input. The method also includes fine-tuning a generative model in accordance with the group of code traces. The method further includes receiving, at the fine-tuned generative model, computer programming code. The method also includes generating, via the fine-tuned generative mode, one or more computer programming code statements corresponding to the computer programming code or simulate an expected output of the computer programming code.