Abstract: A compilation system for compiling multi-layered graphs that improves the optimization and extensibility of computational graphs used in machine learning systems. The system receives a multi-layered computational graph comprising a modular operation graph that provides a type system and device-independent rewrites. The system generates a modular operation generator graph using sets of system and user-supplied kernels, and performs one or more fusions of two or more operations to generate an optimized modular operation generator graph having one or more fused operations. The system generates an executable object using the optimized modular operation generator graph. By employing a multi-layered computational graph representation, the system provides improved integration with the compilation system and improves user extensibility of the compilation process.

Abstract: A system for caching compiler transformations. The compilation system uses a parametrized hash in a form of a parametrized Content Addressable Store IDentifier (parametrized CAS ID) to store operator regions and arbitrary transformations over arbitrary operations of the compiler intermediate representation (IR). The parametrized CAS ID includes a hash of a content of a region of an operation, and a set of parameters including a set of symbolic references to objects used and/or referenced within the region of the operator.

Abstract: A compiler for generating composable kernels. The compiler receives a kernel generator comprising a kernel parameterization and code of a set of operators written in a general purpose programming language. For each operator of the set of operators, the compiler lowers code of the each operator into an intermediate representation of the each operator in an intermediate language, determines a configuration of the each operator based on the kernel parameterization and the intermediate representation of the each operator, and generates a binary object of the each operator of a set of binary objects of the set of operators based on the configuration. The compiler composes a kernel corresponding to the kernel generator based on the set of binary objects of the set of operations and the kernel parameterization.

Abstract: In one embodiment, non-transitory computer-readable medium stores instructions for implementing a source code editor within an integrated development environment. The instructions to cause one or more processors to implement a method comprising receiving data at a source code editor, the data representing a data value to be used by source code displayed by the source code editor, inserting the data representing the data value into the source code, and displaying a graphical representation of the data value in the source code editor, the graphical representation displayed within a program code statement associated with the data value.

Abstract: In one embodiment, non-transitory computer-readable medium stores instructions for implementing a source code editor within an integrated development environment. The instructions to cause one or more processors to implement a method comprising receiving data at a source code editor, the data representing a data value to be used by source code displayed by the source code editor, inserting the data representing the data value into the source code, and displaying a graphical representation of the data value in the source code editor, the graphical representation displayed within a program code statement associated with the data value.