Abstract: A system for provenance aware editing for propagating edits back to spreadsheets is provided. The system receives an indication of an operation to be performed at an output location. The operation indicates one or more input locations on a spreadsheet that each provides an input value. The input values are accessed and tagged with their corresponding input location on the spreadsheet. Based on the operation and the input value from each of the one or more input locations, the system derives and displays the result at the output location. A user edit to the result is received at the output location, which causes transmission of a propagation request to change the input value at one or more of the tagged input locations. Using where-provenance associated with the tagged input locations, the system propagates the user edit to one or more of the tagged input locations.

Abstract: The present disclosure describes a value referred to as a compound object that stores multiple values in a single cell, wherein those multiple values are organized according to a defined structure. The compound object may store multiple values according to a known defined data structure such as, for example, a record, vector, matrix, table, or array. In other embodiments, the compound object may store multiple values as any nested combination of any one of the known or user-defined data structures. Each of the values stored in the compound object are individually referenceable and can fully participate with spreadsheet functionality including calculations, referencing, and formatting.

Abstract: A system for provenance aware editing for propagating edits back to spreadsheets is provided. The system receives an indication of an operation to be performed at an output location. The operation indicates one or more input locations on a spreadsheet that each provides an input value. The input values are accessed and tagged with their corresponding input location on the spreadsheet. Based on the operation and the input value from each of the one or more input locations, the system derives and displays the result at the output location. A user edit to the result is received at the output location, which causes transmission of a propagation request to change the input value at one or more of the tagged input locations. Using where-provenance associated with the tagged input locations, the system propagates the user edit to one or more of the tagged input locations.

Abstract: Systems for performing operations on dynamic data associated with cells of a spreadsheet are provided. Both dynamic data and static data may be associated with a single cell of the spreadsheet. Upon association, parameters (including stream attributes, video attributes, image attributes and audio attributes) may be manipulated by a user, providing dynamic data processing functionality within a spreadsheet. Controls may be provided for playing the dynamic data and/or playing the dynamic data in response to spreadsheet data satisfying a condition. Operations for inserting text transcriptions (e.g., speech-to-text) of an audio track associated with dynamic data as subtitles may further be provided. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on parameters of associated dynamic data.

Abstract: The present disclosure is directed to systems and methods for implementing rich data types in a spreadsheet application. Generally, a value being of a rich data type is as a type of value that has context and established relationships with other types of data. In particular, a rich data type is a data value having associated context, which may be units (e.g., inches, miles, meters, kilograms, seconds, joules, hertz, Fahrenheit, etc.) or other information about the data's type (e.g., city, stock, NCAA football team, car, restaurant, school, etc.). Additionally, a value being of a rich data type further includes established relationships with other types of data.

Abstract: The present disclosure relates to enriching a compound object with data provided by a third party service, database, or local database. In some embodiments, this is performed by receiving an entry of a value in a cell of a spreadsheet; determining whether the value is related to information provided by a service; based on a determination that the value is related to information provided by the service, selecting the service; displaying a field selection user interface; receiving a selection of one or more fields from the field selection user interface; receiving one or more values associated with the selected one or more fields; and enriching a compound object based on the selected one or more fields and associated one or more values.

Abstract: Systems for associating audio files with cells of a spreadsheet are provided. Both audio files and data may be associated with a single cell of the spreadsheet. An audio file may be recorded, retrieved from storage, or converted from a document (e.g., using text-to-speech technology) for association with a spreadsheet. Upon association, audio parameters may be viewed and/or manipulated by a user, providing audio processing functionality within a spreadsheet. Controls may be provided for listening to the audio file and/or playing the audio file in response to spreadsheet data satisfying a condition. Text transcriptions (e.g., speech-to-text) of audio files may be inserted into the spreadsheet. For low vision users, audio transcriptions (e.g., text-to-speech) of data may be generated and “played” for the user. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on audio parameters of associated audio files.

Abstract: Aspects of the present disclosure further provide the ability to define, among other features, the layout of the cell view of the cell in which the compound object is stored as well as the card view of the compound object. Aspects of the present disclosure further provide the ability to modify properties associated with the values stored in a compound object, including, but not limited to properties of calculated values, value formatting, and permissions.

Abstract: Technology is disclosed herein for handing approximate (or uncertain) values in spreadsheet applications. More specifically, the technology describes spreadsheet applications that support arrays or sets of approximate (or uncertain) values as native entities. An approximate (or uncertain) value may be the value of a cell of the spreadsheet that is resolvable by formula, charts and other functionalities. In some implementations, approximate values may include a range of data and a probability distribution that can be automatically created by the spreadsheet application, generated based on context, input by the user, etc. Because the approximate (or uncertain) value is natively available, it can be incorporated in a spreadsheet like other values. Additionally, the approximate (or uncertain) values can automatically propagate through a spreadsheet calculation to obtain a final approximate result.

Abstract: Aspects of the present disclosure relate to systems and methods for automatically constructing a new formula based upon an existing formula. Various methods are employed to analyze an existing formula in order to determine an intent. Once the intent is determined, a new formula may be constructed that satisfies the intent of the existing formula. Further aspects relate to validating the new formula to ensure it produces the same result as the existing formula which it is intended to replace. Various user interface elements are also disclosed which may be employed to provide the newly constructed formulas to users of an application. The various aspects to disclosed herein may be performed by an application, such as a spreadsheet application, performed in real-time, or provided as a remote service.

Abstract: Technologies are described herein for summary data autofill. A device executes an application program configured to receive data input. The application program may determine a portion of the data may be aggregated or conducive to being summarized. Upon the detection of a user input of additional data into a document having data contained therein, the application program may display a suggested complete summary of the data. An input may be received to accept the suggested complete summary, whereby the manner in which the suggested complete summary is displayed may be changed to indicate the acceptance of the suggested complete summary. A confidence level that the suggested complete summary is a correct summary of the data may be determined. The confidence level may be adjusted based on further input of data or additional data.

Abstract: Tools and techniques are described for linking visual properties of charts to cells within tables. Methods provided by these tools enable users to select visual properties that are associated with graphical displays of chart data, and to link these visual properties to respective cells within the tables. User interfaces provided by these tools may provide representations of visual properties associated with the graphical displays of chart data, with these representations of the visual properties being responsive to user input to link the cells in the tables to the visual properties. These user interfaces may also include representations of the cells that are associated with the representations of the visual properties.

Abstract: Systems and methods for associated one or more images with one or more cells of a spreadsheet are described. As described, a plurality of images may be associated with a single cell or a single image may be associated with a range of cells. Additionally, an image and additional data may be associated with the same cell. Upon associating an image with a cell, various parameters of the image may be displayed for viewing and/or customization by a user. Additionally, sort and/or filter operations may be performed on the spreadsheet based on the various parameters of associated images and/or operations (e.g., fit and/or resize operations) may be performed on various parameters of associated images. An associated image may move with a cell when the cell is reordered within the cell table, or an associated image may be allowed to float over the grid but may be referenced by a cell.

Abstract: A user interface element is displayed for in place editing of values within a document. For example, in response to selecting a value, a user interface is displayed near the value that receives a slide gesture for adjusting the value in place. The user interface may be configured to select one of the discrete parts of the value in response to changing a level of the slide gesture. For example, a user may move the swipe gesture from a level used for adjusting the day value to the level representing the year value. The user interface displayed and method(s) used to adjust the value may be based on the type of value and the structure and content of the document.

Abstract: The present disclosure is directed to systems and methods for implementing rich data types in a spreadsheet application. Generally, a value being of a rich data type is as a type of value that has context and established relationships with other types of data. In particular, a rich data type is a data value having associated context, which may be units (e.g., inches, miles, meters, kilograms, seconds, joules, hertz, Fahrenheit, etc.) or other information about the data's type (e.g., city, stock, NCAA football team, car, restaurant, school, etc.). Additionally, a value being of a rich data type further includes established relationships with other types of data.

Abstract: The present disclosure is directed to systems and methods for implementing notifications for rich data types in a spreadsheet application. Generally, a value being of a rich data type is as a type of value that has context and established relationships with other types of data. In particular, a rich data type is a data value having associated context, which may be units (e.g., inches, miles, meters, kilograms, seconds, joules, hertz, Fahrenheit, etc.) or other information about the data's type (e.g., city, stock, NCAA football team, car, restaurant, school, etc.). Additionally, a value being of a rich data type further includes established relationships with other types of data.

Abstract: Systems and methods for associated one or more images with one or more cells of a spreadsheet are described. As described, a plurality of images may be associated with a single cell or a single image may be associated with a range of cells. Additionally, an image and additional data may be associated with the same cell. Upon associating an image with a cell, various parameters of the image may be displayed for viewing and/or customization by a user. Additionally, sort and/or filter operations may be performed on the spreadsheet based on the various parameters of associated images and/or operations (e.g., fit and/or resize operations) may be performed on various parameters of associated images. An associated image may move with a cell when the cell is reordered within the cell table, or an associated image may be allowed to float over the grid but may be referenced by a cell.

Abstract: The present disclosure is directed to systems and methods for implementing rich data types in a spreadsheet application. Generally, a value being of a rich data type is as a type of value that has context and established relationships with other types of data. In particular, a rich data type is a data value having associated context, which may be units (e.g., inches, miles, meters, kilograms, seconds, joules, hertz, Fahrenheit, etc.) or other information about the data's type (e.g., city, stock, NCAA football team, car, restaurant, school, etc.). Additionally, a value being of a rich data type further includes established relationships with other types of data.

Abstract: The present disclosure describes pattern detections for storing multiple values in a compound object. A compound object is a value that stores multiple values in a single cell, wherein those multiple values are organized according to a defined structure. The compound object may store multiple values according to a known defined data structure. In embodiments, the compound object may store multiple values as any nested combination of any one of the known or user-defined data structures (e.g., nesting an array within a vector, or nesting a record within a record, or nesting matrices within a table, etc.). Each of the values stored in the compound object are individually referenceable and can fully participate with spreadsheet functionality including calculations, referencing, and formatting.

Abstract: A user interacts with a predefined portion of a given data item in a set of structured data. All other items in the set of structured data, that have the same value as the given data item, in a corresponding portion, are selected and treated as a group.