Abstract: The present disclosure describes pattern detections for storing multiple values in a compound object. A compound object is a value that stores multiple values in a single cell, wherein those multiple values are organized according to a defined structure. The compound object may store multiple values according to a known defined data structure. In embodiments, the compound object may store multiple values as any nested combination of any one of the known or user-defined data structures (e.g., nesting an array within a vector, or nesting a record within a record, or nesting matrices within a table, etc.). Each of the values stored in the compound object are individually referenceable and can fully participate with spreadsheet functionality including calculations, referencing, and formatting.

Abstract: The present disclosure is directed to a spreadsheet application with an enhanced understanding of mathematical equations using a mathematical engine and a calculation engine. The disclosed spreadsheet application has many enhanced features, such as, but not limited to: analyzing complex equations, identifying dependencies, converting mathematical notation to spreadsheet notation, connecting variables in an equation to other cells of the spreadsheet, solving or simplifying equations, recommending different display representations of data, and a providing a math display mode.

Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for interacting with data in a productivity application are presented. A plurality of values associated with the productivity application may be analyzed to determine whether they include a value that can be added to a set comprising a plurality of values with a set data type upon which the productivity application can execute a plurality of set operations. An indication to add at least one of the analyzed values as a member of the set may be received. At least one of the analyzed values may be added as a member of the set. An indication to perform a set operation associated with the set may be received and performed, and the result of the performed set operation may be displayed on a productivity application user interface.

Abstract: Systems and methods for charting videos and/or attributes of videos associated with a spreadsheet are provided. For instance, when a video is associated with a spreadsheet, the video may be treated as a new type of data within the spreadsheet. In some aspects, a plurality of videos may be associated with a spreadsheet, e.g., within a single cell or a range of cells. In aspects, the videos themselves, as well as video data (e.g., raw pixel data for each video frame, modulated data representing soundwaves of an audio file, etc.), video attributes (e.g., frame rate, aspect ratio, duration, resolution, bits per frame, video size, synchronization data, etc.), frame attributes (e.g., aspect ratio, color space, bitrate, etc.), audio attributes (e.g., pitch, volume, speed, etc.), and/or spreadsheet data (e.g., values in cells, user comments, etc.) may be incorporated into a chart using a spreadsheet charting function, either automatically or by user selection.

Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for interacting with data in a productivity application are presented. A plurality of values associated with the productivity application may be analyzed to determine whether they include a value that can be added to a set comprising a plurality of values with a set data type upon which the productivity application can execute a plurality of set operations. An indication to add at least one of the analyzed values as a member of the set may be received. At least one of the analyzed values may be added as a member of the set. An indication to perform a set operation associated with the set may be received and performed, and the result of the performed set operation may be displayed on a productivity application user interface.

Abstract: Systems and methods for charting images and/or attributes of images associated with a spreadsheet are provided. For instance, when an image is associated with a spreadsheet, the image may be treated as a new type of data within the spreadsheet. In some aspects, a plurality of images may be associated with a spreadsheet, e.g., within a single cell or within a range of cells. In some aspects, the images themselves, as well as image data (e.g., pixelated data, etc.), image attributes (e.g., opacity, color palette, resolution, aspect ratio, image dimensions, author, creation date and/or time, file name, tags, file size, GPS location information, etc.), and/or spreadsheet data (e.g., values in cells, user comments, etc.) may be incorporated into a report (e.g., a chart) using a spreadsheet charting function, either automatically or by user selection.

Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for interacting with data in a productivity application are presented. A plurality of values associated with the productivity application may be analyzed to determine whether they include a value that can be added to a set comprising a plurality of values with a set data type upon which the productivity application can execute a plurality of set operations. An indication to add at least one of the analyzed values as a member of the set may be received. At least one of the analyzed values may be added as a member of the set. An indication to perform a set operation associated with the set may be received and performed, and the result of the performed set operation may be displayed on a productivity application user interface.

Abstract: Systems and methods for charting images and/or attributes of images associated with a spreadsheet are provided. For instance, when an image is associated with a spreadsheet, the image may be treated as a new type of data within the spreadsheet. In some aspects, a plurality of images may be associated with a spreadsheet, e.g., within a single cell or within a range of cells. In some aspects, the images themselves, as well as image data (e.g., pixelated data, etc.), image attributes (e.g., opacity, color palette, resolution, aspect ratio, image dimensions, author, creation date and/or time, file name, tags, file size, GPS location information, etc.), and/or spreadsheet data (e.g., values in cells, user comments, etc.) may be incorporated into a report (e.g., a chart) using a spreadsheet charting function, either automatically or by user selection.

Abstract: Systems and methods for associated one or more images with one or more cells of a spreadsheet are described. As described, a plurality of images may be associated with a single cell or a single image may be associated with a range of cells. Additionally, an image and additional data may be associated with the same cell. Upon associating an image with a cell, various parameters of the image may be displayed for viewing and/or customization by a user. Additionally, sort and/or filter operations may be performed on the spreadsheet based on the various parameters of associated images and/or operations (e.g., fit and/or resize operations) may be performed on various parameters of associated images. An associated image may move with a cell when the cell is reordered within the cell table, or an associated image may be allowed to float over the grid but may be referenced by a cell.

Abstract: Systems for associating streaming data with cells of a spreadsheet are provided. Both dynamic data and static data may be associated with a single cell of the spreadsheet. Upon association, parameters (including stream attributes, image attributes and audio attributes) may be viewed and/or manipulated by a user, providing stream processing functionality within a spreadsheet. Controls may be provided for playing the streaming data and/or playing the streaming data in response to spreadsheet data satisfying a condition. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on parameters of associated streaming data.

Abstract: Systems for associating videos with cells of a spreadsheet are provided. Both dynamic data and static data may be associated with a single cell of the spreadsheet. Upon association, parameters (including video attributes, image attributes and audio attributes) may be viewed and/or manipulated by a user, providing video and audio processing functionality within a spreadsheet. Controls may be provided for playing the video and/or playing the video in response to spreadsheet data satisfying a condition. Text transcriptions (e.g., speech-to-text) of an audio track associated with a video file may be inserted as subtitles into the video or a plurality of individual frames for the video. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on parameters of an associated video.

Abstract: Systems for associating audio files with cells of a spreadsheet are provided. Both audio files and data may be associated with a single cell of the spreadsheet. An audio file may be recorded, retrieved from storage, or converted from a document (e.g., using text-to-speech technology) for association with a spreadsheet. Upon association, audio parameters may be viewed and/or manipulated by a user, providing audio processing functionality within a spreadsheet. Controls may be provided for listening to the audio file and/or playing the audio file in response to spreadsheet data satisfying a condition. Text transcriptions (e.g., speech-to-text) of audio files may be inserted into the spreadsheet. For low vision users, audio transcriptions (e.g., text-to-speech) of data may be generated and “played” for the user. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on audio parameters of associated audio files.

Abstract: The present disclosure is directed to a spreadsheet application with an enhanced understanding of mathematical equations using a mathematical engine and a calculation engine. The disclosed spreadsheet application has many enhanced features, such as, but not limited to: analyzing complex equations, identifying dependencies, converting mathematical notation to spreadsheet notation, connecting variables in an equation to other cells of the spreadsheet, solving or simplifying equations, recommending different display representations of data, and a providing a math display mode.

Abstract: The present disclosure describes a value referred to as a compound object that stores multiple values in a single cell, wherein those multiple values are organized according to a defined structure. The compound object may store multiple values according to a known defined data structure such as, for example, a record, vector, matrix, table, or array. In other embodiments, the compound object may store multiple values as any nested combination of any one of the known or user-defined data structures. Each of the values stored in the compound object are individually referenceable and can fully participate with spreadsheet functionality including calculations, referencing, and formatting.

Abstract: The present disclosure is directed to systems and methods for implementing notifications for rich data types in a spreadsheet application. Generally, a value being of a rich data type is as a type of value that has context and established relationships with other types of data. In particular, a rich data type is a data value having associated context, which may be units (e.g., inches, miles, meters, kilograms, seconds, joules, hertz, Fahrenheit, etc.) or other information about the data's type (e.g., city, stock, NCAA football team, car, restaurant, school, etc.). Additionally, a value being of a rich data type further includes established relationships with other types of data.

Abstract: Systems for associating audio files with cells of a spreadsheet are provided. Both audio files and data may be associated with a single cell of the spreadsheet. An audio file may be recorded, retrieved from storage, or converted from a document (e.g., using text-to-speech technology) for association with a spreadsheet. Upon association, audio parameters may be viewed and/or manipulated by a user, providing audio processing functionality within a spreadsheet. Controls may be provided for listening to the audio file and/or playing the audio file in response to spreadsheet data satisfying a condition. Text transcriptions (e.g., speech-to-text) of audio files may be inserted into the spreadsheet. For low vision users, audio transcriptions (e.g., text-to-speech) of data may be generated and “played” for the user. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on audio parameters of associated audio files.

Abstract: Systems for associating streaming data with cells of a spreadsheet are provided. Both dynamic data and static data may be associated with a single cell of the spreadsheet. Upon association, parameters (including stream attributes, image attributes and audio attributes) may be viewed and/or manipulated by a user, providing stream processing functionality within a spreadsheet. Controls may be provided for playing the streaming data and/or playing the streaming data in response to spreadsheet data satisfying a condition. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on parameters of associated streaming data.

Abstract: Systems and methods for associated one or more images with one or more cells of a spreadsheet are described. As described, a plurality of images may be associated with a single cell or a single image may be associated with a range of cells. Additionally, an image and additional data may be associated with the same cell. Upon associating an image with a cell, various parameters of the image may be displayed for viewing and/or customization by a user. Additionally, sort and/or filter operations may be performed on the spreadsheet based on the various parameters of associated images and/or operations (e.g., fit and/or resize operations) may be performed on various parameters of associated images. An associated image may move with a cell when the cell is reordered within the cell table, or an associated image may be allowed to float over the grid but may be referenced by a cell.

Abstract: Systems for performing operations on dynamic data associated with cells of a spreadsheet are provided. Both dynamic data and static data may be associated with a single cell of the spreadsheet. Upon association, parameters (including stream attributes, video attributes, image attributes and audio attributes) may be manipulated by a user, providing dynamic data processing functionality within a spreadsheet. Controls may be provided for playing the dynamic data and/or playing the dynamic data in response to spreadsheet data satisfying a condition. Operations for inserting text transcriptions (e.g., speech-to-text) of an audio track associated with dynamic data as subtitles may further be provided. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on parameters of associated dynamic data.

Abstract: Systems for associating audio files with cells of a spreadsheet are provided. Both audio files and data may be associated with a single cell of the spreadsheet. An audio file may be recorded, retrieved from storage, or converted from a document (e.g., using text-to-speech technology) for association with a spreadsheet. Upon association, audio parameters may be viewed and/or manipulated by a user, providing audio processing functionality within a spreadsheet. Controls may be provided for listening to the audio file and/or playing the audio file in response to spreadsheet data satisfying a condition. Text transcriptions (e.g., speech-to-text) of audio files may be inserted into the spreadsheet. For low vision users, audio transcriptions (e.g., text-to-speech) of data may be generated and “played” for the user. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on audio parameters of associated audio files.