Abstract: In examples, streaming data is received from a data source (e.g., by an edge device associated with a data platform) and is queued and aggregated. Batch data may similarly be received from a data source. The batch data and the aggregated streaming data may be processed to generate metadata accordingly. The data and metadata may be provided to the data platform, where the metadata may be used to update an index and the data may be stored in association with the index. In some instances, the data may be stored in chunks to facilitate subsequent retrieval of the data. In response to a request for the data, the index may be used to identify relevant data, which may include data associated with batch and/or streaming data formats, thereby enabling the client device to access data having any of a variety of formats from the data platform.

Abstract: A computing system that includes one or more server computing devices including one or more processors configured to execute instructions for a domain extensibility module that provides software development tools for building domain extensions for a database platform, and a data ingestion module that provides software development tools for defining a metadata schema for extracting metadata from data files. The one or more processors are configured to receive a set of data from a user computing device, define a target metadata schema that includes one or more metadata fields that will be populated during a data ingestion process, define a target domain extension that defines one or more data types for storing the received set of data after performing the data ingestion process, and ingest the received set of data using a metadata extraction pipeline to generate metadata files based on the target metadata schema.

Abstract: Methods and systems are provided that are directed to identifying an individual having a specific skill and that is best suited for performing a particular task. The individual may be identified based on having a highest score for the skill out of a pool of individuals having the same skill. In examples, a score specific to each individual out of the pool of individuals having the same skill may be based on multiple interactions with the skill and may be adjusted based on a recency of when each interaction occurred and a level of involvement the individual had with the skill. Accordingly, individuals having recent experience with the skill may be scored, and therefore, ranked higher than individuals having experience with the skill that may have occurred further back in time. In examples, the information about the skills and experiences may be utilized to automatically generate the score.

Abstract: Data from data sources may be processed at an edge device. The edge device may generate a local processing result, filter the data, and/or prioritize the data. Accordingly, data is transmitted from the edge device to the data platform, where it may be processed further. For example, a local processing result may be processed at the data platform, such that processing is performed without all of the data source data. In examples, at least a part of such data may remain at an edge device. The edge device may maintain a manifest of data stored by the edge device. The data platform may generate an aggregated manifest using manifests from associated edge devices, such that it may be determined where data is stored. As a result, the data platform may redirect requests to an associated edge device when it is determined that requested data is remote from the data platform.

Abstract: Data from data sources may be processed at an edge device. The edge device may generate a local processing result, filter the data, and/or prioritize the data. Accordingly, data is transmitted from the edge device to the data platform, where it may be processed further. For example, a local processing result may be processed at the data platform, such that processing is performed without all of the data source data. In examples, at least a part of such data may remain at an edge device. The edge device may maintain a manifest of data stored by the edge device. The data platform may generate an aggregated manifest using manifests from associated edge devices, such that it may be determined where data is stored. As a result, the data platform may redirect requests to an associated edge device when it is determined that requested data is remote from the data platform.

Abstract: A computing system that includes one or more server computing devices including one or more processors configured to execute instructions for a domain extensibility module that provides software development tools for building domain extensions for a database platform, and a data ingestion module that provides software development tools for defining a metadata schema for extracting metadata from data files. The one or more processors are configured to receive a set of data from a user computing device, define a target metadata schema that includes one or more metadata fields that will be populated during a data ingestion process, define a target domain extension that defines one or more data types for storing the received set of data after performing the data ingestion process, and ingest the received set of data using a metadata extraction pipeline to generate metadata files based on the target metadata schema.

Abstract: A remote server computing system is configured to deploy a cloud-service-managed control plane and a cloud service data plane spanning the remote server computing system, a local edge computing device, and a local on-premises computing device connected in a hybrid cloud environment. Energy-related training data is received including a plurality of energy-related training data pairs. A machine learning function is trained using the plurality of training data pairs to predict a classified label for restricted energy-related data that is not accessible to the remote server computing system. The trained machine learning function is deployed to the one or more of the local edge computing device and the local on-premises computing device via the cloud service data plane. The remote server computing system is further configured to receive, via the cloud service data plane, classified output of the trained machine learning function.

Abstract: A computing system that includes one or more server computing devices including one or more processors configured to execute instructions for a domain extensibility module that provides software development tools for building domain extensions for a database platform, and a data ingestion module that provides software development tools for defining a metadata schema for extracting metadata from data files. The one or more processors are configured to receive a set of data from a user computing device, define a target metadata schema that includes one or more metadata fields that will be populated during a data ingestion process, define a target domain extension that defines one or more data types for storing the received set of data after performing the data ingestion process, and ingest the received set of data using a metadata extraction pipeline to generate metadata files based on the target metadata schema.

Abstract: A computing system is provided for intelligent monitoring and management of an electrical system. The system receives electrical usage data and electrical production data via a computer network from a plurality of grid agents at a plurality of points across the electrical system; receives a privacy permission from an owner of one of the plurality of grid agents; based on the privacy permission, authorize sharing of a shareable portion of the electrical usage data and/or a shareable portion of the electrical production data and restrict sharing of a restricted portion of the electrical usage data and/or a restricted portion of the electrical production data; and executes a prediction model which processes patterns observed in the shareable portion of the electrical usage data and the shareable portion of the electrical production data, and predicts a forecasted aspect of the electrical system; and outputs the forecasted aspect of the electrical system.

Abstract: A remote server computing system is configured to present a user interface with a plurality of deployment configuration options including compute configuration options and data storage configuration options for energy-related data within a hybrid cloud environment. The hybrid cloud environment comprises a cloud-service-managed control plane and a data plane utilizing local compute resources and storage. A data control policy is generated that provides cloud-service-managed governance over at least a portion of the data plane. The control plane is configured to enforce the data control policy by subjecting at least a portion of the energy-related data to a data transmission restriction or a local storage restriction. The data plane is used to deploy one or more cloud service functions configured to process at least the portion of the energy-related data and output one or more extracted features from at least the portion of the energy-related data to the data plane.

Abstract: A remote server computing system is configured to deploy a cloud-service-managed control plane and a cloud service data plane spanning the remote server computing system, a local edge computing device, and a local on-premises computing device connected in a hybrid cloud environment. Energy-related training data is received including a plurality of energy-related training data pairs. A machine learning function is trained using the plurality of training data pairs to predict a classified label for restricted energy-related data that is not accessible to the remote server computing system. The trained machine learning function is deployed to the one or more of the local edge computing device and the local on-premises computing device via the cloud service data plane. The remote server computing system is further configured to receive, via the cloud service data plane, classified output of the trained machine learning function.

Abstract: In examples, streaming data is received from a data source (e.g., by an edge device associated with a data platform) and is queued and aggregated. Batch data may similarly be received from a data source. The batch data and the aggregated streaming data may be processed to generate metadata accordingly. The data and metadata may be provided to the data platform, where the metadata may be used to update an index and the data may be stored in association with the index. In some instances, the data may be stored in chunks to facilitate subsequent retrieval of the data. In response to a request for the data, the index may be used to identify relevant data, which may include data associated with batch and/or streaming data formats, thereby enabling the client device to access data having any of a variety of formats from the data platform.

Abstract: Data from data sources may be processed at an edge device. The edge device may generate a local processing result, filter the data, and/or prioritize the data. Accordingly, data is transmitted from the edge device to the data platform, where it may be processed further. For example, a local processing result may be processed at the data platform, such that processing is performed without all of the data source data. In examples, at least a part of such data may remain at an edge device. The edge device may maintain a manifest of data stored by the edge device. The data platform may generate an aggregated manifest using manifests from associated edge devices, such that it may be determined where data is stored. As a result, the data platform may redirect requests to an associated edge device when it is determined that requested data is remote from the data platform.

Abstract: The disclosed technology is generally directed to an audit ledger for externality tracking. In one example of the technology, auditing of a virtual sensor is enabled. The virtual sensor is configured to output an externality value based on received telemetry data. The externality values are associated with the at least one particular type of quantifiable technical externality. Signing of the virtual sensor is enabled. Audit information associated with the signing of the virtual sensor is stored on a ledger. Periodic aggregated externality values based on the externality values output by the virtual sensor are calculated. The periodic aggregated externality values are stored on a distributed ledger. An audit of the periodic aggregated externality values is enabled. The auditing of the periodic aggregated externality values includes verifying the signing of the virtual sensor by the auditor based on the stored audit information.

Abstract: A computing system that includes one or more server computing devices including one or more processors configured to execute instructions for a domain extensibility module that provides software development tools for building domain extensions for a database platform, and a data ingestion module that provides software development tools for defining a metadata schema for extracting metadata from data files. The one or more processors are configured to receive a set of data from a user computing device, define a target metadata schema that includes one or more metadata fields that will be populated during a data ingestion process, define a target domain extension that defines one or more data types for storing the received set of data after performing the data ingestion process, and ingest the received set of data using a metadata extraction pipeline to generate metadata files based on the target metadata schema.

Abstract: Examples are disclosed that relate to an energy data platform. One example provides a method comprising receiving a first energy data set having a first data format, and a second energy data set having a second data format, and ingesting the first energy data set and the second energy data set by automatically converting one or more of the first energy data set and the second energy data set into a standard data format. The method further comprises receiving a request from a first application to provide the first energy data set in the first data format, and in response, providing the first energy data set in the first data format, and receiving a request from a second application to provide the first energy data set in the standard data format, and in response, providing the first energy data set in the standard data format.

Abstract: One example provides a computing system configured to implement a greenhouse gas (GHG) tracking and auditing platform for tracking GHG emissions associated with a plurality of GHG entities, each GHG entity representing one or more of a GHG source and a GHG sink. The computing system comprises a logic subsystem and a data-holding subsystem comprising computer-readable instructions. The instructions are executable to receive sensor data over time from each sensor of one or more sensors, each sensor configured to sense data related to GHG emissions. The instructions are further executable to, for each time interval of a plurality of time intervals, determine a GHG emission amount based at least in part on the sensor data and store GHG emission data. The instructions are further executable to receive a request for a set of GHG emission data and in response to the request, output the set of GHG emission data.

Abstract: A server computing device including a processor. The processor may be configured to, via an application program interface (API), receive a hierarchical data file including a plurality of datasets that are hierarchically organized in a plurality of dataset groups. The processor may be further configured to assign respective dataset metadata to the datasets and respective dataset group metadata to the dataset groups. The processor may be further configured to store, in memory, the plurality of datasets, the dataset metadata, and the dataset group metadata. The processor may be further configured to, via the API, receive a dataset query from a client computing device. The processor may be further configured to perform a search over the dataset metadata and/or the dataset group metadata to thereby generate search results. The processor may be further configured to transmit the search results to the client computing device via the API.

Abstract: A computing device including a processor is provided. For one or more emissions factors, the processor may be configured to receive respective emissions factor data including sensor data received from one or more sensors and user-specified data received at a user interface. The processor may be further configured to receive a plurality of virtual sensor models. Each virtual sensor model may include one or more respective virtual sensor model parameters. At least in part by applying the virtual sensor models to the emissions factor data, the processor may be further configured to compute a plurality of virtual sensor readouts. The processor may be further configured to generate a greenhouse gas emissions estimate from the virtual sensor readouts. The processor may be further configured to convey an indication of the greenhouse gas emissions estimate to the user interface for output on one or more output devices.

Abstract: Methods and systems are provided that are directed to identifying an individual having a specific skill and that is best suited for performing a particular task. The individual may be identified based on having a highest score for the skill out of a pool of individuals having the same skill. In examples, a score specific to each individual out of the pool of individuals having the same skill may be based on multiple interactions with the skill and may be adjusted based on a recency of when each interaction occurred and a level of involvement the individual had with the skill. Accordingly, individuals having recent experience with the skill may be scored, and therefore, ranked higher than individuals having experience with the skill that may have occurred further back in time. In examples, the information about the skills and experiences may be utilized to automatically generate the score.