Abstract: A method for unstructured data analytics in data warehouses includes receiving an unstructured data query from a user, the unstructured data query requesting the data processing hardware determine one or more unstructured data files stored at a data repository that match query parameters. The method includes determining, using an object table, a set of unstructured data files stored at the data repository that matches the query parameters. The object table includes a plurality of rows, each row of the plurality of rows associated with a respective unstructured data file stored at the data repository, and a plurality of columns, each column of the plurality of columns comprising metadata associated with the respective unstructured data file of each row of the plurality of rows. The method includes returning, to the user, a structured data table including the determined set of unstructured data files.

Abstract: The present disclosure provides a storage engine that unifies data warehouses and lakes, by providing uniform fine-grained access control, performance acceleration across multi-cloud storage, and open formats. It provides an application programming interface (API) for query engines spanning across data warehouse and open source runtimes to access distributed data with consistent security and governance controls. Access is evaluated at the API layer, separate from the query engine, and is uniformly enforced across query engines.

Abstract: Techniques for providing an on-demand development environment are described. A service of a provider network receives a request to launch a development environment, such as a notebook, from an electronic device. The service obtains an identification of a computing cluster hosted by the provider network. The service obtains an identification of a compute instance hosted within the provider network, the compute instance executing a software environment to host one or more development environments. The service causes the compute instance to launch a development environment. The service sends a message to configure the launched development environment to execute a computer program written in the development environment using the computing cluster. The service generates a token to secure communications between the electronic device and the development environment and sends the token to an originator of the request.

Abstract: A distributed in-memory query processor may utilize a remote data store. Column segments may be retrieved from the remote data store and loaded into system memory of a computing node. The query processor may, in response to receiving a request to perform a query, identify columns and ranges of column values required to process the query. Partition-level schemas and cross-partition schemas may be formed for computing nodes holding column segments in memory. Computing nodes may be selected for processing the query based on a degree to which a partition or set of partitions matches data requirements of the query.

Abstract: Systems and methods of analyzing search metrics are disclosed. System users are provided with insight into the query or search activity in their system domains. Disclosed systems can enable continuous monitoring of search engine logs for search events (i.e., searches performed by applications using the search engine. Collected data regarding search events is used to derive various metrics such as the total number of queries performed in a relevant period, the total number of queries without results; the top N queries with counts; the top N queries which produced no results, with counts; and the top N documents in results, with counts. In at least one embodiment of the disclosure all such metrics are computed for a last full hour period and all metrics, except in some cases a top-N report, are available for user viewing on an hourly basis.

Abstract: Systems and methods of analyzing search metrics are disclosed. System users are provided with insight into the query or search activity in their system domains. Disclosed systems can enable continuous monitoring of search engine logs for search events (i.e., searches performed by applications using the search engine. Collected data regarding search events is used to derive various metrics such as the total number of queries performed in a relevant period, the total number of queries without results; the top N queries with counts; the top N queries which produced no results, with counts; and the top N documents in results, with counts. In at least one embodiment of the disclosure all such metrics are computed for a last full hour period and all metrics, except in some cases a top-N report, are available for user viewing on an hourly basis.

Abstract: Systems and methods of analyzing search metrics are disclosed. System users are provided with insight into the query or search activity in their system domains. Disclosed systems can enable continuous monitoring of search engine logs for search events (i.e., searches performed by applications using the search engine. Collected data regarding search events is used to derive various metrics such as the total number of queries performed in a relevant period, the total number of queries without results; the top N queries with counts; the top N queries which produced no results, with counts; and the top N documents in results, with counts. In at least one embodiment of the disclosure all such metrics are computed for a last full hour period and all metrics, except in some cases a top-N report, are available for user viewing on an hourly basis.