Abstract: A computer implemented method processes a query. A number of processor units processes the query to identify a result set in response to receiving the query from a first client. The number of processor units stores, the result set in a shared cache assigned to a group of clients, wherein result set stored in the shared cache is accessible by the group of clients. The number of processor units returns the result set to a second client in the group of clients from the shared cache in response to receiving the query from the second client in the group of clients.

Abstract: An accelerator device includes a first processing unit to access a structure of a graph dataset, and a second processing unit coupled with the first processing unit to perform computations based on data values in the graph dataset.

Abstract: A method for controlling compression of data includes accessing genomic annotation data in one of a plurality of first file formats, extracting attributes from the genomic annotation data, dividing the genomic annotation data into multiple chunks, and processing the extracted attributes and chunks into correlated information. The method also includes selecting different compressors for the attributes and chunks identified in the correlated information and generating a file in a second file format that includes the correlated information and information indicative of the different compressors for the chunks and attributes indicated in the correlated information. The information indicative of the different compressors is processed into the second file format to allow selective decompression of the attributes and chunks indicated in correlated information.

Abstract: A system for integrated analysis and management of video data includes a routing server configured to receive video data from an external input video providing device, a video database configured to store the received video data, a video analyzing server cluster including a plurality of video analyzing servers configured to analyze the video data, a metadata database configured to store metadata of the video data, and a video search server configured to search the metadata database and the video database. As described in various embodiments of the present disclosure, the system can perform integrated analysis of various video data received from a number of channels and provide an analysis result, and can also rapidly provide an accurate search result in response to a user's request for search.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for responding to a query. In some implementations, a computer obtains a query. The computer determines a meaning for each term in the query. The computer determines user data for the user that submitted the query. The computer identifies one or more ontologies based on the meanings for at least some of the terms. The computer identifies a knowledge graph based on the identified ontologies and the user data. The computer generates a response to the query by traversing a path of the identified knowledge graph to identify items in the knowledge graph based on the determined meaning for each of the terms. The computer generates path data that represents the path taken by the computer through the identified knowledge graph. The computer provides the generated response and the path data to the client device.

Abstract: This disclosure provides systems, methods, and media for creating a data graph database from various unstructured and unstructured data items for use by various services. The method comprises the operations of identifying unstructured data items in data subjects; recognizing regions of interest (ROIs) in the unstructured data items; and extracting the ROIs from the unstructured data items. The method further comprises encoding the extracted ROIs into ROI vectors; creating a data graph to represent the data subjects, the data items, and the ROI vectors; and storing the data graph into a graph database. The various embodiments can manage data items of different data formats together rather than separately, thus creating a data management system for managing data across data formats. The data management system can also store structured data items into the graph database, thus complementing the existing ETL procedure for structured data items.

Abstract: Disclosed are embodiments for providing batch performance using a stream processor. In one embodiment, a method is disclosed comprising receiving an event, such as a streaming event, from a client. The method determines that the event comprises a primary event and, if so, writes the primary event to a cache and returning the primary event to the client. The method later receives a second event from the client, the second event associated with the first event, annotates the second event based on the primary event, and returns the annotated second event to the client.

Abstract: A method is provided for resharding a sharded database sharded according to a first shard key. The method includes: receiving, by a processor an instruction to reshard the sharded database; receiving, at the processor, a new shard key to be used in a resharding process to reshard the sharded database; determining, by the processor, whether a duration of unavailability of the sharded database during the resharding process is less than a predetermined amount of time; and automatically performing, by the processor, the resharding process according to the new shard key to produce a resharded database, if the duration of unavailability is less than the predetermined amount of time. The method may be performed without users noticing a significant interruption to read/write operations from/to the database.

Abstract: In one embodiment, a device receives, from a requestor, a query function that queries a dataset and an intended use schema associated with the query function. The device determines, using a policy ruleset, whether the intended use schema falls within an available schema for the dataset. The device executes the query function on the dataset to form a result data, when the intended use schema falls within the available schema for the dataset. The device provides the result data to the requestor.

Abstract: A data platform for running a subset of cells in a notebook is provided. The data platform receives a run cells message from a notebook user interface (UI) application specifying the subset of cells to run. For each cell in the subset, the data platform runs the cell to generate a set of results, generates a cell execution stream using the results, stores the stream, and transmits the stream to the notebook UI application. The notebook UI application generates a display for the user using the cell execution stream. The data platform provides an efficient way to run specific cells in a notebook and display the results to the user.

Abstract: A method for utilizing a graph path cache to facilitate real-time data consumption by a plurality of machine learning models is disclosed. The method includes receiving an input from a source, the input relating to a request to characterize a data element; retrieving a data attribute that corresponds to the data element from a data management system; determining, in real-time using the graph path cache, a graph attribute that corresponds to the data element by performing deep link analysis on a graph database; executing, in real-time, a model by using the data attribute and the graph attribute, the model corresponding to the request in the input; and transmitting, in real-time, a result of the executed model to the source in response to the input.

Abstract: An internally-constructed permissions graph database enabling a user to construct and alter the graph database permissions within the graph database. Edge permissions define whether a one node can View, Edit, or Manage another node. A node can view another node if there is at least one edge path connecting the nodes having a “View” permission. Similarly, a node can “Edit” or “Manage” another node if there is at least one edge path connecting the nodes having allowing “Edit” and/or “Manage” permissions, respectively. If a contiguous path of permission edges does not exist from the “caller node” to the “requested node” to be acted upon, then permission to perform the desired action or operation on that node is not granted. Edges have permissions, and Nodes have properties. A “Caller Node” makes Requests upon and “Requested Node,” which are limited by edge permissions.

Abstract: One example method includes receiving a data stream that comprises data in a form of multi-dimensional data structures. The data stream may be received in real time as it is generated. Metadata about the data may be generated and stored. Further, portions of the data may be selected and cached, and the cached data analyzed in real time. Based on the analyzing, various insights may be generated concerning the data that was analyzed.

Abstract: Disclosed herein are methods, systems, and processes for context-based identification of anomalous log data. Log data with multiple original logs is received at an anomalous log data identification system. A context associated training dataset is generated by splitting a string in a log into multiple split strings, generating a context association between each split string and a unique key that corresponds to the log, and generating an input/output (I/O) string data batch that includes I/O string data for each split string in the log by training each split string against every other split string in the log. A context-based anomalous log data identification model is then trained according to a machine learning technique using the I/O string data batch that includes a list of unique strings in the context associated training dataset.

Abstract: During a garbage collection process of a data storage device, superblocks may be filled with dummy data, which may decrease device performance. Embodiments described herein provide systems, methods, and computer readable media for varying a size of a superblock to reduce or eliminate dummy data in a data storage device including a plurality of superblocks. Each of the plurality of superblocks including a plurality of die blocks.

Abstract: Systems and methods for generating a data aggregator interactive graphical user interface. An interactive graphical user interface (GUI) includes a selectable symbol region, a query region and a data results region. The selectable symbol region displays predefined symbols. The query region displays user input fields for generating queries. The system receives user input associated with the user input fields of the query region to form a filter set. The data results region is automatically updated responsive to the user input, to display one or more data values from among one or more databases associated with the filter set. The system receives a subscription request to save the filter set as a user-customized query. A custom symbol is created responsive to the subscription request that is associated with the filter set. The the selectable symbol region is updated to display the custom symbol together with the predefined symbols.

Abstract: An accelerator is disclosed. The accelerator may include an on-chip memory to store a data from a database. The on-chip memory may include a first memory bank and a second memory bank. The first memory bank may store the data, which may include a first value and a second value. A computational engine may execute, in parallel, a command on the first value in the data and the command on the second value in the data in the on-chip memory. The on-chip memory may be configured to load a second data from the database into the second memory bank in parallel with the computation engine executing the command on the first value in the data and executing the command on the second value in the data.

Abstract: A programmable device receives commands from a processor and, based on the commands: identifies a root node in a graph; identifies nodes in the graph that are neighbors of the root node; identifies nodes in the graph that are neighbors of the neighbors; retrieves data associated with the root node; retrieves data associated with at least a subset of the nodes that are neighbors of the root node and that are neighbors of the neighbor nodes; and writes the data that is retrieved into a memory.

Abstract: A controller that controls a control target includes one or more processors, a memory that stores a program to be executed by the processors, a communication interface that accesses a database, and a storage device. The one or more processors is programed to generate an SQL statement in accordance with a function block defined in a user program based on configuration information that defines a correspondence relationship between a data type of the user program and a data type of the database, send the generated SQL statement to the database when the execution result of the SQL statement indicates an error, associate the SQL statement with an execution result of the SQL statement sent to the database and store the same as an error log in the storage device, and send the error log to an information processing device in response to a request.

Abstract: A system for loading graph data from an external store in response to a graph query is disclosed. In some embodiment, given a graph database where all vertices are stored in memory and some but not all edges are stored in the external store, the system performs one of two methods. In the first method, the system iteratively expands a set of vertices that is initially specified in the graph query and collects all edges connected to the set of vertices, including edges stored in the external store, that satisfy a vertex constraint also specified in the query. In the second method, the system finds a set of vertices that satisfy the vertex constraint and collects all edges connected to the set of vertices, including edges stored in an external store.