Abstract: A system and method for data entries deduplication are provided. The method includes indexing an input data set, wherein the input data set is in a tabular formant and the indexing includes providing a unique Row identifier (RowID), wherein rows are the data entries; computing attribute similarity for each column across each pair of rows; computing, for each pair of rows, row-to-row similarity as a weighted sum of attribute similarities; clustering pairs of rows based on their row-to-row similarities; and providing an output data set including at least the clustered pairs of rows.

Abstract: A system and method for performing a hash bucketing process on data in motion are presented. The method includes applying a first hash function on an input dataset to map the input dataset to a bucket, wherein the first hash function results with a first hash value; applying a second hash function on the first hash value to map the input dataset to a record in the bucket; generating metadata based on the input dataset, wherein the metadata at least points to the original location of the input dataset; and storing the generated metadata in the record in the bucket.

Abstract: In some examples, a computer system may receive an indication to present a user interface presenting data for a plurality of metrics related to at least one of a status or a performance of a storage system. The computer system may determine a status of a workflow that processes messages received from the storage system. Further, the computer system may determine an end time for a plurality of metric visualizations to present in the user interface based on the status of the workflow. The computer system may render the plurality of metric visualizations, with each metric visualization having the determined end time. Further, the computer system may provide the plurality of rendered metric visualizations for presentation in the user interface on a display.

Abstract: A system and computer implemented method for cataloging database metadata using a signature matching process are provided. The method includes receiving an input name to be matched to a key in a seed table; generating a first fingerprint by decomposing the received input name into a first set n-grams; generating, based on the received input name, a second fingerprint using a predetermined pronunciation schema, wherein the second fingerprint is a phonetic fingerprint; generating a third fingerprint by decomposing the second fingerprint into a second set of n-grams; identifying a matching key by matching any combination of the first fingerprint, the second fingerprint, and the third fingerprint against keys in the seed table; and cataloging the metadata with the matching key as a tag.

Abstract: In some examples, a computer system may receive a data object including object data. For example, the system may be one of three or more systems located at different respective geographic locations. The system may determine a plurality of chunks by dividing the object data into a plurality of data chunks based on a total number of the systems and determining a parity chunk. The system may send some of the chunks to the other systems, while maintaining a complete instance of the object data at the first system. The system may associate a time with the object data based on receiving the data object. Additionally, the system may associate a time threshold with the complete instance of the object data. For example, the time threshold may indicate a time at which the complete instance of the object data is to be deleted from the system.

Abstract: In system for analyzing large data sets, document/file format can be discovered by attempting to parse the file using several parsers to generate a schema, assigning a score to each parsing, and selecting a parser based on the assigned scores. Schema element attributes, such as statistical parameters, can be derived and used in identifying schema elements associated with other files. Attributes of identified schema elements can be used to substitute missing data values with values based on such attributes. Data values corresponding schema elements can be selected and highlighted, and schema elements and/or attributes thereof can be highlighted based on selected data values. From a cluster of files, a lineage relationship between file pairs, indicating whether one file is derived from another, can be determined for several files. In reducing/compacting data, utilization of all available reducers can be optimized according to current utilization of one or more reducers.

Abstract: A computer program product comprising computer-readable instructions that, when executed in a computer system including one or more computers, cause the computer system to generate or update a user interface of a software application, the computer program product including programmably interconnected objects, said objects including one or more model objects, one or more view objects, and one or more controller objects, wherein each model object is interconnected for data exchange with one or more view objects and/or with one or more controller objects; and each model object includes one or more sub-model objects including hierarchically structured data and representing a state of the user interface; and each view object is associated with at least one model object or at least one sub-model object and configured to generate the user interface or update the user interface in accordance with a change of the state.

Abstract: In some examples, a system may use content classes to manage indexing of object data. A content class may include a set of one or more content properties. Each content property may include a name, an expression for extracting data, and an expression type. When object data is received, such as for indexing, the expression type of each content property may be compared with the data type of the received data. Based at least in part on determining that the expression type matches the data type, the system may extract a data value from the received data in accordance with the expression. The system may save the extracted data value to a data structure in association with the name of the content property, and may subsequently use the data value and the name of the content property when creating an index for the object data.

Abstract: A method and system for tagging database columns are presented. The method includes receiving an input column name of at least one column in a database; performing signature matching of the input column name to contents of a seed table; determining a first confidence score for the signature matching; and tagging a matching value in the seed table as a tag for the input column name, when a first confidence score exceeds a first threshold value.

Abstract: In some examples, a computer system may receive video from one or more video sources. The computer system may detect a plurality of faces in a first video portion of the received video. Further, the computer system may determine that a first face of the plurality of faces has features indicative of an emotion of interest. Based on determining that the first face has the features indicative of the emotion of interest, the computer system may redact other faces of the plurality of faces while leaving the first face unredacted in the first video portion. The computer system may send the first video portion with the first face unredacted and the other faces redacted to at least one computing device.

Abstract: In some examples, a system may include at least one class of storage that is configured for having freed storage space reclaimed to enable reuse of the freed storage space. For instance, the system may determine whether a volume corresponding to the at least one class of storage is used to store system data or user data. If the volume is used to store user data, then the system may determine whether any of the user data has been deleted from the volume. If data has been deleted from the volume, the system may determine whether an available capacity of the volume is less than a remaining capacity threshold before performing reclamation on the at least one storage device corresponding to the volume. Alternatively, if the volume is used to store system data, the system may perform reclamation based on an elapsed period of time since the last reclamation.

Abstract: In some examples, a computer system may receiving a request to allow a second user associated with a second user account to access at least one of a folder or a link associated with a first user account of a first user. The computer system may determine a first profile associated with the first user account, and may further determine whether sharing whitelisting is enabled for the first profile. Additionally, the computer system may determine a second profile associated with the second user account, and may determine whether the second profile is included in a sharing whitelist of the first profile. When sharing whitelisting is enabled for the first profile, the computer system may allow a client device associated with the second user account to access the folder and/or the link when the second profile is included in the sharing whitelist of the first profile.

Abstract: Systems and methods to deploy cloud infrastructure. In one approach, a method includes creating a blueprint using a user interface displayed at a user device, automatically generating code based on the blueprint (e.g., generating the code using a server), and deploying the cloud infrastructure using the code (e.g., deploying to the AWS cloud).

Abstract: Systems and methods to generate testing infrastructure on a cloud for testing software (e.g. an application that runs in a cloud hosted by an AWS server). In one approach, a method includes: generating testing infrastructure on a cloud; and testing, using the testing infrastructure, an application. The method further includes instantiating a browser in the testing infrastructure; importing at least one test case from a repository; and executing the at least one test case for the application.

Abstract: User access to a data storage system including one or more nodes providing a plurality of data storage resources is controlled, the plurality of data storage resources storing one or more user-accessible primary data structures and one or more user-accessible secondary data structures, each secondary data structures being stored on the basis of a respective associated primary data structure, wherein the data storage system stores, for each secondary data structure, data structure metadata which is indicative of a parent data storage resource and an owner data storage resource of the respective secondary data structure. Upon receiving a user request to access a certain secondary data structure of the one or more secondary data structures stored on a respective parent data storage resource, based on data structure metadata stored for the certain secondary data structure, the respective owner data storage resource of the certain secondary data structure is determined.

Abstract: The present application relates to a data system for managing synchronized data protection operations at plural nodes of the data system, the data system including at least a first node and a second node, wherein the first node is communicably connected to the second node and is configured to operate on the basis of first sequence information, the first node being configured to perform a first data protection operation and to transmit a synchronization notification to the second node on the basis of respective instructions included in the first sequence information, and wherein the second node is configured to receive the synchronization notification from the first node and to operate on the basis of second sequence information, the second node being configured to perform a second data protection operation upon receipt of the synchronization notification on the basis of a respective instruction included in the second sequence information.

Abstract: In some examples, one or more computing devices may perform deduplication of data. For instance, a first device may receive, from a second device, a first data-portion identifier corresponding to a first deduplication data portion. The first device may include a first index portion of a deduplication index and the second device may include a second index portion of the deduplication index. Further, the first data-portion identifier may be received based on a first data-portion identifier portion being in a range of values assigned to the first index portion. The first device may locate, in the first index portion of the deduplication index, a second data-portion identifier that matches the first data-portion identifier. The first device may associate the first reference information for the first deduplication data portion with a second deduplication data portion referenced by reference information associated with the second data-portion identifier.

Abstract: In some examples, a system may receive, from a first user, a request to create a team folder from a folder associated with the first user. The request may indicate a requested storage quota from a team folder storage pool to associate with the team folder. The system may determine whether the requested storage quota is below a threshold amount corresponding to a profile for team folder creation associated with the first user. If the requested storage quota is below the threshold amount, the system may automatically create a shared file system for the team folder and allocate a quantity of storage from the team folder storage pool to the shared file system based on the requested storage quota. Alternatively, if the requested storage quota exceeds the threshold amount, the system may generate a communication to an administrator to request approval for creation of the team folder.

Abstract: A storage control system to provide file-level storage and block-level storage services. The storage control system has a computer system including a second I/O unit configured to receive block-level storage related requests, a processor unit, a first memory unit, and a storage unit; and a programmable logic device including a first I/O unit configured to receive file-level storage related requests, an interface unit configured to communicate with the computer system, one or more programmable hardware-implemented processing units and for processing of file-level storage related requests, and a second memory unit.

Abstract: A method and apparatus for cloud infrastructure voting to optimize usage of the cloud infrastructure are provided. The method determines the need to access a database or cloud services within a cloud infrastructure, determining a time of that need to access the database or cloud services within the cloud infrastructure. Access to the database or cloud services within the cloud infrastructure is determined based on the time of the need to access the database or cloud services using predetermined access rules. The apparatus provides a voter and user information database that contains the predetermined access rules for accessing the cloud infrastructure.