Abstract: Systems and methods for data usage monitoring in multi-tenancy enabled HADOOP clusters are disclosed. According to one embodiment, a method for monitoring data usage in multi-tenancy enabled HADOOP clusters may include: (1) receiving metadata related to a dataset in one or more multi-tenant clusters; (2) receiving entitlement data for a plurality of users to the dataset; (3) receiving group membership data for the plurality of users; (4) receiving access permissions for the plurality of users to the dataset; (5) receiving audit logs comprising access history for the plurality of users to the dataset; (6) joining the metadata, entitlement data, group membership data, access permissions, and audit logs into a searchable database; (7) receiving a query comprising at least one of a date range, a file, a directory, a user, and a group of users; (8) applying the query to the searchable database; and (9) returning results to the query.

Abstract: Security design and architecture for a multi-tenant Hadoop cluster are disclosed. In one embodiment, in a multi-tenant Hadoop cluster comprising a plurality of tenants and a plurality of applications, a method for identifying, naming, and creating a multi-tenant directory structure in a multi-tenant Hadoop cluster may include (1) identifying a plurality of groups for a directory structure selected from the group consisting of a superuser group, a plurality of tenant groups, and at least one application group; (2) creating an active directory for each of the groups; (3) adding each of a plurality of users to one of the plurality of tenant groups and the application group; (4) creating tenant directories and home directories for the users; and (5) assigning owners, group owners, default permissions, and extended access control lists to the tenant directories and the home directories.

Abstract: Systems and methods for optimizing cluster resource utilization are disclosed. Systems and methods for optimizing cluster resource utilization are disclosed. In one embodiment, in an information processing apparatus comprising at least one computer processor, a method for optimizing cluster resource utilization may include: (1) retrieving cluster usage information for at least one cluster resource in a multi-tenant environment; (2) determining tenant usage for the cluster resource for each of a plurality of tenants; (3) determining a tenant resource commitment for the cluster resource for each tenant; and (4) presenting tenant usage and tenant resource commitment for each resource.

Abstract: Systems and methods for optimizing cluster resource utilization are disclosed. Systems and methods for optimizing cluster resource utilization are disclosed. In one embodiment, in an information processing apparatus comprising at least one computer processor, a method for optimizing cluster resource utilization may include: (1) retrieving cluster usage information for at least one cluster resource in a multi-tenant environment; (2) determining tenant usage for the cluster resource for each of a plurality of tenants; (3) determining a tenant resource commitment for the cluster resource for each tenant; and (4) presenting tenant usage and tenant resource commitment for each resource.

Abstract: Systems and methods for optimizing cluster resource utilization are disclosed. Systems and methods for optimizing cluster resource utilization are disclosed. In one embodiment, in an information processing apparatus comprising at least one computer processor, a method for optimizing cluster resource utilization may include: (1) retrieving cluster usage information for at least one cluster resource in a multi-tenant environment; (2) determining tenant usage for the cluster resource for each of a plurality of tenants; (3) determining a tenant resource commitment for the cluster resource for each tenant; and (4) presenting tenant usage and tenant resource commitment for each resource.

Abstract: The invention is directed to a computer-implemented method and system for improving processing performance for a group of computing resources, the method implemented on at least one computer having a processor and accessing at least one data storage area. The method comprises implementing the processor for calculating a benchmark for each computing resource in the group of computing resources and normalizing the benchmark across the group of computing resources to determine a number of performance units for each computing resource. The method additionally includes providing a graphical user interface for facilitating visual comparison for comparing processing performance indicators for multiple computing resources in the group of computing resources and reconfiguring at least some of the computing resources represented on the graphical user interface based on the comparison.

Abstract: Security design and architecture for a multi-tenant Hadoop cluster are disclosed. In one embodiment, in a multi-tenant Hadoop cluster comprising a plurality of tenants and a plurality of applications, a method for identifying, naming, and creating a multi-tenant directory structure in a multi-tenant Hadoop cluster may include (1) identifying a plurality of groups for a directory structure selected from the group consisting of a superuser group, a plurality of tenant groups, and at least one application group; (2) creating an active directory for each of the groups; (3) adding each of a plurality of users to one of the plurality of tenant groups and the application group; (4) creating tenant directories and home directories for the users; and (5) assigning owners, group owners, default permissions, and extended access control lists to the tenant directories and the home directories.

Abstract: Security design and architecture for a multi-tenant Hadoop cluster are disclosed. In one embodiment, in a multi-tenant Hadoop cluster comprising a plurality of tenants and a plurality of applications, a method for identifying, naming, and creating a multi-tenant directory structure in a multi-tenant Hadoop cluster may include (1) identifying a plurality of groups for a directory structure selected from the group consisting of a superuser group, a plurality of tenant groups, and at least one application group; (2) creating an active directory for each of the groups; (3) adding each of a plurality of users to one of the plurality of tenant groups and the application group; (4) creating tenant directories and home directories for the users; and (5) assigning owners, group owners, default permissions, and extended access control lists to the tenant directories and the home directories.

Abstract: Systems and methods for resource management for multi-tenant applications in a Hadoop cluster are disclosed. In one embodiment, in an information processing device comprising at least one computer processor, a method for resource management for multi-tenant applications in a Hadoop cluster may include: (1) allocating an initial allocation of a resource in a resource pool to a plurality of tenants, each tenant having a workload; (2) determining a memory requirement for each of the plurality of tenants; (3) determining a maximum number of concurrent queries or jobs for each of the plurality of tenants; (4) determining a memory and vcore requirement for each of the plurality of tenants based on the memory requirement and maximum number of concurrent queries or jobs; and (5) allocating the resources to each of the plurality of tenants.

Abstract: Systems and methods for data usage monitoring in multi-tenancy enabled HADOOP clusters are disclosed. According to one embodiment, a method for monitoring data usage in multi-tenancy enabled HADOOP clusters may include: (1) receiving metadata related to a dataset in one or more multi-tenant clusters; (2) receiving entitlement data for a plurality of users to the dataset; (3) receiving group membership data for the plurality of users; (4) receiving access permissions for the plurality of users to the dataset; (5) receiving audit logs comprising access history for the plurality of users to the dataset; (6) joining the metadata, entitlement data, group membership data, access permissions, and audit logs into a searchable database; (7) receiving a query comprising at least one of a date range, a file, a directory, a user, and a group of users; (8) applying the query to the searchable database; and (9) returning results to the query.

Abstract: The invention is directed to a computer-implemented method and system for improving processing performance for a group of computing resources, the method implemented on at least one computer having a processor and accessing at least one data storage area. The method comprises implementing the processor for calculating a benchmark for each computing resource in the group of computing resources and normalizing the benchmark across the group of computing resources to determine a number of performance units for each computing resource. The method additionally includes providing a graphical user interface for facilitating visual comparison for comparing processing performance indicators for multiple computing resources in the group of computing resources and reconfiguring at least some of the computing resources represented on the graphical user interface based on the comparison.

Abstract: The invention is directed to a computer-implemented method and system for improving processing performance for a group of computing resources, the method implemented on at least one computer having a processor and accessing at least one data storage area. The method comprises implementing the processor for calculating a benchmark for each computing resource in the group of computing resources and normalizing the benchmark across the group of computing resources to determine a number of performance units for each computing resource. The method additionally includes providing a graphical user interface for facilitating visual comparison for comparing processing performance indicators for multiple computing resources in the group of computing resources and reconfiguring at least some of the computing resources represented on the graphical user interface based on the comparison.

Abstract: Systems and methods for resource management for multi-tenant applications in a Hadoop cluster are disclosed. In one embodiment, in an information processing device comprising at least one computer processor, a method for resource management for multi-tenant applications in a Hadoop cluster may include: (1) allocating an initial allocation of a resource in a resource pool to a plurality of tenants, each tenant having a workload; (2) determining a memory requirement for each of the plurality of tenants; (3) determining a maximum number of concurrent queries or jobs for each of the plurality of tenants; (4) determining a memory and vcore requirement for each of the plurality of tenants based on the memory requirement and maximum number of concurrent queries or jobs; and (5) allocating the resources to each of the plurality of tenants.

Abstract: Systems and methods for optimizing cluster resource utilization are disclosed. Systems and methods for optimizing cluster resource utilization are disclosed. In one embodiment, in an information processing apparatus comprising at least one computer processor, a method for optimizing cluster resource utilization may include: (1) retrieving cluster usage information for at least one cluster resource in a multi-tenant environment; (2) determining tenant usage for the cluster resource for each of a plurality of tenants; (3) determining a tenant resource commitment for the cluster resource for each tenant; and (4) presenting tenant usage and tenant resource commitment for each resource.

Abstract: Security design and architecture for a multi-tenant Hadoop cluster are disclosed. In one embodiment, in a multi-tenant Hadoop cluster comprising a plurality of tenants and a plurality of applications, a method for identifying, naming, and creating a multi-tenant directory structure in a multi-tenant Hadoop cluster may include (1) identifying a plurality of groups for a directory structure selected from the group consisting of a superuser group, a plurality of tenant groups, and at least one application group; (2) creating an active directory for each of the groups; (3) adding each of a plurality of users to one of the plurality of tenant groups and the application group; (4) creating tenant directories and home directories for the users; and (5) assigning owners, group owners, default permissions, and extended access control lists to the tenant directories and the home directories.

Abstract: Embodiments of the invention include a computer-implemented control and monitoring method and system for print shop management. The method may include monitoring multiple print servers and insertion devices for inserting printed material into envelopes. Programmed computer processing components may be used for performing steps including receiving print status data and insertion status data from multiple printing and insertion sites, and matching the print data with the insertion data for each submitted print job and integrating the print status data with the insertion data. The method additionally includes providing a user application including multiple user interfaces displaying the integrated print status data and insertion status data in an interactive format.

Abstract: Embodiments of the invention include a computer-implemented control and monitoring method and system for print shop management. The method may include monitoring multiple print servers and insertion devices for inserting printed material into envelopes. Programmed computer processing components may be used for performing steps including receiving print status data and insertion status data from multiple printing and insertion sites, and matching the print data with the insertion data for each submitted print job and integrating the print status data with the insertion data. The method additionally includes providing a user application including multiple user interfaces displaying the integrated print status data and insertion status data in an interactive format.

Abstract: The invention is directed to a computer-implemented method and system for improving processing performance for a group of computing resources, the method implemented on at least one computer having a processor and accessing at least one data storage area. The method comprises implementing the processor for calculating a benchmark for each computing resource in the group of computing resources and normalizing the benchmark across the group of computing resources to determine a number of performance units for each computing resource. The method additionally includes providing a graphical user interface for facilitating visual comparison for comparing processing performance indicators for multiple computing resources in the group of computing resources and reconfiguring at least some of the computing resources represented on the graphical user interface based on the comparison.

Abstract: The invention is directed to a computer-implemented method and system for improving processing performance for a group of computing resources, the method implemented on at least one computer having a processor and accessing at least one data storage area. The method comprises implementing the processor for calculating a benchmark for each computing resource in the group of computing resources and normalizing the benchmark across the group of computing resources to determine a number of performance units for each computing resource. The method additionally includes providing a graphical user interface for facilitating visual comparison for comparing processing performance indicators for multiple computing resources in the group of computing resources and reconfiguring at least some of the computing resources represented on the graphical user interface based on the comparison.