Patents by Inventor Gary Grider

Gary Grider has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10387384
    Abstract: Example embodiments of the present invention relate to a method, a system, and a computer program product for managing metadata. The method includes determining a common characteristic of metadata entries for a plurality of files in a directory of a file system and computing a representative metadata entry for the plurality of metadata entries according to the common characteristic of the metadata entries. The plurality of metadata entries in the file system then may be represented according to the computed representative metadata entry.
    Type: Grant
    Filed: September 30, 2015
    Date of Patent: August 20, 2019
    Assignees: EMC IP Holding Company LLC, TRIAD National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, Gary Grider, Bradley W. Settlemyer
  • Patent number: 10375164
    Abstract: Parallel storage systems are provided with a burst buffer appliance for storage of a partitioned key-value store across a plurality of storage tiers. The burst buffer appliance is configured to store key-value data on first and second storage tiers comprising respective disjoint subsets of storage. One or more servers in the partitioned key-value store provide (i) an interface between one or more local key-value stores and one or more additional storage architectures, and/or (ii) a key value interface that provides access to at least one hardware key-value store. The local key-values are optionally sorted both locally by the local store and globally by the overall MDHIM framework. The local and global sorting can be leveraged to provide batch input/output (IO) operations that aggregate multiple requests into batch operations on one or more sorted ranges.
    Type: Grant
    Filed: December 30, 2013
    Date of Patent: August 6, 2019
    Assignees: EMC Corporation, Triad National Security, LLC, UT-Battelle, LLC
    Inventors: John M. Bent, Sorin Faibish, Gary Grider, Aaron Torres, Stephen W. Poole
  • Patent number: 10313438
    Abstract: Partitioned key-value stores with one-sided communications are provided for secondary global key lookup by range-knowledgeable clients. A secondary global lookups is performed in a partitioned key-value store by receiving a request from an application for a secondary global key; accessing metadata to identify a first server storing the secondary global key; instructing the identified first server to store a first value corresponding to the requested secondary global key into a memory address of the client; and returning program control to the application, wherein the first server identifies a primary key corresponding to the requested secondary global key and instructs a second server storing the corresponding primary key to store a second value corresponding to the primary key into the memory address of the client. The second server stores the second value corresponding to the primary key into the first memory address of the client.
    Type: Grant
    Filed: December 30, 2013
    Date of Patent: June 4, 2019
    Assignees: EMC Corporation, Triad National Security, LLC, UT-Battelle, LLC
    Inventors: John M. Bent, Sorin Faibish, Gary Grider, Aaron Torres, Stephen W. Poole
  • Patent number: 10262000
    Abstract: Techniques are provided for globally appending data from a group of distributed processes to a shared file using a log-structured file system. Data generated by a plurality of processes in a parallel computing system are appended to a shared file by storing the data to the shared file using a log-structured file system (such as a Parallel Log-Structured File System (PLFS)); and generating an index entry for the data, the index entry comprising a logical offset entry and a timestamp entry indicating a time of the storage, wherein the logical offset entry is resolved at read time. The logical offset entry can be populated with an append placeholder that is resolved when the shared file is read. At read time, a plurality of the index entries associated with the shared file can be sorted using the timestamp entry to deliver the requested shared file to a requesting application.
    Type: Grant
    Filed: June 19, 2013
    Date of Patent: April 16, 2019
    Assignees: EMC Corporation, Los Alamos National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, Gary Grider, Aaron Torres
  • Patent number: 10140304
    Abstract: A file system is provided having a plurality of distributed metadata servers with separate metadata servers for file metadata and directory metadata. An exemplary distributed metadata storage system comprises a plurality of compute nodes, wherein at least one compute node comprises a file system client that generates a directory metadata request and/or a file metadata request; a plurality of directory metadata servers to serve directory metadata in response to a given directory metadata request; and a plurality of file metadata servers to serve file metadata in response to a given file metadata request. The plurality of directory metadata servers are distinct from the plurality of file metadata servers. The compute nodes optionally comprise an object client that requests object data from an object store system.
    Type: Grant
    Filed: December 10, 2015
    Date of Patent: November 27, 2018
    Assignees: EMC IP Holding Company LLC, Los Alamos National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, Gary Grider
  • Patent number: 10135924
    Abstract: Techniques are provided for computing data and metadata layout prior to storage in a storage system using a processing platform. An exemplary processing platform comprises one or more of a compute node and a burst buffer appliance. The processing platform communicates with a plurality of the compute nodes over a network, wherein a plurality of applications executing on the plurality of compute nodes generate a plurality of data objects; computes erasure metadata for one or more of the data objects on at least one of the compute nodes; and provides the erasure metadata with the corresponding one or more data objects to a storage system. The processing platform optionally determines a full set of the data objects to be stored and queries the storage system to determine an anticipated layout of the full set of the data objects to be stored. The anticipated layout allows special handling, for example, for small files and large files that are identified based on predefined criteria.
    Type: Grant
    Filed: June 26, 2015
    Date of Patent: November 20, 2018
    Assignees: EMC IP Holding Company LLC, Los Alamos National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, Dennis P. J. Ting, Sasan Teymouri, James M. Pedone, Jr., Gary Grider
  • Patent number: 9870168
    Abstract: A key-value store is provided having one or more key-value storage interfaces. A key-value store on at least one compute node comprises a memory for storing a plurality of key-value pairs; and an abstract storage interface comprising a software interface module that communicates with at least one persistent storage device providing a key-value interface for persistent storage of one or more of the plurality of key-value pairs, wherein the software interface module provides the one or more key-value pairs to the at least one persistent storage device in a key-value format. The abstract storage interface optionally processes one or more batch operations on the plurality of key-value pairs. A distributed embodiment for a partitioned key-value store is also provided.
    Type: Grant
    Filed: December 22, 2014
    Date of Patent: January 16, 2018
    Assignees: EMC Corporation, Los Alamos National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, Dennis P. J. Ting, Percy Tzelnic, Uday Gupta, Gary Grider, David J. Bonnie
  • Patent number: 9852146
    Abstract: A cluster file system is provided having a plurality of distributed metadata servers with shared access to one or more shared low latency persistent key-value metadata stores. A metadata server comprises an abstract storage interface comprising a software interface module that communicates with at least one shared persistent key-value metadata store providing a key-value interface for persistent storage of key-value metadata. The software interface module provides the key-value metadata to the at least one shared persistent key-value metadata store in a key-value format. The shared persistent key-value metadata store is accessed by a plurality of metadata servers. A metadata request can be processed by a given metadata server independently of other metadata servers in the cluster file system. A distributed metadata storage environment is also disclosed that comprises a plurality of metadata servers having an abstract storage interface to at least one shared persistent key-value metadata store.
    Type: Grant
    Filed: March 20, 2015
    Date of Patent: December 26, 2017
    Assignees: EMC IP Holding Company LLC, Los Alamos National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, James M. Pedone, Jr., Percy Tzelnic, Dennis P. J. Ting, Latchesar A. Ionkov, Gary Grider
  • Patent number: 9811545
    Abstract: A sparse file is stored without holes by storing a data portion of the sparse file using a parallel log-structured file system; and generating an index entry for the data portion, the index entry comprising a logical offset, physical offset and length of the data portion. The holes can be restored to the sparse file upon a reading of the sparse file. The data portion can be stored at a logical end of the sparse file. Additional storage efficiency can optionally be achieved by (i) detecting a write pattern for a plurality of the data portions and generating a single patterned index entry for the plurality of the patterned data portions; and/or (ii) storing the patterned index entries for a plurality of the sparse files in a single directory, wherein each entry in the single directory comprises an identifier of a corresponding sparse file.
    Type: Grant
    Filed: June 19, 2013
    Date of Patent: November 7, 2017
    Assignees: EMC IP Holding Company LLC, Los Alamos National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, Gary Grider, Aaron Torres
  • Patent number: 9767107
    Abstract: Improved techniques are provided for storing metadata associated with a plurality of sub-files associated with a single shared file in a parallel file system. The shared file is generated by a plurality of applications executing on a plurality of compute nodes. A compute node implements a Parallel Log Structured File System (PLFS) library to store at least one portion of the shared file generated by an application executing on the compute node and metadata for the at least one portion of the shared file on one or more object storage servers. The compute node is also configured to implement a partitioned data store for storing a partition of the metadata for the shared file, wherein the partitioned data store communicates with partitioned data stores on other compute nodes using a message passing interface. The partitioned data store can be implemented, for example, using Multidimensional Data Hashing Indexing Middleware (MDHIM).
    Type: Grant
    Filed: June 29, 2013
    Date of Patent: September 19, 2017
    Assignees: EMC IP Holding Company LLC, Los Alamos National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, Gary Grider, Aaron Torres
  • Patent number: 9563426
    Abstract: A partitioned key-value store is provided that supports atomic memory operations. A server performs a memory operation in a partitioned key-value store by receiving a request from an application for at least one atomic memory operation, the atomic memory operation comprising a memory address identifier; and, in response to the atomic memory operation, performing one or more of (i) reading a client-side memory location identified by the memory address identifier and storing one or more key-value pairs from the client-side memory location in a local key-value store of the server; and (ii) obtaining one or more key-value pairs from the local key-value store of the server and writing the obtained one or more key-value pairs into the client-side memory location identified by the memory address identifier. The server can perform functions obtained from a client-side memory location and return a result to the client using one or more of the atomic memory operations.
    Type: Grant
    Filed: September 30, 2014
    Date of Patent: February 7, 2017
    Assignees: EMC IP Holding Company LLC, Los Alamos National Security
    Inventors: John M. Bent, Sorin Faibish, Gary Grider
  • Publication number: 20160381138
    Abstract: Techniques are provided for computing data and metadata layout prior to storage in a storage system using a processing platform. An exemplary processing platform comprises one or more of a compute node and a burst buffer appliance. The processing platform communicates with a plurality of the compute nodes over a network, wherein a plurality of applications executing on the plurality of compute nodes generate a plurality of data objects; computes erasure metadata for one or more of the data objects on at least one of the compute nodes; and provides the erasure metadata with the corresponding one or more data objects to a storage system. The processing platform optionally determines a full set of the data objects to be stored and queries the storage system to determine an anticipated layout of the full set of the data objects to be stored. The anticipated layout allows special handling, for example, for small files and large files that are identified based on predefined criteria.
    Type: Application
    Filed: June 26, 2015
    Publication date: December 29, 2016
    Inventors: John M. Bent, Sorin Faibish, Dennis P. J. Ting, Sasan Teymouri, James M. Pedone, JR., Gary Grider
  • Patent number: 9477682
    Abstract: Techniques are provided for parallel compression of data chunks being written to a shared object. A client executing on a compute node or a burst buffer node in a parallel computing system stores a data chunk generated by the parallel computing system to a shared data object on a storage node by compressing the data chunk; and providing the data compressed data chunk to the storage node that stores the shared object. The client and storage node may employ Log-Structured File techniques. The compressed data chunk can be de-compressed by the client when the data chunk is read. A storage node stores a data chunk as part of a shared object by receiving a compressed version of the data chunk from a compute node; and storing the compressed version of the data chunk to the shared data object on the storage node.
    Type: Grant
    Filed: March 13, 2013
    Date of Patent: October 25, 2016
    Assignees: EMC Corporation, Los Alamos National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, Gary Grider
  • Patent number: 9436722
    Abstract: Checksum values are generated and used to verify the data integrity. A client executing in a parallel computing system stores a data chunk to a shared data object on a storage node in the parallel computing system. The client determines a checksum value for the data chunk; and provides the checksum value with the data chunk to the storage node that stores the shared object. The data chunk can be stored on the storage node with the corresponding checksum value as part of the shared object. The storage node may be part of a Parallel Log-Structured File System (PLFS), and the client may comprise, for example, a Log-Structured File System client on a compute node or burst buffer. The checksum value can be evaluated when the data chunk is read from the storage node to verify the integrity of the data that is read.
    Type: Grant
    Filed: March 13, 2013
    Date of Patent: September 6, 2016
    Assignees: EMC Corporation, Los Alamos National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, Gary Grider
  • Patent number: 9317521
    Abstract: Cloud object storage is enabled for checkpoints of high performance computing applications using a middleware process. A plurality of files, such as checkpoint files, generated by a plurality of processes in a parallel computing system are stored by obtaining said plurality of files from said parallel computing system; converting said plurality of files to objects using a log structured file system middleware process; and providing said objects for storage in a cloud object storage system. The plurality of processes may run, for example, on a plurality of compute nodes. The log structured file system middleware process may be embodied, for example, as a Parallel Log-Structured File System (PLFS). The log structured file system middleware process optionally executes on a burst buffer node.
    Type: Grant
    Filed: December 28, 2012
    Date of Patent: April 19, 2016
    Assignees: EMC Corporation, Los Alamos National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, Gary Grider
  • Patent number: 9298733
    Abstract: Techniques are provided for storing files in a parallel computing system based on a user-specification. A plurality of files generated by a distributed application in a parallel computing system are stored by obtaining a specification from the distributed application indicating how the plurality of files should be stored; and storing one or more of the plurality of files in one or more storage nodes of a multi-tier storage system based on the specification. The plurality of files comprise a plurality of complete files and/or a plurality of sub-files. The specification can optionally be processed by a daemon executing on one or more nodes in a multi-tier storage system. The specification indicates how the plurality of files should be stored, for example, identifying one or more storage nodes where the plurality of files should be stored.
    Type: Grant
    Filed: June 28, 2012
    Date of Patent: March 29, 2016
    Assignees: EMC Corporation, Los Alamos National Security, LLC
    Inventors: Sorin Faibish, John M. Bent, Jeffrey M. Nick, Gary Grider, Aaron Torres
  • Patent number: 9245048
    Abstract: Improved sorting techniques are provided that perform a parallel sort using a ranged, partitioned key-value store in a high performance computing (HPC) environment. A plurality of input data files comprising unsorted key-value data in a partitioned key-value store are sorted. The partitioned key-value store comprises a range server for each of a plurality of ranges. Each input data file has an associated reader thread. Each reader thread reads the unsorted key-value data in the corresponding input data file and performs a local sort of the unsorted key-value data to generate sorted key-value data. A plurality of sorted, ranged subsets of each of the sorted key-value data are generated based on the plurality of ranges. Each sorted, ranged subset corresponds to a given one of the ranges and is provided to one of the range servers corresponding to the range of the sorted, ranged subset. Each range server sorts the received sorted, ranged subsets and provides a sorted range.
    Type: Grant
    Filed: December 30, 2013
    Date of Patent: January 26, 2016
    Assignees: EMC Corporation, Los Alamos National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, Gary Grider, Aaron Torres, Stephen W. Poole
  • Patent number: 9183211
    Abstract: Improved techniques are provided for parallel writing of data to a shared object in a parallel computing system. A method is provided for storing data generated by a plurality of parallel processes to a shared object in a parallel computing system. The method is performed by at least one of the processes and comprises: dynamically determining a block size for storing the data; exchanging a determined amount of the data with at least one additional process to achieve a block of the data having the dynamically determined block size; and writing the block of the data having the dynamically determined block size to a file system. The determined block size comprises, e.g., a total amount of the data to be stored divided by the number of parallel processes. The file system comprises, for example, a log structured virtual parallel file system, such as a Parallel Log-Structured File System (PLFS).
    Type: Grant
    Filed: December 28, 2012
    Date of Patent: November 10, 2015
    Assignees: EMC Corporation, Los Alamos National Security, LLC
    Inventors: John M. Bent, Sorin Faibish, Gary Grider
  • Patent number: 9165014
    Abstract: Techniques are provided for storing files in a parallel computing system using different resolutions. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a sub-file. The method comprises the steps of obtaining semantic information related to the file; generating a plurality of replicas of the file with different resolutions based on the semantic information; and storing the file and the plurality of replicas of the file in one or more storage nodes of the parallel computing system. The different resolutions comprise, for example, a variable number of bits and/or a different sub-set of data elements from the file. A plurality of the sub-files can be merged to reproduce the file.
    Type: Grant
    Filed: June 28, 2012
    Date of Patent: October 20, 2015
    Assignees: EMC Corporation, Los Alamos National Security, LLC
    Inventors: Sorin Faibish, John M. Bent, Percy Tzelnic, Gary Grider, Aaron Torres
  • Patent number: 9122700
    Abstract: Collective buffering and data pattern solutions are provided for storage, retrieval, and/or analysis of data in a collective parallel processing environment. For example, a method can be provided for data storage in a collective parallel processing environment. The method comprises receiving data to be written for a plurality of collective processes within a collective parallel processing environment, extracting a data pattern for the data to be written for the plurality of collective processes, generating a representation describing the data pattern, and saving the data and the representation.
    Type: Grant
    Filed: December 20, 2012
    Date of Patent: September 1, 2015
    Assignee: Los Alamos National Security, LLC
    Inventors: Gary A. Grider, Stephen W. Poole