Search Patents
  • Fair sampling of alternate data stream metrics for file systems
    Patent number: 10936538
    Abstract: Embodiments are directed to managing data in a file system. A query may be provided to determine characteristics associated with a file system and a sampling model. The sampling model may be employed to determine objects in the file system based on a traversal of the file system. The sampling model may be employed to determine metrics associated with the alternate data streams (ADSs) included in the objects such that each of the objects that includes a separate main data stream and the ADSs may be associated with data blocks and the ADSs may each be associated with other data blocks. The sampling model and the query may be employed to sample the objects to provide partial results such that the sampling may be distributed between the objects based on the sampling model and the metrics. A result to the query may be provided based on the partial results.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: March 2, 2021
    Assignee: Qumulo, Inc.
    Inventors: Thomas R. Unger, Michael Patrick Kirby, Thomas Scott Urban, Michael R. Fitz, Boyu Zhang
  • File system cache tiers
    Patent number: 11347699
    Abstract: Embodiments are directed to a file system engine that provides a file system that includes a plurality of blocks on a file storage tier with portion of the blocks associated with a cache storage tier. A cache engine provides heat extents that include a heat score and a run length value such that the heat extents are represent activities associated with the blocks. Heat extents associated with file system activities are determined based on a position of the blocks that corresponds with the run length values of the heat extents and sectors on the file storage tier. Heat scores associated with the heat extents may be modified based on the activities and distribution models to conform the heat extents with the distribution models. Blocks associated with heat scores that are less than a threshold value provided by the distribution models may be disassociated from the cache storage tier.
    Type: Grant
    Filed: January 13, 2020
    Date of Patent: May 31, 2022
    Assignee: Qumulo, Inc.
    Inventors: Edward Carpenter, Thomas Gregory Rothschilds, Peter J. Godman, Duncan Robert Fairbanks, Patrick Jakubowski, Zexuan Wang
  • Backup services for distributed file systems in cloud computing environments
    Patent number: 11435901
    Abstract: Embodiments are directed to managing data in a file system that includes storage nodes and storage volumes in a cloud computing environment (CCE). A backup job may be executed to perform further actions, including: providing a backup identifier that is associated with the backup job; determining the storage nodes based on the file system and the CCE; disabling the file system by disabling the storage nodes, wherein each disabled storage node is associated with a shutdown timestamp; determining storage volumes associated with each disabled storage node; and generating storage images that archive a copy of information from the storage volumes; associating the storage images with the backup identifier; confirming that the file system is consistent based on an absence of file system activity occurring subsequent to each shutdown timestamp; and enabling the file system by enabling the storage nodes.
    Type: Grant
    Filed: September 24, 2021
    Date of Patent: September 6, 2022
    Assignee: Qumulo, Inc.
    Inventors: Michael Anthony Chmiel, Duncan Robert Fairbanks, Stephen Craig Fleischman, Nicholas Graeme Williams
  • Data mobility, accessibility, and consistency in a data storage system
    Patent number: 10095708
    Abstract: A transactional block storage system is provided which is capable of supporting a single-phase commit for data writes specifying a protected storage unit. The storage system includes a data storage map that logically links the protected data storage unit to two or more block storage units associated with a layer of the protected data storage unit. The storage system also includes an address abstraction layer which translates write requests to the block storage units and resolves whether those write requests are atomically committed to the storage system in a single phase transaction. The address abstraction layer is further configured to detected when a block storage unit becomes unavailable during a transaction and create a cleaning kit for that block in order to prevent data loss. Additionally, the address abstraction layer facilitates moving, copying, and merging of block storage units without global locking in the storage system.
    Type: Grant
    Filed: March 13, 2015
    Date of Patent: October 9, 2018
    Assignee: Qumulo, Inc.
    Inventors: Aaron Passey, Neal Fachan, Peter Godman
  • Data mobility, accessibility, and consistency in a data storage system
    Patent number: 10860547
    Abstract: A transactional block storage system is provided which is capable of supporting a single-phase commit for data writes specifying a protected storage unit. The storage system includes a data storage map that logically links the protected data storage unit to two or more block storage units associated with a layer of the protected data storage unit. The storage system also includes an address abstraction layer which translates write requests to the block storage units and resolves whether those write requests are atomically committed to the storage system in a single phase transaction. The address abstraction layer is further configured to detected when a block storage unit becomes unavailable during a transaction and create a cleaning kit for that block in order to prevent data loss. Additionally, the address abstraction layer facilitates moving, copying, and merging of block storage units without global locking in the storage system.
    Type: Grant
    Filed: October 4, 2018
    Date of Patent: December 8, 2020
    Assignee: Qumulo, Inc.
    Inventors: Aaron Passey, Neal Fachan, Peter Godman
  • Managing throughput fairness and quality of service in file systems
    Patent number: 10860372
    Abstract: Embodiments are directed to managing file systems over a network. Jobs may be provided to a storage computer in a file system. Control models may be associated with the jobs. Scores may be generated based on the control models. Each job may be associated with a score provided by its associated control model. And, each job that may be behind its corresponding schedule may be associated with a higher score value than each other job that may be either on its corresponding other schedule or ahead of its corresponding other schedule. Commands may be selected for execution based on the commands being associated with a job that may be associated with the higher score value that may be greater than score values associated with other jobs. The jobs may be ranked based on the updated scores. Subsequent commands may be selected and executed based on the ranking of the jobs.
    Type: Grant
    Filed: January 24, 2020
    Date of Patent: December 8, 2020
    Assignee: Qumulo, Inc.
    Inventors: Yuxi Bai, Thomas Gregory Rothschilds, Jonathan Michael MacLaren, Noah Trent Nelson, Kimberly Alice Fairhurst
  • Replicating file system objects in distributed file systems
    Patent number: 10621147
    Abstract: Embodiments are directed to a file system engine that provides a file system with parent objects associated with child objects. The file system engine provides a replication snapshot associated with an epoch of the file system such that each child object modified during the epoch and each associated parent object is associated with the replication snapshot. A root object of a portion of the file system included in the replication snapshot may be provided. A replication engine may traverse the portion of file system starting from the root object such that the parent objects that are not associated with the replication snapshot are omitted from the traversal. The replication engine may determine replication objects based on the traversal such that each replication object was modified during the epoch. Then the replication engine may execute a replication job that copies replication objects to a target file system.
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: April 14, 2020
    Assignee: Qumulo, Inc.
    Inventors: Junjie Liang, Neal Thomas Fachan, Kevin David Jamieson, Kevin Ross O'Neill, Michael Anthony Chmiel
  • Managing file system state during replication jobs
    Patent number: 10725977
    Abstract: Embodiments are directed to managing data in a file system. A source file system may be mirrored on a target file system by executing one or more replication jobs. A root object of the source file system may be associated with a current read-only identifier corresponds to a current update epoch of the source file system. A replication job that copies objects from the source file system to the target file system may be executed. A write request directed to the source file system may be received. Write objects associated with the write request may be determined The source file system may be traversed upwards from the write objects. A read-only identifier associated with each visited object may be determined based on the read-only identifier matching the current read-only identifier. The write request may be enabled based on the mismatch of the read-only identifier and current read-only identifier.
    Type: Grant
    Filed: October 21, 2019
    Date of Patent: July 28, 2020
    Assignee: Qumulo, Inc.
    Inventors: Michael Anthony Chmiel, Sihang Su, Kevin David Jamieson
  • Replicating files in distributed file systems using object-based data storage
    Patent number: 11372819
    Abstract: Embodiments are directed to traversing a file system to determine file system objects to copy to an object store. In response to visiting a document object in the file system, performing further actions, including: determining a hierarchical file path of the document object that corresponds to a location in the file system based on the file system objects that are ancestor file system objects of the document object; generating an object key for the document object that encodes the hierarchical file path such that each portion of the object key corresponds to an ancestor file system object; copying the document object and the object key to the object store such that the document object may be stored in the object store as an object store object and such that the object store object may be indexed using an unordered index based on the object key; or the like.
    Type: Grant
    Filed: October 25, 2021
    Date of Patent: June 28, 2022
    Assignee: Qumulo, Inc.
    Inventors: Nicholas John Carter, Sasha Spielberg Friedrich, Christopher Charles Harward, Kevin David Jamieson, Aleksei Martynov, Sihang Su
  • Error resistant write-ahead log
    Patent number: 11722150
    Abstract: Embodiments are directed to error resistant logging. A write-ahead log (WAL) for preserving a verifiable record of file system activity may be provided such that the WAL may include a sequence of log blocks that each may include a cyclic redundancy check (CRC) value of a next adjacent log block in the WAL. In response to executing a file system operation associated with payload data, further actions may be performed, including: generating log blocks based on the payload data; generating a log segment that includes the log blocks; modifying a portion of the contents of a head-block of the log segment such that the modified head-block of the log segment has a CRC value that matches a CRC value of a tail-block of the WAL; copying the contents of the modified head-block of the log segment into the tail-block of the WAL.
    Type: Grant
    Filed: September 28, 2022
    Date of Patent: August 8, 2023
    Assignee: Qumulo, Inc.
    Inventors: Neal Thomas Fachan, Stephen Craig Fleischman, Conner Saltiel Hansen, David Patrick Rogers, III, Thomas Gregory Rothschilds, Hanqing Zhang
  • Dynamic evaluation and selection of file system pre-fetch policy
    Patent number: 10474635
    Abstract: Embodiments are directed to managing data in a file system. An engine may receive read requests associated with a file system that includes pre-fetch storage and file storage. The engine may employ a pre-fetch policy selected from a plurality of pre-fetch policies to copy blocks to pre-fetch storage. The engine may evaluate the selected pre-fetch policy and also evaluate simulated performances for each unselected pre-fetch policy based on subsequent read requests. The engine may provide a performance score based on the evaluation of the selected pre-fetch policy and it may provide other performance scores based on the simulated evaluation of each unselected pre-fetch policy If one of the other performance scores for one of the unselected pre-fetch policies exceeds the performance score of the selected pre-fetch policy, the engine may select that unselected pre-fetch policies as a new selected pre-fetch policy.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: November 12, 2019
    Assignee: Qumulo, Inc.
    Inventors: Thomas R. Unger, Eric E. Youngblut, Thomas Gregory Rothschilds, Jeremy Drouillard
  • Client aware pre-fetch policy scoring system
    Patent number: 10614033
    Abstract: Embodiments are directed to managing data in a file system. A pre-fetch engine may receive requests from a client the file system that includes a pre-fetch storage tier and a file storage tier of storage devices. The pre-fetch engine determines a pre-fetch policy based on the requests such that the pre-fetch policy determines which blocks to copy to the pre-fetch storage tier. And, the pre-fetch policy may be associated with a score model that includes score rules where one of the rules may be associated with a client score. The pre-fetch engine may obtain scores associated with the score rules such that the scores are based on previous requests made by the client. In response to scores exceeding a threshold value, the pre-fetch engine may copy the blocks to the pre-fetch storage tier. The pre-fetch engine may update the scores based on the performance of the pre-fetch policy.
    Type: Grant
    Filed: January 30, 2019
    Date of Patent: April 7, 2020
    Assignee: Qumulo, Inc.
    Inventors: Thomas Gregory Rothschilds, Thomas R. Unger, Eric E. Youngblut, Peter J. Godman
  • File system cache tiers
    Patent number: 10534758
    Abstract: Embodiments are directed to a file system engine that provides a file system that includes a plurality of blocks on a file storage tier with portion of the blocks associated with a cache storage tier. A cache engine provides heat extents that include a heat score and a run length value such that the heat extents are represent activities associated with the blocks. Heat extents associated with file system activities are determined based on a position of the blocks that corresponds with the run length values of the heat extents and sectors on the file storage tier. Heat scores associated with the heat extents may be modified based on the activities and distribution models to conform the heat extents with the distribution models. Blocks associated with heat scores that are less than a threshold value provided by the distribution models may be disassociated from the cache storage tier.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: January 14, 2020
    Assignee: Qumulo, Inc.
    Inventors: Edward Carpenter, Thomas Gregory Rothschilds, Peter J. Godman, Duncan Robert Fairbanks, Patrick Jakubowski, Zexuan Wang
  • Sharing namespaces across file system clusters
    Patent number: 11921677
    Abstract: Embodiments are directed to sharing namespaces across file system clusters. A file in a spoke file system may be determined based on a command provided to the spoke file system such that the file may be associated with an inode mask. Data blocks associated with the file may be determined based on the command and the inode mask such that the data blocks may be absent from the spoke file system. Requests for leases may be generated based on the absent data blocks such that each lease request corresponds to a portion of the absent data blocks Employing the leases provided by a hub file system to: copy the absent data blocks from the hub file system where each portion of absent data blocks may be associated with a lease; updating the inode mask to include the leases and each copied portion of absent blocks.
    Type: Grant
    Filed: November 7, 2023
    Date of Patent: March 5, 2024
    Assignee: Qumulo, Inc.
    Inventors: Michael Patrick Kirby, Austin Elery Voecks, Alan Francisco Delgado Duran, Noah Trent Nelson, Thomas Scott Urban, Benjamin Gregory Reeves
  • Managing throughput fairness and quality of service in file systems
    Patent number: 11294718
    Abstract: Embodiments are directed to managing file systems over a network. Jobs may be provided to a storage computer in a file system. Control models may be associated with the jobs. Scores may be generated based on the control models. Each job may be associated with a score provided by its associated control model. And, each job that may be behind its corresponding schedule may be associated with a higher score value than each other job that may be either on its corresponding other schedule or ahead of its corresponding other schedule. Commands may be selected for execution based on the commands being associated with a job that may be associated with the higher score value that may be greater than score values associated with other jobs. The jobs may be ranked based on the updated scores. Subsequent commands may be selected and executed based on the ranking of the jobs.
    Type: Grant
    Filed: December 7, 2020
    Date of Patent: April 5, 2022
    Assignee: Qumulo, Inc.
    Inventors: Yuxi Bai, Thomas Gregory Rothschilds, Jonathan Michael MacLaren, Noah Trent Nelson, Kimberly Alice Fairhurst
  • Managing cloud storage for distributed file systems
    Patent number: 11567660
    Abstract: Embodiments are directed to managing data in a file system that includes a plurality of storage nodes and a plurality of storage volumes in a cloud computing environment. Metrics associated with each storage volume may be monitored. In response to the metrics exceeding a threshold value, performing further actions, including: determining storage volumes that are unhealthy based on the metrics that exceed the threshold value; updating metadata associated with the storage volumes to indicate that the storage volumes are unhealthy; decoupling the unhealthy storage volumes from storage nodes coupled to the unhealthy storage volumes; determining replacement storage volumes based on the metadata associated with the unhealthy storage volumes; updating other metadata associated with the replacement storage volumes to indicate that the replacement storage volumes are healthy storage volumes; and coupling the healthy storage volumes with the storage nodes that were coupled to the unhealthy storage volumes.
    Type: Grant
    Filed: March 16, 2021
    Date of Patent: January 31, 2023
    Assignee: Qumulo, Inc.
    Inventors: Michael Anthony Chmiel, Duncan Robert Fairbanks, Stephen Craig Fleischman, Daniel Marcos Motles, Nicholas Graeme Williams
Narrow Results

Filter by US Classification