Patents by Inventor Daniel J. Markwat

Daniel J. Markwat has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Optimizing files stored in a distributed file system
    Patent number: 11036678
    Abstract: Methods and systems for optimizing a number of files stored in a distributed file system are provided. The method includes determining whether the size of a plurality of input files in a directory are less than a block size. The method further includes determining whether the size of the input files in the directory divided by a desired file size is greater than a threshold. Additionally, the method includes combining the collection of input files into a reduced set of files.
    Type: Grant
    Filed: June 27, 2018
    Date of Patent: June 15, 2021
    Assignee: Aetna Inc.
    Inventors: Aaron Zavora, Jason Figura, Daniel J. Markwat
  • OPTIMIZING FILES STORED IN A DISTRIBUTED FILE SYSTEM
    Publication number: 20200004840
    Abstract: Methods and systems for optimizing a number of files stored in a distributed file system are provided. The method includes determining whether the size of a plurality of input files in a directory are less than a block size. The method further includes determining whether the size of the input files in the directory divided by a desired file size is greater than a threshold. Additionally, the method includes combining the collection of input files into a reduced set of files.
    Type: Application
    Filed: June 27, 2018
    Publication date: January 2, 2020
    Inventors: Aaron Zavora, Jason Figura, Daniel J. Markwat
  • High performance data profiler for big data
    Patent number: 10521440
    Abstract: A method for profiling a dataset includes: querying, by a data profiler executed on a distributed computing system, a metadata storage to obtain table information; allocating, by the data profiler, system resources based on the obtained table information; profiling, by the data profiler, the dataset to obtain profiling results, wherein profiling the dataset includes shuffling and repartitioning data blocks of the dataset with respect to a plurality of nodes of the distributed computing system, and computing aggregates based on the shuffled and repartitioned data blocks; and outputting, by the data profiler, the profiling results.
    Type: Grant
    Filed: August 1, 2017
    Date of Patent: December 31, 2019
    Assignee: Aetna Inc.
    Inventors: Zhijun Wu, Sanjeev Kumar Reddy Bollam, Daniel J. Markwat, Shyam Munjuluri
  • HIGH PERFORMANCE DATA PROFILER FOR BIG DATA
    Publication number: 20190266154
    Abstract: A method for profiling a dataset includes: querying, by a data profiler executed on a distributed computing system, a metadata storage to obtain table information; allocating, by the data profiler, system resources based on the obtained table information; profiling, by the data profiler, the dataset to obtain profiling results, wherein profiling the dataset includes shuffling and repartitioning data blocks of the dataset with respect to a plurality of nodes of the distributed computing system, and computing aggregates based on the shuffled and repartitioned data blocks; and outputting, by the data profiler, the profiling results.
    Type: Application
    Filed: August 1, 2017
    Publication date: August 29, 2019
    Inventors: Zhijun Wu, Sanjeev Kumar Reddy Bollam, Daniel J. Markwat, Shyam Munjuluri