Patents by Inventor Marc T. Friedman
Marc T. Friedman has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230342359Abstract: Methods of machine learning for system deployments without performance regressions are performed by systems and devices. A performance safeguard system is used to design pre-production experiments for determining the production readiness of learned models based on a pre-production budget by leveraging big data processing infrastructure and deploying a large set of learned or optimized models for its query optimizer. A pipeline for learning and training differentiates the impact of query plans with and without the learned or optimized models, selects plan differences that are likely to lead to most dramatic performance difference, runs a constrained set of pre-production experiments to empirically observe the runtime performance, and finally picks the models that are expected to lead to consistently improved performance for deployment. The performance safeguard system enables safe deployment not just for learned or optimized models but also for additional of other ML-for-Systems features.Type: ApplicationFiled: June 30, 2023Publication date: October 26, 2023Inventors: Irene Rogan SHAFFER, Remmelt Herbert Lieve AMMERLAAN, Gilbert ANTONIUS, Marc T. FRIEDMAN, Abhishek ROY, Lucas ROSENBLATT, Vijay Kumar RAMANI, Shi QIAO, Alekh JINDAL, Peter ORENBERG, H M Sajjad Hossain, Soundararajan Srinivasan, Hiren Shantilal PATEL, Markus WEIMER
-
Patent number: 11748350Abstract: Methods of machine learning for system deployments without performance regressions are performed by systems and devices. A performance safeguard system is used to design pre-production experiments for determining the production readiness of learned models based on a pre-production budget by leveraging big data processing infrastructure and deploying a large set of learned or optimized models for its query optimizer. A pipeline for learning and training differentiates the impact of query plans with and without the learned or optimized models, selects plan differences that are likely to lead to most dramatic performance difference, runs a constrained set of pre-production experiments to empirically observe the runtime performance, and finally picks the models that are expected to lead to consistently improved performance for deployment. The performance safeguard system enables safe deployment not just for learned or optimized models but also for additional of other ML-for-Systems features.Type: GrantFiled: April 3, 2020Date of Patent: September 5, 2023Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Irene Rogan Shaffer, Remmelt Herbert Lieve Ammerlaan, Gilbert Antonius, Marc T. Friedman, Abhishek Roy, Lucas Rosenblatt, Vijay Kumar Ramani, Shi Qiao, Alekh Jindal, Peter Orenberg, H M Sajjad Hossain, Soundararajan Srinivasan, Hiren Shantilal Patel, Markus Weimer
-
Publication number: 20230177053Abstract: Methods for optimization in query plans are performed by computing systems via a query optimizer advisor. A query optimizer advisor (QO-Advisor) is configured to steer a query plan optimizer towards more efficient plan choices by providing rule hints to improve navigation of the search space for each query in formulation of its query plan. The QO-Advisor receives historical information of a distributed data processing system as an input, and then generates a set of rule hint pairs based on the historical information. The QO-Advisor provides the set of rule hint pairs to a query plan optimizer, which then optimizes a query plan of an incoming query through application of a rule hint pair in the set. This application is based at least on a characteristic of the incoming query matching a portion of the rule hint pair.Type: ApplicationFiled: March 28, 2022Publication date: June 8, 2023Inventors: Matteo INTERLANDI, Wangda ZHANG, Paul S. MINEIRO, Marc T. FRIEDMAN, Alekh JINDAL, Hiren S. PATEL, Rafah Aboul HOSN, Shi QIAO
-
Publication number: 20210263932Abstract: Methods of machine learning for system deployments without performance regressions are performed by systems and devices. A performance safeguard system is used to design pre-production experiments for determining the production readiness of learned models based on a pre-production budget by leveraging big data processing infrastructure and deploying a large set of learned or optimized models for its query optimizer. A pipeline for learning and training differentiates the impact of query plans with and without the learned or optimized models, selects plan differences that are likely to lead to most dramatic performance difference, runs a constrained set of pre-production experiments to empirically observe the runtime performance, and finally picks the models that are expected to lead to consistently improved performance for deployment. The performance safeguard system enables safe deployment not just for learned or optimized models but also for additional of other ML-for-Systems features.Type: ApplicationFiled: April 3, 2020Publication date: August 26, 2021Inventors: Irene Rogan Shaffer, Remmelt Herbert Lieve Ammerlaan, Gilbert Antonius, Marc T. Friedman, Abhishek Roy, Lucas Rosenblatt, Vijay Kumar Ramani, Shi Qiao, Alekh Jindal, Peter Orenberg, H M Sajjad Hossain, Soundararajan Srinivasan, Hiren Shantilal Patel, Markus Weimer
-
Patent number: 10366084Abstract: Aspects extend to methods, systems, and computer program products for optimally pipelining result sets with fault tolerance in distributed query execution. Distributed computing jobs are optimized by dividing the distributed computing jobs into one or more bubbles for execution. Each bubble can be independently executed, potentially in parallel with other bubbles, when resources to handle the bubble are available. Intra-bubble communication can be streamed between vertices within a bubble. Inter-bubble communication can be stored to durable storage. Bubbles provide a failure boundary for a job graph and re-executing a bubble along with storage of intermediate results in durable storage can be used to recover from failures. When a vertex inside a bubble fails, computation can resume by rescheduling the execution of the failed bubble from the durable inputs for that bubble. Durable storage provides a light-weight failover to handle non-deterministic behavior.Type: GrantFiled: September 15, 2016Date of Patent: July 30, 2019Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Zhicheng Yin, Jin Sun, Ming Li, Jaliya Nishantha Ekanayake, Yongchul Kwon, José A. Blakeley, Marc T. Friedman, Haibo Lin, Raghunath Ramakrishnan, Tao Guan
-
Publication number: 20180075098Abstract: Aspects extend to methods, systems, and computer program products for optimally pipelining result sets with fault tolerance in distributed query execution. Distributed computing jobs are optimized by dividing the distributed computing jobs into one or more bubbles for execution. Each bubble can be independently executed, potentially in parallel with other bubbles, when resources to handle the bubble are available. Intra-bubble communication can be streamed between vertices within a bubble. Inter-bubble communication can be stored to durable storage. Bubbles provide a failure boundary for a job graph and re-executing a bubble along with storage of intermediate results in durable storage can be used to recover from failures. When a vertex inside a bubble fails, computation can resume by rescheduling the execution of the failed bubble from the durable inputs for that bubble. Durable storage provides a light-weight failover to handle non-deterministic behavior.Type: ApplicationFiled: September 15, 2016Publication date: March 15, 2018Inventors: Zhicheng Yin, Jin Sun, Ming Li, Jaliya Nishantha Ekanayake, Yongchul Kwon, José A. Blakeley, Marc T. Friedman, Haibo Lin, Raghunath Ramakrishnan, Tao Guan
-
Publication number: 20160292215Abstract: Methods, systems, and computer program products are provided for partitioning online databases. Online database operations, such as, for example, SPLIT, MERGE, and DROP, are used to alter the arrangement of partitions in a federated database. A SPLIT operation splits rows at one partition across a plurality of other partitions. A MERGE operation merges rows at a plurality of partitions in to one partition. A DROP operation shifts responsibility for rows of data from one partition to another partition and then drops the rows from the one partition.Type: ApplicationFiled: June 15, 2016Publication date: October 6, 2016Inventors: Lev Novik, Andrew Kimball, Tony Petrossian, Cihangir Biyikoglu, Santeri Olavi Voutilainen, Tomas Talius, Istvan Cseri, Joachim Hammer, Jason D. Clark, Marc T. Friedman, Ajay Kalhan
-
Patent number: 9372882Abstract: Methods, systems, and computer program products are provided for partitioning online databases. Online database operations, such as, for example, SPLIT, MERGE, and DROP, are used to alter the arrangement of partitions in a federated database. A SPLIT operation splits rows at one partition across a plurality of other partitions. A MERGE operation merges rows at a plurality of partitions in to one partition. A DROP operation shifts responsibility for rows of data from one partition to another partition and then drops the rows from the one partition.Type: GrantFiled: August 5, 2014Date of Patent: June 21, 2016Assignee: Microsoft Technology Licensing, LLCInventors: Lev Novik, Andrew Kimball, Tony Petrossian, Cihangir Biyikoglu, Santeri Olavi Voutilainen, Tomas Talius, Istvan Cseri, Joachim Hammer, Jason D. Clark, Marc T. Friedman, Ajay Kalhan
-
Patent number: 9081837Abstract: The present invention extends to methods, systems, and computer program products for scoping the context used to access a database partition. Embodiments of the invention enable data isolation using partitions in multi-tenant databases, while relieving client applications from dealing with the partitions. For example, a computer system that includes a distributed database system comprising a plurality of database partitions in a federation receives a context to use when performing database access operations within the distributed database system. The context identifies specified relevant portion of the federation. The computer system also receives a database access operation that is associated with the context. The computer system modifies the semantics of the database access operation in accordance with the associated context, to direct application of the database access operation to the specified relevant portion of the federation.Type: GrantFiled: June 21, 2011Date of Patent: July 14, 2015Assignee: Microsoft Technology Licensing, LLCInventors: Lev Novik, Jason D. Clark, Marc T. Friedman, Andrew Kimball, Cihangir Biyikoglu, Joachim Hammer, Tobias Joakim Bertil Ternström, Ajay Kalhan
-
Publication number: 20140344221Abstract: Methods, systems, and computer program products are provided for partitioning online databases. Online database operations, such as, for example, SPLIT, MERGE, and DROP, are used to alter the arrangement of partitions in a federated database. A SPLIT operation splits rows at one partition across a plurality of other partitions. A MERGE operation merges rows at a plurality of partitions in to one partition. A DROP operation shifts responsibility for rows of data from one partition to another partition and then drops the rows from the one partition.Type: ApplicationFiled: August 5, 2014Publication date: November 20, 2014Inventors: Lev Novik, Andrew Kimball, Tony Petrossian, Cihangir Biyikoglu, Santeri Olavi Voutilainen, Tomas Talius, Istvan Cseri, Joachim Hammer, Jason D. Clark, Marc T. Friedman, Ajay Kalhan
-
Patent number: 8805784Abstract: The present invention extends to methods, systems, and computer program products for partitioning online databases. Online database operations, such as, for example, SPLIT, MERGE, and DROP, are used to alter the arrangement of partitions in a federated database. A SPLIT operation splits rows at one partition across a plurality of other partitions. A MERGE operation merges rows at a plurality of partitions in to one partition. A DROP operation shifts responsibility for rows of data from one partition to another partition and then drops the rows from the one partition.Type: GrantFiled: June 21, 2011Date of Patent: August 12, 2014Assignee: Microsoft CorporationInventors: Lev Novik, Andrew Kimball, Tony Petrossian, Cihangir Biyikoglu, Santeri Olavi Voutilainen, Tomas Talius, Istvan Cseri, Joachim Hammer, Jason D. Clark, Marc T. Friedman, Ajay Kalhan
-
Publication number: 20120109926Abstract: The present invention extends to methods, systems, and computer program products for scoping the context used to access a database partition. Embodiments of the invention enable data isolation using partitions in multi-tenant databases, while relieving client applications from dealing with the partitions. For example, a computer system that includes a distributed database system comprising a plurality of database partitions in a federation receives a context to use when performing database access operations within the distributed database system. The context identifies specified relevant portion of the federation. The computer system also receives a database access operation that is associated with the context. The computer system modifies the semantics of the database access operation in accordance with the associated context, to direct application of the database access operation to the specified relevant portion of the federation.Type: ApplicationFiled: June 21, 2011Publication date: May 3, 2012Applicant: Microsoft CoroprationInventors: Lev Novik, Jason D. Clark, Marc T. Friedman, Andrew Kimball, Cihangir Biyikoglu, Joachim Hammer, Tobias Joakim Bertil Ternström, Ajay Kalhan
-
Publication number: 20120109892Abstract: The present invention extends to methods, systems, and computer program products for partitioning online databases. Online database operations, such as, for example, SPLIT, MERGE, and DROP, are used to alter the arrangement of partitions in a federated database. A SPLIT operation splits rows at one partition across a plurality of other partitions. A MERGE operation merges rows at a plurality of partitions in to one partition. A DROP operation shifts responsibility for rows of data from one partition to another partition and then drops the rows from the one partition.Type: ApplicationFiled: June 21, 2011Publication date: May 3, 2012Applicant: Microsoft CorporationInventors: Lev Novik, Andrew Kimball, Tony Petrossian, Cihangir Biyikoglu, Santeri Olavi Voutilainen, Tomas Talius, Istvan Cseri, Joachim Hammer, Jason D. Clark, Marc T. Friedman, Ajay Kalhan
-
Patent number: 7933894Abstract: Systems and methods that generate specialized plans for compiling SQL queries. A plan generator component scans the query representation for parameter sensitive predicates and evaluates each predicate individually based on the parameter values. Accordingly, queries can be identified not only based on their structures, but also based on their parameter conditions. The specialized plans are more efficient for particular values, wherein queries that employ such values are optimally executed.Type: GrantFiled: June 15, 2007Date of Patent: April 26, 2011Assignee: Microsoft CorporationInventors: Marc T. Friedman, Cesar A. Galindo-Legaria, Erik Ismert, Milind Madhukar Joshi, Naveen Prakash
-
Patent number: 7475199Abstract: An incrementally-scalable file system and method. The system architecture enables file systems to be scaled by adding resources, such as additional filers and/or file servers, without requiring that the system be taken offline or being known to client applications. The system also provides for load balancing file accesses by distributing files across the various file storage resources in the system, as dictated by the relative capacities of said storage resources. The system provides one or more “virtual” file system volumes in a manner that makes it appear to client applications that all of the file system's storage space resides on the virtual volume(s), while in reality the files may be stored on many more physical volumes on the filers and/or file servers in the system.Type: GrantFiled: October 19, 2000Date of Patent: January 6, 2009Assignee: EMC CorporationInventors: Jared E. Bobbitt, Jiong (Justin) Chen, Stephan A. Doll, John W. Fawcett, Marc T. Friedman, Robert C. Hickman, Edward P. Johnson, Ty Lam, Patrick Wing Sang Lau, Joseph P. Mullally, Robert J. Smith, Jeffrey C. Tanner
-
Publication number: 20080313131Abstract: Systems and methods that generate specialized plans for compiling SQL queries. A plan generator component scans the query representation for parameter sensitive predicates and evaluates each predicate individually based on the parameter values. Accordingly, queries can be identified not only based on their structures, but also based on their parameter conditions. The specialized plans are more efficient for particular values, wherein queries that employ such values are optimally executed.Type: ApplicationFiled: June 15, 2007Publication date: December 18, 2008Applicant: MICROSOFT CORPORATIONInventors: Marc T. Friedman, Cesar A. Galindo-Legaria, Erik Ismert, Milind Madhukar Joshi, Naveen Prakash
-
Patent number: 7024427Abstract: A virtual file system and method. The system architecture enables a plurality of underlying file systems running on various file servers to be “virtualized” into one or more “virtual volumes” that appear as a local file system to clients that access the virtual volumes. The system also enables the storage spaces of the underlying file systems to be aggregated into a single virtual storage space, which can be dynamically scaled by adding or removing file servers without taking any of the file systems offline and in a manner transparent to the clients. This functionality is enabled through a software “virtualization” filter on the client that intercepts file system requests and a virtual file system driver on each file server. The system also provides for load balancing file accesses by distributing files across the various file servers in the system, through migration of data files between servers.Type: GrantFiled: December 19, 2001Date of Patent: April 4, 2006Assignee: EMC CorporationInventors: Jared E. Bobbitt, Stephan A. Doll, Marc T. Friedman, Patrick Wing Sang Lau, Joseph P. Mullally
-
Publication number: 20030115218Abstract: A virtual file system and method. The system architecture enables a plurality of underlying file systems running on various file servers to be “virtualized” into one or more “virtual volumes” that appear as a local file system to clients that access the virtual volumes. The system also enables the storage spaces of the underlying file systems to be aggregated into a single virtual storage space, which can be dynamically scaled by adding or removing file servers without taking any of the file systems offline and in a manner transparent to the clients. This functionality is enabled through a software “virtualization” filter on the client that intercepts file system requests and a virtual file system driver on each file server. The system also provides for load balancing file accesses by distributing files across the various file servers in the system, through migration of data files between servers.Type: ApplicationFiled: December 19, 2001Publication date: June 19, 2003Inventors: Jared E. Bobbitt, Stephan A. Doll, Marc T. Friedman, Patrick Wing Sang Lau, Joseph P. Mullally
-
Patent number: 6523036Abstract: An incrementally-scalable database system and method. The system architecture enables database servers to be scaled by adding resources, such as additional servers, without requiring that the system be taken offline. Such scaling includes both adding one or more computer servers to a given server cluster, which enables an increase in database read transaction throughput, and adding one or more server clusters to the system configuration, which provides for increased read and write transaction throughput. The system also provides for load balancing read transactions across each server cluster, and load balancing write transactions across a plurality of server clusters.Type: GrantFiled: August 1, 2000Date of Patent: February 18, 2003Assignee: Dantz Development CorporationInventors: Robert C. Hickman, Jared E. Bobbitt, Jeffrey C. Tanner, Patrick Wing Sang Lau, Marc T. Friedman, Joseph P. Mullally
-
Patent number: 5995959Abstract: This invention provides methods to locate and plan the retrieval of data from networked information sources in response to a user query. The methods utilize descriptions of the information sources, the information domain of the sources, and of the query. The methods of this invention integrate both legacy systems and full relational databases with an efficient, domain-independent, query-planning algorithm, reason about the capabilities of different information sources, handle partial goal satisfaction i.e., gather as much data as possible when all that the user requested cannot be gathered, are both sound and complete, and are efficient.Type: GrantFiled: January 23, 1998Date of Patent: November 30, 1999Assignee: The Board of Regents of the University of WashingtonInventors: Marc T. Friedman, Chung T. Kwok, Daniel S. Weld