Patents by Inventor Clarence Wing Yin Ng
Clarence Wing Yin Ng has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11928029Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.Type: GrantFiled: September 11, 2020Date of Patent: March 12, 2024Assignee: Amazon Technologies, Inc.Inventors: Maximiliano Maccanti, Timothy Andrew Rath, Rama Krishna Sandeep Pokkunuri, Akshat Vig, Clarence Wing Yin Ng, Srivaths Badrinath Copparam, Rajaprabhu Thiruchi Loganathan, Wei Xiao, William Alexander Stevenson
-
Patent number: 11841844Abstract: Distributed database management systems may maintain collections of items spanning multiple partitions. Index structures may correspond to items on one partition or to items on multiple partitions. Item collections and indexes may be replicated. Changes to the data maintained by the distributed database management system may result in updates to multiple index structures. The changes may be compiled into an instruction set applicable to the index structures. In-memory buffers may contain the instructions prior to transmission to affected partitions. Replication logs may be combined with an acknowledgment mechanism for reliable transmission of the instructions to the affected partitions.Type: GrantFiled: May 20, 2013Date of Patent: December 12, 2023Assignee: Amazon Technologies, Inc.Inventors: Wei Xiao, Clarence Wing Yin Ng, Medhavi Dhawan, Timothy Andrew Rath, Stefano Stefani
-
Patent number: 11327949Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may export individual partitions of the table from the database and package them to be independently uploaded (e.g., in parallel) to a remote storage system (e.g., a key-value durable storage system). Prior to uploading the exported and packaged partitions to the remote storage system, the service may verify that the exported and packaged partitions can be subsequently restored, which may include unpackaging and/or re-inflating the exported and packaged partitions to create additional unpackaged copies of the partitions, re-importing the additional unpackaged copies of the partitions into the database (e.g., as additional replicas), and/or comparing checksums generated for the exported partitions with checksums generated for the additional unpackaged copies of the partitions.Type: GrantFiled: April 24, 2017Date of Patent: May 10, 2022Assignee: Amazon Technologies, Inc.Inventors: Maximiliano Maccanti, Timothy Andrew Rath, Rama Krishna Sandeep Pokkunuri, Akshat Vig, Clarence Wing Yin Ng, Srivaths Badrinath Copparam, Rajaprabhu Thiruchi Loganathan, Wei Xiao, William Alexander Stevenson
-
Patent number: 11036591Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to restore a given table that was backed up in a remote storage system (e.g., key-value durable storage system), the service may create a new table, and may import a copy of each of the partitions of the given table from the remote storage system into the new table. The request to restore the table may specify a modified value for a configuration parameter for the table or for one of its partitions. The service may apply the new configuration parameter value to the table or its partitions during the restore operation. The new configuration parameter value may indicate an increase or decrease in storage capacity or throughput capacity, and its application may automatically trigger a partition split or move operation.Type: GrantFiled: July 13, 2018Date of Patent: June 15, 2021Assignee: Amazon Technologies, Inc.Inventors: Maximiliano Maccanti, Timothy Andrew Rath, Rama Krishna Sandeep Pokkunuri, Akshat Vig, Clarence Wing Yin Ng, Srivaths Badrinath Copparam, Rajaprabhu Thiruchi Loganathan, Wei Xiao, William Alexander Stevenson
-
Publication number: 20210064476Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.Type: ApplicationFiled: September 11, 2020Publication date: March 4, 2021Applicant: Amazon Technologies, Inc.Inventors: Maximiliano Maccanti, Timothy Andrew Rath, Rama Krishna Sandeep Pokkunuri, Akshat Vig, Clarence Wing Yin NG, Srivaths Badrinath Copparam, Rajaprabhu Thiruchi Loganathan, Wei Xiao, William Alexander Stevenson
-
Patent number: 10776212Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.Type: GrantFiled: April 24, 2017Date of Patent: September 15, 2020Assignee: Amazon Technologies, Inc.Inventors: Maximliano Maccanti, Timothy Andrew Rath, Rama Krishna Sandeep Pokkunuri, Akshat Vig, Clarence Wing Yin Ng, Srivaths Badrinath Copparam, Rajaprabhu Thiruchi Loganathan, Wei Xiao, William Alexander Stevenson
-
Publication number: 20180322017Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to restore a given table that was backed up in a remote storage system (e.g., key-value durable storage system), the service may create a new table, and may import a copy of each of the partitions of the given table from the remote storage system into the new table. The request to restore the table may specify a modified value for a configuration parameter for the table or for one of its partitions. The service may apply the new configuration parameter value to the table or its partitions during the restore operation. The new configuration parameter value may indicate an increase or decrease in storage capacity or throughput capacity, and its application may automatically trigger a partition split or move operation.Type: ApplicationFiled: July 13, 2018Publication date: November 8, 2018Applicant: Amazon Technologies, Inc.Inventors: Maximiliano Maccanti, Timothy Andrew Rath, Rama Krishna Sandeep Pokkunuri, Akshat Vig, Clarence Wing Yin NG, Srivaths Badrinath Copparam, Rajaprabhu Thiruchi Loganathan, Wei Xiao, William Alexander Stevenson
-
Patent number: 10025673Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to restore a given table that was backed up in a remote storage system (e.g., key-value durable storage system), the service may create a new table, and may import a copy of each of the partitions of the given table from the remote storage system into the new table. The request to restore the table may specify a modified value for a configuration parameter for the table or for one of its partitions. The service may apply the new configuration parameter value to the table or its partitions during the restore operation. The new configuration parameter value may indicate an increase or decrease in storage capacity or throughput capacity, and its application may automatically trigger a partition split or move operation.Type: GrantFiled: September 20, 2013Date of Patent: July 17, 2018Assignee: Amazon Technologies, Inc.Inventors: Maximiliano Maccanti, Timothy Andrew Rath, Rama Krishna Sandeep Pokkunuri, Akshat Vig, Clarence Wing Yin Ng, Srivaths Badrinath Copparam, Rajaprabhu Thiruchi Loganathan, Wei Xiao, William Alexander Stevenson
-
Publication number: 20170228417Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may export individual partitions of the table from the database and package them to be independently uploaded (e.g., in parallel) to a remote storage system (e.g., a key-value durable storage system). Prior to uploading the exported and packaged partitions to the remote storage system, the service may verify that the exported and packaged partitions can be subsequently restored, which may include unpackaging and/or re-inflating the exported and packaged partitions to create additional unpackaged copies of the partitions, re-importing the additional unpackaged copies of the partitions into the database (e.g., as additional replicas), and/or comparing checksums generated for the exported partitions with checksums generated for the additional unpackaged copies of the partitions.Type: ApplicationFiled: April 24, 2017Publication date: August 10, 2017Applicant: Amazon Technologies, Inc.Inventors: Maximiliano Maccanti, Timothy Andrew Rath, Rama Krishna Sandeep Pokkunuri, Akshat Vig, Clarence Wing Yin NG, Srivaths Badrinath Copparam, Rajaprabhu Thiruchi Loganathan, Wei Xiao, William Alexander Stevenson
-
Publication number: 20170228290Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.Type: ApplicationFiled: April 24, 2017Publication date: August 10, 2017Applicant: Amazon Technologies, Inc.Inventors: Maximliano Maccanti, Timothy Andrew Rath, Rama Krishna Sandeep Pokkunuri, Akshat Vig, Clarence Wing Yin NG, Srivaths Badrinath Copparam, Rajaprabhu Thiruchi Loganathan, Wei Xiao, William Alexander Stevenson
-
Patent number: 9632878Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may export individual partitions of the table from the database and package them to be independently uploaded (e.g., in parallel) to a remote storage system (e.g., a key-value durable storage system). Prior to uploading the exported and packaged partitions to the remote storage system, the service may verify that the exported and packaged partitions can be subsequently restored, which may include unpackaging and/or re-inflating the exported and packaged partitions to create additional unpackaged copies of the partitions, re-importing the additional unpackaged copies of the partitions into the database (e.g., as additional replicas), and/or comparing checksums generated for the exported partitions with checksums generated for the additional unpackaged copies of the partitions.Type: GrantFiled: September 20, 2013Date of Patent: April 25, 2017Assignee: Amazon Technologies, Inc.Inventors: Maximiliano Maccanti, Timothy Andrew Rath, Rama Krishna Sandeep Pokkunuri, Akshat Vig, Clarence Wing Yin Ng, Srivaths Badrinath Copparam, Rajaprabhu Thiruchi Loganathan, Wei Xiao, William Alexander Stevenson
-
Patent number: 9633051Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.Type: GrantFiled: September 20, 2013Date of Patent: April 25, 2017Assignee: Amazon Technologies, Inc.Inventors: Maximiliano Maccanti, Timothy Andrew Rath, Rama Krishna Sandeep Pokkunuri, Akshat Vig, Clarence Wing Yin Ng, Srivaths Badrinath Copparam, Rajaprabhu Thiruchi Loganathan, Wei Xiao, William Alexander Stevenson
-
Patent number: 9489443Abstract: A system that implements a data storage service may store data in multiple replicated partitions on respective computing nodes on behalf of clients. A storage node may, based on the amount of provisioned resources on a given storage device or logical volume, identify candidate partition management operations to be performed, and may send information about the operations to a central partition management scheduler. The scheduler may apply a global prioritization scheme to determine an order in which to perform the candidate operations. The order may be based on whether the operations include partition splits or partition moves, whether they aim to reduce provisioned storage capacity or reduce throughput capacity on a storage device or logical volume, whether they conflict with each other, whether the total number of partitions (or replicas thereof) involved in partition management at any given time exceeds a pre-determined limit, or whether they were requested by clients.Type: GrantFiled: May 24, 2013Date of Patent: November 8, 2016Assignee: Amazon Technologies, Inc.Inventors: Kiran-Kumar Muniswamy-Reddy, Wei Xiao, Stefano Stefani, Xianglong Huang, Clarence Wing Yin Ng, Jai Vasanth
-
Publication number: 20140344236Abstract: Distributed database management systems may maintain collections of items spanning multiple partitions. Index structures may correspond to items on one partition or to items on multiple partitions. Item collections and indexes may be replicated. Changes to the data maintained by the distributed database management system may result in updates to multiple index structures. The changes may be compiled into an instruction set applicable to the index structures. In-memory buffers may contain the instructions prior to transmission to affected partitions. Replication logs may be combined with an acknowledgment mechanism for reliable transmission of the instructions to the affected partitions.Type: ApplicationFiled: May 20, 2013Publication date: November 20, 2014Inventors: Wei Xiao, Clarence Wing Yin Ng, Medhavi Dhawan, Timothy Andrew Rath, Stefano Stefani