Patents by Inventor Yutaka Suzue
Yutaka Suzue has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10725963Abstract: An “RDMA-Based Memory Allocator” applies remote direct memory access (RDMA) messaging to provide fast lock-free memory allocations and de-allocations for shared memory distributed across multiple servers in an RDMA-based network. Alternately, in various implementations, the RDMA-Based Memory Allocator combines RDMA messaging and remote procedure call (RPC) requests to provide fast lock-free memory allocations and de-allocations for shared memory distributed across multiple servers in an RDMA-based network. In either case, any of the networked servers can act as either or both a client for requesting (or releasing) memory allocations and a host for hosting a portion of the distributed memory. Further, any server (including the requesting client) may act as the host for the distributed memory being allocated or de-allocated by any client via RDMA messaging. Advantageously, being lock-free improves overall performance of memory access between networked computers by reducing overall system latency.Type: GrantFiled: September 12, 2015Date of Patent: July 28, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Yutaka Suzue, Alexander Shamis, Knut Magne Risvik
-
Patent number: 10713210Abstract: A “Key-Value Manager” applies an RDMA-based memory allocator to implement a distributed and lock-free B-Tree based key-value store. In various implementations, the Key-Value Manager is implemented as a standalone library running concurrently on large numbers of networked computing devices. The RDMA-based memory allocator of the Key-Value Manager allocates and accesses the memory of the key-value store via various sequences of RDMA messages (e.g., RDMA reads, RDMA writes, and RDMA atomic compare and swap (CAS) operations). As such, CPUs of computing devices hosting the memory of the key-value store do not need to be notified of or involved in RDMA-based reads and writes to that memory. Consequently, CPU utilization for any computing device that hosts any portion of the key-value store is minimal, thereby enabling the Key-Value Manager to scale to very large numbers of concurrent accesses by very large numbers of computing devices.Type: GrantFiled: October 13, 2015Date of Patent: July 14, 2020Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Alexander Shamis, Yutaka Suzue
-
Patent number: 10686869Abstract: A performance investigation tool (PIT) is described herein for investigating the performance of a distributed processing system (DPS). The PIT operates by first receiving input information that describes a graph processing task to be executed using a plurality of computing units. The PIT then determines, based on the input information, at least one time-based performance measure that describes the performance of a DPS that is capable of performing the graphical task. More specifically, the PIT can operate in a manual mode to explore the behavior of a specified DPS, or in an automatic mode to find an optimal DPS from within a search space of candidate DPSs. A configuration system may then be used to construct a selected DPS, using the plurality of computing units. In one case, the graph processing task involves training a deep neural network model having a plurality of layers.Type: GrantFiled: September 29, 2014Date of Patent: June 16, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Trishul Chilimbi, Yutaka Suzue, Johnson T. Apacible, Karthik Kalyanaraman, Olatunji Ruwase, Yuxiong He, Feng Yan
-
Patent number: 10375167Abstract: A “Distributed Storage Controller” applies an RDMA-based memory allocator to implement a distributed thread-safe and lock-free storage system in shared memory distributed across multiple networked computers. The Distributed Storage Controller enables any number of client applications, processes, subroutines, etc., on any number of networked computers to concurrently perform self-directed lock-free allocations, de-allocations, reads, writes, etc., on the shared memory via sequences of one-way RDMA messages (e.g., RDMA reads, RDMA writes, and RDMA atomic compare and swap (CAS) operations) without requiring CPU locks. As such, the CPUs of computing devices hosting the shared memory do not need to be notified of RDMA-based reads, writes or CAS operations on that memory.Type: GrantFiled: November 20, 2015Date of Patent: August 6, 2019Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Alexander Shamis, Yutaka Suzue, Knut Magne Risvik
-
Patent number: 9792248Abstract: An “RDMA-Based RPC Request System” combines the concepts of RPC and RDMA in a way that can be implemented on commodity networking communications hardware, e.g., RDMA-enabled network interface controllers (NICs) in an Ethernet-based network. In various implementations, the RDMA-Based RPC Request System enables fast lock-free and thread-safe execution of RPC requests between different computers in a network via RDMA-based messages. In other words, the RDMA-Based RPC Request System combines RDMA messaging and RPC requests to enable fast RPC requests via a sequence of RDMA messages transmitted over Ethernet using commodity NICs between networked computers in a data center or other network environment. This RDMA message process is both lock-free and thread-safe.Type: GrantFiled: June 2, 2015Date of Patent: October 17, 2017Assignee: Microsoft Technology Licensing, LLCInventors: Alexander Shamis, Yutaka Suzue
-
Patent number: 9740399Abstract: Described herein are various technologies pertaining to shapewriting. A touch-sensitive input panel comprises a plurality of keys, where each key in the plurality of keys is representative of a respective plurality of characters. A user can generate a trace over the touch-sensitive input panel, wherein the trace passes over keys desirably selected by the user. A sequence of characters, such as a word, is decoded based upon the trace, and is output to a display or a speaker.Type: GrantFiled: January 20, 2013Date of Patent: August 22, 2017Assignee: Microsoft Technology Licensing, LLCInventors: Timothy S. Paek, Johnson Apacible, Dmytro Rudchenko, Bongshin Lee, Juan Dai, Yutaka Suzue
-
Publication number: 20170149890Abstract: A “Distributed Storage Controller” applies an RDMA-based memory allocator to implement a distributed thread-safe and lock-free storage system in shared memory distributed across multiple networked computers. The Distributed Storage Controller enables any number of client applications, processes, subroutines, etc., on any number of networked computers to concurrently perform self-directed lock-free allocations, de-allocations, reads, writes, etc., on the shared memory via sequences of one-way RDMA messages (e.g., RDMA reads, RDMA writes, and RDMA atomic compare and swap (CAS) operations) without requiring CPU locks. As such, the CPUs of computing devices hosting the shared memory do not need to be notified of RDMA-based reads, writes or CAS operations on that memory.Type: ApplicationFiled: November 20, 2015Publication date: May 25, 2017Inventors: Alexander Shamis, Yutaka Suzue, Knut Magne Risvik
-
Publication number: 20170103039Abstract: A “Key-Value Manager” applies an RDMA-based memory allocator to implement a distributed and lock-free B-Tree based key-value store. In various implementations, the Key-Value Manager is implemented as a standalone library running concurrently on large numbers of networked computing devices. The RDMA-based memory allocator of the Key-Value Manager allocates and accesses the memory of the key-value store via various sequences of RDMA messages (e.g., RDMA reads, RDMA writes, and RDMA atomic compare and swap (CAS) operations). As such, CPUs of computing devices hosting the memory of the key-value store do not need to be notified of or involved in RDMA-based reads and writes to that memory. Consequently, CPU utilization for any computing device that hosts any portion of the key-value store is minimal, thereby enabling the Key-Value Manager to scale to very large numbers of concurrent accesses by very large numbers of computing devices.Type: ApplicationFiled: October 13, 2015Publication date: April 13, 2017Inventors: Alexander Shamis, Yutaka Suzue
-
Publication number: 20170075856Abstract: An “RDMA-Based Memory Allocator” applies remote direct memory access (RDMA) messaging to provide fast lock-free memory allocations and de-allocations for shared memory distributed across multiple servers in an RDMA-based network. Alternately, in various implementations, the RDMA-Based Memory Allocator combines RDMA messaging and remote procedure call (RPC) requests to provide fast lock-free memory allocations and de-allocations for shared memory distributed across multiple servers in an RDMA-based network. In either case, any of the networked servers can act as either or both a client for requesting (or releasing) memory allocations and a host for hosting a portion of the distributed memory. Further, any server (including the requesting client) may act as the host for the distributed memory being allocated or de-allocated by any client via RDMA messaging. Advantageously, being lock-free improves overall performance of memory access between networked computers by reducing overall system latency.Type: ApplicationFiled: September 12, 2015Publication date: March 16, 2017Inventors: Yutaka Suzue, Alexander Shamis, Knut Magne Risvik
-
Publication number: 20160357702Abstract: An “RDMA-Based RPC Request System” combines the concepts of RPC and RDMA in a way that can be implemented on commodity networking communications hardware, e.g., RDMA-enabled network interface controllers (NICs) in an Ethernet-based network. In various implementations, the RDMA-Based RPC Request System enables fast lock-free and thread-safe execution of RPC requests between different computers in a network via RDMA-based messages. In other words, the RDMA-Based RPC Request System combines RDMA messaging and RPC requests to enable fast RPC requests via a sequence of RDMA messages transmitted over Ethernet using commodity NICs between networked computers in a data center or other network environment. This RDMA message process is both lock-free and thread-safe.Type: ApplicationFiled: June 2, 2015Publication date: December 8, 2016Inventors: Alexander Shamis, Yutaka Suzue
-
Publication number: 20160092765Abstract: A performance investigation tool (PIT) is described herein for investigating the performance of a distributed processing system (DPS). The PIT operates by first receiving input information that describes a graph processing task to be executed using a plurality of computing units. The PIT then determines, based on the input information, at least one time-based performance measure that describes the performance of a DPS that is capable of performing the graphical task. More specifically, the PIT can operate in a manual mode to explore the behavior of a specified DPS, or in an automatic mode to find an optimal DPS from within a search space of candidate DPSs. A configuration system may then be used to construct a selected DPS, using the plurality of computing units. In one case, the graph processing task involves training a deep neural network model having a plurality of layers.Type: ApplicationFiled: September 29, 2014Publication date: March 31, 2016Inventors: Trishul Chilimbi, Yutaka Suzue, Johnson T. Apacible, Karthik Kalyanaraman, Olatunji Ruwase, Yuxiong He, Feng Yan
-
Publication number: 20150324690Abstract: Training large neural network models by providing training input to model training machines organized as multiple replicas that asynchronously update a shared model via a global parameter server is described herein. In at least one embodiment, a system including a model module storing a portion of a model and a deep learning training module that communicates with the model module are configured for asynchronously sending updates to shared parameters associated with the model. The techniques herein describe receiving and processing a batch of data items to calculate updates. Replicas of training machines communicate asynchronously with a global parameter server to provide updates to a shared model and return updated weight values. The model may be modified to reflect the updated weight values. The techniques described herein include computation and communication optimizations that improve system efficiency and scaling of large neural networks.Type: ApplicationFiled: September 22, 2014Publication date: November 12, 2015Inventors: Trishul A. Chilimbi, Yutaka Suzue, Johnson R. Apacible, Karthik Kalyanaraman
-
Patent number: 8938653Abstract: The subject disclosure is directed towards a technology by which the accuracy of context-based information provided by at least one data source for received context data is increased. Correctness information received in association with usage of looked up context-based information is logged. The correctness information may be processed to increase the overall accuracy by correcting a data source, and/or by creating a blended data source that includes the most likely accurate portions (segments) from among multiple data sources as determined via the correctness information.Type: GrantFiled: December 14, 2011Date of Patent: January 20, 2015Assignee: Microsoft CorporationInventors: Yutaka Suzue, Johnson T. Apacible, Mark J. Encarnación, Jamie Huynh, Simon D. Bernstein
-
Publication number: 20140098036Abstract: Described herein are various technologies pertaining to shapewriting. A touch-sensitive input panel comprises a plurality of keys, where each key in the plurality of keys is representative of a respective plurality of characters. A user can generate a trace over the touch-sensitive input panel, wherein the trace passes over keys desirably selected by the user. A sequence of characters, such as a word, is decoded based upon the trace, and is output to a display or a speaker.Type: ApplicationFiled: January 20, 2013Publication date: April 10, 2014Applicant: Microsoft CorporationInventors: Timothy S. Paek, Johnson Apacible, Dmytro Rudchenko, Bongshin Lee, Juan Dai, Yutaka Suzue
-
Publication number: 20130159804Abstract: The subject disclosure is directed towards a technology by which the accuracy of context-based information provided by at least one data source for received context data is increased. Correctness information received in association with usage of looked up context-based information is logged. The correctness information may be processed to increase the overall accuracy by correcting a data source, and/or by creating a blended data source that includes the most likely accurate portions (segments) from among multiple data sources as determined via the correctness information.Type: ApplicationFiled: December 14, 2011Publication date: June 20, 2013Applicant: Microsoft CorporationInventors: Yutaka Suzue, Johnson T. Apacible, Mark J. Encarnación, Jamie Huynh, Simon D. Bernstein
-
Publication number: 20110307479Abstract: Described is extracting structured information from web pages for use in directly answering queries with data items from the structured data. Users' post-search browsing behaviors (search trails) are treated as implicit labels as to the relevance between web content and user queries, and are used to determine wrappers for extracting structured information. In one implementation, a system identifies websites from web search logs, builds wrappers from users' search trails, filters out bad wrappers (from inconsistent user clicks), and combines structured information from different web sites, e.g., for each query.Type: ApplicationFiled: June 10, 2010Publication date: December 15, 2011Applicant: MICROSOFT CORPORATIONInventors: Xiaoxin Yin, Wenzhao Tan, Xiao Li, Yi-Chin Tu, Yutaka Suzue, Johnson T. Apacible
-
Patent number: 7895031Abstract: The sharing of language models is disclosed. In one embodiment, a language model service is provided that is shareable among handlers for input devices. The service includes a pre-processing mode of operation, and a correction mode of operation. In the former mode, the language model service is designed to receive a range within a document from a handler for an input device, and in response provide advice regarding text under consideration by the handler to insert within the document at the range, based on the context of the document within the range. In the latter mode, the language model service is designed to supervise correction over a range of text within a document, in which a number of different handlers for a number of different input devices were initially responsible for insertion of the text, such that the service solicits suggestions from the handlers, and based thereon determines text corrections. The corrections can then be made by the handlers, or by the service.Type: GrantFiled: March 31, 2006Date of Patent: February 22, 2011Assignee: Microsoft CorporationInventors: Yutaka Nakajima, Yutaka Suzue, Kevin B. Gjerstad, Dong-Hui Zhang, Hiroaki Kanokogi, Benjamin M. Westbrook
-
Patent number: 7634720Abstract: An improved system and method for providing context information of executable code to an input method is provided. Advanced text input methods may be made aware of the type of text expected to be received as input so that input methods may achieve a higher accuracy in recognition of text input. Generic interfaces provide a framework for supporting application authoring platforms to allow application developers to easily specify context information to the system and have it reliably forwarded to the correct input methods. Additionally, a context tagging tool may associate specific text input fields of an existing application with an input scope without modifying the application itself. The context tagging tool may create a manifest that contains tags associating the specific text input fields with an input scope. Any advanced input methods use by the application may be updated with instructions for accessing the context information stored in the manifest.Type: GrantFiled: October 24, 2003Date of Patent: December 15, 2009Assignee: Microsoft CorporationInventors: Patrick Haluptzok, Yutaka Suzue, Angshuman Guha, Anuradha N Padte, Vamshidhar G Reddy, Mukundan Bhoovaraghavan, Ranjit Kumar Gupta, Joshua A. Clow, Robert Lewis Chambers
-
Publication number: 20080208568Abstract: An improved system and method for providing context information of executable code to an input method is provided. Advanced text input methods may be made aware of the type of text expected to be received as input so that input methods may achieve a higher accuracy in recognition of text input. Generic interfaces provide a framework for supporting application authoring platforms to allow application developers to easily specify context information to the system and have it reliably forwarded to the correct input methods. Additionally, a context tagging tool may associate specific text input fields of an existing application with a n input scope without modifying the application itself. The context tagging tool may create a manifest that contains tags associating the specific text input fields with an input scope. Any advanced input methods use by the application may be updated with instructions for accessing the context information stored in the manifest.Type: ApplicationFiled: May 5, 2008Publication date: August 28, 2008Applicant: Microsoft CorporationInventors: Patrick Haluptzok, Yutaka Suzue, Angshuman Guha, Anuradha N. Padte, Vamshidhar G. Reddy, Mukundan Bhoovaraghavan, Ranjit Kumar Gupta, Joshua A. Clow, Robert Lewis Chambers
-
Patent number: 7398462Abstract: A common text framework for application programs having documents of primarily text and input devices for entering and editing text of such documents is disclosed. The framework provides for the interaction of applications and handlers for input devices, and includes a text store interface and a text input processor interface. The former interface permits an application having a document of primarily text to expose the document as an abstraction. The latter interface permits a handler for an input device to access the abstraction of the document and to insert additional text into the document.Type: GrantFiled: April 25, 2000Date of Patent: July 8, 2008Assignee: Microsoft CorporationInventors: Kevin B. Gjerstad, Yutaka Nakajima, Yutaka Suzue, Benjamin M. Westbrook