Patents by Inventor Derek Chiou
Derek Chiou has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11593138Abstract: A physical server with an offload card including a SoC (system-on-chip) and a FPGA (field programmable gate array) is disclosed. According to one set of embodiments, the SoC can be configured to offload one or more hypervisor functions from a CPU complex of the server that are suited for execution in software, and the FPGA can be configured to offload one or more hypervisor functions from the CPU complex that are suited for execution in hardware.Type: GrantFiled: March 3, 2020Date of Patent: February 28, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Derek Chiou, Andrew Putnam, Daniel Firestone, Jack Lavier
-
Patent number: 11366769Abstract: Enabling peripheral device messaging via application portals in processor-based devices is disclosed herein. In one embodiment, a processor-based device comprises a processing element (PE) including an application portal configured to logically operate as a message store, and that is exposed as an application portal address within an address space visible to a peripheral device that is communicatively coupled to the processor-based device. Upon receiving a message directed to the application portal address from the peripheral device, an application portal control circuit enqueues the message in the application portal. In some embodiments, the PE may further provide a dequeue instruction that may be executed as part of the application, and that results in a top element of the application portal being dequeued and transmitted to the application.Type: GrantFiled: February 25, 2021Date of Patent: June 21, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Artur Klauser, Jason S. Wohlgemuth, Abolade Gbadegesin, Gagan Gupta, Soheil Ebadian, Thomas Philip Speier, Derek Chiou
-
Publication number: 20200371828Abstract: A physical server with an offload card including a SoC (system-on-chip) and a FPGA (field programmable gate array) is disclosed. According to one set of embodiments, the SoC can be configured to offload one or more hypervisor functions from a CPU complex of the server that are suited for execution in software, and the FPGA can be configured to offload one or more hypervisor functions from the CPU complex that are suited for execution in hardware.Type: ApplicationFiled: March 3, 2020Publication date: November 26, 2020Inventors: Derek CHIOU, Andrew PUTNAM, Daniel FIRESTONE, Jack LAVIER
-
Patent number: 10540588Abstract: A method is provided for processing on an acceleration component a deep neural network. The method includes configuring the acceleration component to perform forward propagation and backpropagation stages of the deep neural network. The acceleration component includes an acceleration component die and a memory stack disposed in an integrated circuit package. The memory stack has a memory bandwidth greater than about 50 GB/sec and a power efficiency of greater than about 20 MB/sec/mW.Type: GrantFiled: June 29, 2015Date of Patent: January 21, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Douglas C. Burger, Derek Chiou, Eric Chung, Andrew R. Putnam
-
Patent number: 10455061Abstract: A smart NIC (Network Interface Card) is provided with features to enable the smart NIC to operate as an in-line NIC between a host's NIC and a network. The smart NIC provides pass-through transmission of network flows for the host. Packets sent to and from the host pass through the smart NIC. As a pass-through point, the smart NIC is able to accelerate the performance of the pass-through network flows by analyzing packets, inserting packets, dropping packets, inserting or recognizing congestion information, and so forth. In addition, the smart NIC provides a lightweight transport protocol (LTP) module that enables it to establish connections with other smart NICs. The LTP connections allow the smart NICs to exchange data without passing network traffic through their respective hosts.Type: GrantFiled: December 20, 2017Date of Patent: October 22, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Adrian Caulfield, Eric Chung, Doug Burger, Derek Chiou
-
Patent number: 10452995Abstract: A method is provided for processing on an acceleration component a machine learning classification model. The machine learning classification model includes a plurality of decision trees, the decision trees including a first amount of decision tree data. The acceleration component includes an acceleration component die and a memory stack disposed in an integrated circuit package. The memory die includes an acceleration component memory having a second amount of memory less than the first amount of decision tree data. The memory stack includes a memory bandwidth greater than about 50 GB/sec and a power efficiency of greater than about 20 MB/sec/mW.Type: GrantFiled: June 29, 2015Date of Patent: October 22, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Douglas C. Burger, Derek Chiou, Eric Chung, Andrew R. Putnam
-
Patent number: 10129153Abstract: A smart NIC (Network Interface Card) is provided with features to enable the smart NIC to operate as an in-line NIC between a host's NIC and a network. The smart NIC provides pass-through transmission of network flows for the host. Packets sent to and from the host pass through the smart NIC. As a pass-through point, the smart NIC is able to accelerate the performance of the pass-through network flows by analyzing packets, inserting packets, dropping packets, inserting or recognizing congestion information, and so forth. In addition, the smart NIC provides a lightweight transport protocol (LTP) module that enables it to establish connections with other smart NICs. The LTP connections allow the smart NICs to exchange data without passing network traffic through their respective hosts.Type: GrantFiled: May 15, 2017Date of Patent: November 13, 2018Assignee: Microsoft Technology Licensing, LLCInventors: Adrian Caulfield, Eric Chung, Doug Burger, Derek Chiou
-
Publication number: 20180139310Abstract: A smart NIC (Network Interface Card) is provided with features to enable the smart NIC to operate as an in-line NIC between a host's NIC and a network. The smart NIC provides pass-through transmission of network flows for the host. Packets sent to and from the host pass through the smart NIC. As a pass-through point, the smart NIC is able to accelerate the performance of the pass-through network flows by analyzing packets, inserting packets, dropping packets, inserting or recognizing congestion information, and so forth. In addition, the smart NIC provides a lightweight transport protocol (LTP) module that enables it to establish connections with other smart NICs. The LTP connections allow the smart NICs to exchange data without passing network traffic through their respective hosts.Type: ApplicationFiled: December 20, 2017Publication date: May 17, 2018Inventors: Adrian Caulfield, Eric Chung, Doug Burger, Derek Chiou
-
Publication number: 20180137030Abstract: Systems and methods for automatic generation of an exception detector for determining an overflow condition are provided. In one example, a method including receiving code corresponding to at least one block of the hardware module, wherein the code providing at least a first value for a first variable, a second value for a second variable, or an operation to be performed using at least one of the first variable or the second variable, is provided. The method may further include automatically generating an exception detector to determine whether an overflow condition is triggered by at least one of the operation, the first variable, or the second variable.Type: ApplicationFiled: March 1, 2017Publication date: May 17, 2018Inventors: Shachar Raindel, Derek Chiou
-
Patent number: 9888095Abstract: A smart NIC (Network Interface Card) is provided with features to enable the smart NIC to operate as an in-line NIC between a host's NIC and a network. The smart NIC provides pass-through transmission of network flows for the host. Packets sent to and from the host pass through the smart NIC. As a pass-through point, the smart NIC is able to accelerate the performance of the pass-through network flows by analyzing packets, inserting packets, dropping packets, inserting or recognizing congestion information, and so forth. In addition, the smart NIC provides a lightweight transport protocol (LTP) module that enables it to establish connections with other smart NICs. The LTP connections allow the smart NICs to exchange data without passing network traffic through their respective hosts.Type: GrantFiled: June 26, 2015Date of Patent: February 6, 2018Assignee: Microsoft Technology Licensing, LLCInventors: Adrian Caulfield, Eric Chung, Doug Burger, Derek Chiou
-
Publication number: 20170250914Abstract: A smart NIC (Network Interface Card) is provided with features to enable the smart NIC to operate as an in-line NIC between a host's NIC and a network. The smart NIC provides pass-through transmission of network flows for the host. Packets sent to and from the host pass through the smart NIC. As a pass-through point, the smart NIC is able to accelerate the performance of the pass-through network flows by analyzing packets, inserting packets, dropping packets, inserting or recognizing congestion information, and so forth. In addition, the smart NIC provides a lightweight transport protocol (LTP) module that enables it to establish connections with other smart NICs. The LTP connections allow the smart NICs to exchange data without passing network traffic through their respective hosts.Type: ApplicationFiled: May 15, 2017Publication date: August 31, 2017Inventors: Adrian Caulfield, Eric Chung, Doug Burger, Derek Chiou
-
Patent number: 9674090Abstract: A smart NIC (Network Interface Card) is provided with features to enable the smart NIC to operate as an in-line NIC between a host's NIC and a network. The smart NIC provides pass-through transmission of network flows for the host. Packets sent to and from the host pass through the smart NIC. As a pass-through point, the smart NIC is able to accelerate the performance of the pass-through network flows by analyzing packets, inserting packets, dropping packets, inserting or recognizing congestion information, and so forth. In addition, the smart NIC provides a lightweight transport protocol (LTP) module that enables it to establish connections with other smart NICs. The LTP connections allow the smart NICs to exchange data without passing network traffic through their respective hosts.Type: GrantFiled: June 26, 2015Date of Patent: June 6, 2017Assignee: Microsoft Technology Licensing, LLCInventors: Adrian Caulfield, Eric Chung, Doug Burger, Derek Chiou
-
Publication number: 20160379137Abstract: A method is provided for processing on an acceleration component a machine learning classification model. The machine learning classification model includes a plurality of decision trees, the decision trees including a first amount of decision tree data. The acceleration component includes an acceleration component die and a memory stack disposed in an integrated circuit package. The memory die includes an acceleration component memory having a second amount of memory less than the first amount of decision tree data. The memory stack includes a memory bandwidth greater than about 50 GB/sec and a power efficiency of greater than about 20 MB/sec/mW.Type: ApplicationFiled: June 29, 2015Publication date: December 29, 2016Inventors: Douglas C. Burger, Derek Chiou, Eric Chung, Andrew R. Putnam
-
Publication number: 20160380896Abstract: A smart NIC (Network Interface Card) is provided with features to enable the smart NIC to operate as an in-line NIC between a host's NIC and a network. The smart NIC provides pass-through transmission of network flows for the host. Packets sent to and from the host pass through the smart NIC. As a pass-through point, the smart NIC is able to accelerate the performance of the pass-through network flows by analyzing packets, inserting packets, dropping packets, inserting or recognizing congestion information, and so forth. In addition, the smart NIC provides a lightweight transport protocol (LTP) module that enables it to establish connections with other smart NICs. The LTP connections allow the smart NICs to exchange data without passing network traffic through their respective hosts.Type: ApplicationFiled: June 26, 2015Publication date: December 29, 2016Inventors: Adrian Caulfield, Eric Chung, Doug Burger, Derek Chiou
-
Publication number: 20160379115Abstract: A method is provided for processing on an acceleration component a deep neural network. The method includes configuring the acceleration component to perform forward propagation and backpropagation stages of the deep neural network. The acceleration component includes an acceleration component die and a memory stack disposed in an integrated circuit package. The memory stack has a memory bandwidth greater than about 50 GB/sec and a power efficiency of greater than about 20 MB/sec/mW.Type: ApplicationFiled: June 29, 2015Publication date: December 29, 2016Inventors: Douglas C. Burger, Derek Chiou, Eric Chung, Andrew R. Putnam
-
Publication number: 20160381189Abstract: A smart NIC (Network Interface Card) is provided with features to enable the smart NIC to operate as an in-line NIC between a host's NIC and a network. The smart NIC provides pass-through transmission of network flows for the host. Packets sent to and from the host pass through the smart NIC. As a pass-through point, the smart NIC is able to accelerate the performance of the pass-through network flows by analyzing packets, inserting packets, dropping packets, inserting or recognizing congestion information, and so forth. In addition, the smart NIC provides a lightweight transport protocol (LTP) module that enables it to establish connections with other smart NICs. The LTP connections allow the smart NICs to exchange data without passing network traffic through their respective hosts.Type: ApplicationFiled: June 26, 2015Publication date: December 29, 2016Inventors: Adrian Caulfield, Eric Chung, Doug Burger, Derek Chiou
-
Patent number: 8855994Abstract: A simulator is partitioned into a functional component and a behavior prediction component and the components are executed in parallel. The execution path of the functional component is used to drive the behavior prediction component and the behavior prediction component changes the execution path of the functional component.Type: GrantFiled: June 20, 2013Date of Patent: October 7, 2014Inventor: Derek Chiou
-
Publication number: 20130282356Abstract: A simulator is partitioned into a functional component and a behavior prediction component and the components are executed in parallel. The execution path of the functional component is used to drive the behavior prediction component and the behavior prediction component changes the execution path of the functional component.Type: ApplicationFiled: June 20, 2013Publication date: October 24, 2013Inventor: Derek Chiou
-
Patent number: 8494831Abstract: A simulator is partitioned into a functional component and a behavior prediction component and the components are executed in parallel. The execution path of the functional component is used to drive the behavior prediction component and the behavior prediction component changes the execution path of the functional component.Type: GrantFiled: November 19, 2010Date of Patent: July 23, 2013Inventor: Derek Chiou
-
Patent number: 8243744Abstract: Sort elements, such as queues processed in a network processor, are provided with relative priorities relative to each other. A set of relative priorities is used to specify priority order of the sort elements. The priority order may be specified by addressing code in a jump table. Duplicate code in the jump table having multiple entrance points allows for reduction of the size of the jump table. The relative priorities may be applied to a lookup table, hash or other function in order to address the jump table.Type: GrantFiled: March 1, 2005Date of Patent: August 14, 2012Assignee: FutureWei Technologies, Inc.Inventors: Larry R. Dennison, Derek Chiou