Abstract: A robotic kitchen system for preparing food items in combination with at least one kitchen appliance such as a fryer comprises an automated bin assembly, a robotic arm, and a basket held by the robotic arm. The automated bin assembly comprises at least one automated bin for holding the food items. A camera or sensor array collects image data of the food items in the bin(s). A central processor is operable to compute and provide directions to the first robotic arm and automated bin assembly based on the image data and stored data to (a) move the robotic arm to the bin; (b) actuate the bin to drop the food items from the bin into the basket; (c) and to move the basket into the fryer all without human interaction. Related methods are also described.

Abstract: An automated kitchen assistant system inspects a food preparation area in the kitchen environment using a novel sensor combination. The combination of sensors includes an Infrared (IR) camera that generates IR image data and at least one secondary sensor that generates secondary image data. The IR image data and secondary image data are processed to obtain combined image data. A trained convolutional neural network is employed to automatically compute an output based on the combined image data. The output includes information about the identity and the location of the food item. The output may further be utilized to command a robotic arm, kitchen worker, or otherwise assist in food preparation. Related methods are also described.

Abstract: A modular robotic kitchen system is conveniently adaptable to perform a wide range of cooking applications. The modular robotic kitchen system can include a plurality of discrete modular units organized in a small footprint such that multiple types of cooking applications can be performed without a need to replace the modular units. Exemplary modular units include an ingredient module, robotic arm module, assembly and packaging module, and warming module. Optionally a transport unit or sled moves the modules into position. The modular kitchen system includes a central processor operable to carry out different cooking applications upon downloading software corresponding to the specific cooking application and without retooling the existing modules. Related methods are also described.

Abstract: An automated kitchen assistant system inspects a food preparation area in the kitchen environment using a plurality of sensors or cameras. A trained model computes the identity and the location of the food item. In embodiments, the food items are on a grill, and the automated kitchen assistant system is operable to compute the time remaining to remove or flip each of the food items. The output may further be utilized to command a robotic arm, kitchen worker, or otherwise assist in food preparation. Related methods are also described.

Abstract: A robotic kitchen system for preparing food items in combination with at least one kitchen appliance such as a fryer comprises an automated bin assembly, a robotic arm, and a basket held by the robotic arm. The automated bin assembly comprises at least one automated bin for holding the food items. A camera or sensor array collects image data of the food items in the bin(s). A central processor is operable to compute and provide directions to the first robotic arm and automated bin assembly based on the image data and stored data to (a) move the robotic arm to the bin; (b) actuate the bin to drop the food items from the bin into the basket; (c) and to move the basket into the fryer all without human interaction. Related methods are also described.

Abstract: A robotic kitchen system for preparing food items in combination with at least one kitchen appliance such as a fryer comprises an automated bin assembly, a robotic arm, and a basket held by the robotic arm. The automated bin assembly comprises at least one automated bin for holding the food items. A camera or sensor array collects image data of the food items in the bin(s). A central processor is operable to compute and provide directions to the first robotic arm and automated bin assembly based on the image data and stored data to (a) move the robotic arm to the bin; (b) actuate the bin to drop the food items from the bin into the basket; (c) and to move the basket into the fryer all without human interaction. Related methods are also described.

Abstract: A robotic sled-enhanced food preparation system includes a robotic kitchen assistant operable to determine and to perform food preparation steps, and an autonomous mobile sled operable to supply the robotic kitchen assistant with ingredients and supplies. The robotic kitchen assistant includes a scheduling engine to evaluate food inventory levels and automatically determine when to replenish the food inventories using the sled if the food inventory levels are insufficient to complete the food preparation steps. Related methods are also described.

Abstract: A robotic kitchen assistant for frying includes a robotic arm, a fryer basket, and a robotic arm adapter assembly allowing the robotic arm to pick up and manipulate the fryer basket. The robotic arm adapter includes opposing gripping members to engage the fryer basket. A utensil adapter assembly is mounted to the handle of the fryer basket, and the opposing gripper members are actuated to capture a three-dimensional (3D) feature of the utensil adapter assembly. The robotic arm adapter assembly can include an agitator mechanism to shake the fryer basket or another utensil as desired. Related methods are also described.

Abstract: An automated kitchen assistant system inspects a food preparation area in the kitchen environment using a novel sensor combination. The combination of sensors includes an Infrared (IR) camera that generates IR image data and at least one secondary sensor that generates secondary image data. The IR image data and secondary image data are processed to obtain combined image data. A trained convolutional neural network is employed to automatically compute an output based on the combined image data. The output includes information about the identity and the location of the food item. The output may further be utilized to command a robotic arm, kitchen worker, or otherwise assist in food preparation. Related methods are also described.

Abstract: An automated kitchen assistant system inspects a food preparation area in the kitchen environment using a novel sensor combination. The combination of sensors includes an Infrared (IR) camera that generates IR image data and at least one secondary sensor that generates secondary image data. The IR image data and secondary image data are processed to obtain combined image data. A trained convolutional neural network is employed to automatically compute an output based on the combined image data. The output includes information about the identity and the location of the food item. The output may further be utilized to command a robotic arm, kitchen worker, or otherwise assist in food preparation. Related methods are also described.

Abstract: A food preparation system is configured to enhance the efficiency of food preparation operations in a commercial kitchen by displaying instructions on a surface in the kitchen work area. The food preparation system includes a plurality of cameras aimed at a kitchen workspace for preparing the plurality of food items and a processor operable to compute an instruction for a kitchen worker to perform a food preparation step based on one or more types of information selected from order information, recipe information, kitchen equipment information, data from the cameras, and food item inventory information. A projector in communication with the processor visually projects the instruction onto a location in the kitchen workspace for the kitchen worker to observe. Related methods for projecting food preparation instructions are described.

Abstract: A transportable kitchen workcell includes a prefabricated enclosure, a robotic arm secured within the enclosure, one or more food appliances, a food prep area and storage, a sensor assembly, and a processor operable to command the robotic arm to autonomously prepare a completed entree from a wide variety of raw ingredients. A dispensing unit is arranged in the enclosure for dispensing the raw ingredients onto a target surface according to a selected flowrate and based on real time feedback measured during dispensing. The workcell is self-contained and is adapted to be conveniently moved (e.g., towed) to a new location. A wide range of entrees may be completed without rearranging or retooling the equipment in the workcell. New food items may be prepared by the workcell by simply selecting the applicable program, or by downloading an update corresponding to the new food item.

Abstract: A modular robotic kitchen system is conveniently adaptable to perform a wide range of cooking applications. The modular robotic kitchen system can include a plurality of discrete modular units organized in a small footprint such that multiple types of cooking applications can be performed without a need to replace the modular units. Exemplary modular units include an ingredient module, robotic arm module, assembly and packaging module, and warming module. Optionally a transport unit or sled moves the modules into position. The modular kitchen system includes a central processor operable to carry out different cooking applications upon downloading software corresponding to the specific cooking application and without retooling the existing modules. Related methods are also described.

Abstract: A flexible robotic kitchen assistant automates the preparation of food items. The robotic kitchen assistant includes a robotic arm, a sensor assembly comprising a plurality of cameras aimed at a kitchen workspace for preparing the food items, a controller operable to move the robotic arm, and a processor. The processor is operable to command the robotic arm to perform a food preparation step on the food items in the kitchen workspace based on order information, recipe information, kitchen equipment information, and camera data. The system is capable of performing a wide range of tasks commonly used in residential and commercial kitchens and is able to work collaboratively with and in close proximity to human kitchen workers.

Abstract: A robotic sled-enhanced food preparation system includes a robotic kitchen assistant operable to determine and to perform food preparation steps, and an autonomous mobile sled operable to supply the robotic kitchen assistant with ingredients and supplies. The robotic kitchen assistant includes a scheduling engine to evaluate food inventory levels and automatically determine when to replenish the food inventories using the sled if the food inventory levels are insufficient to complete the food preparation steps. Related methods are also described.

Abstract: An automated kitchen assistant system inspects a food preparation area in the kitchen environment using a novel sensor combination. The combination of sensors includes an Infrared (IR) camera that generates IR image data and at least one secondary sensor that generates secondary image data. The IR image data and secondary image data are processed to obtain combined image data. A trained convolutional neural network is employed to automatically compute an output based on the combined image data. The output includes information about the identity and the location of the food item. The output may further be utilized to command a robotic arm, kitchen worker, or otherwise assist in food preparation. Related methods are also described.