Abstract: A flexible robotic kitchen assistant automates the preparation of food items. The robotic kitchen assistant includes a robotic arm, a sensor assembly comprising a plurality of cameras aimed at a kitchen workspace for preparing the food items, a controller operable to move the robotic arm, and a processor. The processor is operable to command the robotic arm to perform a food preparation step on the food items in the kitchen workspace based on order information, recipe information, kitchen equipment information, and camera data. The system is capable of performing a wide range of tasks commonly used in residential and commercial kitchens and is able to work collaboratively with and in close proximity to human kitchen workers.

Abstract: An automated kitchen assistant system inspects a food preparation area in the kitchen environment using a novel sensor combination. The combination of sensors includes an Infrared (IR) camera that generates IR image data and at least one secondary sensor that generates secondary image data. The IR image data and secondary image data are processed to obtain combined image data. A trained convolutional neural network is employed to automatically compute an output based on the combined image data. The output includes information about the identity and the location of the food item. The output may further be utilized to command a robotic arm, kitchen worker, or otherwise assist in food preparation. Related methods are also described.

Abstract: A modular robotic kitchen system is conveniently adaptable to perform a wide range of cooking applications. The modular robotic kitchen system can include a plurality of discrete modular units organized in a small footprint such that multiple types of cooking applications can be performed without a need to replace the modular units. Exemplary modular units include an ingredient module, robotic arm module, assembly and packaging module, and warming module. Optionally a transport unit or sled moves the modules into position. The modular kitchen system includes a central processor operable to carry out different cooking applications upon downloading software corresponding to the specific cooking application and without retooling the existing modules. Related methods are also described.

Abstract: A sleeve apparatus for protecting a robotic kitchen arm from contamination. The sleeve includes a proximal end, a distal end, a passageway extending from the proximal end to the distal end, and an exterior surface. The passageway has an effective diameter less than the effective diameter of the robotic kitchen arm such that the exterior surface of the sleeve apparatus is substantially fold-free when the robotic arm is in the extended configuration. Methods of cleaning a robotic kitchen arm are also described.

Abstract: A robotic sled-enhanced food preparation system includes a robotic kitchen assistant operable to determine and to perform food preparation steps, and an autonomous mobile sled operable to supply the robotic kitchen assistant with ingredients and supplies. The robotic kitchen assistant includes a scheduling engine to evaluate food inventory levels and automatically determine when to replenish the food inventories using the sled if the food inventory levels are insufficient to complete the food preparation steps. Related methods are also described.

Abstract: An automated kitchen assistant system inspects a food preparation area in the kitchen environment using a novel sensor combination. The combination of sensors includes an Infrared (IR) camera that generates IR image data and at least one secondary sensor that generates secondary image data. The IR image data and secondary image data are processed to obtain combined image data. A trained convolutional neural network is employed to automatically compute an output based on the combined image data. The output includes information about the identity and the location of the food item. The output may further be utilized to command a robotic arm, kitchen worker, or otherwise assist in food preparation. Related methods are also described.

Abstract: An automated kitchen assistant system inspects a food preparation area in the kitchen environment using a novel sensor combination. The combination of sensors includes an Infrared (IR) camera that generates IR image data and at least one secondary sensor that generates secondary image data. The IR image data and secondary image data are processed to obtain combined image data. A trained convolutional neural network is employed to automatically compute an output based on the combined image data. The output includes information about the identity and the location of the food item. The output may further be utilized to command a robotic arm, kitchen worker, or otherwise assist in food preparation. Related methods are also described.

Abstract: A food preparation system is configured to enhance the efficiency of food preparation operations in a commercial kitchen by displaying instructions on a surface in the kitchen work area. The food preparation system includes a plurality of cameras aimed at a kitchen workspace for preparing the plurality of food items and a processor operable to compute an instruction for a kitchen worker to perform a food preparation step based on one or more types of information selected from order information, recipe information, kitchen equipment information, data from the cameras, and food item inventory information. A projector in communication with the processor visually projects the instruction onto a location in the kitchen workspace for the kitchen worker to observe. Related methods for projecting food preparation instructions are described.

Abstract: A transportable kitchen workcell includes a prefabricated enclosure, a robotic arm secured within the enclosure, one or more food appliances, a food prep area and storage, a sensor assembly, and a processor operable to command the robotic arm to autonomously prepare a completed entree from a wide variety of raw ingredients. A dispensing unit is arranged in the enclosure for dispensing the raw ingredients onto a target surface according to a selected flowrate and based on real time feedback measured during dispensing. The workcell is self-contained and is adapted to be conveniently moved (e.g., towed) to a new location. A wide range of entrees may be completed without rearranging or retooling the equipment in the workcell. New food items may be prepared by the workcell by simply selecting the applicable program, or by downloading an update corresponding to the new food item.

Abstract: A sleeve apparatus for protecting a robotic kitchen arm from contamination. The sleeve includes a proximal end, a distal end, a passageway extending from the proximal end to the distal end, and an exterior surface. The passageway has an effective diameter less than the effective diameter of the robotic kitchen arm such that the exterior surface of the sleeve apparatus is substantially fold-free when the robotic arm is in the extended configuration. Methods of cleaning a robotic kitchen arm are also described.

Abstract: A robotic food singulation system for providing individual food units in a predetermined arrangement from a whole raw food. A food preparation device outputs individual food units, one at a time, onto a conveyor belt. A programmed processor computes an identity score for the food unit, and evaluates a singulation quality based on characteristics from various sensors or cameras aimed at the conveyor and food unit. The system instructs a robotic arm to pick up the food unit and distribute it in a predetermined arrangement on a target substrate, optionally, with a jawless gripping and release assembly. The target substrate may be a storage device or another food item itself depending on the food assembly instructions. Related methods are also described.

Abstract: A modular robotic kitchen system is conveniently adaptable to perform a wide range of cooking applications. The modular robotic kitchen system can include a plurality of discrete modular units organized in a small footprint such that multiple types of cooking applications can be performed without a need to replace the modular units. Exemplary modular units include an ingredient module, robotic arm module, assembly and packaging module, and warming module. Optionally a transport unit or sled moves the modules into position. The modular kitchen system includes a central processor operable to carry out different cooking applications upon downloading software corresponding to the specific cooking application and without retooling the existing modules. Related methods are also described.

Abstract: A flexible robotic kitchen assistant automates the preparation of food items. The robotic kitchen assistant includes a robotic arm, a sensor assembly comprising a plurality of cameras aimed at a kitchen workspace for preparing the food items, a controller operable to move the robotic arm, and a processor. The processor is operable to command the robotic arm to perform a food preparation step on the food items in the kitchen workspace based on order information, recipe information, kitchen equipment information, and camera data. The system is capable of performing a wide range of tasks commonly used in residential and commercial kitchens and is able to work collaboratively with and in close proximity to human kitchen workers.

Abstract: A sleeve apparatus for protecting a robotic kitchen arm from contamination. The sleeve includes a proximal end, a distal end, a passageway extending from the proximal end to the distal end, and an exterior surface. The passageway has an effective diameter less than the effective diameter of the robotic kitchen arm such that the exterior surface of the sleeve apparatus is substantially fold-free when the robotic arm is in the extended configuration. Methods of cleaning a robotic kitchen arm are also described.

Abstract: A robotic sled-enhanced food preparation system includes a robotic kitchen assistant operable to determine and to perform food preparation steps, and an autonomous mobile sled operable to supply the robotic kitchen assistant with ingredients and supplies. The robotic kitchen assistant includes a scheduling engine to evaluate food inventory levels and automatically determine when to replenish the food inventories using the sled if the food inventory levels are insufficient to complete the food preparation steps. Related methods are also described.

Abstract: System and method for presenting search results. Search results may be mixed and/or prioritized based on one or more criteria. Search results may be mixed and/or prioritized based on user profile data, preferred advertiser/merchant rankings or a combination thereof. Search results may presented to a viewer on a display device simultaneously along with broadcast and/or streaming content. The search results may be “pushed” to a client-side device and presented along with related broadcast content. Alternatively, the search results may be based on one or more user-provided search criteria.

Abstract: An automated kitchen assistant system inspects a food preparation area in the kitchen environment using a novel sensor combination. The combination of sensors includes an Infrared (IR) camera that generates IR image data and at least one secondary sensor that generates secondary image data. The IR image data and secondary image data are processed to obtain combined image data. A trained convolutional neural network is employed to automatically compute an output based on the combined image data. The output includes information about the identity and the location of the food item. The output may further be utilized to command a robotic arm, kitchen worker, or otherwise assist in food preparation. Related methods are also described.

Abstract: System and method for providing time-based content. In one embodiment, time-based offers are presented to viewers of broadcast content, and may be presented on the same display device being used to display broadcast programming. In another embodiment, time-based offers are commercial offers inviting the viewer to purchase goods or services at a special rate for a limited time. Time-based offers may also be customized based on programming content being viewed and/or viewer profile data. Responses to presented time-based offers may be used to update viewer profile data and/or merchant conversion profile data, which is a measure of how effective the particular offer is.

Abstract: A search-enabled remote control device to facilitate viewers' ability to search through programming and/or content options and view results. In one embodiment, a viewer is able to use a traditional remote control interface to navigate through menus or selections and to display search results on screen. In another embodiment, a viewer's watching behavior and/or searching habits are tracked by the search-enabled remote control and used to develop a viewer profile, which may in turn be used to target advertisements, information and/or future programming options.