Abstract: This specification relates to robots and audio processing in robots. In general, one innovative aspect of the subject matter described in this specification can be embodied in a robot that includes: a body and one or more physically moveable components; a plurality of accessory input subsystems and one or more other sensor subsystems; one or more processors; and one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the robot to perform operations. The operations can include: receiving one or more sensor inputs from the one or more other sensor subsystems; determining a predicted direction of a detected sound emitter based on the one or more sensor inputs of the one or more other sensor subsystems; calculating a spatial filter based on the predicted direction; obtaining, by the plurality of accessory input subsystems, respective audio inputs; and processing the respective audio inputs according to the calculated spatial filter.

Abstract: A robot that uses sensor inputs for attention activation and corresponding methods, systems, and computer programs encoded on computer storage media. The robot can be configured to compute a plurality of attention signals from sensor inputs and provide the plurality of attention signals as input to the attention level classifier to generate an attention level. If a user is paying attention to the robot based on the generated attention level, the robot selects a behavior to execute based on the current attention level, wherein a behavior comprises one or more coordinated actions to be performed by the robot.

Abstract: This specification relates to robots and audio processing in robots. In general, one innovative aspect of the subject matter described in this specification can be embodied in a robot that includes: a body and one or more physically moveable components; a plurality of accessory input subsystems and one or more other sensor subsystems; one or more processors; and one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the robot to perform operations. The operations can include: receiving one or more sensor inputs from the one or more other sensor subsystems; determining a predicted direction of a detected sound emitter based on the one or more sensor inputs of the one or more other sensor subsystems; calculating a spatial filter based on the predicted direction; obtaining, by the plurality of accessory input subsystems, respective audio inputs; and processing the respective audio inputs according to the calculated spatial filter.

Abstract: This specification relates to robots and audio processing in robots. One aspect of the subject matter includes: a body and one or more physically moveable components; a plurality of microphones; one or more processors; and one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the robot to perform operations. The operations can include: obtaining map data of an environment of the robot; selecting a test location from the map data; navigating to the selected test location; receiving a sound wave propagating through the environment of the robot; computing one or more acoustic transfer functions for the test signal, wherein each acoustic transfer function represents how the test signal was transformed by the environment of the robot during its propogation through the environment of the robot; and storing each of the transfer functions in association with the test location.

Abstract: This specification relates to robots and audio processing in robots. In general, one innovative aspect of the subject matter described in this specification can be embodied in a robot that includes: a body and one or more physically moveable components; a plurality of microphones and one or more other sensor subsystems; one or more processors; and one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the robot to perform operations. The operations can include: receiving one or more sensor inputs from the one or more other sensor subsystems; determining a predicted direction of a detected sound emitter based on the one or more sensor inputs of the one or more other sensor subsystems; calculating a spatial filter based on the predicted direction; obtaining, by the plurality of microphones, respective audio inputs; and processing the respective audio inputs according to the calculated spatial filter.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using character-driven robots and other agents for volunteer computing and other unengaged time computing tasks. One of the robots is configured to execute instructions that cause the robot to receive one or more sensor inputs from one or more sensor subsystems. From the one or more sensor inputs, a prediction representing a likelihood of one or more users engaging with the robot over a particular subsequent time period is computed. If the computed prediction indicates that the robot is in an unengaged state, the robot selects one or more unengaged time computing tasks and performs the selected one or more unengaged time computing tasks.

Abstract: This specification relates to robots and audio processing in robots. One aspect of the subject matter includes: a body and one or more physically moveable components; a plurality of microphones; one or more processors; and one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the robot to perform operations. The operations can include: obtaining map data of an environment of the robot; selecting a test location from the map data; navigating to the selected test location; receiving a sound wave propagating through the environment of the robot; computing one or more acoustic transfer functions for the test signal, wherein each acoustic transfer function represents how the test signal was transformed by the environment of the robot during its propogation through the environment of the robot; and storing each of the transfer functions in association with the test location.

Abstract: This specification relates to robots and audio processing in robots. In general, one innovative aspect of the subject matter described in this specification can be embodied in a robot that includes: a body and one or more physically moveable components; a plurality of microphones and one or more other sensor subsystems; one or more processors; and one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the robot to perform operations. The operations can include: receiving one or more sensor inputs from the one or more other sensor subsystems; determining a predicted direction of a detected sound emitter based on the one or more sensor inputs of the one or more other sensor subsystems; calculating a spatial filter based on the predicted direction; obtaining, by the plurality of microphones, respective audio inputs; and processing the respective audio inputs according to the calculated spatial filter.

Abstract: A robot that uses sensor inputs for attention activation and corresponding methods, systems, and computer programs encoded on computer storage media. The robot can be configured to compute a plurality of attention signals from sensor inputs and provide the plurality of attention signals as input to the attention level classifier to generate an attention level. If a user is paying attention to the robot based on the generated attention level, the robot selects a behavior to execute based on the current attention level, wherein a behavior comprises one or more coordinated actions to be performed by the robot.

Abstract: A drivable surface includes a plurality of segments that can be arranged according to any desired configuration. One or more mobile agents are configured to automatically explore the drivable surface so as to ascertain the positions, orientations, and/or configurations of the various segments, as well as how they are connected to one another. The information collected during such exploration can be transmitted to a host device or other location, where a virtual representation of the drivable surface can be constructed based on the collected information.

Abstract: A system includes a drivable surface that includes location encoding markings. A mobile agent is provided that includes a drive motor, an imaging system for taking images of the markings, a vehicle wireless transceiver, and a microcontroller operatively coupled to the motor, the imaging system, and the vehicle wireless transceiver. A basestation is provided that includes a controller operatively coupled to a basestation wireless transceiver. Via wireless communication between the wireless transceivers of the mobile agent and the basestation, an action to be implemented by the mobile agent can be determined by the basestation and communicated to the mobile agent, whereupon the microcontroller of the mobile agent controls detailed movement of the mobile agent on the drivable surface based on images taken of the markings of the drivable surface by the imaging system to cause the mobile agent to implement the action on the drivable surface.

Abstract: A system includes a drivable surface that includes location encoding markings. A mobile agent is provided that includes a drive motor, an imaging system for taking images of the markings, a vehicle wireless transceiver, and a microcontroller operatively coupled to the motor, the imaging system, and the vehicle wireless transceiver. A basestation is provided that includes a controller operatively coupled to a basestation wireless transceiver. Via wireless communication between the wireless transceivers of the mobile agent and the basestation, an action to be implemented by the mobile agent can be determined by the basestation and communicated to the mobile agent, whereupon the microcontroller of the mobile agent controls detailed movement of the mobile agent on the drivable surface based on images taken of the markings of the drivable surface by the imaging system to cause the mobile agent to implement the action on the drivable surface.

Abstract: A system includes a drivable surface that includes location encoding markings. A mobile agent is provided that includes a drive motor, an imaging system for taking images of the markings, a vehicle wireless transceiver, and a microcontroller operatively coupled to the motor, the imaging system, and the vehicle wireless transceiver. A basestation is provided that includes a controller operatively coupled to a basestation wireless transceiver. Via wireless communication between the wireless transceivers of the mobile agent and the basestation, an action to be implemented by the mobile agent can be determined by the basestation and communicated to the mobile agent, whereupon the microcontroller of the mobile agent controls detailed movement of the mobile agent on the drivable surface based on images taken of the markings of the drivable surface by the imaging system to cause the mobile agent to implement the action on the drivable surface.

Abstract: A drivable surface includes a plurality of segments that can be arranged according to any desired configuration. One or more mobile agents are configured to automatically explore the drivable surface so as to ascertain the positions, orientations, and/or configurations of the various segments, as well as how they are connected to one another. The information collected during such exploration can be transmitted to a host device or other location, where a virtual representation of the drivable surface can be constructed based on the collected information.

Abstract: A system includes a drivable surface that includes location encoding markings. A mobile agent is provided that includes a drive motor, an imaging system for taking images of the markings, a vehicle wireless transceiver, and a microcontroller operatively coupled to the motor, the imaging system, and the vehicle wireless transceiver. A basestation is provided that includes a controller operatively coupled to a basestation wireless transceiver. Via wireless communication between the wireless transceivers of the mobile agent and the basestation, an action to be implemented by the mobile agent can be determined by the basestation and communicated to the mobile agent, whereupon the microcontroller of the mobile agent controls detailed movement of the mobile agent on the drivable surface based on images taken of the markings of the drivable surface by the imaging system to cause the mobile agent to implement the action on the drivable surface.

Abstract: A system includes a drivable surface that includes location encoding markings. A mobile agent is provided that includes a drive motor, an imaging system for taking images of the markings, a vehicle wireless transceiver, and a microcontroller operatively coupled to the motor, the imaging system, and the vehicle wireless transceiver. A basestation is provided that includes a controller operatively coupled to a basestation wireless transceiver. Via wireless communication between the wireless transceivers of the mobile agent and the basestation, an action to be implemented by the mobile agent can be determined by the basestation and communicated to the mobile agent, whereupon the microcontroller of the mobile agent controls detailed movement of the mobile agent on the drivable surface based on images taken of the markings of the drivable surface by the imaging system to cause the mobile agent to implement the action on the drivable surface.

Abstract: A system includes a drivable surface that includes location encoding markings. A mobile agent is provided that includes a drive motor, an imaging system for taking images of the markings, a vehicle wireless transceiver, and a microcontroller operatively coupled to the motor, the imaging system, and the vehicle wireless transceiver. A basestation is provided that includes a controller operatively coupled to a basestation wireless transceiver. Via wireless communication between the wireless transceivers of the mobile agent and the basestation, an action to be implemented by the mobile agent can be determined by the basestation and communicated to the mobile agent, whereupon the microcontroller of the mobile agent controls detailed movement of the mobile agent on the drivable surface based on images taken of the markings of the drivable surface by the imaging system to cause the mobile agent to implement the action on the drivable surface.

Abstract: A system includes a drivable surface that includes location encoding markings. A mobile agent is provided that includes a drive motor, an imaging system for taking images of the markings, a vehicle wireless transceiver, and a microcontroller operatively coupled to the motor, the imaging system, and the vehicle wireless transceiver. A basestation is provided that includes a controller operatively coupled to a basestation wireless transceiver. Via wireless communication between the wireless transceivers of the mobile agent and the basestation, an action to be implemented by the mobile agent can be determined by the basestation and communicated to the mobile agent, whereupon the microcontroller of the mobile agent controls detailed movement of the mobile agent on the drivable surface based on images taken of the markings of the drivable surface by the imaging system to cause the mobile agent to implement the action on the drivable surface.

Abstract: A system includes a drivable surface that includes location encoding markings. A mobile agent is provided that includes a drive motor, an imaging system for taking images of the markings, a vehicle wireless transceiver, and a microcontroller operatively coupled to the motor, the imaging system, and the vehicle wireless transceiver. A basestation is provided that includes a controller operatively coupled to a basestation wireless transceiver. Via wireless communication between the wireless transceivers of the mobile agent and the basestation, an action to be implemented by the mobile agent can be determined by the basestation and communicated to the mobile agent, whereupon the microcontroller of the mobile agent controls detailed movement of the mobile agent on the drivable surface based on images taken of the markings of the drivable surface by the imaging system to cause the mobile agent to implement the action on the drivable surface.

Abstract: A system includes a drivable surface that includes location encoding markings. A mobile agent is provided that is capable of assuming a plurality of different lateral positions while traveling along the surface. The mobile agent includes a drive motor, an imaging system, a vehicle wireless transceiver, and a microcontroller. The mobile agent is adapted to detect the markings as the mobile agent travels along the surface, to ascertain a current lateral position of the mobile agent with respect to the surface, and to maintain a substantially consistent lateral position of the mobile agent with respect to the surface (for example to follow a lane). A basestation may be provided that includes a controller operatively coupled to a basestation wireless transceiver. An action to be implemented by the mobile agent can be determined by the basestation and wirelessly communicated to the mobile agent.