Abstract: Example implementations may relate to methods and systems for detecting an event in a physical region within a physical space. Accordingly, a computing system may receive from a subscriber device an indication of a virtual region within a virtual representation of the physical space such that the virtual region corresponds to the physical region. The system may also receive from the subscriber a trigger condition associated with the virtual region, where the trigger condition corresponds to a particular physical change in the physical region. The system may also receive sensor data from sensors in the physical space and a portion of the sensor data may be associated with the physical region. Based on the sensor data, the system may detect an event in the physical region that satisfies the trigger condition and may responsively provide to the subscriber a notification that indicates that the trigger condition has been satisfied.

Abstract: A method includes receiving, from a subscriber device, a request including virtual region characteristics and an occupancy threshold, and determining, using image data captured by a camera and the virtual region characteristics, a virtual region corresponding to a portion of a physical region within a field of view of the camera. The virtual region is smaller than the physical region. The method also includes determining, using the image data, an occupancy of the virtual region and determining that the occupancy of the virtual region satisfies the occupancy threshold. In response to determining that the occupancy of the virtual region satisfies the occupancy threshold, the method also includes generating a notification to the subscriber device.

Abstract: Example implementations may relate to methods and systems for detecting an event in a physical region within a physical space. Accordingly, a computing system may receive from a subscriber device an indication of a virtual region within a virtual representation of the physical space such that the virtual region corresponds to the physical region. The system may also receive from the subscriber a trigger condition associated with the virtual region, where the trigger condition corresponds to a particular physical change in the physical region. The system may also receive sensor data from sensors in the physical space and a portion of the sensor data may be associated with the physical region. Based on the sensor data, the system may detect an event in the physical region that satisfies the trigger condition and may responsively provide to the subscriber a notification that indicates that the trigger condition has been satisfied.

Abstract: A robot agent (102) includes an electro-mechanical subsystem (202), a sensor subsystem (204) having one or more sensors, and a computer hardware subsystem (206) to execute one or more sets of executable instructions (212, 214, 216, 218, 220). The one or more sets of executable instructions manipulate the robot agent to predict an action to be implemented by the robot agent in performing a task (112) and predict whether the robot agent will fail in performing the action. The one or more sets of executable instructions further manipulate the robot agent to, responsive to predicting the robot agent will fail in performing the action, obtain guidance input (116) for the first action from at least one guidance source, the guidance input representing guidance for performing the action by the robot agent, and manipulate the electro-mechanical subsystem to perform the action using the guidance input.

Abstract: Example implementations may relate to methods and systems for detecting an event in a physical region within a physical space. Accordingly, a computing system may receive from a subscriber device an indication of a virtual region within a virtual representation of the physical space such that the virtual region corresponds to the physical region. The system may also receive from the subscriber a trigger condition associated with the virtual region, where the trigger condition corresponds to a particular physical change in the physical region. The system may also receive sensor data from sensors in the physical space and a portion of the sensor data may be associated with the physical region. Based on the sensor data, the system may detect an event in the physical region that satisfies the trigger condition and may responsively provide to the subscriber a notification that indicates that the trigger condition has been satisfied.

Abstract: Systems and methods for perception-based tactile sensing in a robot are provided. The robot may include an external portion and an illuminator that outputs illumination. The robot may further include a receiving sensor that receives illumination. The robot may also include a pair of conduits, located at an external portion, that include an injecting conduit that traverses one or more housings of the robot. The injecting conduit may be configured to receive the illumination from the illuminator and output the illumination to illuminate an object external to the robot. The pair of conduits may also include a receiving conduit, traversing one or more housings of the robot, configured to receive the illumination from the object external to the robot and output the illumination to the receiving sensor.

Abstract: Robotic gripper fingers are disclosed. A gripper assembly includes a first finger defining a first object engagement face and a second finger defining a second object engagement face. The first object engagement face of the first finger opposes the second object engagement face of the second finger. The gripper assembly also includes at least one actuator in communication with the first finger that is configured to actuate the first finger relative to the second finger. The gripper assembly includes at least one first sensor facing outward from the first object engagement face. The at least one first sensor is configured to detect objects to be manipulated by actuating the first finger relative to the second finger.

Abstract: A non-backdrivable passive balancing system for a single-axle dynamically balanced robotic device includes a body that includes a distal end and a proximal end, a controller module, and an actuator communicatively coupled to the controller module of the single-axle dynamically balanced robotic device. The actuator receives an engagement signal from the controller module, the engagement signal corresponding to an indication that the dynamically balanced robotic device is stationary, and the actuator causes the linkage to move the body from a disengaged position to an engaged position such that the distal end of the body contacts a ground surface and supports the dynamically balanced robotic device in a substantially upright position.

Abstract: Robot systems including a robot, an on-premise computing device, and a cloud services system are disclosed. An on-premise computing device includes a processor and a non-transitory memory device storing machine-readable instructions that, when executed by the processor, cause the processor to receive raw sensor data from a robot, pre-process the sensor data to remove unnecessary information from the sensor data and obtain pre-processed data, transmit the pre-processed data to a cloud services system, receive, from the cloud services system, an object type, an object pose, and an object location of an object corresponding to the pre-processed data, and transmit a signal to the robot based on at least one of the object type, the object pose, and the object location of the object.

Abstract: Systems are provided to emit, into an environment of interest, information in the form of modulated optical signals. These optical signals can be provided as illumination from a lighting fixture, display, or other source of environmental illumination. The optical signals can include codes or other information to facilitate location-specific operations of a device that is able to receive the optical signals. This can include receiving information about the location of a light emitter, security credentials or encryption keys, information about services that are available from building automation and/or conferencing systems, or other location-related information.

Abstract: Systems and methods for perception-based tactile sensing in a robot are provided. The robot may include an external portion and an illuminator that outputs illumination. The robot may further include a receiving sensor that receives illumination. The robot may also include a pair of conduits, located at an external portion, that include an injecting conduit that traverses one or more housings of the robot. The injecting conduit may be configured to receive the illumination from the illuminator and output the illumination to illuminate an object external to the robot. The pair of conduits may also include a receiving conduit, traversing one or more housings of the robot, configured to receive the illumination from the object external to the robot and output the illumination to the receiving sensor.

Abstract: An example method includes determining a point cloud representation of surfaces within an environment. The method further includes providing for display of a graphical interface that shows a model of the surfaces within the environment based on the point cloud representation. The method additionally includes receiving input data indicating one or more positions for one or more virtual sensors on the graphical interface corresponding to one or more physical positions within the environment. The method also includes determining one or more occluded regions within the environment, where the one or more occluded regions are predicted to be occluded from view by one or more sensors positioned at the one or more physical positions within the environment. The method also includes providing for display in the graphical interface of a graphical representation of the one or more occluded regions within the model of the surfaces within the environment.

Abstract: System, methods, and other embodiments described herein relate to improving persistent simulation of an environment. In one embodiment, a method includes capturing, using at least one sensor, state information about the environment that is proximate to a robotic device. The state information includes data about at least one object that is in the environment. The method includes generating a simulation of the environment according to at least a simulation model and characteristics of the at least one object identified from the state information. The simulation is a virtualization of the environment that characterizes the at least one object in relation to an inertial frame of the environment around the observing robotic device. The method includes predicting a subsequent state for the at least one object within the simulation based, at least in part, on the simulation model. The method includes providing the subsequent state as an electronic output.

Abstract: A non-backdrivable passive balancing system for a single-axle dynamically balanced robotic device includes a body that includes a distal end and a proximal end, a controller module, and an actuator communicatively coupled to the controller module of the single-axle dynamically balanced robotic device. The actuator receives an engagement signal from the controller module, the engagement signal corresponding to an indication that the dynamically balanced robotic device is stationary, and the actuator causes the linkage to move the body from a disengaged position to an engaged position such that the distal end of the body contacts a ground surface and supports the dynamically balanced robotic device in a substantially upright position.

Abstract: Example implementations may relate to methods and systems for detecting an event in a physical region within a physical space. Accordingly, a computing system may receive from a subscriber device an indication of a virtual region within a virtual representation of the physical space such that the virtual region corresponds to the physical region. The system may also receive from the subscriber a trigger condition associated with the virtual region, where the trigger condition corresponds to a particular physical change in the physical region. The system may also receive sensor data from sensors in the physical space and a portion of the sensor data may be associated with the physical region. Based on the sensor data, the system may detect an event in the physical region that satisfies the trigger condition and may responsively provide to the subscriber a notification that indicates that the trigger condition has been satisfied.

Abstract: Example implementations may relate to methods and systems for detecting an event in a physical region within a physical space. Accordingly, a computing system may receive from a subscriber device an indication of a virtual region within a virtual representation of the physical space such that the virtual region corresponds to the physical region. The system may also receive from the subscriber a trigger condition associated with the virtual region, where the trigger condition corresponds to a particular physical change in the physical region. The system may also receive sensor data from sensors in the physical space and a portion of the sensor data may be associated with the physical region. Based on the sensor data, the system may detect an event in the physical region that satisfies the trigger condition and may responsively provide to the subscriber a notification that indicates that the trigger condition has been satisfied.

Abstract: Systems are provided to emit, into an environment of interest, information in the form of modulated optical signals. These optical signals can be provided as illumination from a lighting fixture, display, or other source of environmental illumination. The optical signals can include codes or other information to facilitate location-specific operations of a device that is able to receive the optical signals. This can include receiving information about the location of a light emitter, security credentials or encryption keys, information about services that are available from building automation and/or conferencing systems, or other location-related information.

Abstract: A computing device configured to display a virtual representation of an environment of a robot includes a display device, a memory, and a processor coupled to the memory. The processor is configured to receive data from the one or more sensors of the robot with respect to an object within an environment of the robot. The processor is also configured to display a virtual representation of the object within a virtual mapping of the environment based on the data received from the one or more sensors. The processor is further configured to receive input data selecting the virtual representation of the object. The processor is also further configured to send instructions to the robot to act in response to the received input data.

Abstract: Robotic gripper fingers are disclosed. A gripper assembly includes a first finger defining a first object engagement face and a second finger defining a second object engagement face. The first object engagement face of the first finger opposes the second object engagement face of the second finger. The gripper assembly also includes at least one actuator in communication with the first finger that is configured to actuate the first finger relative to the second finger. The gripper assembly includes at least one first sensor facing outward from the first object engagement face. The at least one first sensor is configured to detect objects to be manipulated by actuating the first finger relative to the second finger.

Abstract: Robot systems including a robot, an on-premise computing device, and a cloud services system are disclosed. An on-premise computing device includes a processor and a non-transitory memory device storing machine-readable instructions that, when executed by the processor, cause the processor to receive raw sensor data from a robot, pre-process the sensor data to remove unnecessary information from the sensor data and obtain pre-processed data, transmit the pre-processed data to a cloud services system, receive, from the cloud services system, an object type, an object pose, and an object location of an object corresponding to the pre-processed data, and transmit a signal to the robot based on at least one of the object type, the object pose, and the object location of the object.