Abstract: Methods and systems for remote perception assistance to facilitate robotic object manipulation are provided herein. From a model of objects in an environment of a robotic manipulator, a virtual boundary line separating two adjacent identified virtual objects may be identified. The robotic manipulator may be configured to perform a task involving a manipulation of at least one object in the environment represented by the identified virtual objects. Based on the identifying, a request for remote assistance with verifying the virtual boundary line may be sent to a remote assistor device. A response to the request, including a modification to the virtual boundary line, may then be received from the remote assistor device. The robotic manipulator may then be caused to perform the task based on the modification to the virtual boundary line.

Abstract: A method and apparatus for gesture interaction with a photo-active painted surface is described. The method may include driving a spatial electromagnetic modulator to emit electromagnetic stimulation in the form of an image to cause photo-active paint to display the image. The method may also include capturing, with at least a camera of a painted surface display system, image data of the image displayed on the photo-active paint applied to a surface and a user motion performed relative to the image. The method may also include analyzing the captured image data to determine a sequence of one or more physical movements of the user relative to the image displayed on the photo-active paint. The method may also include determining, based on the analysis, that the user motion is indicative of a gesture, and driving the spatial electromagnetic modulator to update.

Abstract: Example embodiments may relate to robot-cloud interaction. In particular, a cloud-based service may receive a query from a first robotic system including sensor data, a request for instructions to carry out a task, and information associated with a configuration of the first robotic system. The cloud-based service may then identify stored data including a procedure previously used by a second robotic system to carry out the task and information associated with a configuration of the second robotic system. The cloud-based service may then generate instructions for the first robotic system to carry out the task based at least in part on the sensor data, the procedure used by the second robotic system to carry out the task, the information associated with the configuration of the first robotic system, and the information associated with the configuration of the second robotic system.

Abstract: Methods and systems for teaching positions to components of devices are described. An example method includes providing instructions to a robotic device or robotic manipulator to place the robotic manipulator into a fine-tuning teach mode, in which the robotic manipulator is in a given position and is configured to move based on application of a manual contact in one or more step movements having a preset amount of distance. The method also includes determining that a given manual contact is applied to the robotic manipulator, and causing the robotic manipulator to incrementally move in the one or more step movements having the preset amount of distance.

Abstract: A tileable display panel includes a screen layer, an illumination layer and a display layer. The screen layer is for displaying a unified image to a viewer. The illumination layer includes at least one light source emitting lamp light into a diffusing region of the illumination layer. The illumination layer also includes a plurality of emission apertures that are each configured to emit the lamp light from the diffusing region in a divergent projection beam. The display layer is disposed between the screen layer and the illumination layer. The display layer includes a plurality of pixelets corresponding to the plurality of emission apertures. The pixelets in the plurality of pixelets are positioned to be illuminated by the divergent projection beams from the corresponding emission apertures.

Abstract: Methods and systems for determining a status of a component of a device are provided. An example method includes triggering an action of a component of a device, and responsively receiving information associated with the action of the component from a sensor. The method further includes a computing system having a processor and a memory comparing the information with calibration data and determining a status of the component based on the comparison. In some examples, the calibration data may include information derived from data received from a pool of one or more devices utilizing same or similar components as the component. The determined status may include information associated with a performance of the component with respect to performances of same or similar components of the pool of devices. In one example, the device may self-calibrate the component based on the status.

Abstract: Methods, apparatus, systems, and computer-readable media are provided for selective robot deployment. In various implementations, a context of a user may be determined based at least in part on a record of one or more computing interactions associated with the user. In various implementations, a robot-performable task of the user may be identified based at least in part on the context. In various implementations, a measure of potential or actual interest of the user in deploying a robot to perform the robot-performable task may be determined. In various embodiments, the robot may be selectively deployed based on the measure of potential or actual interest.

Abstract: An implementation operable by a device coupled to a sound sensor array including a plurality of sound sensors in a particular arrangement is provided. The implementation involves obtaining a plurality of simulated responses mapping respective simulated physical arrangements of one or more simulated sound sources to respective expected outputs from the sound sensor array. The implementation also involves receiving a response based on output from the sound sensor array. The response may indicate detection of sounds from a plurality of sound sources in an environment of the sound sensor array. The implementation also involves comparing the received response with at least one of the plurality of simulated responses. The implementation also involves estimating locations of the plurality of sound sources relative to the sound sensor array based on the comparison. The implementation also involves operating the device based on the estimated locations of the plurality of sound sources.

Abstract: Embodiments may relate to intuitive user-interface features for a head-mountable device (HMD), in the context of a hybrid human and computer-automated response system. An illustrative method may involve a head-mountable device (HMD) that comprises a touchpad: (a) sending a speech-segment message to a hybrid response system, wherein the speech-segment message is indicative of a speech segment that is detected in audio data captured at the HMD, and wherein the speech-segment is associated with a first user-account with the hybrid response system, (b) receiving a response message that includes a response to the speech-segment message and an indication of a next action corresponding to the response to the speech-segment message, (c) displaying a screen interface that includes an indication of the response, and (d) while displaying the response, detecting a singular touch gesture and responsively initiating the at least one next action.

Abstract: A method of wirelessly communicating a screen image between a mobile device and a base station coupled to a display terminal includes receiving, at the mobile device, electromagnetic (“EM”) radiation emitted from a base station and incident upon an antenna of the mobile device. A screen image generated by the mobile device is encoded onto a backscatter channel of the EM radiation by modulating an impedance of the antenna. The screen image is transmitted from the mobile device to the base station for display on a display terminal coupled to the base station.

Abstract: Disclosed herein are methods, devices, and systems that may enable a touch-based interface to receive dynamic user inputs based on pressure. An exemplary method may involve: (a) detecting a touch interaction including an increase in pressure greater than a first threshold pressure-increase followed by a reduction in pressure greater than a threshold pressure-reduction; and (b) responsive to detecting the touch interaction, initiating an operation based on a region of the touch-based interface that corresponds to the touch interaction, wherein the operation is associated with the touch interaction.

Abstract: Disclosed herein are methods and systems for determining a safe path for movement of an object by a robotic system. According to these implementations, the robotic system may determine a safety level for each of a plurality of relative orientations of an object. Each such relative orientation may define a spatial orientation of the object relative to direction of movement of the object. Based on the determined safety levels, the robotic system may then determine, for each of the plurality of relative orientations, a velocity limit for movement of the object with a particular relative orientation. Based at least in part on the determined velocity limits, the robotic system may then determine a path for moving the object from a first location to a second location. As such, the robotic system may move the object from the first location to the second location based on the determined path.

Abstract: A battery containment mesh includes a plurality of loops and a plurality of joiners that interconnect the loops into a net sized to surround a battery pack including a plurality of battery cells. The loops and the joiners are fabricated of heat resistant materials capable of maintaining physical integrity in an event of combustion of the battery pack such that the battery containment mesh can carry a weight of the battery pack after the event of combustion.

Abstract: Embodiments described herein may help to provide medical support via a fleet of unmanned aerial vehicles (UAVs). An illustrative UAV may include a housing, a payload, a line-deployment mechanism coupled to the housing and a line, and a payload-release mechanism that couples the line to the payload, wherein the payload-release mechanism is configured to release the payload from the line. The UAV may further include a control system configured to determine that the UAV is located at or near a delivery location and responsively: operate the line-deployment mechanism according to a variable deployment-rate profile to lower the payload to or near to the ground, determine that the payload is touching or is within a threshold distance from the ground, and responsively operate the payload-release mechanism to release the payload from the line.

Abstract: A vehicle-based airborne wind turbine system having an aerial wing, a plurality of rotors each having a plurality of rotatable blades positioned on the aerial wing, an electrically conductive tether secured to the aerial wing and secured to a ground station positioned on a vehicle, wherein the aerial wing is adapted to receive electrical power from the vehicle that is delivered to the aerial wing through the electrically conductive tether; wherein the aerial wing is adapted to operate in a flying mode to harness wind energy to provide a first pulling force through the tether to pull the vehicle; and wherein the aerial wing is also adapted to operate in a powered flying mode wherein the rotors may be powered so that the turbine blades serve as thrust-generating propellers to provide a second pulling force through the tether to pull the vehicle.

Abstract: Techniques and mechanisms for changing a flexibility of a sheet structure. In an embodiment, a garment or other device includes sheet structure, where an interface region is disposed between overlapping layer portions of a sheet structure. While a pressure differential is maintained between the interface region and a chamber of the garment, a valve of the garment is opened to allow an exchange of fluid between the interface region and the chamber. In another embodiment, the exchange of fluid changes a flexibility of the sheet structure by initiating or alleviating friction jamming between the overlapping layer portions.

Abstract: An unmanned aerial vehicle (UAV) is disclosed that includes a retractable payload delivery system. The payload delivery system can lower a payload to the ground using an assembly that secures the payload during descent and releases the payload upon reaching the ground. The assembly can also include a bystander communication module for generating cues for bystander perception. While the assembly securing the payload is being lowered from the UAV, the bystander communication module can generate an avoidance cue indicating that bystanders should avoid interference with the assembly. The assembly also includes sensors that generate data used, at least in part, to determine when the descending assembly is at or near the ground, at which point the assembly releases the payload. The bystander communication module can then cease the avoidance cue and the UAV can retract the assembly.

Abstract: An implementation may involve causing a foot of a robot to orient in a first position, where the foot comprises a sole configured to contact a surface, where the sole comprises a first edge and a second edge, and where in the first position: (i) the first edge contacts the surface, and (ii) a zero moment point (ZMP) is located on the first edge; receiving, from a force sensor, (i) first force data indicative of a first force and (ii) first moment data indicative of a first moment; determining a calibration of the force sensor based at least in part on the first force data, the first moment data, and a distance between the ZMP and a measurement location on the robot; and while the robot is engaged in bipedal movement, controlling the bipedal movement of the robot based at least in part on the calibration.

Abstract: An example method includes receiving, by a mobile robotic device, power from a battery of a first battery pack in order to operate within an environment. The method further includes establishing a first data channel between the mobile robotic device and the first battery pack. The method also includes using the first data channel to transfer sensor data acquired by the mobile robotic device during operation to a local data storage component of the first battery pack. The method additionally includes navigating, by the mobile robotic device, to a battery exchange station to transfer the first battery pack containing the battery and the local data storage component with the sensor data to the battery exchange station. The method further includes after transferring the first battery pack to the battery exchange station, receiving a second battery pack from the battery exchange station to continue operation within the environment.

Abstract: A multi-layer projection screen includes a stray light rejection layer and a lens array. The stray light rejection layer includes an array of pillar structures, wherein each pillar structure of the array of pillar structures includes an entrance aperture, an exit aperture, a pathway extending from the entrance aperture to the exit aperture, and a side wall surrounding the pathway. The lens array is optically aligned to the array of pillar structures. The stray light rejection layer blocks display light received from the lens array having an oblique trajectory that is greater than a threshold angle from a first trajectory.