Abstract: A system for calibrating a deformable sensor is provided. The system includes a deformable sensor including a housing, a deformable membrane coupled to an upper portion of the housing, and an enclosure defined by the housing and the deformable member; an imaging sensor configured to capture an image of the deformable membrane of the deformable sensor; and a controller. The enclosure is configured to be filled with a medium. The controller is configured to: receive the image of the deformable membrane of the deformable sensor; determine whether a contour of the deformable membrane in the image of the deformable membrane of the deformable sensor corresponds to a predetermined contour; and adjust a volume of the medium in the enclosure of the deformable sensor in response to the determination that the contour of the deformable membrane is different from the predetermined contour.

Abstract: A deformable sensor for detecting a pose and force associated with an object is provided. The deformable sensor includes a housing, a deformable membrane coupled to an upper portion of the housing, an enclosure defined by the housing and the deformable membrane and configured to be filled with a medium, a time-of-flight receiver positioned within the enclosure and a plurality of time-of-flight emitters arranged around the time-of-flight receiver within the enclosure. The plurality of time-of-flight emitters are configured to emit signals toward the deformable membrane at different times. The time-of-flight receiver is configured to receive signals reflected from the deformable membrane.

Abstract: Devices, systems, and methods for adjusting the high flex point of a deformable sensor are disclosed herein. A deformable sensor may include an enclosure comprising a housing and a deformable membrane coupled to an upper portion of the housing, where the enclosure is configured to be filled with a medium, a contact mechanism coupled to the housing and selectively adjustable such that adjusting a position of the contact mechanism causes a change in a location of a high flex point of the deformable membrane, and an internal sensor, disposed within the enclosure, having a field of view configured to be directed through the medium and toward a bottom surface of the deformable membrane, where the internal sensor is configured to output a deformation region within the deformable membrane when placed in contact an object.

Abstract: Devices, systems and methods for calibrating a deformable sensor are disclosed herein. A calibration device for calibrating a deformable sensor includes a frame, at least one actuator supported by the frame, where the at least one actuator comprises a drive mechanism operatively coupled to a probe portion, and an electronic control unit communicatively coupled to the drive mechanism of the at least one actuator. The electronic control unit is configured to cause the drive mechanism to move the probe portion a predetermined position to form a predetermined contact surface defined by an end of the probe portion of the actuator.

Abstract: A robot arm assembly for detecting a pose and force associated with an object is provided. The robot arm assembly includes an end effector having a plurality of fingers, and a deformable sensor provided on each finger. The deformable sensor includes a housing, a deformable membrane coupled to the housing, an enclosure filled with a medium, and an internal sensor disposed within the housing having a field of view directed through the medium and toward an internal surface of the deformable membrane. A processor is configured to receive an output from each internal sensor, the output including a contact region of the deformable membrane as a result of contact with the object. The processor determines an amount of displacement of the contact region based on the output from each internal sensor, and determines the pose and the force associated with the object based on the amount of displacement.

Abstract: Systems and methods for determining a location of a robot are provided. A method includes receiving, by a processor, a signal from a deformable sensor including data with respect to a deformation region in a deformable membrane of the deformable sensor resulting from contact with a first object. The data associated with contact with the first object is compared, by the processor, to details associated with contact with the first object to information associated with a plurality of objects stored in a database. The first object is identified, by the processor, as a first identified object of the plurality of objects stored in the database. The first identified object is an object of the plurality of objects stored in the database that is most similar to the first object. The location of the robot is determined, by the processor, based on a location of the first identified object.

Abstract: Systems and methods for detecting pose and force against an object are provided. A method includes receiving a signal from a deformable sensor comprising data from a deformation region in a deformable membrane resulting from contact with the object utilizing an internal sensor disposed within an enclosure and having a field of view directed through a medium and toward a bottom surface of the deformable membrane. The method also determines a pose of the object based on the deformation region of the deformable membrane. The method also determines an amount of force applied between the deformable membrane and the object is determined based on the deformation region of the deformable membrane.

Abstract: Systems and methods for detecting pose and force against an object are provided. A method includes receiving a signal from a deformable sensor comprising data from a deformation region in a deformable membrane resulting from contact with the object utilizing an internal sensor disposed within an enclosure and having a field of view directed through a medium and toward a bottom surface of the deformable membrane. The method also determines a pose of the object based on the deformation region of the deformable membrane. The method also determines an amount of force applied between the deformable membrane and the object is determined based on the deformation region of the deformable membrane.

Abstract: Systems and methods for determining a pose of an object held by a flexible end effector of a robot are disclosed. A method of determining a pose of the object includes receiving tactile data from tactile sensors, receiving curvature data from curvature sensors, determining a plurality of segments of the flexible end effector from the curvature data, assigning a frame to each segment, determining a location of each point of contact between the object and the flexible end effector from the tactile data, calculating a set of relative transformations and determining a location of each point relative to one of the frames, generating continuous data from the determined location of each point, and providing the continuous data to a pose determination algorithm that uses the continuous data to determine the pose of the object.

Abstract: Systems and methods for detecting pose and force against an object are provided. A method includes receiving a signal from a deformable sensor comprising data from a deformation region in a deformable membrane resulting from contact with the object utilizing an internal sensor disposed within an enclosure and having a field of view directed through a medium and toward a bottom surface of the deformable membrane. The method also determines a pose of the object based on the deformation region of the deformable membrane. The method also determines an amount of force applied between the deformable membrane and the object is determined based on the deformation region of the deformable membrane.

Abstract: Systems and methods for estimating deformation and field of contact forces are described. A method includes generating a reference configuration including reference points in space. The reference configuration corresponds to an initial shape of a membrane prior to contact with the manipuland. The method further includes receiving raw data from a TOF device. The raw data includes points in space measured by the TOF device and indicating deformation of the membrane due to contact with the manipuland. The method further includes determining deformation of the membrane that best approximates a current configuration in a least squares sense while satisfying a discrete physical model enforced as a linear constraint that corresponds to a linearized physical model of the deformation that is discretized with an FEM, linearizing the relationship, and estimating deformation and field of contact forces by solving a least squares formulation with physical constraints cast as a sparse quadratic program.

Abstract: Systems and methods for detecting pose and force against an object are provided. A method includes receiving a signal from a deformable sensor comprising data from a deformation region in a deformable membrane resulting from contact with the object utilizing an internal sensor disposed within an enclosure and having a field of view directed through a medium and toward a bottom surface of the deformable membrane. The method also determines a pose of the object based on the deformation region of the deformable membrane. The method also determines an amount of force applied between the deformable membrane and the object is determined based on the deformation region of the deformable membrane.

Abstract: A system and method for determining an IR image offset and calibrating a depth sensing camera to account for the offset is provided. An RGB-D camera may image a checkerboard pattern at a known distance and location. The checkerboard pattern may be provided on a planar device, such as a board. A three-dimensional primitive shape may be placed at in a known location in relation to the checkerboard. Depth data may be obtained from the checkerboard with the primitive shape. As the system knows the actual depth of the primitive shape, a depth offset may be calculated from the returned depth information from the RGB-D camera. The system may determine the offset between the depth information and the color image. The offset may be taken into account to produce more accurate RGB-D images.

Abstract: Robots having varying touch sensitivity are provided. A robot may include a plurality of deformable sensors with differing levels of depth resolution and spatial resolution for detecting a pose and force associated with an object. Each deformable sensor may have an enclosure comprising a deformable membrane, the enclosure configured to be filled with a medium. Each deformable sensor may further include an optical sensor, disposed within the enclosure, having a field of view configured to be directed toward a bottom surface of the deformable membrane. The robot may also include a first portion and a second portion, each comprising at least one deformable sensor of the plurality of deformable sensors.

Abstract: Robots having varying touch sensitivity are provided. A robot may include a plurality of deformable sensors with differing levels of depth resolution and spatial resolution for detecting a pose and force associated with an object. Each deformable sensor may have an enclosure comprising a deformable membrane, the enclosure configured to be filled with a medium. Each deformable sensor may further include an optical sensor, disposed within the enclosure, having a field of view configured to be directed toward a bottom surface of the deformable membrane. The robot may also include a first portion and a second portion, each comprising at least one deformable sensor of the plurality of deformable sensors.

Abstract: Systems and methods for detecting pose and force against an object are provided. A method includes receiving a signal from a deformable sensor comprising data from a deformation region in a deformable membrane resulting from contact with the object utilizing an internal sensor disposed within an enclosure and having a field of view directed through a medium and toward a bottom surface of the deformable membrane. The method also determines a pose of the object based on the deformation region of the deformable membrane. The method also determines an amount of force applied between the deformable membrane and the object is determined based on the deformation region of the deformable membrane.