Autonomous Construction using Found Stones


[ Watch Movie ]


We developed a specialized construction algorithm and robotic system that can autonomously build motion support structures with previously unseen objects.



Raw Material


The stone data set used in our experiments contains samples of decorative creek and pebble stones.


The characteristics of the stone dataset exhibits the extent of our system in the general sense of construction with stones. For example, one can compare our dataset with that of stones found on Mars.

Deposition Planner


The deposition planner utilizes simulations to incorporate the uncertainties in the world description and in the robot dynamics. A physics-based simulator is used for finding an initial set of physically stable poses which is refined through an action space reduction method.



An

approximate close stone mesh

is generated using the noisy and incomplete data from the scanning sensor.

Robot Design


The robot is a low-cost mobile manipulator made from off-the-shelf components, capable of maneuvering over irregular terrain.



The fingers are

curved

while being

flat and thin

near the pick-up points to scoop the object.


Five parallel sub-fingers

are connected to the main rigid finger body through a flexure.


The

flexure joint

enhances compliance and increase friction after the initial grasping.


Stone Crabber

is a 1 DOF Pinch gripper designed to pick up stones.


A downward-facing VGA

gripper camera

is fixed on the end-effector of the arm.


The object pose with the

best "score"

is chosen as the deposition pose.

Experiments


We demonstrate the approach by running the system on a variety of terrains and with mixed materials, including both deformable and rigid components.