Call2 Monitoring ActReMa

Public Summary Month 7/2012

Tue, 04 Sep 2012 15:52:53 GMT

Results from the previous tasks were transferred to the scenario of our industrial partner MEA that employs an industrial robot to solve a real-world bin-picking task. A stereoscopic laser scanner obtains depth images of filled transport boxes. The cylindrical objects relevant for the application are detected in all orientations and under various occlusions. Path planning is simplified by restricting robot movement inside the box to be always straight from top, which is made possible by an additional seventh axis that ends in a magnetic gripper.

Public Summary Month 5/2012

Thu, 31 May 2012 16:47:49 GMT

We conducted experiments where the robot has to actively perceive partially occluded objects which showed that considering object detection results when planning the next view can help finding more objects.

We integrated the components developed in ActReMa into a bin-picking application, performed by the cognitive service robot Cosero at UBO. The robot navigates to the transport box, aligns to it, acquires 3D scans, recognizes objects, plans grasps, executes the grasping, navigates to a processing station, and places the object there.

Public Summary Month 3/2012

Tue, 27 Mar 2012 22:34:09 GMT

For learning object models, we made initial scan alignment more robust by adapting the point-pair feature object detection and pose estimation method of Papazov et al. (ACCV 2010). We only allow transformations that are close to the expected ones in the RANSAC step.

For active object perception, we extended the simulation to include the complete experiment setup, adapted the object recognition method to identify regions of interest, and integrated the planning of the next best view (NBV).

Public Summary Month 1/2012

Fri, 27 Jan 2012 22:06:46 GMT

For learning object models, a board that allows for scanning of multiple object instances in different orientations was designed. The individual object views are segmented and registered. In the resulting point cloud, geometric primitives are detected.

For active perception, sensor poses are sampled above the detected transport box. Their utility is evaluated according to the amount of unknown volume and the points not explained by detected primitives. The pose with the highest utility is chosen to acquire a new range scan.

Public Summary Month 11/2011

Sun, 27 Nov 2011 14:12:49 GMT

The Metronom 3D sensor has been mounted on the mobile robot Dynamaid. Its measurements are more precise and less noisy than Kinect measurements.

The experiment partners started work on the learning of object models from examples and active object recognition.
For the learning of object models, scans from different views are registered and unconstrained detection of geometric primitives is performed (Fig. 1).
For active object recognition, we also registered depth measurements from different views (Fig. 2). This reduces occlusion effects and facilitates recognition.

Public Summary Month 9/2011

Tue, 27 Sep 2011 15:12:25 GMT

The experiment partners continued work on object recognition, grasp selection, and motion planning for picking objects out of a transport box.

The primitive-based object recognition has been accelerated and made more robust. Now, 2D contours are also considered for recognition. The best visible object is selected.

Grasps are sampled, checked for collisions, and ranked offline. In the current situation, we check for reachability with our robot arm, collisions with the transport box and other objects, and plan reaching motions.

The components have been integrated in simulation as well as for the real robot Cosero.

Public Summary Month 7/2011

Wed, 27 Jul 2011 17:51:48 GMT

In the ActReMa experiment, a robot delivers parts to a process station. The robot is equipped with a 3D scanning sensor. It must recognize objects in a box and grasp them.

The experiment partners started their work according to the plan. For two scenarios: a mobile robot and a stationary robot, the sensor placement has been decided. Objects are detected using the fitting of shape primitives. The robot has been modeled for the simulation of grasp and motion planning. Objects can now be grasped flexibly from a table.