The first self-checkout system was installed in 1986 at a Kroger grocery store outside of Atlanta. It took several decades, but the technology has finally proliferated across the United States. Given the automated direction grocery stores are taking, it seems like robotic bagging can’t be far away.
MIT’s CSAIL department is introducing RoboGrocery this week. It combines computer vision with a soft robotic gripper to package a wide range of different items. To test the system, the researchers placed 10 objects unfamiliar to the robot on a grocery conveyor belt.
The products ranged from delicate items such as grapes, bread, kale, muffins and crackers to more solid items such as soup cans, food boxes and ice cream containers. The vision system activates first, detecting the objects before determining their size and orientation on the belt.
When the gripper touches the grapes, the pressure sensors in the fingers determine that they are, in fact, delicate and therefore should not go to the bottom of the bag – something many of us no doubt learned the hard way. It then detects that the soup can has a more rigid structure and places it at the bottom of the bag.
“This is an important first step toward robots packaging food and other items in real-world environments,” said Annan Zhang, one of the study’s lead authors. “While we are not yet ready for commercial deployment, our research demonstrates the power of integrating multiple sensing modalities into soft robotic systems.”
The team notes that there is still plenty of room for improvement, including upgrades to the gripper and imaging system to better determine how and in what order to pack things. As the system becomes more robust, it can also be expanded outside of grocery stores to more industrial spaces like recycling plants.
/cdn.vox-cdn.com/uploads/chorus_asset/file/25283723/STK048_XBOX_B.jpg)
