Blocks assemble! learning to assemble with large-scale structured reinforcement learning

SKS Ghasemipour, S Kataoka… - International …, 2022 - proceedings.mlr.press
Assembly of multi-part physical structures is both a valuable end product for autonomous
robotics, as well as a valuable diagnostic task for open-ended training of embodied …

Translating a visual lego manual to a machine-executable plan

R Wang, Y Zhang, J Mao, CY Cheng, J Wu - European Conference on …, 2022 - Springer
We study the problem of translating an image-based, step-by-step assembly manual created
by human designers into machine-interpretable instructions. We formulate this problem as a …

Ikea-manual: Seeing shape assembly step by step

R Wang, Y Zhang, J Mao, R Zhang… - Advances in Neural …, 2022 - proceedings.neurips.cc
Human-designed visual manuals are crucial components in shape assembly activities. They
provide step-by-step guidance on how we should move and connect different parts in a …

Break and make: Interactive structural understanding using lego bricks

A Walsman, M Zhang, K Kotar, K Desingh… - … on Computer Vision, 2022 - Springer
Visual understanding of geometric structures with complex spatial relationships is a
fundamental component of human intelligence. As children, we learn how to reason about …

CNC-Net: Self-Supervised Learning for CNC Machining Operations

M Yavartanoo, S Hong… - Proceedings of the …, 2024 - openaccess.thecvf.com
CNC manufacturing is a process that employs computer numerical control (CNC) machines
to govern the movements of various industrial tools and machinery encompassing …

Simulation-aided learning from demonstration for robotic lego construction

R Liu, A Chen, X Luo, C Liu - arXiv preprint arXiv:2309.11010, 2023 - arxiv.org
Recent advancements in manufacturing have a growing demand for fast, automatic
prototyping (ie assembly and disassembly) capabilities to meet users' needs. This paper …

A lightweight and transferable design for robust lego manipulation

R Liu, Y Sun, C Liu - International Symposium on …, 2024 - asmedigitalcollection.asme.org
Lego is a well-known platform for prototyping pixelized objects. However, robotic Lego
prototyping (ie, manipulating Lego bricks) is challenging due to the tight connections and …

Learning to Build by Building Your Own Instructions

A Walsman, M Zhang, A Fishman, A Farhadi… - arXiv preprint arXiv …, 2024 - arxiv.org
Structural understanding of complex visual objects is an important unsolved component of
artificial intelligence. To study this, we develop a new technique for the recently proposed …

TreeSBA: Tree-Transformer for Self-Supervised Sequential Brick Assembly

M Guo, C Li, Y Zhao, GH Lee - arXiv preprint arXiv:2407.15648, 2024 - arxiv.org
Inferring step-wise actions to assemble 3D objects with primitive bricks from images is a
challenging task due to complex constraints and the vast number of possible combinations …

SCANet: Correcting LEGO Assembly Errors with Self-Correct Assembly Network

Y Wan, K Zhou, H Dong - arXiv preprint arXiv:2403.18195, 2024 - arxiv.org
Autonomous assembly in robotics and 3D vision presents significant challenges, particularly
in ensuring assembly correctness. Presently, predominant methods such as MEPNet focus …