Simple 3‑D Robots Made From A Few Photos

A new system called ART can build full 3‑D models of moving objects from only a handful of ordinary pictures. Unlike older methods that need slow calculations or work only on one type of object, ART treats the item as a set of stiff pieces that can rotate or slide. The technique uses a transformer network to turn the few images into “part slots. ” Each slot holds information about one piece of the object, such as its shape, color and how it moves.When all slots are combined, the result is a complete 3‑D model that can be used in simulations or games. The team trained ART on a large, varied set of objects with detailed part labels and tested it on many different challenges. The new approach outperforms previous systems by a wide margin and sets the current best standard for turning pictures into articulated 3‑D models.