Claytronics is an abstract future concept that combines nanoscale robotics and computer science to create individual nanometer-scale computers called claytronic atoms, or catoms, which can interact with each other to form tangible 3D objects that a user can interact with. This idea is more broadly referred to as programmable matter. Claytronics has the potential to greatly affect many areas of daily life, such as telecommunication, human-computer interfaces, and entertainment.
Current research is exploring the potential of modular reconfigurable robotics and the complex software necessary to control the “shape changing” robots. “Locally Distributed Predicates or LDP is a distributed, high-level language for programming modular reconfigurable robot systems (MRRs)”. There are many challenges associated with programming and controlling a large number of discrete modular systems due to the degrees of freedom that correspond with each module. For example, reconfiguring from one formation to one similar may require a complex path of movements controlled by an intricate string of commands even though the two shapes differ slightly.
In 2005, research efforts to develop a hardware concept were successful on the scale of millimeters, creating cylindrical prototypes 44 millimeters in diameter which interact with each other via electromagnetic attraction. Their experiments helped researchers verify the relationship between mass and potential force between objects as “a 10-fold reduction in size [which] should translate to a 100-fold increase in force relative to mass”. Recent advancements in this prototype concept are in the form of one millimeter diameter cylindrical robots fabricated on a thin film by photolithography that would cooperate with each other using complex software that would control electromagnetic attraction and repulsion between modules.
Today, extensive research and experiments with claytronics are being conducted at Carnegie Mellon University in Pittsburgh, Pennsylvania by a team of researchers which consists of Professors Todd C. Mowry, Seth Goldstein, graduate and undergraduate students, and researchers from Intel Labs Pittsburgh.
The driving force behind programmable matter is the actual hardware that is manipulating itself into whatever form is desired. Claytronics consists of a collection of individual components called claytronic atoms, or catoms. In order to be viable, catoms need to fit a set of criteria. First, catoms need to be able to move in three dimensions relative to each other and be able to adhere to each other to form a three-dimensional shape. Second, the catoms need to be able to communicate with each other in an ensemble and be able to compute state information, possibly with assistance from each other. Fundamentally, catoms consist of a CPU, a network device for communication, a single pixel display, several sensors, an onboard battery, and a means to adhere to one another.
The researchers at Carnegie Mellon University have developed various prototypes of catoms. These vary from small cubes to giant helium balloons. The prototype that is most like what developers hope catoms will become is the planar catom. These take the form of 44 mm diameter cylinders. These cylinders are equipped with 24 electromagnets arranged in a series of stacked rings along the cylinder's circumference. Movement is achieved by the catoms cooperatively enabling and disabling the magnets in order to roll along each other's surfaces. Only one magnet on each catom is energized at a time. These prototypes are able to reconfigure themselves quite quickly, with the uncoupling of two units, movement to another contact point, and recoupling taking only about 100 ms. Power is supplied to the catoms using pickup feet on the bottom of the cylinder. Conductive strips on the table supply the necessary power.
In the current design, the catoms are only able to move in two dimensions relative to each other. Future catoms will be required to move in three dimensions relative to each other. The goal of the researchers is to develop a millimeter scale catom with no moving parts, to allow for mass manufacturability. Millions of these microrobots will be able to emit variable color and intensity of light, allowing for dynamic physical rendering. The design goal has shifted to creating catoms that are simple enough to only function as part of an ensemble, with the ensemble as a whole being capable of higher function.
As the catoms are scaled down, an onboard battery sufficient to power it will exceed the size of the catom itself, so an alternate energy solution is desired. Research is being done into powering all of the catoms in an ensemble, utilizing the catom-to-catom contact as a means of energy transport. One possibility being explored is using a special table with positive and negative electrodes and routing the power internally through the catoms, via “virtual wires.”
Another major design challenge will be developing a genderless unary connector for the catoms in order to keep reconfiguration time at a minimum. Nanofibers provide a possible solution to this challenge. Nanofibers allow for great adhesion on a small scale and allow for minimum power consumption when the catoms are at rest.
Organizing all of the communication and actions between millions of sub-millimeter scale catoms requires development of advanced algorithms and programming languages. The researchers and engineers of Carnegie Mellon-Intel Claytronics Research Lab launched a wide range of projects to develop the necessary software to facilitate communication between catoms. The most important projects are developing new programming languages which work more efficiently for claytronics. The goal of a claytronics matrix is to dynamically form three-dimensional shapes. However, the vast number of catoms in this distributed network increases complexity of micro-management of each individual catom. So, each catom must perceive accurate position information and command of cooperation with its neighbors. In this environment, software language for the matrix operation must convey concise statements of high-level commands in order to be universally distributed. Languages to program a matrix require a more abbreviated syntax and style of command than normal programming languages such as C++ and Java.
The Carnegie Mellon-Intel Claytronics Research Project has created two new programming languages: Meld and Locally Distributed Predicates (LDP).
Meld is a declarative language, a logic programming language originally designed for programming overlay networks. By using logic programming, the code for an ensemble of robots can be written from a global perspective, enabling the programmer to concentrate on the overall performance of the claytronics matrix rather than writing individual instructions for every one of the thousands to millions of catoms in the ensemble. This dramatically simplifies the thought process for programming the movement of a claytronics matrix.
Locally distributed predicates (LDP)
LDP is a reactive programming language. It has been used to trigger debugging in the earlier research. With the addition of language that enables the programmer to build operations in the development of the shape of the matrix, it can be used to analyze the distributed local conditions. It can operate on fixed-size, connected groups of modules providing various functions of state configuration. A program that addresses a fixed-size module rather than the entire ensemble allows programmers to operate the claytronic matrix more frequently and efficiently. LDP further provides a means of matching distributed patterns. It enables the programmer to address a larger set of variables with Boolean logic, which enables the program to search for larger patterns of activity and behavior among groups of modules.
Performance errors for thousands to millions of individual catoms are hard to detect and debug, therefore, claytronics matrix operations require a dynamic and self-directed process for identifying and debugging errors. Claytronics researchers have developed Distributed Watchpoints, an algorithm-level approach to detecting and fixing errors missed by more conventional debugging techniques. It establishes nodes that receive surveillance to determine the validity of distributed conditions. This approach provides a simple and highly descriptive set of rules to evaluate distributed conditions and proves effective in the detection of errors.
Two important classes of claytronics algorithms are shape sculpting and localization algorithms. The ultimate goal of claytronics research is creating dynamic motion in three-dimensional poses. All the research on catom motion, collective actuation and hierarchical motion planning require shape sculpting algorithms to convert catoms into the necessary structure, which will give structural strength and fluid movement to the dynamic ensemble. Meanwhile, localization algorithms enable catoms to localize their positions in an ensemble. A localization algorithm should provide accurate relational knowledge of catoms to the whole matrix based on noisy observation in a fully distributed manner.
As the capabilities of computing continue to develop and robotic modules shrink, claytronics will become useful in many applications. The featured application of claytronics is a new mode of communication. Claytronics will offer a more realistic sense to communication over long distance called pario. Similar to how audio and video provide aural and visual stimulation, pario provides an aural, visual and physical sensation. A user will be able to hear, see and touch the one communicating with them in a realistic manner. Pario could be used effectively in many professional disciplines from engineering design, education and healthcare to entertainment and leisure activities such as video games.
The advancements in nanotechnology and computing necessary for claytronics to become a reality are feasible, but the challenges to overcome are daunting and will require great innovation. In a December 2008 interview, Jason Campbell, a lead researcher from Intel Labs Pittsburgh, said, "my estimates of how long it is going to take have gone from 50 years down to just a couple more years. That has changed over the four years I’ve been working on the project".
- Goldstein (2005), p. 99-101
- De Rosa (2009)
- Karagozler (2009)
- Goldstein (2010b)
- Karagozler (2006)
- Kirby (2005), p. 1730-1731
- Kirby (2007)
- Aksak (2007), p. 91
- Goldstein (2010a)
- Ashley-Rollman (2007b)
- Ashley-Rollman (2007a)
- De Rosa (2008)
- Rister (2007)
- De Rosa (2007)
- Funiak (2008)
- Goldstein (2009), p. 29-45
- Byrne (2008)
- Aksak, B., Cassell, A., Li, J., Meyyappan, M., & Callen, P. (2007). Friction of Partially Embedded Vertically Aligned Carbon Nanofibers Inside Elastomers. Applied Physics Letters, 91.
- Ashley-Rollman, M. P., De Rosa, M., Srinivasa, S. S., Pillai, P., Goldstein, S. C., & Campbell, J. D. (2007a). Declarative Programming for Modular Robots. In Workshop on Self-Reconfigurable Robots/Systems and Applications at IROS '07.
- Ashley-Rollman, M. P., Goldstein, S. C., Lee, P., Mowry, T. C., & Pillai, P. (2007b) Meld: A Declarative Approach to Programming Ensembles. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems IROS '07.
- Byrne, Seamus. (2008, December 22). Morphing Programmable Gadgets Could Soon Be a Reality. Retrieved February 20, 2010 from http://www.news.com.au/morphing-gadgets-could-soon-be-a-reality/story-0-1111118387380
- De Rosa, M., Goldstein, S. C., Lee, P., Campbell, J. D. & Pillai, P. (2008) Programming Modular Robots with Locally Distributed Predicates. In Proceedings of the IEEE International Conference on Robotics and Automation ICRA '08.
- De Rosa, M., Goldstein, S. C., Lee, P., Pillai, P., & Campbell, J. (2009). A Tale of Two Planners: Modular Robotic Planning with LDP. 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009, October 11, 2009 - October 15.
- De Rosa, M., Goldstein, S. C., Lee, P., Campbell, J. D., Pillai, P. & Mowry, T. C. (2007) Distributed Watchpoints: Debugging Large Multi-Robot Systems. In Proceedings of the IEEE International Conference on Robotics and Automation ICRA '07.
- Funiak, S., Pillai, P., Ashley-Rollman, M. P., Campbell, J. D., & Goldstein, S. C. (2008). Distributed Localization of Modular Robot Ensembles. In Proceedings of Robotics: Science and Systems.
- Goldstein, Seth C. (2010a, January). Software Research. Retrieved March 2, 2010 from https://www.cs.cmu.edu/~claytronics/software/index.html
- Goldstein, Seth C. (2010b, January). The Claytronics Team. Retrieved February 20, 2010 from https://www.cs.cmu.edu/~claytronics/people/index.html
- Goldstein, S. C., Campbell, J. D., & Mowry, T. C. (2005). Programmable Matter. Computer, 38(6), 99-101.
- Goldstein, S. C., Mowry, T. C., Campbell, J. D., Ashley-Rollman, M., De Rosa, M., Funiak, S. et al. (2009). Beyond Audio and Video: Using Claytronics to Enable Pario. AI Magazine, 30(2), 29-45.
- Karagozler, M. E., Goldstein, S. C., & Reid, J. R. (2009). Stress-Driven MEMS Assembly + Electrostatic Forces = 1 mm Diameter Robot. 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2009).
- Karagozler, M., Kirby, B., Goldstein, S. C., Lee, W., & Marinelli, E. (2006). Ultralight Modular Robotic Building Blocks for the Rapid Development of Planetary Outposts. Revolutionary Aerospace Systems Concepts Academic Linkage (RASC-AL).
- Kirby, B., Goldstein, S. C., Mowry, T., Aksak, B., & Hoburg, J. (2007). A Modular robotic System Using Magnetic Force Effectors. Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS '07).
- Kirby, B., Goldstein, S. C., Mowry, T., Aksak, B., & Hoburg, J. (2005). Catoms: Moving Robots Without Moving Parts. AAAI (Robot Exhibition), 1730-1731.
- Rister, B. D., Campbell, J. D., Pillai, P., & Mowry, T. C. (2007). Integrated Debugging of Large Modular Robot Ensembles. In Proceedings of the IEEE International Conference on Robotics and Automation ICRA '07.
- Intel sees future with shape-shifting humanoid robots
- The Synthetic Reality Project at Carnegie Mellon
- "'Programmable matter' one day could transform itself into all kinds of look-alikes" in the Post-Gazette
- "'Teleporting' over the internet" on BBC
- "Claytronics and the Pario World" on WorldChanging
- A demo video of Catoms in action