Triton 47 › Robotics & automation › The maker turn
Autonomous agents
Index note speech→text→3D→print; goal G ideation; Aider; GPT list of construction robots
Surprising, how humans have shaped the world.
Similarly, except, if we look from third entity perspective, it all just appeared and is a product of life forms that existed and currently are.

So by looking each entity that has existed or is existing as autonomous agent, we can look at this from another perspective, where agents , mostly robots or AI systems can shape the society. Based on the interaction between agents and human and agents, these systems can bring up ideas (ideas which are new to humans), and autonomously shape the surroundings.
Well, the experience is largely not new to most of us, as for example, we see rest of the humans shaping the society if we are the observer of it. By programming the agents of say construction of dome on mars. What is impactful is that, more like text generation through LLMs or image generation through stable diffusion models, it would be materialistic generation of surroundings from an idea, expressed through say words.


One can already devise a system where they say something, and it could be 3d printed.
speech to text -> text to 3D model -> 3D model to 3D printer -> object, but it represents a generic-mono system, where it can form generic forms but of a single type of material. However, in our discussion, where multiple entities (or even single) is concerned is capable of performing diverse tasks to achieve a state of the world (or surroundings) solely governed by energy input.
For anything to exist, the system must first ideate a goal G. Then through iterations, the system would manifest itself or propel towards goal G. Without first ideating the goal, it can be come a random walk of progress. Also, however, the agent may find it impossible to reach the ideated goal, and an approximate or an distant idea might be obtained. But when thinking realistically, through whats possible, always the state can be attained, and when things seem even impossible, are only limited by the imagination and current progress there of, and may even be possible in long distant future. Which is almost likely is.
“You can do only what you know.” and knowing and ideating go together in materializing the idea. Hence, these systems or agents must be able to have the knowledge of how to execute a certain plan to attain the desired ideated result. But how does one know? : research. In all, these agents must also be capable of doing research from their surroundings to obtain knowledge, and use that knowledge to bring out the desired ideated transformation. All in all, it costs energy, but how does energy come from, through forces, that exist. In vague terms, its like universe started as if the rubber band is stretched and charges separated and gravity formed, all in all energy was created in this universe, and this energy is flowing (through the form of forces) back into equilibrium, not exactly, but analogously for thought. As the universe takes action, the force of consciousness brings out and shapes new realities (from imagination there within : unless both the reality and imagination in mind are taken ‘real’ i.e. the things which exist, in your definition, then its just reality transforming reality, and perhaps consciousness also started as another force therein).
However, we think of the agents as non conscious (or not as barely enough) to be called sentient (I don’t know). But, these systems, much like look-up table of concepts or ideas, would know the associations and a logic of associations (reasoning, reasoning is just another chained ideas based on other ideas (or assumptions )). And, it would be interesting to see what these systems would autonomously come up with, if with anything at all, or they would just be the tools of human, made by human.
For autonomous development, in terms of software development, an example is Aider, an AI based software development tool that offers such a scene, driven by model capable of handling diverse forms of expression and understanding of what it is working on.


🤖📝 :These sophisticated technologies are pushing the boundaries of how abstract ideas can be translated into tangible, material surroundings:
- Robotic Construction Systems 🏗️
- Autonomous Bricklaying Robots: Systems like Hadrian X (by Fastbrick Robotics) and SAM (Semi-Automated Mason) are capable of autonomously laying bricks to build walls and other structures. They are more advanced than traditional 3D printing due to their versatility and adaptability to different construction styles.
- Mobile Construction Drones: Researchers have developed drone-based construction systems, capable of working in swarms to lay bricks or apply materials, similar to how bees build hives. These drones can autonomously work on complex structures with minimal human intervention.
- Digital Twin & BIM (Building Information Modeling) with AI Integration 🏢🤖
- Digital Twin technologies, combined with AI, create a real-time digital representation of physical structures that can autonomously plan and manage modifications. BIM, which involves a comprehensive digital model of buildings, is integrated with AI agents to autonomously assess construction sequences and optimize the building process.
- Swarm Robotics for Assembly 🤖🐝
- Inspired by nature, swarm robots are a group of robots that work together to perform tasks like assembling or constructing without centralized control. Companies like Ocado are already using such swarm robotics for automation in warehouses, and similar technologies are being explored for autonomous assembly of physical structures.
- Self-Assembling Materials 🔄⚙️
- Programmable Matter: This concept involves materials that can change their physical properties (e.g., shape, density, or stiffness) on command. Researchers are working on modular robotics (like MIT’s M-Blocks) that can reconfigure themselves into different structures, effectively acting like a “3D printer” but with intelligent, moving pieces.
- Shape Memory Alloys: These materials change shape based on external stimuli (like temperature or magnetic fields) and can potentially be used to create self-assembling systems for construction.
- Robotic Arms and Cobots 🤖💪
- Collaborative Robots (Cobots): These robots work alongside human operators to enhance capabilities, such as lifting heavy loads or performing precision tasks in construction. Examples like Boston Dynamics’ Spot are being used on construction sites to inspect, survey, and carry out minor construction tasks autonomously.
- Robotic Arms: Advanced robotic arms equipped with machine learning algorithms can build complex structures autonomously by mimicking human motions.
- Extraterrestrial Construction Technologies 🚀🌑
- Autonomous Rover-Based Construction: NASA and ESA are exploring technologies where autonomous rovers can build structures using in-situ materials like lunar or Martian soil. Using techniques such as sintering (heating lunar dust to create bricks) combined with robots capable of assembling those bricks, these systems aim for autonomous habitat construction in space environments.
- Automated Agricultural Systems 🌾🤖
- Agricultural Drones and Robots: These systems can autonomously plant trees, create irrigation systems, or manage farmland, effectively reshaping the local surroundings from an initial blueprint or idea. It ties into the broader concept of autonomous agents shaping environments by taking ideas like “afforestation” and turning them into actionable, material results.
- Construction with Autonomous Vehicles 🚜📊
- Automated Construction Vehicles: Earthmoving equipment, such as autonomous excavators or bulldozers (like those developed by Komatsu or Caterpillar), can autonomously perform construction-related activities by interpreting digital plans, making them similar to 3D printing but on a larger, earth-moving scale.
- Biomimetic Construction Robots 🐜🏗️
- Termite-Inspired Robots: Inspired by termites’ ability to create massive structures, robots like those developed by Harvard’s Wyss Institute can autonomously build complex structures without centralized control. They rely on simple rules and local environmental information, creating complex architectural forms collectively.
These technologies represent a significant step beyond traditional 3D printing, with capabilities to autonomously translate human ideas into physical form in ways that involve more complex decision-making, movement, and assembly processes. They show promise for large-scale infrastructure, complex construction, and even extraterrestrial habitat creation—reflecting a shift towards an era where intelligent systems reshape the world from conceptual ideas.
Original: https://triton7777.wordpress.com/2024/10/09/autonomous-agents/