Triton 47 › Money, work & society › After the PhD
Simulating society
Index note people as MLLM/MLLA embeddings; NVIDIA ACE; crowd dynamics; HumanBody repo; "when I start working on a problem, the problem goes away like magic"
Ever wondered, why people on the street behave the way they do.
A person is a neural network with human architecture that is encoded through the genes and evolved naturally through natural processes. Analogously, such complex system is currently represented by multimodal-large-language-models (MLLM) or multimodal-large-language-action (MLLA) model. Generically, any concept is represented by an embedding which is the number vector representation which is the state which points to certain concept in its space (mathematically constructed look up N dimensional space for N dim vector representing state).
In a world, there are buildings, roads-pavements, cars, and much like sim city. And there are people characters. Quite a while back, recently, NVIDIA announced ACE which provides autonomous character (which has a personality, which ofc, can just be tuned to any liking: link here)

Ofc. such modelling of the society is helpful, as long thought and used in many scenarios such as crowd dynamics, emergency evacuations, large population models ,which provide behavioral control. And is indeed an interesting field of study.
So when you go out, or just exist and see people like NPCs on the street, minding their own business, while your heart is fluttering beyond any reach, but you couldn’t reach because you value the state of not disturbing them, and disturbing them can be seen as adversely by them. But to know the people, one might rely on simulation techniques, to understand the world better. Ofc, confession are also and could be solely the only solution, but could be at the cost of loss in value of the current state. Simulation might just provide people a game like experience, but also calm their hearts.
One effect I have noticed is that, when one (usually myself) start working on a problem to find a solution, the problem goes away like magic. The work happens on paper, but results are reflected somehow through this conscious fabric in the real world, as if the history written is the state of the past ingrained, and the state of reality then can move on to a new state or a chapter.
People in different circumstances come up with great things. This happens not solely because of the person, which is of course a great contributing factor, but also the circumstance which governs. The team effort, or the unknown effort in making it happen everything leads to the resulting state. and all the actions of everything has led you to your current state. By knowing the realities of people, or social interaction, existing puts it on a different plane of thought and feeling, and experience. But of course, only nature can also provide a vast feeling beyond, when felt with depth, makes itself look alive, as if one could talk to nature through their thoughts. Or maybe its seen as some ghost, or psychological effect of self identity interpreting the happenings.
Many dynamics exist in society, for e.g. a person has utmost needs of air (so they breathe and they have to breathe), food (so they eat) and water (so they drink and need to), along with other constraints due to society (need to work, and also coexist) which puts them in a predictable nature. Need to sleep also constrains the daily cycle of beings. All such things are natural to think of, and people involve such ideas in everyday life without explicitly identifying and defining them. A gigantically complex brain still feels tiny, as if each imagined space of each person is as big as yours. Its like being a singularity, and moving through all space volume of heads of all beings occupying on planet, only to know all that there is, i.e., not just fundamentals, but the information itself, which is ever changing, always existing in richer forms, contributing to richer experiences, and which is what defines the world, defines the actions of all beings and the next state.
If you would mathematically include this experience (with its infinite and mysterious nature, as one only truly knows how much it has experienced. Many laws for e.g. are read from the book, and are believed solidly, but even then flaws in theorized laws can pop up from time to time). But given this model of experience, the simulation of society is complete (with all other physical laws which govern things).
A link to some incomplete (draft idea project)
https://github.com/ajinkyagorad/HumanBody
Oh yes, and another thing, is to allow the true simulation of society, the models should reflect all the behaviors humans possesses, which in data usually are not taken into account, as only ethically viable content is taken into account. which might highlight the ethical limitations of such simulations.
Original: https://triton7777.wordpress.com/2025/01/30/simulating-society/