Triton 47 › AI & computation › The ChatGPT year
How AI generation typically (may) work?
Index note transformer defragments; Luma Genie lungs GIF
AI is a neural network trained to do a specific set of tasks, for e.g. text prediction, or image generation based on text, text to video, and so on.
Typically network adds the key elements that relate to words, zooms it, then adds the details around it , in the network. Transformer transforms the input embedding from its input space (e.g. text embeddings, or meaning-embedding which is just like representative of an symbol to an concept) to output space, which at first represents small local patches of details, but eventually as the network progresses, its structure fragmented in the network is defragmented to generation, this can be thought of as the recall of the network for the given input pattern. When you imagine things, they are generated through such a method.
Here is an example of text to 3d imagined by network
note the input text “human lungs respiratory system breathing”, and the output
https://lumalabs.ai/genie?one=21469e84-c6e3-4e49-8890-1301c7355237&view=one
similarly, in conscious brain, the experi of 3d structure is percieved when the pathway is activated, similarly for all senses, the conscious, the experi is sensed is what is we.

Even though the reachable progress is still in the algorithm, more pragmatic use of this method which is finely adapted (to at least my) our needs may seem to take time where people properly structure the information and make these more efficient,
but more matters is the feeling of the sci-fi age you are living in, and no the lack of feeling, may be.
Original: https://triton7777.wordpress.com/2023/12/28/how-ai-generation-typically-may-work/