Growing LLMs

How to design LLMs so they respond to increased neural network weights for deeper processing, without loosing the already learned synaptic memory weights. Such aspect forms a critical part of the living systems which grow over time, and are capable of not just learning, but capable of upgrading their own learning hardware.