Problem. I am investigating the group actions of LLMs. Tokenized actions currently seem to follow SO(d) whereas latent space actions on the concept manifold follow so(d) and form approximate Lie Groups.
Results. This is still an area of active research. Stay tuned!