Google’s doing a ton of cool research into using LLMs to drive robotics.
This is one of the most inspiring blog posts I’ve read: https://deepmind.google/discover/blog/rt-2-new-model-translates-vision-and-language-into-action/
There’s a lot more on their blog, but this one was my entry into their rabbit hole.