If it was me guiding the development of AI agents, I would push away from language models, toward richly multimodal approaches, as quickly as I could. I would hurry to enrich their sensorium, widening the aperture to reality.
— Robin Sloan, Are AI language models in hell?