If it was me guiding the devel­op­ment of AI agents, I would push away from language models, toward richly multi­modal approaches, as quickly as I could. I would hurry to enrich their sensorium, widening the aperture to reality.