It can scarcely be denied that the supreme goal of all theory is to make the irreducible basic elements as simple and as few as possible without having to surrender the adequate representation of a single datum of experience.

— Albert Einstein, On the Method of Theoretical Physics, Oxford University Press, 1933 (via)

Likely the origin of the aphorism, “everything should be as simple as possible, but not simpler”.