The genius gave his own answer (in his 1954 * Ideas and Opinions*) to this question:
[QUOTE=Albert Einstein]
I am convinced that we can discover by means of pure mathematical constructions the concepts and the laws connecting them with each other, which furnish the key to the understanding of natural phenomena. Experience may suggest the appropriate mathematical concepts, but they most certainly cannot be deduced from it. Experience remains, of course, the sole criterion of the physical utility of a mathematical construction. But the creative principle resides in mathematics. In a certain sense, therefore I hold it true that pure thought can grasp reality, as the ancients dreamed. [my emphasis]
[/QUOTE]