A quotation by David van Dantzig
The mathematician may be compared to a designer of garments, who is utterly oblivious of the creatures whom his garments may fit. To be sure, his art originated in the necessity for clothing such creatures, but this was long ago; to this day a shape will occasionally appear which will fit into the garment as if the garment had been made for it. Then there is no end of surprise and delight.
Neither in the subjective nor in the objective world can we find a criterion for the reality of the number concept, because the first contains no such concept, and the second contains nothing that is free from the concept. How then can we arrive at a criterion? Not by evidence, for the dice of evidence are loaded. Not by logic, for logic has no existence independent of mathematics: it is only one phase of this multiplied necessity that we call mathematics.
How then shall mathematical concepts be judged? They shall not be judged. Mathematics is the supreme arbiter. From its decisions there is no appeal.We cannot change the rules of the game, we cannot ascertain whether the game is fair. We can only study the player at his game; not, however, with the detached attitude of a bystander, for we are watching our own minds at play.
The attempt to apply rational arithmetic to a problem in geometry resulted in the first crisis in the history of mathematics. The two relatively simple problems -- the determination of the diagonal of a square and that of the circumference of a circle -- revealed the existence of new mathematical beings for which no place could be found within the rational domain.
Quoted in E Maor, To infinity and beyond (Princeton 1991)