A quotation by J Willard Gibbs

Mathematics is a language
[at a Yale faculty meeting]

One of the principal objects of research in my department of knowledge is to find the point of view from which the subject appears in the greatest simplicity.
Quoted in A L Mackay, Dictionary of Scientific Quotations (London 1994)

A mathematician may say anything he pleases, but a physicist must be at least partially sane.