The mathematics books and journals are stored in Rose Library.
Math books usually start with the call number QA and are on the 3rd floor of Rose.
These are the broad categories within the QA section:
71-90 Instruments and machines, including computer science & software
101-145 Elementary mathematics and arithmetic
273-280 Probabilities and mathematical statistics
440-699 Geometry, trigonometry, and topology
801-939 Analytic mechanics