The funny thing with architecture is that you still have to try to marry rich to get that beautiful mid-century house.

Kidding aside - you might want to read these threads to help you with your decision.

http://archinect.com/forum/thread/56909971/what-is-it-like-being-an-architect

http://archinect.com/forum/thread/62276896/what-is-your-current-debt-amount-still-owed-from-university-loans

http://archinect.com/forum/thread/59353835/how-hard-is-it-to-find-a-job

http://archinect.com/forum/thread/33824929/do-you-think-the-job-market-will-get-better-soon

http://archinect.com/forum/thread/62178937/is-architecture-really-worth-it-insight-into-the-profession

As a side note, to be perfectly honest math isn't really used all that much in architecture, beyond a basic conceptual understanding of geometry and trigonometry.  But you won't really be doing calculations - a basic conceptual understanding of how structures work, combined with experience, gives you a good general sense while you're designing, and then the structural engineer completes the actual calculations.  (And I am somebody who loves and excelled in maths so I'm not saying this from a standpoint of hating it.)

Although of course, there are plenty of architects who love math, who have mathematical minds, and who use that to inform and guide their designs.  But you don't HAVE to.  Especially if you're doing residential... I would guess the vast majority of architects practice hardly using much math.

there are many avenues of design outside of architecture, music, clothing, furniture, interior, exterior, industrial, appliance, consulting, landscape, urban planning, Shoe design, life coach design (designing plans for people who dnt understand you need a plan for you life)