While you don't need advanced "maths", you still need a very good understanding (above average) of the calculus and geometry.  What is crucial is a very good understanding of physics because that is the world we design in.  You may not ever see it outside of school but you do need to be comfortable with physics

Are you in the United States or somewhere else?

You need a general understanding of math and geometry. In architecture school you'll learn a little more about it. Then in practice you just need a good structural engineer.

The math is very basic, like: if a room has to have 15 square foot per person and you want to fit 30 people in it how big does it need to be?

Also the physics is also more based on vibes than math, for example, can you say why it's better to drill a round hole in a beam than a square one?

Can't speak for wherever you're from. I think other people are making the point about the realistic value and need for math (basically you only really need it in school), but I'd tack on one note about physics in the US. 

Check the curriculum of the school(s) you want to go to. Unless you can take AP physics and place out of it in college wherever you plan on going, don't take it.  A lot of undergrad degrees require physics before structures, so you'd potentially just be taking it again. If you're bored I guess you could just take it twice though... 

I took physics and calculus at a community college the summer before I started MArch. Basic, but enough. I even enjoyed it! In my work it is absolutely critical that I have some lasting understanding of the subjects, but by no means do I calculate differentials at my desk. 

While you don't necessarily need to take Physics in high school (it would likely be a good idea as you don't have to pay for it... in the U.S. at public school), you will need to understand physics enough to understand the basic engineering priciples used in Architecture. You can take it in college. You might not necessarily take the "Physics with Calculus" and honestly, you won't necessarily have to use calculus in professional practice as that would be what Professional Engineers are for. "Physics with Calculus" is a series of physics courses taught at some colleges that will involve more use of calculus in the course work versus your more basic math and algebra.

You can also take regular physics and also take math courses in calculus. At my local college, we have calculus math courses AND physics with calculus which you would usually enroll in "physics with calculus" and "calculus" math courses and the physics with calculus would be applying the use of calculus in the physics course assignment.

Well thank you for your response, then I might go ror