Is math the hardest part of engineering?

I’m considering becoming an engineer, I have a 4.0 and I’m currently on my calculus journey. So far so good. I find math to not be so difficult, I’ve seen many dread calculus overall. Is math the thing that makes people not go for engineering? If I’m good in math, will I be set and is it the hardest class? Are there engineering classes that are harder and I might need to change my expectations?