What breaks down in math without the concept of the "empty set"?
So the idea that a "set" is a thing in and of itself such that it can even be empty means that a "set" is more than the things in the "set" collectively considered. Without this concept of an "empty set", if we just considered a set a collection of things, what would math be missing and would calculus and other such things still hold?