All you have to do is mention “infinity” and sensible people go all soft and squishy and you get the posts above. First off, it cannot be said too often, There is no mathematical entity as infinity. Say it. Good. Now say it again.
On the other hand, there are infinite sets, many, many of them. So many that one cannot assign a size to them. You cannot even say (legitimately, in most versions of set theory), the “set of all sets”. (You cannot say in any version, the “set of all sets that are not elements of themselves”.)
Now what about infinity squared. Well that would usually be understood to mean the cartesian product of an infinite set with itself. In the most usual axiomatization of set theory, called ZFC, for Zermelo-Frankel with choice, the cartesian product of any infinite set with itelf has the same cardinality (or size) as the set itself, whatever that is. Without choice that can break down. However, for the set of natural numbers (0,1,2,3,4,…) that is easy to prove without choice. You can enumerate the set of pairs (which is the cartesian product of the set with itself) in a perfectly definite way. Begin with (0,0), the pair whose coordinates add up to 0, then follow with (0,1), (1,0), the two whose coordinates add up to 1, then (0,2),(1,1),(2,0) and so on. It is quite easy to write a simple formula that implements this.
Leaving sets aside, what about 1/0? Well 1/0 makes just as much sense as the set of all sets that are not elements of themselves. In other words, it is just not there. But there are kinds of arithmetic that allow infinite entities. One way of doing calculus (which used to be called infinitesimal calculus and still is in French) is to introduce positive numbers called infinitesimals that are non-zero but smaller than 1/n for any natural number n. If i is such an infintesimal, then 1/i is called an infinite number. This use of the word “infinite” is basically unrelated to the use in set theory, even though some fairly sophisticated set theory (called ultrafilters) is used to find a good model of infinitesimals.
From this point of view, a derivative is essentially a difference quotient: f’(x) is the “ordinary part” (every finite number is the sum of an ordinary number and an infinitesimal number) of (f(x+i)-f(x))/i for an infinitesimal i, provided that ordinary part is independent of i. And integrals are defined as sums over an infinite index of the usual kinds of terms.
Then there are the Conway numbers that have their own variety of infinite numbers and their infinitesimal reciprocals. And there may be other uses of “infinity” that I don’t know about. But my main point is that the word itself has no single meaning and neither does the question. Oh yes, if e is an infinte number, e^2 is another infinite number, infinitely larger than e since e^2/e is still infinitely large. And not only is 1/e^2 infinitesimal, it is infinitesimally smaller than 1/e.