One is special because it's not zero.
Two is special because an alphabet of two symbols allows exponentially shorter representations of objects than an alphabet of only one symbol.
Three is special because an alphabet of three symbols allows infinite non-repeating (EDIT: square-free, to be precise) strings, but an alphabet of two symbols does not.
Is four special?*
* other than for being the smallest number not otherwise special, smartass