Analogies are always flawed. It is certainly the Epicurean position that there are a finite number of kinds of atoms, but an infinite quantity of each kind.
The idea of an infinite alphabet is one I can't really wrap my head around. And of course, for an alphabet and a language to carry meaning implies a subject capable of interpreting meaning. Atoms and their compounded objects don't require a subject.