I think that we need to recognize that the vocabulary around numbers and numerals is a product of history and so is sometimes confusing.
To prevent confusion, I think what we should say when we NEED to be exact is:
A numeral system is a set of symbols, called digits, and rules for combining...