With group theory, this is not difficult. Going through the proofs for groups might lead you to a purely number-theoretic argument. Possibly using prime factorizations as well.
Let (Z/nZ)* be the set of nonzero elements of Z/nZ.
(Z/nZ)* is a group under multiplication if and only if (n,a)=1 for all 1 <= a < n. This is true because if (n,a) = d >1. then d*(n/d) does not belong to (Z/nZ)*. Conversely, it is relatively straight-forward to show that (n,a)=1, (n,b)=1 implies (ab,n)=1 and that every element has an inverse. It follows that (Z/nZ)* is a group (associativity and identity are trivial).
(n,a)=1 for all 1<= a< n if and only if phi(n)=|(Z/nZ)*| = n-1.