As Dr. Peterson said earlier, the word “structure” may have different meanings in different branches of mathematics. In algebra, it means a set, one or more operations on the elements of a set, some restrictions on those operations, and perhaps an order relation among the elements of the set.
So a magma is a structure that has a non-empty set S, a binary operation denoted by @ that can be applied to any two elements of S with the following limitation:
a, b∈S⟹a @ b∈S.
Notice that the odd integers with the arithmetic operation of addition do not form a magma.
A more complex structure is a semi-group, which is a magma with an additional limitation, namely
a, b, c∈S⟹(a @ b) @ c=a @ (b @ c).
An even more complex structure is a monoid, which is a semi-group with an additional limitation, namely
∃ i@∈S such that a @ i@=a for any a∈S.
Notice that the even integers with the arithmetic operation of multiplication form a semi-group, but not a monoid.
We can build a more complex structure called a group by adding one more restriction to a monoid, namely
a∈S⟹∃ b∈S such that a @ b=i@.
And we can put together a still yet more complex structure called an abelian group by adding still yet another restriction, namely
a, b∈S⟹a @ b=b @ a.
And we can go on, especially by having more than one operation.
So maybe now you can see what is meant by a structure in algebra and how more complex structures are built from simpler structures.