I'm watching a documentary on Netflix right now about Chimpanzees - and what happens when a chimp from one group crosses into another group's territory is that they fight.
They may not have a word for "illegal", but they do still have a concept of deeming certain actions impermissible - which amounts to the same thing as "illegal".
And the other thing to keep in mind, is that no chimp community has any "right" to any territory, other than their ability to defend it.
Humans are just playing out this same thing on a larger scale. Nobody owns anything, and nobody has a right to anything, other than what agreements they can rely upon to be enforced by the larger society they are a part of. This is not just a white person thing, or a European thing, or even a human thing. The phenomena at play here would apply to any community of self interested, vulnerable individuals.
Moralizing is a bankrupt concept. The only way we can hope to make people's lives better is by recognizing that everything can be described in terms of economics and game theory, and then figuring out how to structure society so that those game-theoretical dynamics can work to everyone's advantage (rather than just a select few, as has been the case historically).