This is true of everyday people. But a small percentage of people are psychopaths, who are perfectly happy to be violent whenever they can get away with it.

A seriously deprived scenario will make others violent, but there is always a subset that is violent even in comfortable situations.