I hear what you are saying and agree with you. I think what happens with these folks is something that is common through human history - doesn't make it right, but more a recognition of the common human experience for those in positions of power over others.
What we are talking about is privilege - not in an ideological way, but in are more traditional, power understanding. Ron Highfield, a theologian I don't always agree with, wrote a short book on rethinking the church and in it he was talking about privilege. Here's a definition he used - "A privilege is an exception given to an individual or group to a law binding on others or a positive benefit bestowed by law on some but not everyone." I think it's a pretty good definition over all, even if it leans heavy on just the idea of legal privilege.
When I talk the core idea of this definition and apply it to what we are talking about - what we have is that people become used to the privilege and think that it is normal and has always been this way. Most humans live in practice as those history started when they were born and will end when they die. This is why those who have been privileged in some way, legal or otherwise, will fight and resist when that assumed privilege starts to go away. In a sense, it becomes a part of how they define themselves - it becomes part of their identity. And that's what we are really dealing with - change in identity for people.
In that sense, it does require effort because a person's identity is being changed. And that brings uncertainty and for many a sense of loss because what was is no longer. There's at least two ways of talking about change in identity. There's one group of people who willingly do self-examination of their identity. This is voluntary and the healthiest way of dealing with change to one's identity.
As second way is non-voluntary. It is having your identity change because something is thrust on you by those in positions of power. So many groups have suffered from this. People adapt in order to survive.
And the third way is also non-voluntary. It is having one's identity change because society and norms change. The people who experience this are the ones who have been in power and have made "the rules" and expectations on everyone else to conform to their identity and authority and power. This is the most dangerous group because they are the ones who have never had to change - they forced change on others. And they will resist forcibly to hold onto the status quo.
