You Are the Villain
To understand: You are the villain in someone's story. Nothing will ever alter it. Instead, their memories will alter themselves to fit the narrative.
Perhaps you were the one that got away. Or the one that was left behind. Maybe, you were the nameless sage, who with a single act of kindness or word of wisdom altered the course of the story. Or the relentless bully that drove the light of sympathy out of them once and for all.
Very few people are able or willing to bear the burden of their own sins. Very, very few are ever the villain in their own story, no matter what they've done. Instead, they will claim to have been forced, influenced, deceived or provoked to their most unbearable deeds.
And there you are, ready to bear that burden. Eventually, they will convince themselves that you had it coming; that they were right to pile all their shame, blame, and punishments on you.
Nothing will ever change that story. You will never convince them that their memories are convenient, their analysis unfair, their assignments misplaced. Because you are bearing the burden of their guilt, you are a bad person, and your words are not to be trusted.
This is why they blame you. It has nothing to do with you. You must walk away, and never return.
Own your head.