Everything was all about you. You had the great life. Sure you subjects worked hard and had little to eat, but that is no reason for them to have kicked you out!
You got trapped in political maneuvering and framed for gross negligence by your closest advisor.
Your son took up with despicable youth. They convinced him that his time had come and he needed to be rid of you. You barely escaped before the revolution.
An enemy army invaded your land and overwhelmed your defenses. You were able to get some of your subjects out but are ashamed you could not save them all. You decided it was best to fade into obscurity.