
Have had your day
Past Success
Use it to talk about someone who has lost their former glory or relevance. 
Not Insulting
It's not meant to insult, but to state that someone's best times are behind them. 
Context Matters
In different contexts, it can be either a neutral observation or a gentle criticism. 