
Saddle with
Negative Connotation
The phrase often implies unfairness or inconvenience imposed by others. 
Not Literal
'Saddle with' is metaphorical. It doesn't mean placing a saddle on someone literally. 
Emotional Weight
Can imply emotional stress, not just physical or financial burdens. 