
Rattle somebody’s cage
Playful Teasing
The phrase can imply lighthearted teasing, not always serious annoyance. 
Provoking Reaction
Use it to describe actions aiming to get a reaction, often in a challenging way. 
Negative Connotation
It can imply a negative intent, such as irritating someone on purpose. 