
Twiddle your thumbs
Not Always Negative
The phrase can imply relaxed waiting without stress or urgency. 
Informal Expression
Mainly used in casual conversations, not in formal writing. 
Figurative Speech
People don't always literally twiddle their thumbs; it's often used metaphorically. 