Having said that
Definition 1 of 2
Pro Tip 1/3Contrast Signal
Use when shifting from a positive to a more critical thought. 
She's really skilled at her job. Having said that, she struggles with deadlines.
Pro Tip 2/3Slight Admission
It can introduce a minor concession or acknowledgment of a flaw. 
The movie was great. Having said that, the acting was a bit wooden.
Pro Tip 3/3Partial Agreement
Shows agreement with the previous statement, but with reservations. 
Your point is valid. Having said that, we must consider the other arguments too.