He has a way with him

what exactly does this phrase mean - is it critical or complimentary, or can it be either? Would you be offended if someone used it of you?

He has a certain charm, a raffish quality. He is (potentially) seductive. It's usually a compliment.