"under my thumb"

Does anyone know the derivation of this phrase? Is it connected to "rule of thumb"?