The first printed record of this phrase that I can find is from The history of the famous preacher Friar Gerund de Campazas, by José Francisco de Isla, 1772:
Tell us what is
Modesty of Voice, for you happened accidentally on purpose to drop this word, and I don't rightly know what it signifies.