Shake my tree

Does anyone know exactly what "shake my tree" means?

If you don't want my peaches, don't shake my tree. That's the expression that I've heard. My understand of that phrase is -- if you don't want my opinion (or whatever) don't bother me.