He won't pull up any trees

Does anyone know where the saying "He won't pull up any trees" comes from? - I think it means he won't get very far in life.

Farmers used to have to pull stumps to clear a field for plowing. That's all I know that comes close to the above.