Playing the rag game

Where did the phrase "playing the rag game" and similar phrases using the word rag or ragging come from and why the use of that word.

That's a good question. And I don't have the answer. There's a Brit phrase -- losing your rag. See www.phrases.org.uk bulletin_board 11 messages 569.html

Then there's a cowboy game of taking the rag off the bush. And, of course, on the rag.