The Queen's "grey men"?

Posted by ESC on January 30, 2004

Someone has asked what that means. Does it mean her staff -- the "suits" that make up her staff? I found this:

My Story by Sarah Ferguson and Jeff Coplon. In this surprising autobiography, the Duchess of York reveals herself as a deeply fearful and insecure woman who never thought she was good enough to be a member of the royal family. She accuses the "Grey Men" who work at Buckingham Palace of plotting to destroy her, but she mostly blames herself for the scandal surrounding her marriage, and has nothing but praise for Prince Andrew and the rest of the royal family. A very interesting book.