"Oh for Pete's sake!"?

Where the heck does that come from?

It's a Minced oath, just like "where the heck."

Entering "Pete" and "sake" into the archive search box will get you a load of old posts about it, such as this one:

Replies