Evidently it was a Led Zeppelin song, too — that one even has its own Wikipedia entry. I tend to avoid googling things that are really more about what I remember, because my memory is quite often inaccurate and learning the truth would tempt me to adjust my memory. The Burl Ives’ song I remember was self-referential, refering to (another?) song called “Over the Hills and Far Away”:

Tom he was the piper’s son
Learned to play when he was young
and the only tune that he could play
Was Over the Hills and Far Away…

The Wikipedia however says that the proper title of that song is “Tom, Tom, the Piper’s Son” — and that it’s really a nursery rhyme. Hmm.