From Tom Lehrer:
Eating an orange
while making love
Makes for bizarre enj-
oyment thereof
Douglas R. Hofstadter's reply:
"Make love with an orange,"
our teacher Tom toots,
"And you'll harvest bizarre, ing-
enious fruits!"
Or, an entire poem with Rhymes of Orange on every line from the same DRH:
A poem without "or-
ange" as a rhyme is not nice --
it's a bustling bazaar
in Jodhpur, with no spice.
It's a Friday night bar
in Georgetown, without ice,
It is Deborah Kerr
'n John Wayne -- Yul look twice!
Tiger Woods chipping far
and just missing -- no dice!
Yankees blurting "Au revoir"
in Japan, East/West splice!
Or a Volkswagen car
engine smoking -- ach, Scheiß!
A poem without "or-
ange" as a rhyme is not nice.
From BBC television, the show Qi starring Stephen Fry (certified genius).
Only two words actually rhyme with orange and both of them are locations.
Blorringe is a town in Wales where a famous horse is buried.
Goringe is also the name of a town, but it's in Sweden. (There are four more towns of this name scattered across the U.S., but wouldn't have existed in 1587.)
It should be noted that there are any number of others, but they are all surnames of families, and traditionally names of people don't count as "rhyming" words.