If you don't mind a knockoff, MidnightBox has an iPod Shuffle-like clip-on MP3 player (2GB) for $7.95, plus $3.99 for shipping. That deal is good today only, and while supplies last. Details about this no-brand, no-name player are slim to say the least. It's available in your choice of eight colors, which is nice, and it comes with earbuds and a USB cable for syncing/charging.
Of course, it doesn't have some of the Shuffle's more advanced features, like VoiceOver, and I'm not sure if or how it handles playlists. It's also not readily apparent what audio formats it supports, assuming it supports any other than MP3.