I loved Amarok when I was primarily using linux. I remember seeing something about a windows port that was part of KDE for windows, but it wasn't working well last I checked (about a year or two ago)

I'm not sure if it fits all your needs, but I have found MediaMonkey to be my favorite windows music player.

And for video, it's VLC regardless of platform and its not close.