I remember that song being earmarked for single release before Lush split up so it would have made sense for him to perform with them to promote the song given his popularity at the time.
I did a version of it too a few years ago and released it on Valentine's day. It's ok but not great... I'm just too lazy to provide a link!
It's a great song!