Are they there listed under C:\Documents and Settings\(user name)\Desktop ?? If they are there try delete - in case not deleting rename the icons and then try delete them. In my experience at times icons that do not delete can be deleted after renaming them.
