Try double clicking it as if you were going to open it. Often times, you will get a message that says it cannot find the target file and it will ask you if you want to remove the shortcut.
If that doesn't work, try rebooting and then delete it.
If it still doesn't work, let us know.