If you just want to free space on your desktop, just delete the icon. Doing this will not delete the program itself, just the SHORTCUT to the program. However, if you want to totally remove the program the icon is associated with, you have to uninstall (Control Panel - Add/Remove Programs) and it will remove the PROGRAM itself, including the icon.
Just be careful what programs you delete when uninstalling!