You might be able to delete various .dll and other system files, so when you try to do a certain task it would most likely crash, but if you are in the OS then you can't delete the Windows folder.
Now if you booted up into another OS and deleted it, it won't boot you and most likely will see a BSOD screen, or it will say "Missing Operating System".