You should remove it before you put the new one in, if the old one is an AGP then you'll have to removie it first.
And make sure to touch your case for a few seconds before touching the card, just to get rid of any static electricity. (it may not be necessary, but better safe than sorry).