Apparently both will run at the lowest value, so the 512 will be reduced to 256. You will still have the same amount of total ram though, and the speed will increase a good amount.
It will down clock the cards to the slowest of the 2 and will only use 256mbs of the 512mb one. And for stability always put the slowest card in the top main slot.