i'm pretty sure vlc doesn't support rm type files.
there's another program to watch rm files and it's free. it's called "real alternative."
if the problem exists then i'm "guessing" it has something to do with your vid card or firmware. does the cpu spike to max when it stutters? investigate the reason why that associated program spiked