I find it very annoying to, when your in windows and you want to get rid of it, right click on the task bar, click toolbars, and then deselect language bar. If you go to msconfig i believe its ctfmon.exe.
But whenever you start a MS Office app it loads back up again.