right click the media file and go to properties. Then see the tab that says open with default application? Click on that and choose your application and it will change all those file types to windows media player.
However, WMP kind of sucks IMO and you should check out a better one like this: