What version of Outlook are you using?
Easiest way to get to it in Outlook 2010/2013 is to open a new email hit insert -> signatures -> signatures. Edit the signature and save.
From that same menu you should be able to set the defaults for new message and reply.