What version of Outlook are you using?
Easiest way to get to it in Outlook 2010/2013 is to open a new email hit insert -> signatures -> signatures.  Edit the signature and save.  
From that same menu you should be able to set the defaults for new message and reply.