It will make a world of difference provided you meet two requirements:
1. You use thermalpaste rather than a thermal pad (which are actually hard to come by anyways). The better the brand the better the heat conductivity. Most aftermarket CPU fans come with thermalpaste.
2. You dont overdo the thermalpaste. Overdoing is just as bad as under-doing