Should thumb and HDD be ejected before removal?

I have always just pulled them out of the USB port. Someone told me I should eject them first.

Does it make a difference?

Thanks
 
Top