Are you using cable internet? Because it's a shared connection, if alot of people around you are online and downloading, it's going to slow down your internet as well.
What i've always found helpful at times is resetting the modem when the internet starts becoming very slow. Although that usually only happens when i'm downloading lots of files at once for a long period of time.