A router is the proper way, and easier, and cheaper to do, but a new modem would be the easest way to do.
If you do get a router(which I would recommend) and you have a desktop computer on different floors thats not going to be moving around, I would get a wired router and just run the cable though the wall, it's actually simple to do, you just have to not be phobic about attics
