I created a module with a web controller, and setup a route and returned a string, and it worked. Great!
So I added a little bit and changed the route and I can't seem to make odoo pick up the changes. The first thing I tried was uninstalling and reinstalling the module, but even though I had changed the route, I got a 404 on the new route and the old one still worked.
I tried uninstalling, and Updating the module list and reinstalling the same issue. I even tried adding a new route and that one isn't working, it's like odoo can only see the module and controllers as they were initially added. How do I force it to read the changes?
After a bit more work, I was able to ask a more specific question regarding my problem, and later found an answer to it. Someone with 500 karma please delete this one.