It sounds like your web browser is doing something called "Aggressive caching." Basically its saving information so that everytime you revisit your site, it will load faster.

For more information and to fix this issue, here's a FAQ from our help page that might do the trick.