While classic spring-loaded mousetraps and glue traps seem like the easiest option, you may want to consider using a humane trap. Glue traps cause the mice extreme stress and they may cause enough damage that the mouse eventually dies. Mousetraps also sometimes don't kill the mouse right away, leaving it to either slowly suffocate or starve.
There are traps that come in the form of cages with bait, that close automatically once the bait is tampered with. They're usually around ten dollars and can be reused again and again, making them not only more humane, but also more cost-effective if you have major mouse problem.