Put a dab of bait in a toilet paper or paper towel tube. Balance it on the edge of the mouse-ridden countertop in such a way that if he crawls in and goes to the other end, he will unbalance it and tip it off the edge of the counter. Place an empty trashcan below to catch him in. Humanely discard mouse in the morning.
This plan worked! Except that my cat tipped over the trashcan with the mouse in it while I was at work, thus freeing it. Luckily, kitty cornered the mouse under our grandfather clock, where it cowered all day until I got home. Still, it was quite surprising to look under the clock and see that pair of beady eyes staring out at me. With no small amount of screaming, my wife and I managed to capture the mouse in this cookie jar. I then popped him into our coffee grinder and... No, just kidding. We let him go in a wilderness rodent preserve near our house.