This is where I go to get replacement parts. They even come with a battery holder that lets you easily replace the battery in the future. no soldering anymore. it is only $3.99 w holder $1.49 for just the battery. You do need a soldering gun to get the batteries out and replace them.
http://www.nintendorepairhut.com/repairsupplies.html
But usually I get some crappy Super Famicom game I will never care about saving and its resell value is poor and take the battery from that game. Its usually some parlor game or board game.