It's a 'funky' looking battery. Kind of like two HRM batteries put together. The easiest way to do it is to go to a watch shop (I went to one in a mall) and had them replace it. They know to be mindful of the gasket and to not crimp it.
It will cost you about $12. It helps if they sell polar watches there, but it doesn't have to be a "sports" store.