Replaced the battery and looks like I didn't mess up anything. The replacement was $7 with the cheapest shipping of $11 (damn you Digikey), still much cheaper then what Keisight quotes. Didn't find what the replacement procedure in the service manual is so had to improvise. Completely ...