Rust removers are acidic. Vinegar is acetic acid. You can also try lemon juice which is citric acid. For stains at the bottom of the bowl, empty all the water out of the toilet and pour in straight vinegar high enough to cover the stain. Then just let it sit until gone. Use a ...