Remove any decorations, as well as your fish. Some recommend putting your fish in a temporary bath thatâs filled with the same water from your tank (even if itâs dirty). If the tank or bowl has been filthy for awhile, you might want to also prepare a saltwater bath to kill off any germs your fish has picked up.