To remove an old faucet, shut the water off at the pipes under the sink or at the main shut-off to the house. Then remove the water connections and the nuts securing the faucet to the sink. INSTALLATION. Step 1: Adding the Gasket. Before the faucet is attached, there should be a seal between the faucet and the sink.