How to Clean Labels from Wine Bottles | Eco-Friendly Method! 4️⃣ Step Four: Remove bottles from water + remove labels. Take the wine bottles out of the water and remove labels. The labels should come off easily without any sticky residue, however if there is still paper or glue residue stuck to the bottles then move on to the next step to get the labels off completely.