During a boil order, can my family take showers or baths using tap water? Yes, it is safe to take a bath or shower, but be careful not to swallow any water. Use caution when bathing babies and young children. Consider giving them a sponge bath to reduce the chance of them swallowing water.