If your water is milky and has an oily sheen on top, that’s not bubbles. That might be pipe lubricant or even a leak from a nearby heating system.
Troubleshooting Cloudy Water in Reverse Osmosis Systems: How to Relieve
Also, if the entire neighborhood has milky water and the company says “don’t drink it,” don’t drink it. Seriously. Follow the boil-water advisory.
But for 99% of you reading this? It’s just air. You’re fine. Go drink that glass already.