I use a humidifier in the winter. But I’m worried about mold and bacteria spewing into the air. Should I be?

Yes.
Doctors often recommend humidifiers in the winter because if your nose and throat get too dry, that raises the risk of getting a cold.