Germs, like you and I, enjoy the warm and slightly moist embrace of a bath towel. (Hey, if it isn't moist when you first put it on, it gets moist.) But these germs are just here to cuddle; normal use of a bath towel is not likely to make you sick.
A towel might feel soft in the store, but that doesn't mean it will stay soft once you wash it. If you want towels that will feel soft throughout their lifespan, materials like rayon, Pima and Egyptian Cotton are your best bet.