When someone does something that aggravates us, it's in our nature to ask them why. That can make things better or worse, depending on how you go about it. If you want to avoid sounding passive aggressive, you need to make your curiosity obvious.