Shower caddies are a great way to store stuff for easy access -- until they slide down your shower head, make a loud bang and scare you to death. Prevent this problem with a cable tie.
By tying a cable tie around the neck of the shower head, it prevents the caddy from moving forward. It's a cheap solution and resistant to rust.
Shower caddy [Imgur]