when you put it back you should have to push down somewhat, to feel the spring is holding it under some pressure.
if you don't have any pressure, the cap won't close and spray the coolant as soon as it gets hot...