That's called confirmation bias. You recognise it more, when it does happen, rather than when it doesn't.