Most important I even learned in physics graduate school was "physics research has many more 3 sigma effects than it should." Part of it is that if you do 100 searches you are going to see one three sigma effect. Couple that with reporting bias (only the interesting stuff is reported).
And it certainly does not imply "one chance in 100 the result is a fluke". Will science journalists never learn how to interpret a p-value into English?