I do that all the time, but not because I don't want to look stupid. Usually it's because they're talking about something I'm just not interested in, but I don't want to be rude about it.