Evolutionary wonder or folly?

I find it curious that when we don't like something that we have tasted, we hold it in our mouths and find it difficult to swallow it. I mean, logically speaking it would make sense if we swallowed as quickly as possible so as to minimize tasting it. But instead we can't swallow. Is it an evolutionary way of not swallowing poison? Or are we just stupid?