Do you say the /t/ in often?

That tricky /t/ in "often," should it be pronounced or not? The most common answer is 'no,' and it's been like that for a long, long time.

Even Queen Elizabeth didn't say that /t/.