The Persistence of Memory

The other day my boss said to me (via IM) "I knew you were going to say that," which I find very annoying and which he has said to me before. Now we get along pretty well so I told him I didn't like it and he said I say it to him. This strikes me as odd because it's not something I say very often (and really only to Snowman). And when he proceeded to explain the circumstances under which I would say it, it sounded completely unfamiliar. I'm not saying I didn't say it, because I can't remember everything I've ever said. I'm just saying I didn't say it.