Dyslexic? Would this offend?

Since college, some friends have referred to me as having "temporal dyslexia" when I get excitable and start talking about historical events as if I had been there. It's been a running joke among friends.

I was considering using the phrase publicly, but it occurred to me it could be insensitive. Technically it ought to be "dystempia" anyway, although that sounds line a canine disease.

Would the use of "temporal dyslexia" in a humorous context be offensive? Because it's totally optional and I'd rather not use it if it's cruel.

Thanks, everybody. All good points. It's a seriously cutesy old in-joke, anyway, like an ancient family nickname. That it's grammatically suspect was part of the joke, sort of like "OK".

Dyschronic sounds better than dystempic, but I think overall I just won't use the phrase.