Well, now he's really just confused. Was that rude? He honestly has no idea, he's never particularly needed nor wanted to know. He still doesn't particularly care, but he's baffled enough to have lost track of what, if anything, he'd originally intended to say.

"... It doesn't matter."

He'd never been inclined to give his name in the first place, after all.