I imagine that you confuse him sometimes as well, but then everyone's confusing at different times. It's whether or not you're both willing to make the effort to work past that. To learn enough about each other that the confusion goes away.