Why is this considered endearing?

Because it shows you are humble and not so arrogant that you would expect everyone to laugh when you make a joke. Your co worker is probably noticing that about you, and finds it "endearing". I aagree.