I find anyone, not just Sir, trying to hold eye contact with me very unsettlingly & makes me very nervous, probably because I know my eye's show my emotions ie vunerability, fear, etc.
Also tone of voice, for me, can create nervousness, vunerability, fear.