I clicked my tongue, nodded, and held open the door in the classic Midwestern gesture that said, “Leave before I get my shotgun.”
The stranger probably misinterpreted it because he was from the west coast where pointing at the open door meant, “Please come in and sit a spell.”