Yes. Once his hands are on you, it's really too late. He can prevent you from drawing, or take your gun, or turn it on you. Even had you had a gun, once you showed it, he would have waited.
Ultumately, distance and a watchful eye are the best deterrent for this. No opportunity.