I suspect it's more likely that the inspectors see women as a soft touch and lower risk and more easily intimidated and less prone to violence.

In the same way ticket inspectors on trains ask people in suits for tickets but avoid asking the 6ft tall roadmen.

This is my theory. My relatives wouldn’t have a clue whether they were lying about being some official inspector and saying they’re allowed to inspect, and they would probably be scared of either an official looking, or bailiff looking person telling them this.