Those who call out to you from behind the private apartments (which you share with your wives), most of them do not reason and understand (and are therefore lacking in good manners)
Verily, those who call out to you from outside your apartments, most of them do not have the understanding (of your exalted station and incomparable status and polite manners of veneration that are due to you)
As for those who call out to you from (outside) your house, most of them cannot use their intellects! (Note that calling him out is looked upon as an unintellectual act. A noteworthy topic!)
Al-muntakhab fi tafsir al-Qur'an al-Karim
Those who call you O Muhammad, from without the chambers of your wives; most of them do not have the sense nor the knowledge of how to act under given conditions