Female barrister here, never had this problem (but I suspect it’s purely because the local Bar Code prescribes a “plain colour dress code” and to wear suits comparable to men’s here)