It is quite pointless to limit rousing the rabble of hirdsmen, there is no time penalty between becoming a hirdsman and disassembling is quite simple for rousing purposes and switching back after.
I'd suggest either simply allowing hirds to be rousable (kills the spirit of the skill, due to the name), or impose some limit.