The wiki says these dudes are just in charge of guarding like castles and fortresses, is there some lore reason they can be taken with any army? All the other allied units you can easily come up with some excuse for them going on an adventure with your guys but aren't these guys supposed to stay put?