@finland it's possible to balance it if you put a cap in it too how much npc's you can hire.
Take WvW in gw2 for example. A solo player can destroy a tier0 supply camp. But at tier 2-3 it's almost impossible. Same idea can be applied to settlements here.