I think it would be cool of there were one way territory connections, then you could make having the higher ground useful, or you could have it so that castle towers can attack the outside, but in order to get in you have to go through the gates.