Thank you everyone for your input.
My focus is to have a large Castle/Medieval theme and although those two sets intrigue me and I feel I should have some sort of village element, I'm just not totally sold on the idea.
I plan to merge the two Castles and at least one of the Gatehouses into one large Castle, so I will have a sizable courtyard.