Though he owned the land where it stood, those that lived there thought they had every right to stay there as long as they pleased, without being disturbed.