Wealthy towns must have affordable homes