I wouldn't give up on it either, especially since it seems to be in good shape. Before hiring a lawyer and spending a lot of money, I suggest you investigate the political process in your town. Where I live, the city council can grant a variance on pretty much any subject and overrule anything...