Big log surrounded by small lots

[Peter Smirnoff]

Looking for a spiritual advice :) So we bought an old house in Mass suburb everybody wants to live in. Then the usual New England story: spent a lot of time and money trying to figure out how to fix the house, but everything feel through, and now we're going to tear it down. Our builder says that we should build the house up to to maximum allowed size. The problem is that we have the biggest plot in the neighborhood: 15K sq foot literally surrounded by 5k-7k lots. Curious to hear opinions: does it make sense to build a house which will be two times bigger and two times more expensive in such neighborhood? (Not to mention that all neighbors are not happy about it.)