 All these higher costs are helping to drive a shrinkage trend, says Robert Dietz. New home size has actually been falling in recent quarters as builders adapt to an environment where housing affordability conditions are really quite challenged. Construction of townhouses rose 6% last year and now constitutes a multi-decade high share, nearly one in five new homes.