High interest rates, fluctuating material prices and labor uncertainty mean that activity may not rebound this year, economists say.