Homes don't like not being keep in a small temperature range, if you let the home get cold, you can get wood shrinkage, drywall can pop nails or screw, wall can crack .. its a false savings not to keep the house heated ( or cooled )
Pipes can freeze but other then that houses have been unconditioned for a long time with wood and drywall without any issues.
·