Rather than a house I've decided to just use an illustration I had ready. Can hopefully animate in the different elements in the same way.
So this is going pretty well I think. Rough gif below (frame rate doesn't match so it's a bit abrupt). Next step is to reverse it so that it loops seamlessly.