家徒四壁

to have nothing but the bare walls in one's house—...