You're going to want to use a similar building material in the debris as in the buildings.
If it's a wooden frame building there needs to be wooden debris. If its' all stone, then more stone.
So the buildings dictate the materials.
You will use a base of styrofoam to build up a large quantity. Then you'll cover it with a mix of stones, broken plaster pieces, wooden debris, kitty litter (clean), and odds and ends like the chairs etc mentioned.
Check this feature out
Page 3 or so here