I've seen commercially available individual bricks made of cork. They are very precise, uniform, and expensive if you want to construct a building. Solution is to buy sheet cork of a suitable thickness, slice off brick-width strips, and then chop off brick-sized lengths. Since cork is soft, it can be crumbled to simulate old or damaged bricks. Cork surface already has a suitable texture.