Everything that is loose should be removed, especially if you hear that it has come loose underneath.
I would ask a well-stocked stove store. The ones we have sell some of that (and perform glide casting, etc.). I have a feeling that some special plaster will be required since it is both exposed to moisture and the bricks change temperature (move?) when you fire it. I don't think plaster B holds very long.