Wet plaster should work, someone worked with plyfa I recall. In the bathroom, I'm planning to use a rigid foam construction board (LUX, KGC) and that should work outside the bathroom as well......
Trim can be cut in thicker plyfa. If you absolutely want a rift-sawn structure on the outside, you need to piece together several boards...