Not unlikely, there's brick behind it. In my walls, there's often been a nail with a slightly triangular shape, which tends to bend in the wall. If you pull it out, you can expect to take a chunk of plaster with it. Usually, the hole ends up behind a trim, it's not too hard to fix.
If you want to get it out, place a piece of plank against the wall as a support for the crowbar, and pull with all your might.