Sounds a bit like the walls in my previous apartment. Brick that is plastered, as porous as anything, crumbles as soon as you drill into them and difficult to get plugs to hold. Came up with the brilliant idea to mix plastic padding and apply generously in the holes with the plugs and let it dry, then they held like rock, then it was just a matter of screwing things up. The length is pretty crucial.