Start by scraping the surface with a putty knife to remove loosely embedded gravel particles.
Then you can use regular wall filler (not lightweight filler). You can paint with regular wall paint 7 to get a matte yet easily wipeable surface. Snap a photo and try different shades; you can have a color other than white.