It looks like joint strips that are placed over joints on boards to prevent movement between them.
If you replace the boards with rigid gypsum that is jointed over studs, you can often skip these, but not always.
If you remove these and wallpaper over, the wallpaper will crack here during the next autumn storm.