Would have removed the wall, with the reservation that you should check the measurements of the desired sliding doors first. When we bought doors, we chose to say the wall was 2 cm shorter than it was to get slightly smaller doors (cheaper and more practical). 2 doors are best, 3 doors require 3 tracks. It doesn't look like you will need more than 2 doors, but check that. If removing the wall piece means you need 3 doors, I would consider leaving it in place.