Heat loss is something that can sometimes be lived with. However, make sure that the vapor barrier remains intact behind the cabinet to prevent condensation in the wall. However, if you have too little insulation behind the cabinet, you may get condensation in the cabinet!
Regards,
Per