But even if it doesn't attract VAT, e.g food, children's clothes, the retailer they buy from will be taxed and so will their employees, so the saved money will eventually return to govt. via taxation. And at a higher rate than 5%. govt. doesn't lose anything.
M