I honestly would just play it with the armor on, yeah it takes forever to kill someone, but that's the whole point of armor and it's challenging. But if you prefer to play it where they are a little easier to kill, then go for it. I only take it off enemies when it's for like animations or something.