For me the goblin camp itself was non KOS since I smeared the shit on my face, so he let me pass. But when I got inside is where I started to kill shit and it was pretty much OK, use LOS and choke points to funnel all the dudes to you, dont go and chase them. They are all pretty weak as well in there, most trash has like 7HP and some like 15. Only the few havs like 20+ HP and have buffs and such.
Only tough areas inside was with the barbarian dude and his minions, but you find some explosive barrels in one of the jail cells on the left. Place a couple in the doorway to his room. Aggro him and back the fuck up away from barrels and then when he rushes you, and if youre lucky one or two of his minions, he/they will end up right in the door way to end his turn, so explode his ass with the explosive barrels. I did the same strat with the 3 named bosses after you save the Druid. Since I had him come along with me to help and I was like Lv3 and that bitch boss was like lv 6 I think and she kept one rounding all my dudes. Rest of the fights were pretty easy and survivable if you had full rest and, again, used choke points and LOS.
So then when you go back outside after dealing with all the BS inside, thats where it gets tricky since the whole damn place aggros your ass. But you can also take this in steps and fight one part at a time. And again, most of the dudes have like 7-15 HP so they are EZ if your rolls RNG is with you.