Don't even try this instance with randoms, I am really amazed how ppl play this game, they often have quite an ok gear, but don't know their skills, class specifics, don't think about what is going on to react properly and don't read chat. It's been too frustrating for me to play with such ppl, so I try to do bylor alone with boxes and I succeed around 80% of the time.
Try spamming stun as often as you can. Invincibility is not that bad, can be broken, but when baylor goes berserk+invincible it's game over.
I agree that the lvl 105 instance should be a bit easier so people can learn and not get discouraged. Now it's a shock going from 'hey I'm in SV in exalted gear using autohunt' to 'got wrecked by Baylor in 3 seconds'