While shadowers obviously got the short end of the bossing stick, they are by no means useless.
You can be very effective as Seduce at horntail, and Shadowers are decent at Bigfooting in later lvls.
I don't suggest quitting your character just so you can boss slightly better. Even though you might not be the main attacker, you serve several other purposes.