I'm with gcalex. There's a way to go about doing this that will make things easier. Tapering should NEVER be forced or rushed, and to jump from 50% to now you're looking at a 100% drop—that's HUGE. Don't force yourself to do it all at once, and don't worry that you'll be on it forever. You're pushing yourself into a damned if you do, damned if you don't scenario and that is probably not helping your overall anxiety, I'd imagine, too.
Maybe you answered this already, but do you not reasonably think that maybe your night sweats are due to withdrawal of this drug? That sounds like the most obvious culprit to me.