Congrats!! This is something you CAN do and you are absolutely right, you CAN be anxiety free.
I weaned off Zoloft three years ago (was of no help and had nasty side effects) and switched completely to natural ways of controlling my anxiety. The withdrawal was difficult but I had plans in place to deal with it. I drank a lot of kava and chamomile tea which helped keep me stay calm and I also started on a strict vitamin regiman consisting of a b-complex, omega 3, calcium and magnesium. Additionally, I went to an acupuncturist in the beginning while going through the withdrawal. Deep breathing techniques also were very helpful.
Also, just a suggestion, if you can remember the time in your life at which point you went from not having anxiety to having anxiety, think about what was going on at the time that may have triggered the anxiety. When I went to my doctor 7 years ago with anxiety issues, she just automatically put me on drugs without really asking what was happening at the time that would cause it. After 4 years on drugs and the last three years completely drug-free using natural methods, a therapist was finally able to help me figure out WHY I have anxiety. She said it's from complicated grief; from not grieving the loss of my dad 8 years ago. And well, I didn't grieve his loss, because he's not dead... he's severely brain damaged. So according to the therapist, I haven't grieved the loss of who my dad was and therefore it is coming through as anxiety. I am now working through the grieving process so that I can live my life without anxiety! So I encourage you to really think about if an event may have triggered the start of your anxiety and you can then deal with the event rather than having anxiety the rest of your life.
Good luck with this process!! It will be difficult at times, but just make sure you have alternatives in place to help you with the anxiety so you don't feel like you HAVE to go back on the meds.
Katie