I can sort of relate to your story. I have ADD as well and was taking Adderall for a few years and had done marvelous on it, laser-sharp focus, but a few months back my anxiety just exploded and I suddenly found myself unable to tolerate any stimulants because of the anxiousness/panic that I felt would ensue. What I can say is of priority is to treat the anxiety first. Once the anxiety is treated, then a gradual re-introduction of a psychostimulant like Concerta may be warranted for your ADD.
In my case, I am currently on Guanfacine, which is a blood pressure med which also happens to be prescribed for ADD and anxiety. It's also well known to be an excellent adjunct to stimulant medications, to counter their unpleasant side effects. For example, before taking this med, my resting HR was around 90 but would go close to or over 100 at times due to my near-constant anxious state of mind. Having gotten to the right dosage, my resting HR is now around 60. So, I am much more comfortable with taking a stimulant now that my fight-or-flight system is more in control. I am also taking Klonopin twice daily, but benzo's tend to raise my heart rate. Alas, the Guanfacine solved multiple issues in my case, so that I am now on the benzo and can take Adderall again without worrying about tachycardia so much.
If you are unwilling or not given the opportunity to try a benzo to treat your anxiety, then it might be worth mentioning a medication like Guanfacine or Clonidine (in addition to your SSRI) because they tackle both anxiety and ADD, albeit mildly. They are not first-line medications for either condition, but still may be helpful in your case.