If you think this is going to make your anxiety worse, then my advice would be to go for it. The way to overcome anxiety is to face it - not run from it. At the moment, you are contemplating whether to run from it. In the long run, this is going to make things worse - not only for your anxiety, but of course, your education and possibly your future.
Of course it is going to be a struggle for you… which is why you have more reason to go for it. Trust me. When you face your anxieties, you learn ways to deal with it for the future. When I have what I perceive to be the worse days I have ever had, I think to myself, "since this is the worst episode yet, I can learn from this and future episodes will be easier to deal with". And this is so true (and works). The more anxiety inducing situation you put yourself into, and you face it and come out at the end of it, the more stronger you start to believe you can deal with your anxiety in the long run.
And even if you don't meet up to the standards you want (in terms of dealing with situations), it doesn't mean you are a failure - just that you have to lower your standards or look at the other positives that you can. The more you find evidence to back up your positive beliefs, and the more you find evidence to counteract towards negative beliefs, the better you will feel.
I can totally feel for you. I have an apprenticeship starting next month. I am of course dreading it. But if I bail out, not only will I therefore struggle to earn some money, but I will make my anxiety worse in the long run. So I am trying with all my might to push through because the more I do, the better I can be prepared for the future.
It is a matter of dedication. You can still push yourself into doing things you don't want to do - or things that you think are going to cause danger for you. I recently had to do a presentation during my university course a few months ago. I was dreading the event for 2 years. The closer it became towards the date, the more anxious and hopeless I started to feel. But I knew I just had to do it. I did it. And I never stumbled for a second during the speech. I messed up in terms of remembering all the information that I was presenting - but I expected that. I just held the hope that if I can do an adequate job, even if it is not the best one, I may still be able to get the pass. And I did. I received my certificate recently. I have my degree. And I am so happy that I didn't bail out.
You can do it too. By the end of it, you will feel glad you did it. If you don't do it, I fear that you may regret it and that this may make you worse in terms of your anxiety.
I wish you good look. ;)