It's not just you. Insomnia makes it way worse for most people. Not for me, ive been an insomniac all my life so nothings really changed. But for most people, yeah it seems to cause a worsening of symptoms, sometimes severely.
And of course, the anxiety makes it hard to sleep, another wonderful positive feedback loop.