Yep, you may not feel like you're anxious but compared to the normal individual, you still are. So, your body is still in panic attack mode. I think I hated the sense of doom more than anything else with the anxiety. And like you, I'd have days where it seemed to come over me every 15 minutes or so, that feeling like you've just gone down a hill at 80 mph.
I hate this stuff.