I think you probably would be having more if it was a tumor.
I don't think it's epilepsy. I looked up simple partial seizures and you have none of those symptoms. It did not speak of de ja vu. As I said, just go to your dr again and tell him or her your concerns.