Is it racist to find the East Indian accent "annoying" (to say the least)?

I do like Scottish, French, British (there are different ones), and even German accents. I'm neutral towards most foreign accents (i.e. Jamaican, Russian, Korean, Greek, etc), but most of my friends and I find the East Indian accents one of the most difficult to understand and very painful to the ears and irritating.