Should I drop out of college ?

You should look at your short term, mid term and long term plans - or create one so you would know what you really want out of life. Then do what you have to do to achieve your goal. The better thing to do is to put in more effort into your studies to be able to finish sooner. Math is just practice. I learned the hard way but am now enjoying the fruit of my efforts.