So i blew it out a while ago, and it jsut occured to me, is it a bad idea to have taken that out completely? And still be listning to loud music and stuff, cuz it seems like it imght be liuke having the amp work to hard or something, i dunno. Sorta vague.

 

As long as the terminals from the busted speaker aren't touching, you'll be fine.