It used to happen when it was cold, but would go away when the car warmed up. Now it pretty much happens all the time, and on top of that the car shakes for a couple of seconds now. I'm not getting any misfires. Anyone know a couple of reasons why this is happening?

Belt noise - YouTube

 

belt is super shiny. looks like you just need a new one.

 

I wish i could get the shaking on camera. Could that really be the cause? And do you know what belt that is?

 

I'm pretty sure that's the serpentine belt. That noise is hard to say. It's probably the bearings in one of the pully's are just worn. Can you pinpoint which pully it may be coming from?