hosting sometimes fast / sometimes slow

I am having an issue with my hosting company and I am wondering if everyone else runs into the same problem.

Most of the time the access/page load times to my websites is acceptable, but sometimes it's very, very slow. It's not the scripts.

Is this something to expect with shared hosting and what would be the way to avoid this? Is getting a dedicated server the only answer of would you still run into problems with it?