Try the video on another computer. Sounds like a codec problem or a "lack of horsepower" problem with your computer. Describe to us your set up and we can go from there.
Just to clarify, what resolutions are you currently filming at? What are you using for playback? Have you tried playing the footage back on something else?