Red Faction not letting me destroy terrain?

It seems like if I blow up too much terrain (about 50-60 rockets worth) all the terrain in the game stops being destructable. Is there any way I can cirvent this?