I started changing it after every smoke. After a while I switched to every few smokes. Eventually I began changing it when I saw it was ripped from moving the firebox. The winter of 2014 I didn't change it until spring because it was too damn cold to mess with it.
None of it made a noticeable difference, do what pleases you.