Viewing figures for the show are down 40% in the last five years, but diehard fans are digging their heels in.