Can paying interest to your company save tax?

You recently borrowed a substantial sum of money from your company rather than take extra salary or dividends. Your bookkeeper says it might be more tax efficient if your company charged you interest. This sounds counter-intuitive but is it correct?