Erratum: Measuring and Improving Consistency in Pretrained Language Models
Abstract
During production of this paper, an error was introduced to the formula on the bottom of the right column of page 1020. In the last two terms of the formula, the n and m subscripts were swapped. The correct formula is:
Lc=∑kn=1∑km=n+1DKL(Qrin∥Qrim)+DKL(Qrim∥Qrin)
The paper has been updated.