{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# MS to EN" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "
\n", " | Size (MB) | \n", "Quantized Size (MB) | \n", "BLEU | \n", "SacreBLEU Verbose | \n", "SacreBLEU-chrF++-FLORES200 | \n", "Suggested length | \n", "
---|---|---|---|---|---|---|
small | \n", "42.7 | \n", "13.4 | \n", "35.392561 | \n", "68.4/43.4/29.5/20.5 (BP = 0.967 ratio = 0.967 ... | \n", "59.64 | \n", "256 | \n", "
base | \n", "234 | \n", "82.7 | \n", "40.353823 | \n", "71.4/48.1/34.5/25.1 (BP = 0.971 ratio = 0.972 ... | \n", "63.24 | \n", "256 | \n", "
bigbird | \n", "246 | \n", "63.7 | \n", "38.877588 | \n", "70.2/46.3/32.5/23.2 (BP = 0.983 ratio = 0.983 ... | \n", "62.49 | \n", "1024 | \n", "
small-bigbird | \n", "50.4 | \n", "13.1 | \n", "36.331393 | \n", "68.9/44.1/30.3/21.2 (BP = 0.973 ratio = 0.973 ... | \n", "60.57 | \n", "1024 | \n", "
noisy-base | \n", "234 | \n", "82.7 | \n", "40.384611 | \n", "71.4/48.2/34.6/25.1 (BP = 0.971 ratio = 0.971 ... | \n", "63.31 | \n", "256 | \n", "