{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# EN to MS" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "
\n", " | Size (MB) | \n", "Quantized Size (MB) | \n", "BLEU | \n", "SacreBLEU Verbose | \n", "SacreBLEU-chrF++-FLORES200 | \n", "Suggested length | \n", "
---|---|---|---|---|---|---|
small | \n", "42.7 | \n", "13.4 | \n", "39.805387 | \n", "80.2/63.8/52.8/44.4 (BP = 0.997 ratio = 0.997 ... | \n", "64.46 | \n", "256 | \n", "
base | \n", "234 | \n", "82.7 | \n", "42.210713 | \n", "86.3/73.3/64.1/56.8 (BP = 0.985 ratio = 0.985 ... | \n", "66.28 | \n", "256 | \n", "
bigbird | \n", "246 | \n", "63.7 | \n", "39.090717 | \n", "70.5/46.7/32.4/22.9 (BP = 0.989 ratio = 0.989 ... | \n", "63.96 | \n", "1024 | \n", "
small-bigbird | \n", "50.4 | \n", "13.1 | \n", "36.90195 | \n", "67.0/43.8/30.1/21.0 (BP = 1.000 ratio = 1.028 ... | \n", "62.85 | \n", "1024 | \n", "
noisy-base | \n", "234 | \n", "82.7 | \n", "41.827831 | \n", "73.1/49.7/35.3/25.4 (BP = 0.985 ratio = 0.985 ... | \n", "66.46 | \n", "256 | \n", "