I just use spm_encode to encode the data before calling fairseq-preprocess . If you need to get the pruned vocabulary ids, you can probably ...
確定! 回上一頁