Issues

• Can I use a user dictionary?

  WorksApplications/SudachiTra#65 · Filter by author mumumu09chi opened on May 12, 2023
  2

• The entry of \n in vocab.txt is causing token index shifting

  WorksApplications/SudachiTra#64 · Filter by author hiroshi-matsuda-rit opened on May 8, 2023

• Introduce token-based authentication for PyPI

  WorksApplications/SudachiTra#63 · Filter by author mh-northlander opened on Mar 17, 2023

• setup.py install is deprecated.

  WorksApplications/SudachiTra#62 · Filter by author mh-northlander opened on Mar 15, 2023

• Vocabulary file handling

  WorksApplications/SudachiTra#57 · Filter by author mh-northlander opened on Mar 10, 2023

• tokenizer.model_max_length is incorrect

  WorksApplications/SudachiTra#51 · Filter by author mh-northlander opened on Jan 31, 2023
  1

• Tokenizer initializations behave differently

  WorksApplications/SudachiTra#43 · Filter by author mh-northlander opened on Feb 9, 2022

• Add to the test for alignments of encoded tokens by JapaneseBertWordPieceTokenizer

  bug
  WorksApplications/SudachiTra#42 · Filter by author t-yamamura opened on Jan 26, 2022

• use pathlib instead of os.path

  WorksApplications/SudachiTra#41 · Filter by author t-yamamura opened on Jan 25, 2022