Issues

Bug: inspect.getframeinfo fails in blingfire/__init__.py when imported within timeit or certain contexts
microsoft/BlingFire#191 · opened on Apr 20, 2026
The XLM-Roberta-Base model is not 100% compatible with HF Tokenizers implementation
microsoft/BlingFire#186 · opened on Aug 11, 2025
In some cases, blingfire models created with the new vocab.txt produce different results.
microsoft/BlingFire#181 · opened on Nov 9, 2024
Loading the bert_base_tok.bin model sometimes throws an exception
microsoft/BlingFire#178 · opened on Aug 30, 2023
c# example negative offset for Starts
microsoft/BlingFire#177 · opened on Jul 19, 2023
Build_Dll_For_Linux_ARM64 job fails
microsoft/BlingFire#176 · opened on Jul 12, 2023
1
Support for CLIP tokenizers from Hugging Face
microsoft/BlingFire#173 · opened on Jun 5, 2023
Import issue on MacOS M1
microsoft/BlingFire#171 · opened on May 12, 2023
8
/O2 in CMakeLists.txt is incompatible with vcpkg using Ninja
microsoft/BlingFire#170 · opened on May 8, 2023
Unable to Modify Tokenization Logic
microsoft/BlingFire#169 · opened on May 1, 2023
Issues building on Mac OSX M2
microsoft/BlingFire#168 · opened on Apr 27, 2023
2
"terminate called after throwing an instance of 'std::runtime_error'"
microsoft/BlingFire#166 · opened on Apr 14, 2023
1
BlingFire fails with all-lowercase text
microsoft/BlingFire#165 · opened on Apr 12, 2023
Add xlm-roberta-large tokenization support
microsoft/BlingFire#158 · opened on Nov 17, 2022
Could java call the tokenizer of bin file
microsoft/BlingFire#157 · opened on Nov 14, 2022
Missing vcruntime140.dll and vcruntime140_1.dll dependencies
microsoft/BlingFire#156 · opened on Aug 19, 2022
4
Missing numpy dependency on setup.py
microsoft/BlingFire#155 · opened on Aug 18, 2022
How to create i2w model
microsoft/BlingFire#154 · opened on Aug 9, 2022
1
what is the last char of the last word from GetWords?
microsoft/BlingFire#150 · opened on Jun 22, 2022
M2M100 Marianmt tokenizers
microsoft/BlingFire#145 · opened on Apr 12, 2022
Trouble installing for custom model creation
microsoft/BlingFire#144 · opened on Mar 29, 2022
2
Byte offsets for original input bytes to allow non-destructive tokenization
microsoft/BlingFire#143 · opened on Mar 15, 2022
Sentence boundary for other languages
microsoft/BlingFire#141 · opened on Feb 24, 2022
Word Tokenization - Unexpected Output
microsoft/BlingFire#139 · opened on Jan 24, 2022
Invalid parameters error FAMultiMapPack_fixed.cpp
microsoft/BlingFire#138 · opened on Jan 17, 2022