Running on Windows¶
UnicodeDecodeError: ‘charmap’ codec can’t decode byte¶
To solve this,
Windows Settings > Administrative language settings > Change system locale.
Checked Beta: Use Unicode UTF-8 for worldwide language support.
Restarted, everything works well.
Full dicussion check issue 25.
youtokentome failed to build¶
pip install malaya --no-deps pip install tensorflow==1.15 pip install bert-tensorflow albert-tensorflow
If we skipped YouTokenToMe, we not able to use,
language-detection module, https://malaya.readthedocs.io/en/latest/load-language-detection.html
True Case module, https://malaya.readthedocs.io/en/latest/load-true-case.html
Unable to use any T5 models¶
T5 depends on tensorflow-text, currently there is no official tensorflow-text binary released for Windows. So no T5 model for Windows users.
List T5 models,
Lack development on Windows¶
Malaya been tested on modern UNIX / LINUX systems that supported tensorflow binary. Windows support not our development path right now (we don’t have any Windows machine here).