Alex Black c28372cb49 BERT tokenization fixes (#35)
* Add composite token preprocessor

Signed-off-by: AlexDBlack <blacka101@gmail.com>

* Fix case issue with bert tokenization

Signed-off-by: AlexDBlack <blacka101@gmail.com>
2019-07-20 22:00:40 +10:00
..
2019-07-20 22:00:40 +10:00
2019-07-20 22:00:40 +10:00