100 Multi-language Text Reader and Decision Maker Laya(github.com)
Writing language: KoreanRead in the original language
Plain summary
- Laya is a system that receives texts in over 100 languages and performs multi-choice format decision-making through a single neural network process.
- The main models consist of an English model, a multilingual model for 100 languages based on mmBERT, and task-specific typed-decision models, with a router that automatically selects the appropriate model based on the request.
- It can process document inputs up to 8192 tokens, and for long documents of around 4000 tokens, it correctly answers 16 to 18 out of 20 test requests (measured based on publicly available research scripts).
- It can be installed in Python environments 3.10 or higher, supporting reinforcement learning, ONNX conversion, and batch processing. Separate libraries for TypeScript and Node.js are also provided.
Found on
GitHub ↗ / 29,818 stars
Have you run into something like this? Tell us in a line or two what you did. You do not need to know the product.