binhvq/news-corpus

A collaborative project to collect datasets in SEA languages, SEA regions, or SEA cultures.

Agent Skills that make Claude write Vietnamese a Vietnamese professional would actually ship.

Dự án bao gồm: 1. Xây dựng bộ dữ Instructions Vietnamese (chất lượng, nhiều, và đa dạng). 2.LLM Training, Finetuning, Evaluating & Testing trên Open-source mô hình ngôn ngữ: Bloomz,T5, UL2, LLaMA (1&2), OpenLLaMA, GPT-J pythia etc. 3. Ứng dụng và Giao diện Người dùng (UI)

Браунський корпус української мови

Underthesea - AI Assistant

PhoGPT: Generative Pre-training for Vietnamese (2023)

A list of Nepali Dataset sources. (Hoping that it will encourage everyone to research more on Nepali language)

A toolbox for Vietnamese Optical Character Recognition.

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。