Recently I finally uploaded to Huggingface the biggest known LLM for Bulgarian before the release of INSAIT's BgGPT in 2024. In 2024 or so the GPT2 weights were available in Mega.nz. The training procedure and the method for published in 2021. https://huggingface.co/twenkid/gpt2-medium-bg GPT2-Medium-BG 2021Updates 13.1.2025: The dataset was discovered, adding more details about it.GPT2-Medium 345M for BulgarianThe model was created and trained from scratch, using tensorflow in free Google Colab T4. The research experiment...
Tuesday, February 11, 2025
In
AGI,
AI,
Artificial General Intelligence,
Artificial Intelligence,
BgGPT,
NLP,
Programming,
български,
За Тош,
История,
Обработка на естествен език
by Todor "Tosh" Arnaudov - Twenkid
//
Tuesday, February 11, 2025
//
Leave a Comment
GPT2-Medium-BG 2021 - the biggest LLM for Bulgarian before INSAIT's BgGPT 2024
Read More
