Mini LLM for texts (SLM)

[paulocoutinhox]

Hi,

I made Mini LLM for texts (SLM):
https://github.com/paulocoutinhox/mini-llm

Im not expert in Ai, but if any expert help us with that open source projeto to help fine tune new SLM, will be nice.

Thanks.

[andimarafioti]

Hey! Super cool project!
As you probably know, we created nanoVLM inspired by nanoGPT. You can probably find good inspiration there! Otherwise, modded-nanogpt is a library where people focused on speed running the training.

Maybe the question would be, what do you want to focus on for miniLLM?

[paulocoutinhox]

Hi! These projects are interesting, but they're often too complex, poorly organized, and not beginner-friendly.

My focus is to fine-tune any model within a well-documented and organized project, so that newcomers can understand and get involved more easily.