Will there be smaller models, such as 7B or 14B, open-sourced in the future?

[k4nyeEaaast]

Hi @Peng-fei-Wang , thanks for your excellent work!

Due to hardware limitations, will smaller models, such as 7B or 14B, be open-sourced in the future? Or is it possible for me to train a usable model using a smaller model within the Agentar-Scale-SQL framework?

[Peng-fei-Wang]

Hi @k4nyeEaaast , thank you for your interest and kind words about our work!

Regarding your question, for our journey with the BIRD leaderboard, we chose a 32B model as the base model to achieve the best possible performance. Consequently, we don't have a smaller-sized model available at this time.

However, the future open-source content for Agentar-Scale-SQL will not be limited to the methods we used on BIRD. We have some new plans in the works and may release new models to this GitHub repository next year, which could feature some interesting capabilities. When we do, we will definitely take the community's demand for various model sizes (like 7B or 14B) into consideration.

Thank you again for your attention and support!