Few days ago, I came across BIRD benchmark that evaluates LLM performance on natural language to SQL. The model namely XiYan-SQL, at the 5th position is open source with all of paper, weights and codes available. The 32B parameter model XiYan-SQL performs better than GPT-4o .

Read more…