Defog provides AI-powered data analysis solutions. The company focuses on offering trustworthy AI technology that prioritizes data privacy and accuracy.

Defog

We help enterprises deploy fine-tuned LLMs for enterprise analytics. 

Y Combinator

Davidovs Venture Collective

Pioneer Fund

Script Capital

Hike Ventures

Dharmesh Shah

Divya Bhat

Defog.ai (YC W23)

Excited to open-source SQLCoder-70B! It outperforms all other models in the market for Postgres text-to-SQL generation by a wide margin. 

We got these results by fine-tuning Meta's CodeLlama-70B, released yesterday, on less than 20,000 hand-curated prompt-completion pairs. This follows our 34B, 15B and 7B models - and is the most capable one yet.

You can find SQLCoder-70B on Hugging Face (link in the comments)

The model has a CC BY-SA 4.0 license, which means that you are free to use it as is for any use (including commercial) as long as you also open-source any changes you make to it (eg, if you fine-tune it further).

You can now utilize Defog.ai (YC W23) defog-sqlcoder on MLX with a straightforward command:

📌 Access it here: https://lnkd.in/dMU7gFhh
📌 Find it on MLX at: https://lnkd.in/djrY4Fa8

It's important to note, as previously mentioned and now confirmed officially, that beam search is not supported in MLX.

7B model better than the most recent GPT4 out of the gate on text to SQL!

I've said it and will say it again: except for very general tasks (like a search engine), smaller models are better/cheaper/faster!

𝐎𝐩𝐞𝐧 𝐒𝐨𝐮𝐫𝐜𝐞 𝐀𝐈 𝐢𝐧 𝐒𝐢𝐧𝐠𝐚𝐩𝐨𝐫𝐞? 𝐉𝐨𝐢𝐧 𝐮𝐬 𝐭𝐡𝐢𝐬 𝛑 𝐃𝐚𝐲 🥧

Stoked to have Rishabh Srivastava from Defog.ai (YC W23) share with us about SQLCoder 🔥. There'll be quick fire demos (5 minutes), so if you're building something cool ✨ and wanna show the community, please do join us 🤗

Zahari, Teng Fone and I thought it'll be pretty cool to do something for Pi Day. This will be a fun and cosy - so do register! 

==
SQLCoder is a family of state of the art text to SQL models. It has been developed by fine tuning Meta’s CodeLlama, and achieved super GPT-4 performance on the SQL-Eval benchmark. 🏆

SQLCoder is open source, with more than 100k downloads on Hugging Face. It has been developed by a team based entirely out of Singapore. 🇸🇬

https://lnkd.in/gY3zNzjb

This week was special for #opensource models.
- Meta released Code Llama 70B 
- 01.AI released Yi-VL-34B
- Defog.ai (YC W23) released SQLCoder, which beats GPT 4 by 11% On benchmarks

#Community discussions and my talks with experts in the field echo the same enthusiasm for open source #generativeai in 2024.

What do you think? Is open source going to catch up to OpenAI and the potential GPT5 later in the year?

Check out the latest developments in our weekly newsletter “AI Emergence” https://lnkd.in/g64-i6yu

AI:DEFOG

Defog