Discussion on "Extracting and Generating JSON Data with OpenAI GPT, LangChain, and Python"

Karol Horosin · 2023-09-11T23:32:28.938Z

📜 Click here if you're looking for a Node.js version of this article. In this blog post, I will share how to use LangChain, a flexible framework for building AI-driven applications, to extract and generate structured JSON data with GPT and Langcha...

it's a detailed article with all useful information. i fine-tuned gpt3.5 with train and valid sets, i got the result file but i don't know how to analyse it! as the train accuracy column values fluctuate with 0.333 - 0.66 - 0,66-0- 0,66- 1e-05- 0-0.66-0.7-1 . does this mean i need more samples for training ?

i training gpt3.5 for binary classification task i would like to know the accuracy of fine-tuned model. i got a csv file which include 4 columns [step train_loss train_accuracy valid_loss valid_mean_token_accuracy] but the accuracy values is fluctuated is that mean my model doesn't work as appropriate ?

Karol Horosin

Ware you following any tutorial? How big is your set? Do results look OK when you test manually? Hard to help with limited info!

Arwa Saqabi

Karol Horosin sorry it wasn't your tutorial. I was confused. but kindly if you have knowledge about fine-tune gpt3.5 on binary classification task. i have a more than 200 000 samples. i think i will need just part of it.

Thanks for sharing this detailed breakdown! Sure it'll be useful for a lot of folks building similar apps in AI

Yeah there's still very limited resources on these tools. Especially there's a lack of good examples online

Good one, how about using function calling?

This is a great approach but not flexible between LLMs. It should bo more optimal prompt size wise. For function calling, I would use openai Python package directly.

Karol Horosin any tips on how to do this right?

Coder Bible Ill think about a separate article. In the meantime, I've prepared a demo of function calling. Not for data extraction but instead of calling a function you can just take the input and use it in your application.

github.com/horosin/openai-functions-demo

Discussion

Extracting and Generating JSON Data with OpenAI GPT, LangChain, and Python

Responses(3)

Recent in Forum

Search Hashnode

Extracting and Generating JSON Data with OpenAI GPT, LangChain, and Python

Responses(3)

Recent in Forum