Search Hashnode

Search posts, tags, users, and pages

Comment by Arwa Saqabi on "Extracting and Generating JSON Data with OpenAI GPT, LangChain, and Python" | Hashnode

Discussion

Arwa Saqabi

NLP

Sep 26, 2023

it's a detailed article with all useful information. i fine-tuned gpt3.5 with train and valid sets, i got the result file but i don't know how to analyse it! as the train accuracy column values fluctuate with 0.333 - 0.66 - 0,66-0- 0,66- 1e-05- 0-0.66-0.7-1 . does this mean i need more samples for training ?

Karol Horosin

Software Lead

Sep 26, 2023

what do you mean? what were you training for? what was your testing methodology?

Arwa Saqabi

NLP

i training gpt3.5 for binary classification task i would like to know the accuracy of fine-tuned model. i got a csv file which include 4 columns [step train_loss train_accuracy valid_loss valid_mean_token_accuracy] but the accuracy values is fluctuated is that mean my model doesn't work as appropriate ?

Karol Horosin

Sep 26, 2023

Karol Horosin

Software Lead

Sep 27, 2023

Ware you following any tutorial? How big is your set? Do results look OK when you test manually? Hard to help with limited info!

Arwa Saqabi

NLP

Sep 27, 2023

Karol Horosin sorry it wasn't your tutorial. I was confused. but kindly if you have knowledge about fine-tune gpt3.5 on binary classification task. i have a more than 200 000 samples. i think i will need just part of it.