Natural Language Programming | Prompting (chatGPT)

5 readers

1 users here now

Welcome ton !nlprog where anything Natural Language Programming related is game, prompts, ideas, projects and more for any model are welcome.

We follow Lemmy’s code of conduct.

Communities

Useful links

founded 2 years ago

MODERATORS

manitcor@lemmy.intai.tech

Is ChatGPT A Good Translator - A preliminary evaluation of ChatGPT/GPT-4 for machine translation. (github.com)

submitted 2 years ago* (last edited 2 years ago) by manitcor@lemmy.intai.tech to c/nlprog@lemmy.intai.tech

4 comments fedilink hide all child comments

We conduct a preliminary evaluation of ChatGPT/GPT-4 for machine translation. [V1] arXiv

This repository shows the main findings and releases the evaluated test sets as well as the translation outputs, for the replication of the study.

you are viewing a single comment's thread
view the rest of the comments

[–] kurwa@lemmy.world 2 points 2 years ago (1 children)

This was a very interesting read. I tried very basic translation myself with chat gpt before although I was weary of it's reliably. This however makes me more hopeful.

I'm wondering about the randomness issue, are you only using the web interface and not the API? Couldn't you set the temp=0 to get the output to be more reliable? (I'm assuming you most likely don't have chat gpt 4 API access so I know you would have to wait for that.)

[–] tourist@community.destinovate.com 3 points 2 years ago

Translation to Chat GPT is really a loose term, because actually what you are telling it to do is create a story in language B that follows the plot of the story in language A. So naturally it is going to take some creative license with the translation, and you'll get a more accurate response if you give it the context of what you're translating.