Ground Truth

When you created your Thread, you used an LLM to generate your first draft reponses. But these are likely not right! But what is "right"?

That's where the ground truth comes in. You together with the community can edit responses to show what "right" looks like. This is called setting the Ground Truth for your Thread.

Why Ground Truth is Important

Say you have a problem. And you want to use an LLM to solve it. Great! But what's not great is that this is actually very hard.

First of all, there are around are thousands of different LLMs. How do you choose one for your needs? Second, out of the box, LLMs are unlikely to work for your problem.

Threads solves both of these problems. To the first issue, it allows you to define what "right" looks like and then run tons of LLMs against it, helping you find the one that's closest. To the second issue, in order to get under-performing LLMs to work better, you first need to understand why they are under performing! By setting the Ground Truth reponse you expect to get from your LLM, you can grow this understanding.

Setting Ground Truth

Setting the Ground Truth for your Thread is easy. Click here for detailed instructions