Overview of steps
- Sign in to Gists
- Create a gist
- Edit the default variant
- Run the gist
- Save the run as a test case
Step-by-step guide
1. Sign in to Gists
1. Sign in to Gists
Create a free Gists account on the Sign In page if you haven’t already.
2. Create a gist
2. Create a gist
- Navigate to
Gistson the left menu - Click on
New Gistbutton on the page - Accept the default name or give it a custom name in the modal
- Click on the
Createbutton
3. Edit the default variant
3. Edit the default variant
On the management page for the new gist you just created,
-
Click on
Defaultvariant in the list to enter theVariant Editorpage -
On the right panel of
Variant Editor, enter your LLM prompts. You can add variables by wrapping the variable name with curly brackets like this:{{<variable_name>}}Space between curly brackets and variable names or in the variable names are not supported.Here is an example LLM prompt you can copy and try: -
Click on
Savebutton on the top right
Good job! You’ve created your first gist. Let’s test it out!
4. Run the gist
4. Run the gist
-
On the bottom of the right panel, find the
Runtab -
You should see a table with headers
variantandvalue -
Enter some value into the
valuecell for the variables. E.g.Patriots have lost another game this seasonif you’re using the example prompt above -
Click on the green
Runbutton at the bottomIt can take the LLM a few seconds to respond
5. Save the run as a test case
5. Save the run as a test case
When the LLM responds, the output will show up in the
Output panel, next to the Variable panel- Click on the More icon with three vertical dots on the right
- Click on
Add to Testson the menu - On the bottom left corner of the page, you’ll see the
Teststab. A new test case calledUntitled test caseshould be added. Feel free to change its name.
Fantastic! You can now iterate on LLM prompts and add test cases as you go to ensure consistent responses.