Skip to main content
Learn how to create a trustworthy LLM prompt in 10 minutes.

​
Overview of steps

  1. Sign in to Gists
  2. Create a gist
  3. Edit the default variant
  4. Run the gist
  5. Save the run as a test case

​
Step-by-step guide

1. Sign in to Gists

Create a free Gists account on the Sign In page if you haven’t already.

2. Create a gist

  1. Navigate to Gists on the left menu
  2. Click on New Gist button on the page
  3. Accept the default name or give it a custom name in the modal
  4. Click on the Create button

3. Edit the default variant

On the management page for the new gist you just created,
  1. Click on Default variant in the list to enter the Variant Editor page
  2. On the right panel of Variant Editor, enter your LLM prompts. You can add variables by wrapping the variable name with curly brackets like this: {{<variable_name>}}
    Space between curly brackets and variable names or in the variable names are not supported.
    Here is an example LLM prompt you can copy and try:
    Classify the following content into one of these categories:
[sport, celebrity, politics, tech, business, economics, local]

content: """
{{content}}
"""

Format the response in json with schema: {category: string}
  3. Click on Save button on the top right
Good job! You’ve created your first gist. Let’s test it out!

4. Run the gist

  1. On the bottom of the right panel, find the Run tab
  2. You should see a table with headers variant and value
  3. Enter some value into the value cell for the variables. E.g. Patriots have lost another game this season if you’re using the example prompt above
  4. Click on the green Run button at the bottom
    It can take the LLM a few seconds to respond

5. Save the run as a test case

When the LLM responds, the output will show up in the Output panel, next to the Variable panel
  1. Click on the More icon with three vertical dots on the right
  2. Click on Add to Tests on the menu
  3. On the bottom left corner of the page, you’ll see the Tests tab. A new test case called Untitled test case should be added. Feel free to change its name.
Fantastic! You can now iterate on LLM prompts and add test cases as you go to ensure consistent responses.