Prompt Guide

Overview

Prompts in Videlicet are instructions sent to the Large Language Model (LLM) to specify how to translate text. Prompts are generative and can be refined until the desired output is achieved. Videlicet offers this prompt feature to allow translation refinement during the ingest process. Cost and accuracy is a consideration with prompts at ingest because results will vary with the different LLMs.

Based on our analaysis, for prompt testing, you will use Gemini Flash - it is the most cost effective and fast

Prompts Screen Overview

The prompts screen will allow the user to:

• create and update a prompt
• save/save and run a prompt
• save the AI transcription
• create, add, remove, and update labels
• associate a label to a prompt
• view when a prompt was updated and when it was last run
• view prompts running and queued

For testing purposes, please limit the number of pages per label to 10. This will help keep costs down.

Also, after you submit a prompt for processing, please wait until the job is complete. It may look like nothing is happening, but it is running in the background. You can monitor the jobs running by viewing the jobs queued and jobs complete:

How to create and edit a prompt

Navigate to the Prompts tab on the main toolbar. You will see all previously created prompts on this page. To create a new prompt, select the “New Prompt” button.

Type in the name of the new Prompt and press OK to save or Cancel to exit:

You will be taken to Prompt entry where you can enter in the prompt, specify the LLM model to use, as well as the label. Press the “Save” button to save the prompt. Press the “Save & Run” button to save the prompt and run the prompt against the selected LLM.

Do not continually press the “Save and Run” button until the job has completed. This will result in the same job multiple times and quickly increase cost.

As the job completes translating a page, it will be displayed alongside the original text.

If the translation is acceptable, press the “Save AI transcription” button. This will save the transcription and make it searchable. Otherwise, you can rework the prompt until you achieve the desired result.

Click on “Go to ce457-000001-page0001” and it will take you back to the transcription screen so that you can view the original text and either manual or AI generated transcription.

Manual versus AI translation - What Happens?

The default is manual transcriptions. If a manually transribed page already exists, and you click “Save AI transcription”, it will not get saved. If a manual transcription does not exist, then it will get saved to the transcription page.

For example, the cursive page that was just translated already has a manual transcription. The AI transcription will not overwrite the manual transcription.

How to create a label

Labels define the sample set (pages) to be used with a prompt. For example, if you want to run the prompt against one page of text, then add one page to a label and assign it to the prompt.

For cost and testing purposes, do not add more than 10 pages to a label

To add a new label press the “Create new label”

To remove file “ce457-000001-page0001” from label “cursive-test”, fill in the “Page name prefix” and select the label, then press “Remove labels from pages”.

To add file “ce457-000001-page0002” from label “cursive-test”, fill in the “Page name prefix” and select the label, then press “Add labels to pages”.

Now when you view the prompt “cursive”, with label “cursive test”, you will see the new page loaded and a blank transcription.