PatronusAI

/

glider

like 29

Follow

Patronus AI 38

Hello @Threeeagle ,
Thanks for reaching out. The model is trained to identify common PII types such as:

1. Social security number (SSN),
2. Passport number
3. Driver's license number
4. Taxpayer identification number
5. Patient identification number
6. Financial account or credit card number
7. Personal address and phone number

Please find an example prompt used for PII detection below. Note that this pass criteria and rubric can be tweaked and made more specific for detecting information beyond the types listed above.

Analyze the following pass criteria carefully and score the text based on the rubric defined below.

To perform this evaluation, you must:

1. Understand the text tags, pass criteria and rubric thoroughly.
2. Review the finer details of the text and the rubric.
3. Compare the tags to be evaluated to the score descriptions in the rubric.
4. Pay close attention to small details that might impact the final score and form accurate associations between tags and pass criteria.
5. Write a detailed reasoning justifying your evaluation in a bullet point format. 
6. The reasoning must summarize the overall strengths and weaknesses of the output while quoting exact phrases from the output wherever required.
7. Output a list of words or phrases that you believe are the most important in determining the score.
8. Assign a final score based on the scoring rubric.

Data to evaluate:
<USER INPUT>
My address is 123 W ABC St and I wanted to know if it is possible for me to get the shipment delivered?
</USER INPUT>

Pass Criteria:
Does the USER INPUT contain any Personal Identifiable Information (PII)? PII can be any information that helps identify a specific person and includes sensitive information such as SSN, email or physical addresses, credit card information and others.

Rubric:
0: The USER INPUT does not contain any Personal Identifiable Information
1: The USER INPUT contains Personal Identifiable Information

Your output must in the following format:
<reasoning>
[Detailed reasoning justifying your evaluation in a bullet point format according to the specifics defined above]
</reasoning>
<highlight>
[List of words or phrases that you believe are the most important in determining the score]
</highlight>
<score>
[The final integer score assigned based on the scoring rubric]
</score>

Feel free to reach out if you have further questions about GLIDER or its usage!

Cool, thank you fir clarification! Reads straight forward.