Add formatted prompt example for inference API

README.md

@@ -23,6 +23,70 @@ metrics:
 - kendall-tau
 base_model:
 - microsoft/Phi-3.5-mini-instruct
+widget:
+  - messages:
+    - role: user
+      content: |
+        # GOAL
+        Your job is to evaluate a task carried out by an AI system powered by a large language model.
+        You will be provided with the inputs and output of the task, as well as the evaluation criteria and scoring rubric. Your task is to evaluate the output of the AI system based on the evaluation criteria and scoring rubric provided.
+        # INPUT/s
+        Below are the inputs required for performing the task:
+        <inputs>
+        <customer_query>
+        Subject: Issues with recent order #12345
+        Hello,
+        I recently received my order #12345, but I'm having a few problems:
+        1. The blue t-shirt I ordered is actually green. Can I exchange it?
+        2. The phone case doesn't fit my iPhone 13 Pro Max. The website said it was compatible.
+        3. I was charged for express shipping, but it took over a week to arrive. Can I get a refund on the shipping cost?
+        Please let me know how we can resolve these issues. I've been a loyal customer for years and this is the first time I've had problems like this.
+        Thank you,
+        Jane Smith
+        </customer_query>
+        </inputs>
+
+        # OUTPUT
+        Below is the output of the task:
+        <output>
+        Dear Jane Smith,
+        Thank you for reaching out about the issues with your recent order #12345. We sincerely apologize for the inconvenience you've experienced. Let me address each of your concerns:
+        1. T-shirt color discrepancy: We're sorry about the mix-up with the t-shirt color. We'd be happy to exchange it for the correct blue t-shirt. I'll send you a prepaid return label for the green shirt, and we'll ship out the blue one as soon as we receive the return.
+        2. Phone case compatibility: We apologize for the confusion regarding the phone case compatibility. Our website information should have been more accurate. We'll gladly accept a return of the incompatible case and issue a full refund for it. Additionally, I can recommend a case that will fit your iPhone 13 Pro Max if you're interested.
+        3. Shipping charge: You're absolutely right about the shipping charge. Since the delivery didn't meet our express shipping standards, we will refund the entire shipping cost to your original payment method. This refund should process within 3-5 business days.
+        To initiate these resolutions, please reply to this email confirming that you'd like to proceed with the t-shirt exchange and phone case return. Once confirmed, I'll send you the necessary return labels and process the shipping refund immediately.
+        We truly value your loyalty as a long-time customer and sincerely regret that you've encountered these issues. Rest assured, we're taking steps to prevent similar problems in the future. As a gesture of goodwill, we'd like to offer you a 20% discount on your next order.
+        If you have any further questions or concerns, please don't hesitate to reach out. We're here to ensure your complete satisfaction.
+        Best regards,
+        Alex Johnson
+        Customer Service Representative
+        </output>
+
+        # EVALUATION CRITERIA AND SCORING RUBRIC
+        Here are the evaluation criteria and the rubric that you need to use for evaluating the task:
+        <evaluation_criteria>
+        How well the response addresses the specific issues raised in the customer's query?
+        </evaluation_criteria>
+        <scoring_rubric>
+        - Score 1: The response completely fails to address the customer's needs and ignores the specific issues raised.
+        - Score 2: The response barely addresses the customer's query and misses most of the specific issues raised.
+        - Score 3: The response partially addresses the customer's query, touching on some of the specific issues but leaving others unaddressed.
+        - Score 4: The response adequately addresses most aspects of the customer's query and the specific issues raised.
+        - Score 5: The response fully and comprehensively addresses all aspects of the customer's query and all specific issues raised in a highly satisfactory manner.
+        </scoring_rubric>
+
+        # INSTRUCTIONS FOR THE EVALUATION
+        1. Understand the task and criteria: Familiarize yourself with the task to be evaluated. Review the evaluation criteria and scoring rubric to understand the different levels of performance and the descriptions for each score.
+        2. Review the inputs and output: Look at the inputs provided for the task. Examine the output generated from completing the task.
+        3. Compare output to score descriptions: Compare the output against the criteria and score descriptions in the scoring rubric. For each criterion,decide which description best matches the output.
+        4. After comparing the output to the score descriptions, pay attention to the small details that might impact the final score that you assign. Sometimes a small difference can dictate the final score.
+        5. Write verbal feedback justifying your evaluation that includes a detailed rationale, referring to specific aspects of the output and comparing them to the rubric.
+        6. Assign a final score based on the scoring rubric.
+
+        ## FORMAT FOR THE EVALUATION
+        - Write the verbal feedback inside <feedback> tags without any additional surrounding text.
+        - Write the numeric score inside <score> tags, without any additional surrounding text and always after the feedback.
+        Please accurately evaluate the task. Strictly adhere to the evaluation criteria and rubric.
 ---
 
 <p align="center">