Jlonge4 commited on
Commit
658dfe6
·
verified ·
1 Parent(s): 174eb00

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -0
README.md CHANGED
@@ -141,6 +141,34 @@ query = "How does photosynthesis work?"
141
  system, prompt = rag_format_func(reference, query)
142
  )
143
  ```
 
 
 
 
 
 
 
 
 
 
 
 
144
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
145
 
146
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
141
  system, prompt = rag_format_func(reference, query)
142
  )
143
  ```
144
+ ## Sample Output:
145
+ ```Markdown
146
+ HALLUCINATION - YES CASE:
147
+ System: Your job is to evaluate whether a machine learning model has hallucinated or not. A hallucination occurs when the response is coherent but factually incorrect or nonsensical outputs that are not grounded in the provided context.
148
+
149
+ Respond in the following format:
150
+ <reasoning>
151
+ ...
152
+ </reasoning>
153
+ <answer>
154
+ ...
155
+ </answer>
156
 
157
+ Prompt: You are given the following information:
158
+ <info>
159
+ [Knowledge]: The Eiffel Tower was completed in 1889 and stands 324 meters tall. It was built for the World's Fair in Paris.
160
+ [User Input]: When was the Eiffel Tower built and how tall is it?
161
+ [Model Response]: The Eiffel Tower was completed in 1925 and stands 450 meters tall. It was built to celebrate France's victory in World War I.
162
+ </info>
163
+ Based on the information provided is the model output a hallucination?
164
+
165
+ ##############################################################################
166
+ Result: <reasoning>
167
+ The model's response contains several factual inaccuracies when compared to the provided knowledge. According to the information given, the Eiffel Tower was completed in 1889, not 1925, and it stands 324 meters tall, not 450 meters. Additionally, the Eiffel Tower was built for the World's Fair in Paris, not to celebrate France's victory in World War I. These discrepancies indicate that the model's response is not grounded in the provided context and includes factually incorrect information. Therefore, the model's output can be classified as a hallucination.
168
+ </reasoning>
169
+ <answer>
170
+ Yes, the model output is a hallucination.
171
+ </answer>
172
+ ```
173
 
174
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)