Update README.md
Browse files
README.md
CHANGED
@@ -141,6 +141,34 @@ query = "How does photosynthesis work?"
|
|
141 |
system, prompt = rag_format_func(reference, query)
|
142 |
)
|
143 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
144 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
145 |
|
146 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
|
|
141 |
system, prompt = rag_format_func(reference, query)
|
142 |
)
|
143 |
```
|
144 |
+
## Sample Output:
|
145 |
+
```Markdown
|
146 |
+
HALLUCINATION - YES CASE:
|
147 |
+
System: Your job is to evaluate whether a machine learning model has hallucinated or not. A hallucination occurs when the response is coherent but factually incorrect or nonsensical outputs that are not grounded in the provided context.
|
148 |
+
|
149 |
+
Respond in the following format:
|
150 |
+
<reasoning>
|
151 |
+
...
|
152 |
+
</reasoning>
|
153 |
+
<answer>
|
154 |
+
...
|
155 |
+
</answer>
|
156 |
|
157 |
+
Prompt: You are given the following information:
|
158 |
+
<info>
|
159 |
+
[Knowledge]: The Eiffel Tower was completed in 1889 and stands 324 meters tall. It was built for the World's Fair in Paris.
|
160 |
+
[User Input]: When was the Eiffel Tower built and how tall is it?
|
161 |
+
[Model Response]: The Eiffel Tower was completed in 1925 and stands 450 meters tall. It was built to celebrate France's victory in World War I.
|
162 |
+
</info>
|
163 |
+
Based on the information provided is the model output a hallucination?
|
164 |
+
|
165 |
+
##############################################################################
|
166 |
+
Result: <reasoning>
|
167 |
+
The model's response contains several factual inaccuracies when compared to the provided knowledge. According to the information given, the Eiffel Tower was completed in 1889, not 1925, and it stands 324 meters tall, not 450 meters. Additionally, the Eiffel Tower was built for the World's Fair in Paris, not to celebrate France's victory in World War I. These discrepancies indicate that the model's response is not grounded in the provided context and includes factually incorrect information. Therefore, the model's output can be classified as a hallucination.
|
168 |
+
</reasoning>
|
169 |
+
<answer>
|
170 |
+
Yes, the model output is a hallucination.
|
171 |
+
</answer>
|
172 |
+
```
|
173 |
|
174 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|