Update README.md

README.md

@@ -32,6 +32,26 @@ Including the source language during inference helps reduce hallucinations and i
 - **Training Loss:**
   - Decreased from 1.423 to 0.176
 
+Below is a revised version with a short explanation added:
+
+---
+
+## Inference
+
+Load `generation_config` and `processor` from the base model as a quick fix to use the default generation settings.
+
+*Note: The new models currently lack high-quality fine-tuning scripts. When saving a fine-tuned model using `model.save_pretrained()`, the processor configuration—including essential audio parameters—is not automatically saved. This omission can lead to errors during inference due to the model’s complex architecture. Loading these components from the base model ensures that all critical settings are properly included.*
+
+```python
+generation_config = GenerationConfig.from_pretrained(
+    'microsoft/Phi-4-multimodal-instruct', 'generation_config.json'
+)
+processor = AutoProcessor.from_pretrained(
+    'microsoft/Phi-4-multimodal-instruct', trust_remote_code=True
+)
+```
+
+
 ## Model description
 
 More information needed