Update README.md
Browse files
README.md
CHANGED
@@ -23,7 +23,7 @@ LoRA-Flow provides an efficient way to fuse different LoRA modules which can out
|
|
23 |
![1.jpg](https://cdn-uploads.huggingface.co/production/uploads/64d99f6cd7e30889c6c477b4/ifiu1FTHilrmUkD4FKkgV.jpeg)
|
24 |
# Training Details
|
25 |
## LoRA modules Training
|
26 |
-
For language LoRA modules: we use the
|
27 |
|
28 |
For math LoRA module: the training data for English math LoRA is constructed by [Metamath](https://arxiv.org/abs/2309.12284), which is comprised of 395K mathematical problems in English.
|
29 |
|
|
|
23 |
![1.jpg](https://cdn-uploads.huggingface.co/production/uploads/64d99f6cd7e30889c6c477b4/ifiu1FTHilrmUkD4FKkgV.jpeg)
|
24 |
# Training Details
|
25 |
## LoRA modules Training
|
26 |
+
For language LoRA modules: we use the 52K training samples respectively which from [Okapi](https://aclanthology.org/2023.emnlp-demo.28).
|
27 |
|
28 |
For math LoRA module: the training data for English math LoRA is constructed by [Metamath](https://arxiv.org/abs/2309.12284), which is comprised of 395K mathematical problems in English.
|
29 |
|