File size: 378 Bytes
fa8fc26 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
dtype: bfloat16
merge_method: passthrough
slices:
- sources:
- layer_range: [0, 9]
model: mistralai/Mistral-7B-Instruct-v0.3
- sources:
- layer_range: [8, 17]
model: mistralai/Mistral-7B-Instruct-v0.3
- sources:
- layer_range: [16, 25]
model: mistralai/Mistral-7B-Instruct-v0.3
- sources:
- layer_range: [24, 31]
model: mistralai/Mistral-7B-Instruct-v0.3 |