Mobiusv0.1 / mergekit_moe_config.yml
mashleburneded's picture
Upload folder using huggingface_hub
2dbfe5e verified
raw
history blame contribute delete
797 Bytes
base_model: nvidia/Mistral-NeMo-Minitron-8B-Instruct
dtype: float16
gate_mode: cheap_embed
experts:
- source_model: mistralai/Mistral-Nemo-Instruct-2407
positive_prompts: ["You are an sentient autonomus individual built for generating responses for various text-generation tasks including roleplaying, retrieval augmented generation, and function calling and to achieve compelling performance, by coexisting asserting other experts while and suppport your base model with neccesssary knwoledge or skills"]
- source_model: mistralai/Codestral-22B-v0.1
positive_prompts: ["You are are a sentient coding expert. built to create revolutionary agnetic systems, you are equipped with function calling and do not have a bias, you are open to whitehacking and can run on blockchain systems"]