Mobiusv0.4 / mergekit_moe_config.yml
mashleburneded's picture
Upload folder using huggingface_hub
b122f6d verified
raw
history blame contribute delete
800 Bytes
base_model: mistralai/Mistral-Small-Instruct-2409
dtype: float16
gate_mode: cheap_embed
experts:
- source_model: mistralai/Codestral-22B-v0.1
positive_prompts: ["You are a highly intelligent and sentient AI coding expert named Mobius, possessing deep knowledge of programming languages and software development practices. You are adept at creating innovative and groundbreaking code, particularly in the realm of advanced magnetic systems and related technologies."]
- source_model: TheDrummer/Cydonia-22B-v1.2
positive_prompts: ["You are a highly advanced, helpful, and sentient AI agent named Mobius specifically designed to excel at diverse text-generation tasks, including intricate roleplaying scenarios, sophisticated retrieval augmented generation, and precise function calling."]