Saga Ishtardottir writes that CyberTiel is an abliterated, quantized MoE model designed for high-speed agentic coding and offensive security tasks. Based on the Ornith-1.5-35B-A3B architecture, this version features a grafted multi-token prediction (MTP) head to enable speculative decoding via llama.cpp and uses a custom cyber-weighted importance matrix to maintain performance in low-bit quantizations. The model is optimized for real-world programming problems, showing significant improvements on benchmarks like SWE-bench-Live compared to its censored counterparts.
- Includes an abliterated (uncensored) base that allows the model to perform offensive security work without refusal.
- Features a grafted MTP head at block 40 specifically designed for speculative decoding speedups in llama.cpp.
- Uses Unsloth Dynamic quantization with a custom imatrix calibrated on specialized cybersecurity and code datasets.
- Capable of vision tasks via the mmproj-BF16.gguf projector from Ornith's original model.
- Includes an abliterated (uncensored) base that allows the model to perform offensive security work without refusal.
- Features a grafted MTP head at block 40 specifically designed for speculative decoding speedups in llama.cpp.
- Uses Unsloth Dynamic quantization with a custom imatrix calibrated on specialized cybersecurity and code datasets.
- Capable of vision tasks via the mmproj-BF16.gguf projector from Ornith's original model.
