LLM
Llama 3.2 1B Synthia I Redmond GGUF
GGUF quantization of the Llama 3.2 1B Synthia I Redmond model, fine-tuned on synthetic data for multilingual chat.
About this model
This is a GGUF-quantized version of the Llama 3.2 1B Synthia I Redmond model, originally fine-tuned by ArtificialGuyBR on the Synthia-v1.5-I dataset (synthetic data distillation from GPT-4). The quantization enables efficient inference on consumer hardware via llama.cpp and compatible runtimes. The base model supports 8 languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. It uses the ChatML prompt format and is licensed under Apache 2.0. The original full-precision model is available at artificialguybr/LLAMA3.2-1B-Synthia-I-Redmond. GPU sponsorship for training was provided by Redmond.AI.
Project signals
- 129 Hugging Face downloads
- 1 Hugging Face likes
Topics
transformers · gguf · instruct · finetune · chatml · gpt4 · synthetic data · distillation · facebook · meta