awq-quantization
NewActivation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on limited GPU memory, when you need faster inference than GPTQ with better accuracy preservation, or for instruction-tuned and multimodal models. MLSys 2024 Best Paper Award winner.
Install & Usage
~/.claude.jsonAdd the configuration to "mcpServers": { "awq-quantization": { "command": "...", "args": [] } }
/mcpSecurity Audits
Frequently Asked Questions
What is awq-quantization?
Activation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on limited GPU memory, when you need faster inference than GPTQ with better accuracy preservation, or for instruction-tuned and multimodal models. MLSys 2024 Best Paper Award winner.
How to install awq-quantization?
To install awq-quantization: open your mcp config (~/.claude.json), then add the config to "mcpServers": { "awq-quantization": { "command": "...", "args": [] } }. Finally, /mcp in Claude Code.
What is awq-quantization best for?
awq-quantization is a mcp categorized under General. It is designed for: deployment, ai-&-ml, data-&-analytics. Created by davila7.