StarCoder 2
✓ VerifiedState-of-the-art open-access code LLM by BigCode
About
StarCoder 2 is a family of open-access Large Language Models for code, developed by BigCode (Hugging Face & ServiceNow). Released in February 2024, it comes in 3B, 7B, and 15B parameter sizes. Trained on The Stack v2 (4 trillion tokens), it offers state-of-the-art performance, transparency, and a 16K context window, making it a powerful tool for code completion and generation.
Key Features
- ✓Trained on 4 trillion tokens (The Stack v2)
- ✓3 sizes: 3B, 7B, 15B parameters
- ✓16K token context window
- ✓Supports 600+ programming languages
- ✓Fill-in-the-Middle (FIM) capability
- ✓Grouped Query Attention (GQA)
- ✓Transparent and open-access
Use Cases
- →Self-hosting a code assistant
- →Fine-tuning on private codebases
- →Researching code LLMs
- →Offline code completion
- →Building custom developer tools
Technical Details
Languages
AI Models
Integrations
Frequently Asked Questions
What is StarCoder 2?
StarCoder 2 is a family of open-access Large Language Models for code, developed by BigCode (Hugging Face & ServiceNow). Released in February 2024, it comes in 3B, 7B, and 15B parameter sizes. Trained on The Stack v2 (4 trillion tokens), it offers state-of-the-art performance, transparency, and a 16K context window, making it a powerful tool for code completion and generation.
Is StarCoder 2 free?
Yes, StarCoder 2 is open source and free to use. 3B, 7B, 15B models, OpenRAIL-M license, Weights available on Hugging Face
What programming languages does StarCoder 2 support?
StarCoder 2 supports 1+ programming languages including 600+ languages.
What AI models does StarCoder 2 use?
StarCoder 2 is powered by StarCoder2-3B, StarCoder2-7B, StarCoder2-15B.
What platforms does StarCoder 2 support?
StarCoder 2 is available on Linux, Windows, macOS.
What can StarCoder 2 do?
StarCoder 2 provides code completion, code generation. Key features include: Trained on 4 trillion tokens (The Stack v2), 3 sizes: 3B, 7B, 15B parameters, 16K token context window.
Similar Tools
Compare StarCoder 2 with these alternatives