AlphaCode
code
research
AlphaCode is a 41.4B-parameter transformer model for code generation (Feb 2022). Trained on public GitHub code, it gener...
Version: 1.0
Released: 3y 8m 25d ago on 02/07/2022
Architecture
- parameters: 41400000000
- context_length: 2048
- training_data: Trained on code from public GitHub repos (Python, JavaScript, Rust, etc.)
- inference: autoregressive code generation
Capabilities
- code generation
- code generation
- competitive programming
- multi-language support
Benchmarks
- CodeContest: Top 54% of participants
Safety
- No public alignment details; research model
- May generate incorrect or biased code
Deployment
- regions: private
- hosting: No public deployment
- integrations: research code and dataset released (Apache 2.0).
Tags
code generationtransformerresearch