OpenAI Codex
text-to-code
paid
OpenAI Codex (2021) is a code generation AI derived from GPT-3 and fine-tuned on public code repositories. It can interp...
Version: 1.0
Released: 4y 2m 22d ago on 08/10/2021
Architecture
- parameters: GPT-3 scale (~175B) decoder-only Transformer
- context_length: 2048 tokens
- training_data: 159 GB of Python code from 54M GitHub repos
- inference: Autoregressive Transformer
Capabilities
- Generates code from natural language prompts
- Supports multiple programming languages (Python, JavaScript, Java, etc.)
- Can complete, explain, and debug code snippets
Benchmarks
- Pass@1: ~70% correct on coding tasks (if tested 100x per prompt)
Safety
- Trained to refuse malicious code generation
- detects malware/exploit requests and declines.
Deployment
- regions: global
- hosting: OpenAI servers
- integrations: GitHub Copilot, IDE extensions
Tags
code generationprogrammingGPT-3developer tools