Preview · Launched September 9, 2026
Sylor S3 Preview.
Orzatty’s frontier model: 2.7 trillion parameters in a MoE architecture with 104B active per token and 1M context. Closed preview.
This is a preview: access is limited and we are not publishing verifiable comparisons against our other models yet.
- Total parameters
- 2.8T
- Active parameters
- 104B
- Context
- 1M tokens
Specifications
Technical sheet.
Sylor S3 Preview is the third generation of the Sylor family: 2.8T total parameters in a Mixture-of-Experts architecture with 104B active per token. It ships as a closed preview.
Total parameters 2.8T
Active parameters 104B
Architecture Mixture-of-Experts
Context 1M tokens
Access Closed Preview · sylor.orzatty.com
Launch date September 9, 2026
Training Massive CPT and SFT on a base model
Corpus Over 60 TB · public code data and Orzatty-curated sets
Comparison
S2 Pro and S3 Preview.
Two generations with different access: one publishes GGUF weights, the other is tried in closed preview.
| Sylor S2 Pro | Sylor S3 Preview | |
|---|---|---|
| Total parameters | 744B (MoE) | 2.8T (MoE) |
| Active parameters | 40B | 104B |
| Context | 1M native | 1M |
| Inference cost | Lower (40B active) | Higher (104B active) |
| Access | Open GGUF on Hugging Face | Closed Preview, API coming soon |
Try Sylor S3 Preview.
Available now on sylor.orzatty.com. API coming soon on Orzatty AI Studio.