| --- |
| name: duo |
| base_model: s-sahoo/duo |
| license: apache-2.0 |
| pipeline_tag: text-generation |
| tasks: text-generation |
| language: en |
| datasets: Skylion007/openwebtext |
| --- |
| > [!IMPORTANT] |
| > Original Model Link : [https://huggingface.co/s-sahoo/duo](https://huggingface.co/s-sahoo/duo) |
| > |
| |
| ``` |
| name: duo |
| base_model: s-sahoo/duo |
| license: apache-2.0 |
| pipeline_tag: text-generation |
| tasks: text-generation |
| language: en |
| datasets: Skylion007/openwebtext |
| ``` |
| # Duo |
| Duo is a diffusion masked language model with 130m parameters. This repo makes the `flash_attn` and CUDA libraries optional so that all frameworks can be supported. [Code for this model](https://github.com/s-sahoo/duo) |
| |
