https://github.com/facebookresearch/pythia
Tip revision: 2bfba5892f0669c67385829eb4496a74a55d1b7f authored by Vedanuj Goswami on 08 June 2021, 15:04:37 UTC
[WIP][feat] FSDP
[WIP][feat] FSDP
Tip revision: 2bfba58
| File | Mode | Size |
|---|---|---|
| __init__.py | -rw-r--r-- | 164 bytes |
| attention.py | -rw-r--r-- | 9.9 KB |
| bottleneck.py | -rw-r--r-- | 6.4 KB |
| decoders.py | -rw-r--r-- | 2.7 KB |
| embeddings.py | -rw-r--r-- | 20.5 KB |
| encoders.py | -rw-r--r-- | 22.1 KB |
| fusions.py | -rw-r--r-- | 24.4 KB |
| hf_layers.py | -rw-r--r-- | 18.7 KB |
| layers.py | -rw-r--r-- | 26.1 KB |
| losses.py | -rw-r--r-- | 25.7 KB |
| metrics.py | -rw-r--r-- | 41.2 KB |
| optimizers.py | -rw-r--r-- | 3.4 KB |
| schedulers.py | -rw-r--r-- | 2.1 KB |
