File: distributed.optim.md

package info (click to toggle)
pytorch 2.9.1%2Bdfsg-1~exp2
  • links: PTS, VCS
  • area: main
  • in suites: experimental
  • size: 180,096 kB
  • sloc: python: 1,473,255; cpp: 942,030; ansic: 79,796; asm: 7,754; javascript: 2,502; java: 1,962; sh: 1,809; makefile: 628; xml: 8
file content (15 lines) | stat: -rw-r--r-- 321 bytes parent folder | download 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
 
```{eval-rst}
.. role:: hidden
    :class: hidden-section
```

# Distributed Optimizers

:::{warning}
Distributed optimizer is not currently supported when using CUDA tensors
:::

```{eval-rst}
.. automodule:: torch.distributed.optim
    :members: DistributedOptimizer, PostLocalSGDOptimizer, ZeroRedundancyOptimizer
```