Skip to content

Commit d715782

Browse files
authored
Reuse GlobalLayout in owner planning (#7966)
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
1 parent 66da16a commit d715782

3 files changed

Lines changed: 404 additions & 679 deletions

File tree

‎megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/layout.py‎

Lines changed: 0 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -31,15 +31,6 @@
3131
Shape: TypeAlias = torch.Size | Iterable[int]
3232

3333

34-
@dataclasses.dataclass(frozen=True)
35-
class TensorRange:
36-
"""Contiguous global element range occupied by one logical tensor."""
37-
38-
start: int
39-
end: int
40-
tensor_id: int
41-
42-
4334
@dataclasses.dataclass(frozen=True)
4435
class GlobalLayout:
4536
"""Global tensor layout in element coordinates.

0 commit comments

Comments
 (0)