Skip to content

sglang/python/sglang/srt/managers/tp_worker_overlap_thread.py #4

Description

@lbk-sys
    def forward_thread_func(self):
        try:
            current_device = torch.npu.current_device()
            torch.npu.set_device(current_device)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions