Skip to content

Pull requests: pytorch/TensorRT

New pull request New
102 Open 2,508 Closed
102 Open 2,508 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Wrap the live ICudaEngine after compile instead of serialize/deserialize. cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime component: tests Issues re: Tests
#4698 opened Sep 9, 2026 by micwill755 Collaborator • 10/10 Loading…
6 of 9 tasks
fix select empty tensor squeeze dgx spark cla signed component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: core Issues re: The core compiler component: tests Issues re: Tests
#4695 opened Sep 9, 2026 by apbose Collaborator Loading…
7 tasks
Skip TRTInterpreter.validate_conversion when partition already proved full support. cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths
#4693 opened Sep 8, 2026 by micwill755 Collaborator • 9/10 Loading…
4 of 9 tasks
fix(dynamo): fall back to PyTorch for nonzero on TensorRT-RTX backend: TensorRT-RTX cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests
#4692 opened Sep 8, 2026 by tp5uiuc Collaborator Loading…
5 of 7 tasks
@tp5uiuc
Always compile Edge engines and dual-profile PI05 language I/O cla signed documentation Improvements or additions to documentation
#4691 opened Sep 8, 2026 by micwill755 Collaborator Loading…
3 tasks
fix(dynamo): check bool before int in to_numpy/to_torch cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths
#4689 opened Sep 5, 2026 by Anai-Guo Loading…
fix(tests): gate the BF16 suite on the minor SM version for sm_87 cla signed component: tests Issues re: Tests
#4688 opened Sep 5, 2026 by Anai-Guo Loading…
cherry pick from release/2.14 branch back to main ci: full ci: nightly Run the nightly lane (all tiers incl. llm / kernels / distributed) on every push cla signed component: api [Python] Issues re: Python API component: build system Issues re: Build system component: tests Issues re: Tests
#4687 opened Sep 5, 2026 by lanluo-nvidia Collaborator Loading…
7 tasks
fix: add the missing f-string prefix to two diagnostic messages cla signed component: api [Python] Issues re: Python API component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: fx component: runtime fx
#4686 opened Sep 5, 2026 by Anai-Guo Loading…
Move Edge exporter to tools/hf cla signed component: api [Python] Issues re: Python API component: build system Issues re: Build system documentation Improvements or additions to documentation
#4685 opened Sep 5, 2026 by micwill755 Collaborator Loading…
2 tasks
fix: name the engine and the binding in execute_engine failures cla signed component: core Issues re: The core compiler component: runtime component: tests Issues re: Tests
#4682 opened Sep 4, 2026 by SrivastavaKshitij Loading…
7 of 9 tasks
1
fix: bind a scalar engine output at rank 0 cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests
#4681 opened Sep 4, 2026 by SrivastavaKshitij Loading…
5 of 7 tasks
1
1
Add an Edge Exporter user guide cla signed documentation Improvements or additions to documentation
#4675 opened Sep 4, 2026 by micwill755 Collaborator Loading…
2 tasks
Replace Edge wrappers with family setattr patches cla signed component: api [Python] Issues re: Python API component: build system Issues re: Build system component: tests Issues re: Tests
#4673 opened Sep 3, 2026 by micwill755 Collaborator Loading…
2 tasks
exporters cla signed component: api [Python] Issues re: Python API component: build system Issues re: Build system component: tests Issues re: Tests
#4672 opened Sep 3, 2026 by micwill755 Collaborator Loading…
7 tasks
13
feat(executorch): let a TensorRT engine write the caller's KV cache in place cla signed component: api [C++] Issues re: C++ API component: api [Python] Issues re: Python API component: tests Issues re: Tests documentation Improvements or additions to documentation
#4667 opened Sep 2, 2026 by Conarnar Contributor Loading…
7 tasks done
10
fix(dynamo): decide MutableTorchTensorRTModule LIVE from weight snaps… cla signed component: api [Python] Issues re: Python API component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime component: tests Issues re: Tests
#4664 opened Sep 2, 2026 by cehongwang Collaborator Loading…
7 tasks
1
1
Raise when TensorRT enqueueV3 fails cla signed component: api [Python] Issues re: Python API component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime
#4662 opened Sep 2, 2026 by micwill755 Collaborator Loading…
3 tasks
1
fix(runtime): support NCCL2 communicator binding ci: nightly Run the nightly lane (all tiers incl. llm / kernels / distributed) on every push cla signed component: core Issues re: The core compiler component: runtime component: tests Issues re: Tests
#4661 opened Sep 2, 2026 by apbose Collaborator Loading…
1
3
Fix the ExecuTorch CUDA 12 build and test failures cla signed component: api [Python] Issues re: Python API component: core Issues re: The core compiler component: runtime component: tests Issues re: Tests
#4659 opened Sep 2, 2026 by shoumikhin Contributor Loading…
Convert torch.cond to TensorRT IIfConditional cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes component: tests Issues re: Tests
#4657 opened Sep 2, 2026 by micwill755 Collaborator Loading…
2 tasks done
1
fix(fx): drop the dynamic_range argument from the 8 remaining mark_as_int8_layer calls cla signed component: api [Python] Issues re: Python API component: fx fx
#4651 opened Aug 30, 2026 by Anai-Guo Loading…
3
fix: order the placeholders first before computing serde range constraints ci: full cla signed component: api [Python] Issues re: Python API component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests
#4648 opened Aug 29, 2026 by tp5uiuc Collaborator Loading…
@tp5uiuc
1
fix: keep PyTorch-executed weights on the device when the mutable module offloads ci: full cla signed component: api [Python] Issues re: Python API component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime component: tests Issues re: Tests
#4647 opened Aug 29, 2026 by tp5uiuc Collaborator Loading…
@tp5uiuc
2
fix: guard the FP32 GEMMs that reach TensorRT-RTX through linear and attention backend: TensorRT backend: TensorRT-RTX ci: full cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests
#4646 opened Aug 29, 2026 by tp5uiuc Collaborator • 4/4 Loading…
@tp5uiuc
5
ProTip! Follow long discussions with comments:>50.