[PyTorch] Documentation for op fuser API#2447
[PyTorch] Documentation for op fuser API#2447timmoon10 wants to merge 23 commits intoNVIDIA:mainfrom
Conversation
Signed-off-by: Tim Moon <tmoon@nvidia.com>
Signed-off-by: Tim Moon <tmoon@nvidia.com>
Greptile SummaryThis PR adds comprehensive documentation for the operation fuser API, including a detailed usage guide with examples and a developer guide for implementing custom operations and fusions. The documentation demonstrates basic usage patterns, quantization support, and branching operations. Key changes:
What was reviewed: Confidence Score: 5/5
Important Files Changed
Last reviewed commit: 03abb07 |
Signed-off-by: Tim Moon <tmoon@nvidia.com>
Review suggestion from @greptile-apps Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Signed-off-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>
This comment was marked as outdated.
This comment was marked as outdated.
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Signed-off-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>
Signed-off-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>
This comment was marked as outdated.
This comment was marked as outdated.
Signed-off-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>
Signed-off-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>
docs/examples/op_fuser/op_fuser.rst
Outdated
There was a problem hiding this comment.
Not sure what that means - any examples?
There was a problem hiding this comment.
For MXFP8, it's not safe for the quantize op to produce a MXFP8Tensor with swizzled scales. There's no way to know if it will consumed by a GEMM or by something else.
Signed-off-by: Tim Moon <tmoon@nvidia.com>
Signed-off-by: Tim Moon <tmoon@nvidia.com>
|
@greptile-apps I'm about to push a commit with a major reorganization. In addition to checking correctness, please check that the writing is clear and sounds natural. |
for more information, see https://pre-commit.ci
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Signed-off-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>
|
/te-ci |
This comment was marked as resolved.
This comment was marked as resolved.
Signed-off-by: Tim Moon <tmoon@nvidia.com>
Signed-off-by: Tim Moon <tmoon@nvidia.com>
Signed-off-by: Tim Moon <tmoon@nvidia.com>
Signed-off-by: Tim Moon <tmoon@nvidia.com>
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Signed-off-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>
Signed-off-by: Tim Moon <tmoon@nvidia.com>
Signed-off-by: Tim Moon <tmoon@nvidia.com>
Description
This PR adds a basic usage guide for the op fuser and includes it in the autogenerated API docs. It also includes a guide for implementing custom ops and fusions.
Type of change
Changes
Checklist: