[TensorRT EP] TRT EP cache docs (#20785)

Commit

1 year ago

[TensorRT EP] TRT EP cache docs (#20785) Add a section for how to use three major TRT EP caches: TRT timing cache, TRT engine cache and Embedded engine model /EPContext model. Some materials are from my GTC slides.

References

#20785 - [TensorRT EP] TRT EP cache docs

#24621 - Add GenAI Chat Template Function Docs

#26165 - [WIP] Modifications to Card Component Based on User Feedback

#26900 - Update genai API docs

#26951 - [WIP][Docs] Plugin EP packaging guidance

Author

chilo-ms

Parents

3ae8137f

onnxruntime e3e4f215 - [TensorRT EP] TRT EP cache docs (#20785)

onnxruntime
e3e4f215 - [TensorRT EP] TRT EP cache docs (#20785)