Nvidia’s TensorRT 8.0 boasts faster conversational AI performance

Nvidia has released TensorRT 8.0 for Nvidia GPUs including its Jetson modules. This latest AI inference optimization SDK delivers up to 2x the natural language query performance compared to v7.0 with 1.2ms latency using BERT. At GTC 2021 in April Nvidia announced TensorRT 8.0 along with related technologies such as a GUI-based TAO framework that 8230.

...

Read Full Post

News Link: http://linuxgizmos.com/nvidias-tensorrt-8-0-boasts-faster-conversational-ai-performance/.
RSS Link: http://linuxgizmos.com/feed/.

Linux Chatter is a news aggregator service that curates some of the best Linux, Cloud, Technical Guides, Hardware and Security news. We display just enough content from the original post to spark your interest. If you like the topic, then click on the 'read full post' button to visit the author's website. Use Linux Chatter to find content from amazing authors!

Note: The content provided has been modified and is not displayed as intended by the author. Any trademarks, copyrights and rights remain with the source.

Disclaimer: Linux Chatter sources content from RSS feeds and personal content submissions. The views and opinions expressed in these articles are those of the authors and do not necessarily reflect those of Linux Chatter.