NVIDIA recently released the eighth generation of its popular AI software TensorRT which cuts inference time in half for language queries — enabling developers to build the best-performing search engines, ad recommendations and chatbots and deliver them from the cloud to the edge.

https://analyticsindiamag.com/nvidia-releases-eighth-generation-of-its-popular-conversational-ai-software-tensorrt/