Machine learning inference, the process of using trained models to make predictions on new data, is a critical component of many AI applications. Traditionally, organizations have…