Based on conversations with a dozen companies doing real-time ML in both US and China, I wrote about online inference and online learning -- their use cases, solutions, and challenges.
Machine learning is going real-time, and most companies aren't ready.
https://huyenchip.com/2020/12/27/real-time-machine-learning.html
Machine learning is going real-time, and most companies aren't ready.
https://huyenchip.com/2020/12/27/real-time-machine-learning.html