"Necessity is the mother of invention," AWS CEO Andy Jassy told a packed audience during his keynote. "There is a lot of machine learning being done on the cloud, and most of it is happening on AWS.

One way AWS is doing that is through AWS Inferentia. a machine learning inference chip, custom designed by AWS to deliver high throughput, low latency inference performance at an extremely low cost.