This is where the context and orchestration layer comes in; the so-called middle layer that connects foundation models to applications will ideally control the traffic of API calls to models to ...