Working with Engineering Teams

Insist that model accuracy is more important than latency and push back on the engineering constraint Collaborate with engineering to explore trade-offs: simplify the model, reduce features, use distillation, or implement caching to meet the latency target Hand off the model to engineering and let them figure out how to make it fast enough Abandon the model entirely and use a simple rules-based system instead