CompTIA DataX DY0-001 (V1) Practice Question

The correct answer is shadow deployment. This strategy involves deploying the new model alongside the production model, where it receives a copy of the live production traffic. However, its predictions are not used for any actual business decisions; they are logged for analysis. This allows the team to compare the new model's performance, stability, and latency against the current model under real-world conditions without any risk to customers, which perfectly matches the scenario's requirements.

• Canary deployment is incorrect because it involves routing a small percentage of live traffic to the new model, and the predictions are used for that subset of users. This would violate the requirement of not exposing any customers to the new model's outcomes.
• Blue-green deployment is incorrect because it involves switching all traffic from the old model environment ('blue') to a new model environment ('green') at once. It does not support running both models in parallel on the same traffic for validation without impacting users.
• A/B testing is incorrect because its purpose is to compare two or more models by serving their predictions to different segments of users and measuring the impact on business metrics. This inherently requires exposing customers to the new model's predictions.