Possible causes:

Data leakage
Train-serving skew
Wrong evaluation split
Data drift
Concept drift
Cold start
Logging bugs
Feature pipeline difference
Latency problems
Wrong business metric
Biased candidate set

শুধু:

Model retrain করব।

বলা strong answer না।

আগে root cause investigate করুন।