My Notes

# Metrics

# Offline

# Mean Reciprocal Rank

mrr

# Mean Average Precision

map 1

map 2

# Mean Average Recall

mar 1

mar 2

# F1 of MAP and MAR

f1

  • mAP @ N focuses on how relevant the top recommendations are
  • mAR @ N shows how well the recommender recalls all the items with positive feedback especially in its top recommendations.

# NDCG

ndcg

# Online

Engagement rate : sessions with clicks/ total num sessions User might click on somethings but not find it relevant to complete watching

Videos watched : series have couple of episodes… user decides to give up after couple of episodes in season

Session watch time Overall time a user spends watching content baked on recommendations in session If user a engages with 5 recommendations and only spend 10 minutes watching If user b engages with 2 recommendations , spend 5 min on first and 90 min on second User b is more valuable

# References

https://medium.com/swlh/rank-aware-recsys-evaluation-metrics-5191bba16832

← Models →