Skip to content
Opening PDP recos in a bottom sheet once user’s click on back chevron from PDPs to land back to catalog feed
Show the top 20 recos in the bottom tab with a view all buttonClicking on view all routes back to PDP with a scroll animation that takes users to PDP recosAnimation built to assist and help users recall the position of PDP recos at the bottom part of PDPs
We have setup the experiment with 3 variants namely - Test 1 - Sunset count of 3Test 2 - Sunset count of 5Test 3 - Sunset count of 7Sunset refers to the number of times reco bottom sheet appears per userExperience rolled out for Android app version v18.4 / 566
0.37% statistically significant jump in O/V for variant 1, ~0.17% for variant 3Statistically Significant jump in reco Net order / visitor by ~0.7-0.9% across variants. Reco contribution to net orders increased by ~0.6% per variantV/Vi is down in experiment duration across variants which can be explained by pre period normalisation error - Platform V/Vi across test variants was relatively lower by ~0.1%-0.4% w.r.t control in the pre periodReco usage post sunset has dropped by 5% across variants. Metric accuracy to be confirmedScale up decision - O/Vi and NMV/Vi at platform is positive but is yet to mature for significance. Conversations initiated with data team to scale up the audience size to 10% app opens
Platform metricsO/VV/ViO/ViGMV/ViNet orders/ViNMV/ViPDP reco metrics - OC from PDP reco between test and controlO/V → V/Vi → O/Vi → GMV/Vi → Net orders/Vi → NMV/Vi for PDP reco specifically between test and controlBottom sheet usage tracking - Out of test users, how many have seen / interacted and exhausted the bottom sheet popupReco usage post sunset - How is net PDP reco usage holding post sunset - Look at V/Vi on PDP recos pre and post sunset for the same duration
Experiment with alternative ways to assist in PDP reco rediscovery like - FIF widget placed on feeds when users click back from PDPCreating stepper tabs on top of PDP alongside FIF / bottom sheet experience Reference - 
Involve design to do a thorough outside IN and suggest best experience for reco rediscovery
PRD - Reco rediscovery
Objective -
Generating intent on PDP drops by pushing visibility for high conversion / relevance PDP recommedation
Problem context -
Only ~36% of PDP opens reach PDP reco. PDP reco has the highest conversion amongst all real estates.
Approach -
Experiment design -
-
Metrics -
Platform funnel / NSM
Variant
Audience size
App visitors
O/V
V/Vi
O/Vi
GMV/Vi
Net orders/Vi
NMV/Vi
Ad_revenue/Vi
Variant 1 | Sunset = 3
4,640,583
3,644,810
0.32%
-0.06%
0.27%
0.64%
0.09%
0.12%
0.05%
Variant 2 | Sunset = 5
4,641,991
3,646,526
-0.02%
0.08%
0.06%
0.18%
0.05%
0.08%
0.04%
Variant 3 | Sunset = 7
4,646,557
3,649,954
0.20%
-0.07%
0.13%
0.07%
0.06%
0.08%
0.03%
Control
4,645,756
3,650,793
There are no rows in this table
Funnel metric - PDP reco
Variant
viewers
ro/v
v/vi
ro_vi
gmv/vi
net_ro/vi
nmv/vi
reco_orders/total_orders
pre_v_vi
post_v_vi
post_vs_pre_v_vi
Sunset - 3
2,771,690
0.78%
-0.17%
0.61%
0.51%
0.53%
0.40%
0.63%
9.57
9.75
1.02
Sunset - 5
2,773,466
0.37%
-0.02%
0.36%
0.31%
0.62%
0.54%
0.29%
9.35
9.27
0.99
Sunset - 7
2,776,107
0.74%
-0.16%
0.58%
0.46%
0.65%
0.55%
0.80%
9.23
8.96
0.97
There are no rows in this table
Next steps -
Want to print your doc?
This is not the way.
This is not the way.
Try clicking the ··· in the right corner or using a keyboard shortcut (
CtrlP
) instead.