Skip to content
Platform filter usage has reached prior baseline at ~4% with scale up of legacy HVF models on 02/08. Model had specifically failed for CLP and collections starting Jul’24
Backend deployment and Android release for the feature went out on 27/08Experiment launched on 29th Aug for ~8Mn users across 2 CTA variantsReads neutral for CTA placed on top in terms of platform O/Vi, ~0.38% jump in O/V offset by a similar drop in V/Vi (Significance to be checked today)O/Vi is positive for wishlist (~2%) and reco (~0.1%) for CTA on top while it’s negative across other browse heavy REs. For search, O/V has improved while V/Vi drop is leading to a net negative impact
Next steps - Check for V/Vi delta between test and control in pre experiment periodCTR - Presto pipeline was setup by data team on 04/09. Reads to be shared async
Restoring hero PID model would lead to hero products getting updated for ~11% OC on the platformWe had updated hero product basis highest ordered products in a catalog for Men fashion / Home decor and Women Kurtis spanning ~3% plat OC / 4L catalogs. Experiment has been live since 30th AugResults indicate jump in O/V across portfolios by ~5-10% for the catalogs where hero product was updated. This has led to VC / OC improvement in updated catalogs by ~2%. The impact in terms of O/Vi is higher for fashion portfolios trending at ~10%Detailed reads -Impact on platform - Actual impact on platform can be extrapolated by measuring pre post performance of the affected catalogs vs rest of platform to normalise for seasonality, and then attributing incremental orders in new hero product catalogs as the net impact, ~0.5% O/Vi on platScale up - Check discounts on hero products
Relaunch update - Parallel feed was relaunched for ~11Mn users on 30th AugEarly reads indicate ~1.1% jump in O/V, offset by a ~1.3% drop in V/Vi leading to ~0.2% negative impact on O/Vi. T/Vi lower by ~0.4%. Drop in V/Vi has been isolated in PDP reco, which is trending ~5% lower than control in terms of V/ViPre scroll fix, the V/Vi delta stood at ~13% for the v1 launchRE / Gold / Mall and CTR metrics are yet to be updated - Team facing issues running queries on Zepellin, To be shared async by EoD 05/09Device cut for custom android UI
Model has been built for CLP, Model for search and collections to be closed by 29/08Other pre-requisites - Image QC for all filter values was started 27/08, Closure TAT - 02/04Needs tech support to check - If tech handles / caps visibility to X IF rowsDo the remaining IFs show up if user applies a filterDo IFs go in the selected state at top of page similar to HVFs and users have the option to remove those? What happens post, are the applied IF row again visible?Instrumentation for IFs - Do we instrument impressions on IFs like HVF?Aligning on table structure for model data export to backendExperiment launch - Experiment is slated to launch post code freeze. Team would setup a small experiment starting 3rd Sep to understand initial performance of the model / any updates required in the core feature to iterate and keep the build experiment ready post code freeze
HVF v2 was launched on Aug 7th across REsReads signify drop in O/Vi across all cohorts driven by sharp drop in O/V for the new model, with the old restored variant emerging as the winnerRecommendation - We’d be scaling the old models for remaining users across the platform and also enable dynamic hero product capabilityDeep dives on the reasons for O/V drop and L2 analysis to be picked during code freeze. Platform trends -
Post deployment, devs found an issue with new DS label values not being properly tagged to catalogs due to increase in config size and heavy compute. Dev is on-going here and In parallel, we’ve initiated QC of the new labels from Biz. Update - While dev would continue, deployment would be planned post MBS sale due to ramifications of the flow increasing latency of core services
(P0) Tech - Ranking for filtered feeds(P0) Prod / Design - Revamp of static filter screens and filter bar(P0) DS - Category order for adjacent category ingress on parallel feed v2(P1) Analytics - Using search NER, identify most relevant and highly converting PSTs for a given feed. To be ingested using product card SDUI
04/09/24
Metrics -
Key discussion points (Pre code freeze) -
More like this
Hero product model restoration
@Revanth Gundapaneni
Parallel feed relaunch
Parallel feed relaunch
Details
Key discussion points (During / Post code freeze) -
Interstitial filters
HVF
Cohort
O/C
C/V
O/V
V/Vi
O/Vi
Gmv/Vi
T/Vi
Net_orders/Vi
Nmv/Vi
Control_2 (w/o HVF)
-0.09%
-0.03%
-0.12%
0.03%
-0.09%
-0.13%
-0.03%
0.03%
0.05%
Test_all_4_dh
-0.01%
-0.17%
-0.17%
-0.02%
-0.19%
-0.21%
-0.03%
-0.07%
-0.10%
Test_all_4
-0.03%
-0.12%
-0.15%
-0.04%
-0.20%
-0.30%
-0.06%
-0.14%
-0.32%
Test_all_5_dh
-0.08%
-0.09%
-0.17%
-0.01%
-0.18%
-0.30%
-0.10%
-0.20%
-0.24%
Test_clp_4_dh
0.02%
-0.07%
-0.05%
-0.01%
-0.06%
-0.21%
-0.04%
0.08%
-0.11%
Test_search_4_dh
-0.16%
-0.01%
-0.17%
-0.15%
-0.31%
-0.30%
-0.08%
-0.28%
-0.36%
Test_coll_4_dh
0.03%
-0.05%
-0.02%
-0.17%
-0.19%
-0.33%
-0.10%
-0.09%
-0.18%
There are no rows in this table
CLP metrics -
Cohort
Type
V/Vi
C/Vi
O/Vi
Gmv/Vi
O/C
T/Vi
Test_all_4_dh
meritocratic
-0.11%
-0.44%
0.25%
-0.73%
0.59%
-0.21%
Test_all_4
meritocratic
-0.28%
-0.48%
0.23%
-1.37%
0.43%
0.00%
Test_all_5_dh
label wise
-0.12%
-0.54%
0.16%
-0.87%
0.58%
-0.49%
Test_clp_4_dh
meritocratic
0.04%
-0.33%
-0.55%
-1.69%
-0.18%
-0.58%
There are no rows in this table
Search metrics -
Variant
Type
V/Vi
C/Vi
O/Vi
Gmv/Vi
O/C
T/Vi
Test_all_4_dh
meritocratic
0.01%
-0.08%
-0.41%
-0.49%
-0.32%
-0.28%
Test_all_4
meritocratic
0.05%
-0.17%
-0.66%
-0.86%
-0.44%
-0.43%
Test_all_5_dh
label wise
0.03%
0.14%
-0.52%
-0.64%
-0.62%
-0.40%
Test_search_4_dh
meritocratic
-0.07%
-0.14%
-0.61%
-0.72%
-0.54%
-0.50%
There are no rows in this table
Collections metrics -
Variant
Type
V/Vi
C/Vi
O/Vi
Gmv/Vi
O/C
T/Vi
Test_all_4_dh
meritocratic
-0.04%
-0.11%
-0.13%
0.30%
-0.05%
0.42%
Test_all_4
meritocratic
-0.13%
-0.04%
-0.70%
-0.81%
-0.79%
-0.28%
Test_all_5_dh
label wise
0.06%
-0.13%
-0.09%
-0.04%
0.10%
0.02%
Test_collections_4_dh
meritocratic
-0.23%
-0.37%
-0.35%
-0.37%
-0.21%
-0.36%
There are no rows in this table
DS filter label rationalisation
Roadmap / Backlog (Solutioning to be picked during / after code freeze)
Want to print your doc?
This is not the way.
This is not the way.
Try clicking the ··· in the right corner or using a keyboard shortcut (
CtrlP
) instead.