ÔÚÊÔÑé¿¢ÊÂǰ£¬£¬£¬£¬£¬£¬£¬ÑÇÂíÑ·¹Ù·½»á²»×¼Ê±ÎªÄú¸üÐÂÊÔÑéЧ¹û
ÊÔÑéЧ¹û
ÔÚÊÔÑé¿¢ÊÂ֮ǰ£¬£¬£¬£¬£¬£¬£¬ÎÒÃÇÿ¸ô¼¸Öܶ¼»á¸üÐÂÒ»´ÎÄúµÄÊÔÑéЧ¹û¡£¡£¡£¡£¡£¡£¡£Äú¿ÉÒÔͨ¹ýµã»÷ÊÔÑé¿ØÖÆÃæ°åÖеÄÊÔÑéÃû³ÆÀ´»á¼ûÄúµÄЧ¹û¡£¡£¡£¡£¡£¡£¡£ÇëÎðƾ֤ÔçÆÚЧ¹û¿¢ÊÂÊÔÑ飬£¬£¬£¬£¬£¬£¬ÓÉÓÚÕâЩЧ¹û¿ÉÄܾßÓÐÎóµ¼ÐÔ¡£¡£¡£¡£¡£¡£¡£Ó¦ÆÚ´ýÊÔÑ鿢ʣ¬£¬£¬£¬£¬£¬£¬È»ºóÔÙ¾öÒéÒªÐû²¼ÄÄÒ»°æÉÌÆ·ÐÎò¡£¡£¡£¡£¡£¡£¡£
ÌáÐÑ£º ÊÔÑ鿢ʺ󣬣¬£¬£¬£¬£¬£¬ÇëÎñ±ØÔÚ¡°A+ ÉÌÆ·ÐÎòÖÎÀíÆ÷¡±ÖÐÖØÐÂÌá½»»ñʤÉÌÆ·ÐÎò£¬£¬£¬£¬£¬£¬£¬´Ó¶øÐû²¼¸ÃÉÌÆ·ÐÎò¡£¡£¡£¡£¡£¡£¡£
Ú¹ÊÍЧ¹û
ÎÒÃÇÆ¾Ö¤ÔÚÊÔÑéʱ´úÍøÂçµÄÊý¾Ý£¬£¬£¬£¬£¬£¬£¬ÅÌËãÐû²¼Ã¿Ò»ÌõÉÌÆ·ÐÎò¿ÉÄܱ¬·¢µÄһϵÁÐÓ°Ïì¡£¡£¡£¡£¡£¡£¡£ÎÒÃÇ»á»ã×ÜÕë¶ÔÊÔÑéÖÐËùÓÐÒÑ×¢²á ASIN µÄЧ¹û¡£¡£¡£¡£¡£¡£¡£ÎÒÃÇÌṩÒÔϼ¸ÖÖЧ¹û£º
ij¸ö°æ±¾µÄÉÌÆ·ÐÎò¿ÉÄܸüºÃ¡£¡£¡£¡£¡£¡£¡£ÀýÈ磬£¬£¬£¬£¬£¬£¬ÈôÊÇЧ¹ûÏÔʾ°æ±¾ A ¸üºÃµÄ¿ÉÄÜÐÔΪ 75%£¬£¬£¬£¬£¬£¬£¬ÔòÒâζ×ÅÔÚÎÒÃÇÅÌËã³öµÄ¿ÉÄÜÓ°ÏìÖУ¬£¬£¬£¬£¬£¬£¬Ðû²¼°æ±¾ A ÓÐ 75% µÄ¼¸ÂÊ»áÌá¸ßÏúÁ¿/ÏúÊÛ¶î¡£¡£¡£¡£¡£¡£¡£
¹ØÓÚÿһ°æÉÌÆ·ÐÎò£¬£¬£¬£¬£¬£¬£¬ÎÒÃÇ»áÏÔʾ£º ÏúÁ¿¡¢ÏúÊ۶ת»¯ÂÊ¡¢Ã¿Î»Î¨Ò»Éí·Ý»á¼ûÕß¹ºÖõÄÉÌÆ·ÊýÄ¿ÒÔ¼°·ÖÅɸø¸Ã°æ±¾µÄÑù±¾Á¿¡£¡£¡£¡£¡£¡£¡£×ª»¯ÂÊÊÇÖ¸ÔÚÊÔÑéÖп´µ½ A+ ÉÌÆ·ÐÎò²¢¹ºÖÃÁËÉÌÆ·µÄΨһÉí·Ý»á¼ûÕßËùÕ¼µÄ°Ù·Ö±È¡£¡£¡£¡£¡£¡£¡£Ñù±¾Á¿ÊÇÖ¸Éó²éÁËÿһ°æÉÌÆ·ÐÎòµÄΨһÉí·Ý»á¼ûÕßµÄÊýÄ¿¡£¡£¡£¡£¡£¡£¡£Ã¿Î»Î¨Ò»Éí·Ý»á¼ûÕß¹ºÖõÄÉÌÆ·ÊýÄ¿¼´ÊÇÏúÁ¿³ýÒÔÑù±¾Á¿¡£¡£¡£¡£¡£¡£¡£
Ô¤¹ÀÄ껯ӰÏì¡£¡£¡£¡£¡£¡£¡£ÏµÍ³½ö»áΪÒÑÍê³ÉµÄÊÔÑéÌî³ä´Ë²¿·Ö¡£¡£¡£¡£¡£¡£¡£ËüÏÔʾÁËÐû²¼»ñʤÉÌÆ·ÐÎò°æ±¾ÔÚ½ÓÏÂÀ´µÄÒ»ÄêÄÚ¿ÉÄÜ´øÀ´µÄÏúÁ¿¼°ÏúÊÛ¶îÔöÌíÔ¤¹ÀÖµ¡£¡£¡£¡£¡£¡£¡£¹ØÓÚÖÃÐÅˮƽ½Ï¸ßµÄ»ñʤÉÌÆ·ÐÎò£¬£¬£¬£¬£¬£¬£¬Äú»á×¢ÖØµ½´ó²¿·ÖÔ¤¹ÀÓ°Ïì¶¼½ÏÁ¿Æð¾¢¡£¡£¡£¡£¡£¡£¡£¹ØÓÚÖÃÐÅˮƽ½ÏµÍµÄ»ñʤÉÌÆ·ÐÎò£¬£¬£¬£¬£¬£¬£¬Äú»á×¢ÖØµ½¡°½Ï²î°¸Àý¡±µÄÓ°Ïì¿ÉÄÜÊǸºÃæµÄ¡£¡£¡£¡£¡£¡£¡£ÕâÊÇÓÉÓÚÊÔÑéʱ´úЧ¹û½Ï²îµÄÉÌÆ·ÐÎòÏÖʵÉÏÈÔÓпÉÄÜËæ×Åʱ¼äµÄÍÆÒÆÐ§¹û¸üºÃһЩ¡£¡£¡£¡£¡£¡£¡£
Ô¤¹ÀÄ껯ӰÏì
ÒªÕ¹ÍûÒ»ÄêÄÚµÄÓ°Ï죬£¬£¬£¬£¬£¬£¬ÎÒÃÇ»áÅÌËã»ñʤÉÌÆ·ÐÎòµÄÈÕ¾ùÏúÁ¿ÔöÌíÊý£¬£¬£¬£¬£¬£¬£¬È»ºó³ËÒÔ 365¡£¡£¡£¡£¡£¡£¡£ÕâÊÇÒ»¸ö¹ÀËãÖµ£¬£¬£¬£¬£¬£¬£¬ÆäÖÐûÓÐ˼Á¿¼¾½ÚÐÔ¡¢¼ÛǮת±ä»òÆäËûÓ°ÏìÄúÏÖʵӪҵµÄÒòËØ£»£»£»£»£»£»´ËÖµ½ö¹©²Î¿¼£¬£¬£¬£¬£¬£¬£¬ÎÒÃDz»¿É°ü¹ÜÈκÎÊÕÒæÔöÌí¡£¡£¡£¡£¡£¡£¡£
¡¾¿ÉÄÜ¡¿ÁÐÏÔʾµÄÊÇÎÒÃÇÅÌËãµÄ¿ÉÄÜЧ¹û¹æÄ£µÄÖÐÐÄÖµ (50%)¡£¡£¡£¡£¡£¡£¡£¡¾×î¼Ñ°¸Àý¡¿ºÍ¡¾½Ï²î°¸Àý¡¿ÁÐÏÔʾÕâЩЧ¹ûµÄ 95% ÖÃÐÅÇø¼ä¡£¡£¡£¡£¡£¡£¡£
ÎÞ¶¨ÐÔЧ¹û
ÊÔÑ鿢ʺó¿ÉÄÜ»áÏÔʾÎÞ¶¨ÐÔЧ¹û£¬£¬£¬£¬£¬£¬£¬»ò˵Ã÷ij¸ö°æ±¾µÄÉÌÆ·ÐÎòÓÅÓÚÁíÒ»¸ö°æ±¾µÄÖÃÐÅˮƽ½ÏµÍµÄЧ¹û¡£¡£¡£¡£¡£¡£¡£²»¹ý£¬£¬£¬£¬£¬£¬£¬ÕâЩЧ¹ûÈÔÈ»ºÜÓмÛÖµ¡£¡£¡£¡£¡£¡£¡£
ÒÔÏÂÊǵ¼ÖÂÊÔÑéµÃ³öÎÞ¶¨ÐÔЧ¹ûµÄһЩԵ¹ÊÔÓÉ£º
Äú¶ÔÉÌÆ·ÐÎòËù×öµÄ¸ü¸Ä·ù¶È̫С£¡£¡£¡£¡£¡£¡£¬£¬£¬£¬£¬£¬£¬ÎÞ·¨ÏÔÖø¸Ä±äÂò¼ÒÐÐΪ
Á÷Á¿²»·ó¸ß£¬£¬£¬£¬£¬£¬£¬È±·¦ÒÔÈ·¶¨ÖÃÐÅˮƽ½Ï¸ßµÄ»ñʤÉÌÆ·ÐÎò
Äú²âÊÔµÄÁ½¸ö°æ±¾µÄÉÌÆ·ÐÎòÔÚÍÆ¶¯ÏúÁ¿·½ÃæÓµÓÐÏàËÆµÄЧ¹û
´ó´ó¶¼Âò¼ÒÔÚ×ö³ö¹ºÖþöÒéʱ²¢²»ÌåÌùÄú¶ÔÉÌÆ·ÐÎò×öµÄ¸ü¸Ä
ÔÚʵÑéÃ÷È·ÎÞ¶¨ÐÔЧ¹ûʱ£¬£¬£¬£¬£¬£¬£¬Çë²Î¿¼ÄúµÄÊÔÑé¼ÙÉè¡£¡£¡£¡£¡£¡£¡£ÀýÈ磬£¬£¬£¬£¬£¬£¬Æ¾Ö¤ÄúµÄ¸ü¸ÄÄÚÈÝ£¬£¬£¬£¬£¬£¬£¬ÎÞ¶¨ÐÔЧ¹û»á¸æËßÄúijÖÖÀàÐ͵ÄÉÌÆ·ÐÎò²»ÖµµÃͶ×Ê£¬£¬£¬£¬£¬£¬£¬ÓÉÓÚËü²»»áÓ°ÏìÂò¼ÒÐÐΪ¡£¡£¡£¡£¡£¡£¡£»£»£»£»£»£»òÕߣ¬£¬£¬£¬£¬£¬£¬Äú¿ÉÒÔ»ñÖªÁ½ÖÖÍÆÏúÉÌÆ·µÄ·½·¨ÓÐÒ»ÂÉЧ¹û¡£¡£¡£¡£¡£¡£¡£Äú¿ÉÒÔÔËÐÐÆäËûÊÔÑéÀ´ÑéÖ¤ÄúÔÚ֮ǰ²âÊÔÖеķ¢Ã÷¡£¡£¡£¡£¡£¡£¡£
ÊÔÑéÒªÁì
ÕâЩÓйØÊÔÑéÒªÁìµÄ˵Ã÷¿É×ÊÖúÄúÏàʶÎÒÃÇÔõÑùÑ¡ÔñÊÔÑéʤ³öÊé¼®£¬£¬£¬£¬£¬£¬£¬ÊµÏÖÏîĿЧ¹û£»£»£»£»£»£»²»¹ý£¬£¬£¬£¬£¬£¬£¬ÊÔÑé²¢·ÇÇ¿ÖÆÒªÇ󡣡£¡£¡£¡£¡£¡£
ÊÔÑé»ùÓÚСÎÒ˽¼ÒÂò¼ÒÕË»§¡£¡£¡£¡£¡£¡£¡£ÔÚÊÔÑéʱ´ú£¬£¬£¬£¬£¬£¬£¬Ã¿¸ö¿´µ½ÄúµÄÉÌÆ·ÐÎòµÄÂò¼ÒÕË»§¶¼±»ÊÓΪÊÔÑéµÄÒ»²¿·Ö¡£¡£¡£¡£¡£¡£¡£Âò¼Ò»áËæ»ú·ÖÅɵ½Ä³¸ö°æ±¾µÄÉÌÆ·ÐÎò£¬£¬£¬£¬£¬£¬£¬Ö»ÒªÔÚÊÔÑéʱ´úʶ±ðµ½¸ÃÂò¼Ò£¬£¬£¬£¬£¬£¬£¬ÏµÍ³¾Í»áΪÆäÏÔʾͳһÏîÉÌÆ·ÐÎò£¬£¬£¬£¬£¬£¬£¬²»ÊÜ×°±¸ÀàÐÍ»òÆäËûÒòËØµÄÓ°Ïì¡£¡£¡£¡£¡£¡£¡£Ñù±¾Á¿²»°üÀ¨ÎÞ·¨Ê¶±ðÂò¼ÒµÄÒ³ÃæµÄ»á¼ûÁ¿¡£¡£¡£¡£¡£¡£¡£ÎÒÃÇ¿ÉÄÜ»á´ÓÑù±¾ÖÐ×Ô¶¯É¾³ýijЩÀàÐ͵ÄÊý¾Ý£¨Èçͳ¼ÆÒì³£Öµ£©£¬£¬£¬£¬£¬£¬£¬ÒÔÌá¸ßЧ¹ûµÄ׼ȷÐÔ¡£¡£¡£¡£¡£¡£¡£
ÎÒÃÇʹÓñ´Ò¶Ë¹ÆÊÎöÒªÁìÀ´ÆÊÎöÊÔÑéЧ¹û¡£¡£¡£¡£¡£¡£¡£ÕâÒâζ×ÅÎÒÃÇ»áÆ¾Ö¤Ä£×ÓºÍÏÖʵÊÔÑéЧ¹û¹¹½¨Ò»¸ö¸ÅÂÊÂþÑÜģʽ¡£¡£¡£¡£¡£¡£¡£ÎÒÃǻᱨ¸æºóÑé¸ÅÂÊÂþÑܵį½¾ùЧӦֵ£¨¾ÍÉÌÆ·ÊýĿת±ä¶øÑÔ£©ÒÔ¼° 95% ÖÃÐÅÇø¼ä£¨Ò²³ÆÎª¡°¿ÉÐÅÇø¼ä¡±£©£¬£¬£¬£¬£¬£¬£¬²¢ÔÚÊÔÑéʱ´úƾ֤´Ó×îÏÈÒÔÀ´ÍøÂçµÄËùÓÐÊÔÑéÊý¾ÝÿÖܸüС£¡£¡£¡£¡£¡£¡£»£»£»£»£»£»ñʤ´¦Öóͷ£µÄÖÃÐŶÈÊÇÖ¸¼¸ÂÊÂþÑÜÖлá¶ÔÉÌÆ·ÏúÊÛ±¬·¢Æð¾¢Ó°ÏìµÄЧ¹ûËùÕ¼µÄ°Ù·Ö±È¡£¡£¡£¡£¡£¡£¡£
ÒªÕ¹ÍûÒ»ÄêµÄÓ°Ï죬£¬£¬£¬£¬£¬£¬ÎÒÃÇ»áÅÌËãÊÔÑéʱ´úÌìÌìÓ®µÃºÍʧȥµÄ´¦Öóͷ£ÏúÊÛÁ¿µÄƽ¾ù²îÖµ£¬£¬£¬£¬£¬£¬£¬È»ºó³ËÒÔ 365¡£¡£¡£¡£¡£¡£¡£ÎÒÃÇÆ¾Ö¤ºóÑé¸ÅÂÊÂþÑÜÌṩӰÏìÁ¦ 95% ÖÃÐÅÇø¼ä¡£¡£¡£¡£¡£¡£¡£
ÑÇÂíÑ·¹ÙÍøÔÎÄÏêÇ飺
Experiment Results
We¡¯ll update your experiment results every few weeks until it ends. You can access your results by clicking on the experiment name in the experiments dashboard. Don¡¯t end your experiment based on early results, as those can be misleading. Instead, wait for your experiment to end before deciding what content to publish.
Tip: When your experiment ends, make sure to publish the winning content by re-submitting it in the A+ content manager.
Interpreting Results
Based on the data collected during the experiment, we calculate a range of possible impacts of publishing each piece of content. Results are aggregated for all enrolled ASINs in an experiment. We provide a few kinds of results:
Probability that one version of content is better. For example, if we say there is a 75% probability that Version A is better, that means that 75% of the possible impacts that we calculated show a likely positive units/sales lift from publishing Version A.
For each version of content, we show: Units, sales, conversion rate, units sold per unique visitor, and sample size assigned to that version. The conversion rate is the percentage of unique visitors in the experiment who saw the A+ content and made a purchase. Sample size is the count of unique visitors who saw each version of content. Units per unique visitor is units divided by sample size.
Projected one-year impact. This section is only populated for completed experiments. It shows an estimate of the possible incremental units and sales over the next year from publishing the winning version of content. For high-confidence winners, you will notice that most of the projected impacts are positive. For low-confidence winners, you will notice that the ¡®worse case¡¯ impact may be negative. This is because there is still a chance that the content that performed worse during the experiment may actually perform better over time.
Projected One-Year Impact
To project one year impact, we calculate the average daily sales increase of the winning content and multiply by 365. This is an estimate which doesn¡¯t take into account seasonality, price changes, or other factors that would affect your business in the real world; it is provided for informational purposes only and we cannot guarantee any incremental benefits.
The Likely column shows the median (the 50th percentile) of the range of possible outcomes we calculated. The Best Case and Worse Case columns show the 95% confidence interval of those outcomes.
Inconclusive Results
An experiment can end with results that are inconclusive, or results that show a low confidence that one version of content is better than another. However, these results can still be valuable.
Here are some reasons why an experiment may have inconclusive results:
The change you made to your content was too small to significantly change customer behavior
There wasn¡¯t enough traffic to determine the winning content with high confidence
The two versions of content you tested were similarly effective in driving sales
The change you made to your content isn¡¯t something that most customers care about when making a purchase decision
Refer to your experiment hypothesis when trying to make sense of inconclusive results. For example, depending on what you changed, an inconclusive result can tell you that a certain type of content isn¡¯t worth investing in because it doesn¡¯t affect customer behavior. Or, it can tell you that two ways of merchandising your product are similarly effective. You can run additional experiments to confirm what you¡¯ve learned from your earlier tests.
Experiment Methodology
These notes on experiment methodology may help you understand how we choose an experiment winner and project impact; however, this is not required to run an experiment.
Experiments are based on individual customer accounts. During an experiment, each customer account that sees your content is considered part of the experiment. Customers are randomly assigned to view one version of content will see that content persistently for the duration of the experiment regardless of device type or other factors, as long as the customer can be identified. Visits to your page where a customer cannot be identified are not included in the sample size. We may automatically remove certain types of data from the sample to improve the accuracy of results, such as statistical outliers.
We use a Bayesian approach to analyze experiment results. This means we construct a probability distribution based on a model as well as the actual results of the experiment. We report the mean effect size (in terms of change in units) as well as the 95% confidence interval (also known as a credible interval) of the posterior probability distribution, which is updated weekly during the experiment based on all experiment data collected since the start. The confidence of a winning treatment is the percentage of outcomes in the probability distribution that show a positive unit sales impact.
To project one year impact, we compute the average difference between the winning and losing treatment sales per day for the duration of the experiment so far and multiply by 365. We provide a 95% confidence interval for the impact which is based on the posterior probability distribution.
ÎÄÕÂȪԴ£ºÑÇÂíÑ·¹Ù·½ÍøÕ¾
- 1LazadaµêËÁ²úÆ·±»Ï¼ÜÁ˸ÃÔõô°ì£¿£¿£¿£¿£¿
- 2¿ç¾³×ÔÁ¦Õ¾ÔËÓªµÄËĸöϸ½ÚÎÊÌâ
- 3¿ç¾³ºÏ¹æ°üÀ¨ÄÄЩÏîÄ¿
- 4shopeęÍåÕ¾¶Ô´ó½µÄÍË»õÓöȼ°Á÷³ÌÏÈÈÝ
- 5ÑÇÂíÑ·Âô¼Ò¿ªµêÔõÑùÑ¡Ôñ²úÆ·Öֱ𣿣¿£¿£¿£¿
- 6ÑÇÂíѷѡƷÎóÇøºÍѡƷ˼Ð÷
- 7ÑÇÂíÑ·Âô¼ÒÎÞ»õԴģʽ¿ªµêÐèÒªÖªµÀµÄһЩÒþ²ØÏÝÚå
- 8¿ç¾³ÍøÂçÊг¡µ÷ÑеÄÖ÷ÒªÐÔ
- 9Ñ¡Ôñ¶¶Òôƽ̨µÄÔµ¹ÊÔÓÉ
- 10Facebook¹ã¸æÒª¼à¿ØµÄ»ù±¾Ö¸±êÓÐÄÄЩ£¿£¿£¿£¿£¿