๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ
Data Analysis/Growth Hacking

A/B test ๊ด€๋ จ ํ•™์Šต์ž๋ฃŒ

by Hagrid 2022. 12. 8.
๋ฐ˜์‘ํ˜•

A/B TEST ๊ธฐ๋ณธ ์ž๋ฃŒ

๐Ÿ– a/b test ๊ณ„์‚ฐ๊ธฐ : https://abtestguide.com/calc/

 

A/B-Test Calculator - Power & Significance - ABTestGuide.com

Std. Error of difference SEdifference = ( SEA2 + SEB2 )1/2

abtestguide.com

๐Ÿ– a/b test ๊ณ„์‚ฐ๊ธฐ๋ฅผ ์จ๋„ ๋˜๋Š”๊ฐ€ ? https://yozm.wishket.com/magazine/detail/1325/

 

A/B ํ…Œ์ŠคํŠธ ๊ฒฐ๊ณผ, ์ด๊ฒŒ ๋งž์•„? | ์š”์ฆ˜IT

์ด ๊ธ€์€ A/B ํ…Œ์ŠคํŠธ ๊ฒ€์ฆ ๋ฐฉ๋ฒ•๊ณผ ๊ด€๋ จ๋œ ๋ช‡ ๊ฐ€์ง€ ํŒ์„ ๋“œ๋ฆฝ๋‹ˆ๋‹ค. ์ €๋Š” ์ฒ˜์Œ์— ์ „ํ™˜์œจ์„ PV๋กœ ๊ณ„์‚ฐํ•ด์•ผ ํ•˜๋Š”์ง€, UV๋กœ ๊ณ„์‚ฐํ•ด์•ผ ํ•˜๋Š”์ง€๋ถ€ํ„ฐ ํ—ท๊ฐˆ๋ ธ์Šต๋‹ˆ๋‹ค. ๊ทธ๋ž˜์„œ ์ธก์ • ๊ธฐ์ค€์„ ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ•๋ถ€ํ„ฐ ์‹œ์ž‘

yozm.wishket.com

๐Ÿ– https://yozm.wishket.com/magazine/detail/1012/

 

p๊ฐ’? ์‹ ๋ขฐ๊ตฌ๊ฐ„? AB ํ…Œ์ŠคํŠธ๋ฅผ ์™„์„ฑํ•˜๋Š” ํ†ต๊ณ„ ๋ถ„์„, ๊ธฐ๋ณธ ๊ฐœ๋… ์žก๊ธฐ | ์š”์ฆ˜IT

ํ•œ ๋ฒˆ์ด๋ผ๋„ AB ํ…Œ์ŠคํŠธ๋ฅผ ๋Œ๋ ค๋ณธ๋‹ค๋ฉด ๊ฒฐ๊ณผ ๋ถ„์„์ด ์ƒ๊ฐ๋ณด๋‹ค ์–ด๋ ค์šด ์ผ์ž„์„ ๊นจ๋‹ซ๊ฒŒ ๋ฉ๋‹ˆ๋‹ค. ๋ป”ํžˆ ๋ˆˆ์— ๋ณด์ด๋Š” ๊ฒฐ๊ณผ, ์ˆ˜์น˜์ธ๋ฐ ๋งค๋ฒˆ ํ•ด์„ํ•˜๊ธฐ๊ฐ€ ๋‚œ๊ฐํ•ฉ๋‹ˆ๋‹ค. ๋”ฐ๋ผ์„œ ์ด๋ฒˆ ๊ธ€์—์„œ AB ํ…Œ์ŠคํŠธ ๊ฒฐ๊ณผ๋ฅผ

yozm.wishket.com

๐Ÿ– https://angeloyeo.github.io/2021/01/05/confidence_interval.html

 

์‹ ๋ขฐ ๊ตฌ๊ฐ„์˜ ์˜๋ฏธ - ๊ณต๋Œ์ด์˜ ์ˆ˜ํ•™์ •๋ฆฌ๋…ธํŠธ

 

angeloyeo.github.io

๐Ÿ– ์ง€ํ‘œ์„ ์ • : https://bigsol.atlassian.net/wiki/spaces/YFJMS/pages/9863246

 

Log in with Atlassian account

We tried to load scripts but something went wrong. Please make sure that your network settings allow you to download scripts from the following domain: https://aid-frontend.prod.atl-paas.net/atlassian-id/front-end/5.0.396

id.atlassian.com

๐Ÿ– https://blog.hackle.io/post/abtest-bucketing

 

ํ•ตํด ๋ธ”๋กœ๊ทธ(Hackle Blog) : A/Bํ…Œ์ŠคํŠธ์—์„œ ๊ฐ€์žฅ ์ค‘์š”ํ•œ ์‚ฌ์šฉ์ž ๋ถ„๋ฐฐ ๋ฐฉ๋ฒ•๊ณผ ๊ณ ๋ คํ•  ์ 

A/B ํ…Œ์ŠคํŠธ์—์„œ ์‚ฌ์šฉ์ž๋ฅผ ๋ฌด์ž‘์œ„๋กœ ๋ถ„๋ฐฐํ• ๋•Œ ๊ณ ๋ คํ•ด์•ผ ํ•˜๋Š” ๊ฒƒ์— ๋Œ€ํ•ด ์•Œ๋ ค๋“œ๋ฆฝ๋‹ˆ๋‹ค.

blog.hackle.io

๐Ÿ– https://medium.com/daangn/1%EC%A3%BC-1%EA%B0%9C-%EC%8B%A4%ED%97%98%ED%95%98%EB%8A%94-%ED%94%84%EB%A1%9C%EB%8D%95%ED%8A%B8-%ED%8C%80%EC%9D%B4-%EB%90%98%EB%8A%94-%EC%97%AC%EC%A0%95-b8a4c337a8e1

 

1์ฃผ 1๊ฐœ ์‹คํ—˜ํ•˜๋Š” ํ”„๋กœ๋•ํŠธ ํŒ€์ด ๋˜๋Š” ์—ฌ์ •

์•ˆ๋…•ํ•˜์„ธ์š” ๋‹น๊ทผ๋งˆ์ผ“ ์ค‘๊ณ ๊ฑฐ๋ž˜ํŒ€์—์„œ ๋ฐ์ดํ„ฐ ๋ถ„์„๊ฐ€๋กœ ์ผํ•˜๊ณ  ์žˆ๋Š” ๋งคํŠœ์—์š”!

medium.com

๐Ÿ– https://towardsdatascience.com/the-essential-guide-to-sample-ratio-mismatch-for-your-a-b-tests-96a4db81d7a4

 

The essential guide to Sample Ratio Mismatch for your A/B tests

If you can’t trust the result of an experiment, you can’t trust the decisions you make based on it; and you’d be surprised how often you…

towardsdatascience.com

A/B TEST ๊ด€๋ จ ์‹ฌํ™” ์ž๋ฃŒ

๐Ÿ“Œ A/B ํ…Œ์ŠคํŠธ์˜ ํ™•์žฅํŒ, MAB (Multi-Armed Bandits) ์•Œ๊ณ ๋ฆฌ์ฆ˜

 

A/B ํ…Œ์ŠคํŠธ์˜ ํ™•์žฅํŒ, MAB (Multi-Armed Bandits) ์•Œ๊ณ ๋ฆฌ์ฆ˜

์ด๋ฒˆ ํฌ์ŠคํŒ…์—์„œ๋Š” A/B ํ…Œ์ŠคํŠธ์˜ ํ™•์žฅํŒ์ด๋ผ ๋ณผ ์ˆ˜ ์žˆ๋Š” MAB (Multi-Armed Bandits) ์•Œ…

playinpap.github.io

๐Ÿ“Œ ๋ฒ ์ด์ง€์•ˆ A/B ํ…Œ์ŠคํŠธ in Python

 

๋ฒ ์ด์ง€์•ˆ A/B ํ…Œ์ŠคํŠธ in Python

๋ฒ ์ด์ง€์•ˆ ๊ด€์ ์—์„œ AB Test๋ฅผ ํ•˜๋Š” ๋ฐฉ๋ฒ•์— ๋Œ€ํ•ด ์ •๋ฆฌํ–ˆ์Šต๋‹ˆ๋‹ค. ์ „์ฒด ์ฝ”๋“œ๋Š” ์—ฌ๊ธฐ ์—์„œ ํ™•์ธํ•  ์ˆ˜ …

playinpap.github.io

๐Ÿ“Œ A/B ํ…Œ์ŠคํŠธ์—์„œ ์˜๋ฏธ์žˆ๋Š” ํšจ๊ณผ ๊ธฐ์ค€ (MDE)์„ ์„ค์ •ํ•˜๋Š” ๋ฐฉ๋ฒ•

 

A/B ํ…Œ์ŠคํŠธ์—์„œ ์˜๋ฏธ์žˆ๋Š” ํšจ๊ณผ ๊ธฐ์ค€ (MDE)์„ ์„ค์ •ํ•˜๋Š” ๋ฐฉ๋ฒ•

๋ถ€์ œ: A/B ํ…Œ์ŠคํŠธ์˜ ๊ฐ€์žฅ ์ฐพ๊ธฐ ํž˜๋“  ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ์•Œ์•„๋ณด๊ธฐ ์ด ๊ธ€์€ ๊ฐœ์ธ ๋ธ”๋กœ๊ทธ ์— ๋จผ์ € ์ž‘์„ฑ๋œ ๊ธ€์ž…๋‹ˆ๋‹ค…

playinpap.github.io

๐Ÿ“Œ ๋ฒ ์ด์ง€์•ˆ A/B ํ…Œ์ŠคํŠธ - Bayes theorem

 

๋ฒ ์ด์ง€์•ˆ A/B ํ…Œ์ŠคํŠธ - Bayes theorem

์ด ๊ธ€์€ ์ž‘์„ฑ์ž ๋ธ”๋กœ๊ทธ ์—์„œ๋„ ๋ณด์‹ค ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๋นˆ๋„์ฃผ์˜(Frequentist) vs ๋ฒ ์ด์ง€์•ˆ(Baye…

playinpap.github.io

๐Ÿ“Œ https://yozm.wishket.com/magazine/detail/1034/

 

AB ํ…Œ์ŠคํŠธ ์ธ์‚ฌ์ดํŠธ์˜ ์ƒˆ๋กœ์šด ์ฐจ์›, ๋ฒ ์ด์ง€์•ˆ ํ†ต๊ณ„์  ๊ฐ€์„ค ๊ฒ€์ • | ์š”์ฆ˜IT

AB ํ…Œ์ŠคํŠธ๋ฅผ ํ•˜๊ณ  ๊ฒฐ๊ณผ๋ฅผ ๊ณต์œ ํ•  ๋•Œ๋ฉด ‘๋Œ€์•ˆ์ด ์›๋ณธ๋ณด๋‹ค ๋‚˜์„ ํ™•๋ฅ ’์— ๊ด€ํ•ด ๋ฌผ์–ด๋ณด๋Š” ์‚ฌ๋žŒ์ด ๊ผญ ํ•œ ๋ช…์ฏค์€ ์ƒ๊น๋‹ˆ๋‹ค. ๋‹จ์ˆœํ•œ ์ง€ํ‘œ ๋น„๊ต๋ฅผ ๋„˜์–ด์„œ, AB ํ…Œ์ŠคํŠธ๋กœ ์–ป์€ ๊ฒฐ๊ณผ๊ฐ€ ์ •๋ง๋กœ ์˜๋ฏธ ์žˆ๋Š”์ง€

yozm.wishket.com

 

๋ฐ˜์‘ํ˜•

๋Œ“๊ธ€