๐ŸŽฏ 1๏ธโƒฃ ์•™์ƒ๋ธ” ๊ธฐ๋ฒ• ์ด์ •๋ฆฌ: ํŒ€ํ”Œ ์ „๋žต์ด๋ผ๊ณ  ์ƒ๊ฐํ•˜์ž!

๐Ÿ”น ์•™์ƒ๋ธ”(Ensemble) = ํ˜ผ์ž๋ณด๋‹จ ์—ฌ๋Ÿฟ์ด ํ•จ๊ป˜

๐Ÿ‘‰ ์—ฌ๋Ÿฌ ๊ฐœ์˜ ๋จธ์‹ ๋Ÿฌ๋‹ ๋ชจ๋ธ(ํŒ€์›)์„ ์กฐํ•ฉํ•ด์„œ ๋” ์ข‹์€ ์„ฑ๋Šฅ์„ ๋‚ด๋Š” ๋ฐฉ๋ฒ•

โ†’ ๋งˆ์น˜ ์ถ•๊ตฌ์—์„œ ๊ณต๊ฒฉ์ˆ˜, ์ˆ˜๋น„์ˆ˜, ๊ณจํ‚คํผ๋ฅผ ๋”ฐ๋กœ ์“ฐ๋Š” ๊ฒƒ์ฒ˜๋Ÿผ!


๐Ÿ’ก 4๊ฐ€์ง€ ๋Œ€ํ‘œ ์ „๋žต ์š”์•ฝ

์ „๋žต ์„ค๋ช… ์˜ˆ์‹œ ๋ชจ๋ธ
Bagging ๋ฐ์ดํ„ฐ๋ฅผ ์—ฌ๋Ÿฌ ์กฐ๊ฐ์œผ๋กœ ๋‚˜๋ˆ ์„œ ์—ฌ๋Ÿฌ ๋ชจ๋ธ์— ๋™์‹œ์— ํ•™์Šต์‹œํ‚ด (๋ณ‘๋ ฌํ•™์Šต) Random Forest
Boosting ์•ž์—์„œ ํ‹€๋ฆฐ ๊ฑธ ๋‹ค์Œ ๋ชจ๋ธ์ด ๋ณด์™„ํ•˜๊ฒŒ ๋งŒ๋“ฆ (์ˆœ์ฐจํ•™์Šต) XGBoost, LightGBM
Voting ์„œ๋กœ ๋‹ค๋ฅธ ๋ชจ๋ธ๋“ค์˜ ๊ฒฐ๊ณผ๋ฅผ ๋‹ค์ˆ˜๊ฒฐ ๋˜๋Š” ํ‰๊ท ์œผ๋กœ ๊ฒฐ์ • LogReg + SVM + KNN
Stacking ์—ฌ๋Ÿฌ ๋ชจ๋ธ์˜ ์˜ˆ์ธก ๊ฒฐ๊ณผ๋ฅผ ์ƒˆ๋กœ์šด ์ž…๋ ฅ๊ฐ’์œผ๋กœ โ†’ ์ตœ์ข… ๋ชจ๋ธ์ด ํ•™์Šต Base + Meta ๋ชจ๋ธ

๐Ÿ“Œ ๋น„์œ ๋กœ ์ •๋ฆฌํ•˜๋ฉด?

์ „๋žต ๋น„์œ 
Bagging ๊ฐ™์€ ๋ฌธ์ œ๋ฅผ ์—ฌ๋Ÿฌ ์กฐ๋ณ„ ๊ณผ์ œ๋กœ ๋‚˜๋ˆ  ํ’€๊ณ , ๊ฒฐ๊ณผ๋ฅผ ํ‰๊ท ๋ƒ„
Boosting ์•ž์‚ฌ๋žŒ์ด ํ‹€๋ฆฐ ๊ฑธ ๋’ท์‚ฌ๋žŒ์ด ๊ณ ์น˜๋ฉด์„œ ์ ์  ์ •๋‹ต์— ๊ฐ€๊นŒ์›Œ์ง
Voting ์„œ๋กœ ๋‹ค๋ฅธ ์˜๊ฒฌ์„ ๊ฐ€์ง„ ์นœ๊ตฌ๋“คํ•œํ…Œ ์„ค๋ฌธ ๋Œ๋ ค์„œ ๋‹ค์ˆ˜๊ฒฐ๋กœ ๊ฒฐ์ •
Stacking ์—ฌ๋Ÿฌ ์ „๋ฌธ๊ฐ€๊ฐ€ ์˜ˆ์ธกํ•œ ๊ฒฐ๊ณผ๋ฅผ ๋ชจ์•„, ๊ทธ๊ฒƒ๋งŒ ์ „๋ฌธ์œผ๋กœ ๋ถ„์„ํ•˜๋Š” ๋ฉ”ํƒ€ ์ „๋ฌธ๊ฐ€๊ฐ€ ์ตœ์ข… ํŒ๋‹จ

๐Ÿ” 2๏ธโƒฃ Boosting: XGBoost vs LightGBM ์‹œ๊ฐํ™” ์š”์•ฝ

๐ŸŒณ ํŠธ๋ฆฌ ๊ตฌ์กฐ ์ฐจ์ด: ์–ด๋–ป๊ฒŒ ๋ถ„๊ธฐ์ ์„ ๋งŒ๋“ค๊นŒ?

ํ•ญ๋ชฉ XGBoost LightGBM
ํŠธ๋ฆฌ ์„ฑ์žฅ ๋ฐฉ์‹ Level-wise (์ˆ˜ํ‰์ ์œผ๋กœ ๊ท ํ˜•์žˆ๊ฒŒ) Leaf-wise (๊ฐ€์žฅ ์†์‹ค ํฐ ๋ฆฌํ”„๋ถ€ํ„ฐ ์ˆ˜์ง์ ์œผ๋กœ)
์†๋„ ๋А๋ฆฐ ํŽธ (๊ท ํ˜• ์œ ์ง€) ๋น ๋ฆ„ (์ตœ์  ๋…ธ๋“œ๋ถ€ํ„ฐ ๊ณต๊ฒฉ)
๋ฉ”๋ชจ๋ฆฌ ์‚ฌ์šฉ ๋” ๋งŽ์ด ์‚ฌ์šฉ ๋” ์ ๊ฒŒ ์‚ฌ์šฉ
๋ฒ”์ฃผํ˜• ์ฒ˜๋ฆฌ One-hot ํ•„์š” ์ž๋™ ์ฒ˜๋ฆฌ ๊ฐ€๋Šฅ

๐Ÿ“Œ Leaf-wise ๋ฐฉ์‹์€ ์„ฑ๋Šฅ์ด ๋›ฐ์–ด๋‚˜์ง€๋งŒ ๊ณผ์ ํ•ฉ ์œ„ํ—˜์ด ์žˆ์–ด.

โ†’ ๋Œ€๋Ÿ‰์˜ ๋ฐ์ดํ„ฐ์ผ ๋•Œ LightGBM์ด ๊ฐ•๋ ฅํ•จ!


๐Ÿงช 3๏ธโƒฃ ๊ณผ์ ํ•ฉ์ด ๋ญ”๋ฐ? โ†’ ๋ชจ๋ธ์ด ๋„ˆ๋ฌด ์™ธ์šด ๊ฑฐ์•ผ!