๐Ÿ”ฅ[Ship to Production] ์˜คํ”ˆ ํ”„๋กœ์ ํŠธ ์‹œ์ฆŒ 2 ํ–‰์‚ฌ (4์›” 4์ผ) - AI์™€ ํ•จ๊ป˜ ํ˜„์žฅ์— ํ•„์š”ํ•œ ํ”„๋กœ์ ํŠธ ๊ณต๊ฐœ

[Ship to Production] ์˜คํ”ˆ ํ”„๋กœ์ ํŠธ ์‹œ์ฆŒ2 - ํ˜„์—… ์ข…์‚ฌํ•˜๋Š” Bro๋ถ„๋“ค์ด ํ˜„์—…์— ํ•„์š”ํ•œ ๋‹ค์–‘ํ•œ ํ”„๋กœ์ ํŠธ๋ฅผ ๊ณต๊ฐœํ•ฉ๋‹ˆ๋‹ค.:fire:

โ‘  Dr.Kube | K8s ์žฅ์•  ์ž๋™ ์ง„๋‹จ ๋ฐ ๋ณต๊ตฌ AI ์—์ด์ „ํŠธ (๋ฐœํ‘œ : Jonghwa Baek)

  • Tried: Prometheus ๋ฉ”ํŠธ๋ฆญ ๊ธฐ๋ฐ˜ ์ด์ƒ ํƒ์ง€ ํŒŒ์ดํ”„๋ผ์ธ์„ ๊ตฌ์ถ•ํ•˜๊ณ , ์ž„๊ณ„๊ฐ’ ๋„๋‹ฌ ์‹œ ์ž๋™์œผ๋กœ ํŒŒ๋“œ๋ฅผ ์žฌ์‹œ์ž‘ํ•˜๋Š” ์ œ์–ด ๋กœ์ง ์„ค๊ณ„
  • Failed: ์ž๋™ ๋ณต๊ตฌ ์Šคํฌ๋ฆฝํŠธ๊ฐ€ ์‹คํ–‰๋  ๋•Œ, ๋ฆฌ์†Œ์Šค ๋ถ€์กฑ์œผ๋กœ ์Šคํฌ๋ฆฝํŠธ ์ž์ฒด๊ฐ€ ํƒ€์ž„์•„์›ƒ๋˜๋Š” ๋ฐ๋“œ๋ฝ์ด ๋ฐœ์ƒํ–ˆ์Šต๋‹ˆ๋‹ค. ์ข…์†์„ฑ ์žˆ๋Š” ์„œ๋น„์Šค๋“ค์ด ์ˆœ์ฐจ์ ์œผ๋กœ ์‚ด์•„๋‚˜์ง€ ์•Š์•„ ์—ฐ์‡„ ์žฅ์• ๋ฅผ ์ผ์œผํ‚ด
  • Learned: "๋ฌด์—‡์„ ์ž๋™ํ™”ํ•  ๊ฒƒ์ธ๊ฐ€"๋ณด๋‹ค "์–ธ์ œ ์ž๋™ํ™”๋ฅผ ๋ฉˆ์ถœ ๊ฒƒ์ธ๊ฐ€"๊ฐ€ ๊ฐ€์šฉ์„ฑ์„ ๊ฒฐ์ •ํ•จ. ๋ณต๊ตฌ ๋กœ์ง์— Graceful Shutdown๊ณผ Health Check ๋Œ€๊ธฐ ์‹œ๊ฐ„์„ ์„ธ๋ฐ€ํ•˜๊ฒŒ ๋ฐ˜์˜ํ•ด์•ผ ํ•œ๋‹ค๋Š” ์ธ์‚ฌ์ดํŠธ๋ฅผ ์–ป์Œ

โ‘ก Gopedia | Enterprise Knowledge Graph (๋ฐœํ‘œ : Dong-Ho Shin)

  • Tried: ํฉ์–ด์ง„ ๊ธฐ์ˆ  ๋ฌธ์„œ๋ฅผ ๋ฒกํ„ฐ DB์— ์ƒ‰์ธํ•˜๊ณ  LLM์„ ์—ฐ๋™ํ•œ RAG ๊ฒ€์ƒ‰ ์‹œ์Šคํ…œ ๊ตฌ์ถ•
  • Failed: ๊ธฐ์ˆ  ๋ฌธ์„œ ํŠน์œ ์˜ ์ฝ”๋“œ ๋ธ”๋ก๊ณผ ๋„ํ‘œ๊ฐ€ ํŒŒ์‹ฑ ๊ณผ์ •์—์„œ ํ…์ŠคํŠธ๋กœ ์ž˜๋ฆฌ๋ฉด์„œ ๊ฒ€์ƒ‰ ํ’ˆ์งˆ์ด ๊ธ‰๊ฒฉํžˆ ๋–จ์–ด์กŒ์Šต๋‹ˆ๋‹ค. ๋‹จ์ˆœ ํ…์ŠคํŠธ ๋งค์นญ์œผ๋กœ๋Š” ๊ธฐ์ˆ  ์šฉ์–ด ๊ฒ€์ƒ‰์ด ๋ถˆ๊ฐ€๋Šฅํ–ˆ์Œ
  • Learned: ๋‹จ์ˆœ ์ž„๋ฒ ๋”ฉ๋งŒ์œผ๋กœ๋Š” ๊ธฐ์ˆ ์  ๋งฅ๋ฝ์„ ํŒŒ์•…ํ•  ์ˆ˜ ์—†์Œ. ๊ณ„์ธต์  ์ •๋ณด ๊ตฌ์กฐํ™” ์ „๋žต์ด ํ•„์ˆ˜์ด๋ฉฐ, ์‹œ๋งจํ‹ฑ ๊ฒ€์ƒ‰์œผ๋กœ์˜ ์ „ํ™˜์ด ํ•„์š”ํ•˜๋‹ค๋Š” ๊ฒฐ๋ก ์„ ์–ป์Œ

โ‘ข HoneyBeePF | eBPF ๊ธฐ๋ฐ˜ ์„ ํƒ์  ๊ด€์ธก์„ฑ ํ”Œ๋žซํผ (๋ฐœํ‘œ: Minjin Park)

  • Tried: ๊ฐœ๋ฐœ์ž๊ฐ€ K8s ์„ค์ •์„ ๋ชฐ๋ผ๋„ ๋ฐฐํฌํ•  ์ˆ˜ ์žˆ๋„๋ก Backstage ๊ธฐ๋ฐ˜ ํฌํ„ธ์„ ๊ตฌ์ถ•ํ•˜๊ณ , ArgoCD๋ฅผ ํ†ตํ•œ GitOps ํŒŒ์ดํ”„๋ผ์ธ์„ ํ‘œ์ค€ํ™”
  • Failed: ํ•˜๋‚˜์˜ ํ…œํ”Œ๋ฆฟ์œผ๋กœ ๋ชจ๋“  ํŒ€์˜ ์š”๊ตฌ์‚ฌํ•ญ์„ ๋‹ด์œผ๋ ค๋‹ค ์„ค์ • ํŒŒ์ผ์ด ๊ณผ๋„ํ•˜๊ฒŒ ๋ณต์žกํ•ด์กŒ์Šต๋‹ˆ๋‹ค. ์ธํ”„๋ผ๋ฅผ ์ถ”์ƒํ™”ํ• ์ˆ˜๋ก ์˜คํžˆ๋ ค ํ™•์žฅ์„ฑ์ด ๋ง‰ํžˆ๋Š” ์—ญ์„ค์— ๋ถ€๋”ชํž˜
  • Learned: "๋งŒ๋Šฅ ํ…œํ”Œ๋ฆฟ"์€ ๋ถˆ๊ฐ€๋Šฅ, ์ตœ์†Œํ•œ์˜ ๊ณตํ†ต ๊ทœ์•ฝ๋งŒ ๊ฐ•์ œํ•˜๊ณ  ๋‚˜๋จธ์ง€๋Š” ์ž์œจ์„ฑ์„ ์ฃผ๋Š” ๊ฐ€๋“œ๋ ˆ์ผ(Guardrail) ๋ฐฉ์‹์ด ์‹ค๋ฌด์ ์ด๋ผ๋Š” ํ•ฉ์˜๋ฅผ ๋งŒ๋“ฆ

โ‘ฃ KubeAI | ์ž์—ฐ์–ด ๊ธฐ๋ฐ˜ K8s ์šด์˜ AI ๋Œ€์‹œ๋ณด๋“œ (๋ฐœํ‘œ: ๊น€์˜์ฃผ, CHAE HWA KWAK)

  • Tried: ๋ฉ€ํ‹ฐ ํ…Œ๋„ŒํŠธ ํ™˜๊ฒฝ์—์„œ GPU ๋ฆฌ์†Œ์Šค๋ฅผ ๋ถ„ํ•  ํ• ๋‹นํ•˜๊ณ , Karpenter๋กœ ํ•„์š”ํ•œ ์ˆœ๊ฐ„์—๋งŒ ๋…ธ๋“œ๋ฅผ ์ƒ์„ฑ/์‚ญ์ œํ•˜๋Š” Dynamic Scaling ๊ตฌํ˜„
  • Failed: ์Šค์ผ€์ค„๋Ÿฌ๊ฐ€ ๋…ธ๋“œ๋ฅผ ๋‚ด๋ฆฌ๋Š” ํƒ€์ด๋ฐ๊ณผ ๋ชจ๋ธ์˜ ์ฒดํฌํฌ์ธํŠธ ์ €์žฅ ํƒ€์ด๋ฐ์ด ๋งž์ง€ ์•Š์•„ ํ•™์Šต ๋ฐ์ดํ„ฐ๊ฐ€ ์œ ์‹ค๋จ. ๋ฉ”๋ชจ๋ฆฌ ์˜ˆ์ธก ๋ชจ๋ธ์ด OOM์„ ๊ฐ์ง€ํ•˜์ง€ ๋ชปํ•ด ๋…ธ๋“œ๊ฐ€ ํ†ต์งธ๋กœ ๋‹ค์šด๋˜๋Š” ๊ฒฝํ—˜
  • Learned: AI ์›Œํฌ๋กœ๋“œ๋Š” ์ผ๋ฐ˜ ์„œ๋น„์Šค์™€ ๋‹ฌ๋ฆฌ ์Šคํ…Œ์ดํŠธํ’€ ํŠน์„ฑ์ด ๊ฐ•ํ•ด์„œ, ์ •์  ํ• ๋‹น์€ ๋‹ต์ด ์•„๋‹˜. ๋ถ€ํ•˜์— ๋”ฐ๋ผ ๊ฐ€๋ณ€์ ์œผ๋กœ ์กฐ์ ˆํ•˜๋Š” ์˜คํ†  ์Šค์ผ€์ผ๋ง ์„œ๋น™ ์—”์ง„์˜ ํ•„์š”์„ฑ ์ฒด๊ฐ

โ‘ค KubeRCA | AI ๊ธฐ๋ฐ˜ K8s ์ธ์‹œ๋˜ํŠธ ๊ทผ๋ณธ ์›์ธ ๋ถ„์„ ์ž๋™ํ™” (๋ฐœํ‘œ: Bohyun Choi)

  • Tried: K8s ์ด๋ฒคํŠธ ๋กœ๊ทธ์™€ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜ ๋กœ๊ทธ๋ฅผ ์ˆ˜์ง‘ํ•ด LLM์— ์ „๋‹ฌ, ์žฅ์•  ๊ทผ๋ณธ ์›์ธ์„ ์ž์—ฐ์–ด๋กœ ์š”์•ฝํ•ด์ฃผ๋Š” ์‹œ์Šคํ…œ ๊ตฌ์ถ•
  • Failed: ์ˆ˜๋งŒ ๊ฑด์˜ ๋กœ๊ทธ๋ฅผ ๊ทธ๋Œ€๋กœ ๋˜์ง€๋‹ˆ LLM์ด ํ™˜๊ฐ์„ ์ผ์œผ์ผœ ์ž˜๋ชป๋œ ํ•ด๊ฒฐ์ฑ…์„ ์ œ์‹œํ–ˆ์Šต๋‹ˆ๋‹ค. ๋…ธ์ด์ฆˆ๊ฐ€ ์„ž์—ฌ ์ •ํ™•๋„๊ฐ€ 50% ๋ฏธ๋งŒ์œผ๋กœ ๋–จ์–ด์ง
  • Learned: ๋กœ๊ทธ์˜ "์–‘"๋ณด๋‹ค "์ •์ œ"๊ฐ€ ํ•ต์‹ฌ! ์•Œ๊ณ ๋ฆฌ์ฆ˜ ๊ณ ๋„ํ™”๋ณด๋‹ค ๋„๋ฉ”์ธ ์ง€์‹ ๊ธฐ๋ฐ˜์˜ ๋กœ๊ทธ ์ „์ฒ˜๋ฆฌ์™€, ๋ฒกํ„ฐ DB(RAG)๋ฅผ ํ™œ์šฉํ•œ ๊ณผ๊ฑฐ ํ•ด๊ฒฐ ์‚ฌ๋ก€ ์ฐธ์กฐ๊ฐ€ ํ›จ์”ฌ ํšจ๊ณผ์ ์ด๋ผ๋Š” ๊ฑธ ํ™•์ธ

์—ฌ๋Ÿฌ ์‹œํ–‰์ฐฉ์˜ค๋ฅผ ๊ฑฐ์นœ ํŒ€๋“ค์ด 2๊ฐœ์›”์„ ๋” ๊ณ ๋„ํ™”ํ•œ ๊ฒฐ๊ณผ๋ฌผ์„ 4์›” 4์ผ์— ๊ณต๊ฐœํ•ฉ๋‹ˆ๋‹ค.

์ด ํ”„๋กœ์ ํŠธ, ์šฐ๋ฆฌ ์กฐ์ง ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•  ์ˆ˜ ์žˆ๊ฒ ๋Š”๋ฐ? ์ฐธ์—ฌ ์‹ ์ฒญ ์‹œ, PoC ์˜ํ–ฅ๊ณผ ํ˜„์žฌ ๊ฒช๊ณ  ๊ณ„์‹  ๋ฌธ์ œ๋ฅผ ์ž…๋ ฅํ•ด์ฃผ์„ธ์š”. ํ–‰์‚ฌ ์ดํ›„ ํ•ด๋‹น ํŒ€๊ณผ ์˜จ๋ผ์ธ ๋ฏธํŒ…์„ ์—ฐ๊ฒฐํ•ด๋“œ๋ฆฝ๋‹ˆ๋‹ค.

:link: ์ฐธ์—ฌ ์‹ ์ฒญ ๋งํฌ

| This is a space where knowledge is not merely consumed, but respected, sovereign, and connectedโ€”shared together with cloud industry professionals (Bros).|
| ์ง€์‹์ด ์†Œ๋น„๋˜์ง€ ์•Š๊ณ  ์กด์ค‘ยท์ฃผ๊ถŒ๋ณด์žฅยท์—ฐ๊ฒฐ๋˜๋Š” ๊ณต๊ฐ„์œผ๋กœ ํด๋ผ์šฐ๋“œ ํ˜„์—… ์ „๋ฌธ๊ฐ€(Bro)์™€ ํ•จ๊ป˜ ๊ณต์œ ํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. |

1 Like