๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

Stack/AWS

[AWS DEA] ์‹œํ—˜ ํ•ฉ๊ฒฉ์„ ์œ„ํ•œ ์™„์ „ ๊ฐ€์ด๋“œ2 (feat.Claude Sonnet 4.6)

๋ฐ˜์‘ํ˜•

 

 

 

๐ŸŽฏ AWS ์ž๊ฒฉ์ฆ ๊ฐ€์ด๋“œ 2025

AWS DEA ์™„๋ฒฝ ์ •๋ฆฌ
์„œ๋น„์Šค 60๊ฐœ + ๋ฌธ์ œ ํŒจํ„ด 30๊ฐœ + 3์ผ ํ•ฉ๊ฒฉ๋ฒ•

Data Engineer Associate(DEA-C01) ์‹œํ—˜์— ๋‚˜์˜ค๋Š” ๋ชจ๋“  ์šฉ์–ด๋ฅผ ์‹ค์ƒํ™œ ๋น„์œ ๋กœ ์ดํ•ดํ•˜๊ณ , 60๊ฐœ ์„œ๋น„์Šค ๊ตฌ์กฐ ์ง€๋„์™€ ๋ฌธ์ œ ์œ ํ˜• 30ํŒจํ„ด, 3์ผ ํ•ฉ๊ฒฉ ๊ณต๋ถ€๋ฒ•๊นŒ์ง€ ํ•œ ๋ฒˆ์— ์ •๋ฆฌํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ“… DEA-C01 ๊ธฐ์ค€ โฑ ์ฝ๊ธฐ ์•ฝ 15๋ถ„ ๐Ÿง  ๋‚œ์ด๋„ โ˜…โ˜…โ˜…โ˜†โ˜† โœ๏ธ ์ดํ˜„
00 / Exam Info

์‹œํ—˜ ๊ธฐ๋ณธ ์ •๋ณด ํ•œ๋ˆˆ์—

 

DEA-C01 ์ŠคํŽ™์„ ๋จผ์ € ํŒŒ์•…ํ•ด์•ผ ๊ณต๋ถ€ ์ „๋žต์ด ์žกํžŒ๋‹ค.

65
๋ฌธ์ œ ์ˆ˜
130๋ถ„
์‹œํ—˜ ์‹œ๊ฐ„
720
ํ•ฉ๊ฒฉ ์ ์ˆ˜ /1000
$150
์‘์‹œ๋ฃŒ
4๊ฐœ
๋„๋ฉ”์ธ ์˜์—ญ

๐Ÿ“Œ ์‹œํ—˜ ๋„๋ฉ”์ธ ๋น„์ค‘ (DEA-C01)

  • Domain 1. ๋ฐ์ดํ„ฐ ์ˆ˜์ง‘ ๋ฐ ๋ณ€ํ™˜ (34%) — Kinesis, Glue, DMS, Lambda, SQS ์ค‘์‹ฌ
  • Domain 2. ๋ฐ์ดํ„ฐ ์ €์žฅ ๋ฐ ๊ด€๋ฆฌ (26%) — S3, Redshift, DynamoDB, RDS, Lake Formation
  • Domain 3. ๋ฐ์ดํ„ฐ ์šด์˜ ๋ฐ ์ง€์› (22%) — CloudWatch, Step Functions, MWAA, EventBridge
  • Domain 4. ๋ฐ์ดํ„ฐ ๋ณด์•ˆ ๋ฐ ๊ฑฐ๋ฒ„๋„Œ์Šค (18%) — IAM, KMS, Macie, Lake Formation
 
01 / Analogy

AWS ์šฉ์–ด, ์‹ค์ƒํ™œ ๋น„์œ ๋กœ ์ดํ•ดํ•˜๊ธฐ

 

๋ฐ์ดํ„ฐ ํŒŒ์ดํ”„๋ผ์ธ ์ „์ฒด๋ฅผ ์Šค๋งˆํŠธ ๊ณต์žฅ์— ๋น„์œ ํ•˜๋ฉด ๋ชจ๋“  ์„œ๋น„์Šค๊ฐ€ ํ•œ๋ฒˆ์— ๋ณด์ธ๋‹ค.

์ „์ฒด ๊ตฌ์กฐ ๋น„์œ  ๐Ÿญ

AWS ๋ฐ์ดํ„ฐ ํŒŒ์ดํ”„๋ผ์ธ = ๋Œ€ํ˜• ์Šค๋งˆํŠธ ๊ณต์žฅ

์›์žฌ๋ฃŒ(Raw Data)๊ฐ€ ์ž…๊ตฌ๋กœ ๋“ค์–ด์˜ค๋ฉด → ์ปจ๋ฒ ์ด์–ด ๋ฒจํŠธ(Kinesis)๋กœ ์ด๋™ → ๊ฐ€๊ณต ๊ณต์žฅ(Glue/EMR)์—์„œ ๋ณ€ํ™˜ → ์ฐฝ๊ณ (S3, Redshift)์— ๋ณด๊ด€ → ๋ถ„์„์‹ค(QuickSight/Athena)์—์„œ ์ธ์‚ฌ์ดํŠธ ์ถ”์ถœ. ๊ณต์žฅ ์ „์ฒด๋ฅผ ๋ณด์•ˆ ํŒ€(IAM/KMS)์ด ์ง€ํ‚ค๊ณ , ๊ณต์žฅ์žฅ(CloudWatch)์ด ๋ชจ๋‹ˆํ„ฐ๋งํ•œ๋‹ค.

Domain 1 ๐Ÿ“ฅ ๋ฐ์ดํ„ฐ ์ˆ˜์ง‘ / ์ŠคํŠธ๋ฆฌ๋ฐ
๐Ÿ”„
Amazon Kinesis Data Streams
์‹ค์‹œ๊ฐ„ ์ปจ๋ฒ ์ด์–ด ๋ฒจํŠธ

๊ณต์žฅ ์ž…๊ตฌ์˜ ์ปจ๋ฒ ์ด์–ด ๋ฒจํŠธ. ๋ฐ์ดํ„ฐ๊ฐ€ ๋Š์ž„์—†์ด ์˜ฌ๋ผ์˜จ๋‹ค. ์›ํ•˜๋Š” ์œ„์น˜(์ƒค๋“œ)์— ์—ฌ๋Ÿฌ ์ž‘์—…์ž๊ฐ€ ๋™์‹œ ์ฒ˜๋ฆฌ. 24์‹œ๊ฐ„~7์ผ ๋ณด๊ด€.

๐Ÿš›
Kinesis Data Firehose
์ž๋™ ๋ฐฐ๋‹ฌ ํŠธ๋Ÿญ

๋ชฉ์ ์ง€(S3/Redshift)๋กœ ์ž๋™ ๋ฐฐ๋‹ฌํ•ด์ฃผ๋Š” ํŠธ๋Ÿญ. ์šด์ „์ž(๊ฐœ๋ฐœ์ž) ์—†์–ด๋„ OK. ๋‹จ, ์‹ค์‹œ๊ฐ„์ด ์•„๋‹Œ ์†Œ๋Ÿ‰์”ฉ ๋ฌถ์–ด์„œ ๋ฐฐ๋‹ฌ(Micro-batch).

๐Ÿงฎ
Kinesis Data Analytics
์‹ค์‹œ๊ฐ„ ๊ณ„์‚ฐ๊ธฐ

๋ฒจํŠธ ์œ„ ์ฆ‰์„ ๊ณ„์‚ฐ๊ธฐ. ์ง€๋‚˜๊ฐ€๋Š” ๋ฐ์ดํ„ฐ๋ฅผ SQL/Flink๋กœ ์‹ค์‹œ๊ฐ„ ๋ถ„์„. "๋ถˆ๋Ÿ‰๋ฅ  5% ์ดˆ๊ณผ ์‹œ ์ฆ‰์‹œ ์•Œ๋žŒ!"

๐Ÿ“ฌ
Amazon SQS
๋Œ€๊ธฐํ‘œ ๋ฒˆํ˜ธ๊ธฐ

์€ํ–‰ ๋ฒˆํ˜ธํ‘œ ๋ฝ‘๋Š” ๊ธฐ๊ณ„. ์†๋‹˜(๋ฉ”์‹œ์ง€)์ด ๋ชฐ๋ ค๋„ ์ค„ ์„ธ์›Œ ์ˆœ์„œ๋Œ€๋กœ ์ฒ˜๋ฆฌ. ์ตœ๋Œ€ 14์ผ ๋ณด๊ด€. 1:1 ๋น„๋™๊ธฐ ํ†ต์‹ .

๐Ÿ“ข
Amazon SNS
๊ต๋‚ด ๋ฐฉ์†ก ์‹œ์Šคํ…œ

๋ฐฉ์†ก์‹ค์—์„œ ์ „์ฒด ๋ฐฉ์†ก ํ•œ ๋ฒˆ ๋ˆ„๋ฅด๋ฉด ๊ตฌ๋…ํ•œ ๋ชจ๋“  ์ฑ„๋„(SQS, Lambda, Email)์— ๋™์‹œ ์ „๋‹ฌ. 1:N ํŒฌ์•„์›ƒ.

๐Ÿ“…
Amazon EventBridge
์Šค๋งˆํŠธ ์ผ์ • ๋น„์„œ

์ด๋ฒคํŠธ(ํŒŒ์ผ ์—…๋กœ๋“œ, DB ๋ณ€๊ฒฝ)๋ฅผ ๊ฐ์ง€ํ•ด์„œ ์ž๋™์œผ๋กœ ๊ด€๋ จ ์„œ๋น„์Šค์— ์ „๋‹ฌ. "S3์— ํŒŒ์ผ ์˜ฌ๋ผ์˜ค๋ฉด Lambda ์ž๋™ ์‹คํ–‰."

๐Ÿšš
AWS DMS
์ด์‚ฟ์ง ์„ผํ„ฐ

Oracle → Aurora ์ด์‚ฌ ๋•Œ ๋ถ€๋ฅด๋Š” ์ „๋ฌธ ์ด์‚ฌ ์—…์ฒด. ์ด์‚ฌ ์ค‘์—๋„ ๊ธฐ์กด DB ์‚ฌ์šฉ ๊ฐ€๋Šฅ(CDC). ์ด๊ธฐ์ข… DB ํ˜ธํ™˜ ์ง€์›.

๐Ÿ“ฆ
AWS Snowball Edge
๋ฐ์ดํ„ฐ ์ด์‚ฌ ๋ฐ•์Šค

์ธํ„ฐ๋„ท ๋А๋ฆด ๋•Œ ๋ฌผ๋ฆฌ์  ํ•˜๋“œ๋“œ๋ผ์ด๋ธŒ ๋ฐ•์Šค๋ฅผ ํƒ๋ฐฐ๋กœ ๋ฐ›์•„ ๋ฐ์ดํ„ฐ ์ฑ„์šด ๋’ค ๋ณด๋‚ด๋ฉด S3์— ์ž๋™ ์—…๋กœ๋“œ.

Domain 1 โš™๏ธ ๋ฐ์ดํ„ฐ ๋ณ€ํ™˜ / ์ฒ˜๋ฆฌ
๐Ÿงต
AWS Glue
์ž๋™ ๋ฒˆ์—ญ ๊ณต์žฅ ์ง์›

CSV/JSON์„ ์ž๋™์œผ๋กœ Parquet์œผ๋กœ ๋ณ€ํ™˜. Crawler = ์žฌ๋ฃŒ ํŒŒ์•…, Job = ๊ฐ€๊ณต, Catalog = ๋ชฉ๋ก ๊ด€๋ฆฌ. ์„œ๋ฒ„๋ฆฌ์Šค.

๐Ÿ‘จ‍๐Ÿณ
AWS Glue DataBrew
์š”๋ฆฌ ๋ ˆ์‹œํ”ผ ์•ฑ

์ฝ”๋”ฉ ์—†์ด ๋“œ๋ž˜๊ทธ์•ค๋“œ๋กญ์œผ๋กœ ๋ฐ์ดํ„ฐ ์ •์ œ. "์ค‘๋ณต ์ œ๊ฑฐ", "๊ฒฐ์ธก์น˜ ์ฑ„์šฐ๊ธฐ" ๋ฒ„ํŠผ์œผ๋กœ ์ฒ˜๋ฆฌ. ๋ถ„์„๊ฐ€ ์ง์ ‘ ์‚ฌ์šฉ ๊ฐ€๋Šฅ.

๐Ÿญ
Amazon EMR
๋Œ€ํ˜• ๊ณต์žฅ ํด๋Ÿฌ์Šคํ„ฐ

Spark/Hive/Hadoop์„ ๋Œ๋ฆฌ๋Š” ๋Œ€ํ˜• ์ œ์กฐ ๊ณต์žฅ. ์„œ๋ฒ„ ์ˆ˜๋ฐฑ ๋Œ€ ๋Œ€๊ทœ๋ชจ ๋ฐฐ์น˜ ์ฒ˜๋ฆฌ. ์ž‘์—… ๋๋‚˜๋ฉด ๊ณต์žฅ ํ•ด์ฒด → ๋น„์šฉ ์ ˆ๊ฐ.

โšก
AWS Lambda
ํ˜ธ์ถœ ์‹œ ์ถœ๊ทผํ•˜๋Š” ์•Œ๋ฐ”

ํ‰์†Œ์—” ๋Œ€๊ธฐ, ์ด๋ฒคํŠธ ๋ฐœ์ƒ ์‹œ ์ฆ‰์‹œ ์ถœ๊ทผํ•ด์„œ 15๋ถ„ ๋‚ด ์ฒ˜๋ฆฌํ•˜๊ณ  ํ‡ด๊ทผ. ์„œ๋ฒ„ ๊ด€๋ฆฌ 0. ์†Œ๋Ÿ‰·์งง์€ ์ฒ˜๋ฆฌ์— ์ตœ์ .

๐Ÿ”„
Amazon MWAA (Airflow)
๊ณต์ • ํ๋ฆ„๋„ ๊ด€๋ฆฌ์ž

๊ณต์ •์˜ ์ˆœ์„œ·์˜์กด์„ฑ ๊ด€๋ฆฌ. "A ์™„๋ฃŒ → B ์‹œ์ž‘ → C·D ๋™์‹œ → E ๋งˆ๋ฌด๋ฆฌ". DAG๋กœ ๋ณต์žกํ•œ ํŒŒ์ดํ”„๋ผ์ธ ์Šค์ผ€์ค„๋ง.

๐Ÿ—‚๏ธ
AWS Glue Data Catalog
๊ณต์žฅ ์ž์žฌ ๋ชฉ๋ก๋ถ€

์–ด๋””์— ์–ด๋–ค ์ž์žฌ๊ฐ€ ์žˆ๋Š”์ง€ ๋ฉ”ํƒ€๋ฐ์ดํ„ฐ ๋ชฉ๋ก. Athena, EMR, Redshift Spectrum์ด ์ด ๋ชฉ๋ก์„ ๊ณต์œ ํ•ด์„œ ์‚ฌ์šฉ.

Domain 2 ๐Ÿ—„๏ธ ๋ฐ์ดํ„ฐ ์ €์žฅ
๐Ÿฌ
Amazon S3
๋ฌดํ•œ ํ™•์žฅ ์ฐฝ๊ณ 

์šฉ๋Ÿ‰ ๋ฌด์ œํ•œ ์ดˆ๋Œ€ํ˜• ์ฐฝ๊ณ . ์–ด๋–ค ํŒŒ์ผ์ด๋“  ์ €์žฅ. Lifecycle์œผ๋กœ ์ž์ฃผ ์•ˆ ์“ฐ๋Š” ํŒŒ์ผ์„ ์ €๋ ดํ•œ ๋ƒ‰๋™์ฐฝ๊ณ (Glacier)๋กœ ์ž๋™ ์ด๋™.

๐ŸงŠ
S3 Glacier / Deep Archive
๋ƒ‰๋™ ์ฐฝ๊ณ 

๊ฑฐ์˜ ์•ˆ ๊บผ๋‚ผ ์ž๋ฃŒ๋ฅผ ๋„ฃ๋Š” ๋ƒ‰๋™ ๋ณด๊ด€ ์ฐฝ๊ณ . ๊บผ๋‚ผ ๋•Œ ํ•ด๋™ ์‹œ๊ฐ„ ํ•„์š”(์ˆ˜๋ถ„~12์‹œ๊ฐ„). ๊ฐ€๊ฒฉ ๋งค์šฐ ์ €๋ ด. ๊ทœ์ • ์ค€์ˆ˜ ๋ณด๊ด€.

๐Ÿงฉ
Amazon DynamoDB
ํฌ์ŠคํŠธ์ž‡ ๋ฉ”๋ชจ์žฅ

Key๋กœ ์ฆ‰์‹œ ๊บผ๋‚ด๋Š” ํฌ์ŠคํŠธ์ž‡. ์–ด๋””์„œ๋“  1ms ์‘๋‹ต. ํ˜•์‹ ์ž์œ (NoSQL). ๋ณต์žกํ•œ ์ฟผ๋ฆฌ ๋ถˆ๊ฐ€. "userId → ์‚ฌ์šฉ์ž ์ •๋ณด ์ฆ‰์‹œ ์กฐํšŒ."

๐Ÿ“Š
Amazon Redshift
๋Œ€ํ˜• ๋ถ„์„ ์—ฐ๊ตฌ์†Œ

์ˆ˜์‹ญ์–ต ๊ฑด ๋ฐ์ดํ„ฐ๋ฅผ ์ปฌ๋Ÿผ ๋‹จ์œ„๋กœ ๋ถ„์„ํ•˜๋Š” ์—ฐ๊ตฌ์†Œ. ๋ณต์žกํ•œ ์ง‘๊ณ„ ์ฟผ๋ฆฌ ๊ณ ์† ์ฒ˜๋ฆฌ. OLAP ์ „์šฉ. DISTKEY·SORTKEY ์„ค๊ณ„๊ฐ€ ์„ฑ๋Šฅ ํ•ต์‹ฌ.

๐Ÿฅ
Amazon RDS / Aurora
์ „์ž ์˜๋ฌด ๊ธฐ๋ก ์‹œ์Šคํ…œ

์ •ํ˜•ํ™”๋œ ๊ด€๊ณ„ํ˜• ๊ธฐ๋ก ๊ด€๋ฆฌ. INSERT/UPDATE/SELECT ๋น ๋ฅธ OLTP. Aurora = RDS ๊ณ ์„ฑ๋Šฅ ๋ฒ„์ „(5๋ฐฐ ๋น ๋ฆ„). Multi-AZ ๊ณ ๊ฐ€์šฉ์„ฑ.

๐Ÿ’จ
Amazon ElastiCache
์ฑ…์ƒ ์œ„ ํฌ์ŠคํŠธ์ž‡

์ž์ฃผ ์“ฐ๋Š” ๊ฑธ ์ฑ…์ƒ ์œ„์— ๊บผ๋‚ด๋‘๊ธฐ. DB๊นŒ์ง€ ์•ˆ ๊ฐ€๋„ ๋ฉ”๋ชจ๋ฆฌ์—์„œ ์ฆ‰์‹œ ์‘๋‹ต(๋งˆ์ดํฌ๋กœ์ดˆ). Redis = ๊ธฐ๋Šฅ ํ’๋ถ€, Memcached = ๋‹จ์ˆœ.

๐Ÿ›๏ธ
AWS Lake Formation
๋ฐ์ดํ„ฐ ์ฐฝ๊ณ  ๋ณด์•ˆ๊ด€

๋ฐ์ดํ„ฐ ๋ ˆ์ดํฌ์˜ ์ถœ์ž…์ฆ ๊ด€๋ฆฌ์ž. "AํŒ€์€ ๊ณ ๊ฐ ํ…Œ์ด๋ธ”๋งŒ, BํŒ€์€ ๋งค์ถœ ์ปฌ๋Ÿผ๋งŒ" ์„ธ๋ฐ€ํ•œ ์ ‘๊ทผ ๊ถŒํ•œ ์„ค์ •. ์ค‘์•™ ๊ฑฐ๋ฒ„๋„Œ์Šค ์ œ๊ณต.

โฑ๏ธ
Amazon Timestream
์‹œ๊ฐ„ํ‘œ ์ผ์ง€ ๊ธฐ๋ก๊ณ„

IoT ์„ผ์„œ, ์„œ๋ฒ„ ๋ฉ”ํŠธ๋ฆญ์ฒ˜๋Ÿผ ์‹œ๊ฐ„์ˆœ ๋ฐ์ดํ„ฐ ์ „์šฉ DB. ์‹œ๊ณ„์—ด ์ฟผ๋ฆฌ์— ์ตœ์ ํ™”. ์ž๋™ ์••์ถ•·TTL ๊ด€๋ฆฌ. Grafana ์—ฐ๋™.

Domain 2/3 ๐Ÿ“ˆ ๋ถ„์„ / ์ฟผ๋ฆฌ
๐Ÿ”
Amazon Athena
์ฐฝ๊ณ ์—์„œ ๋ฐ”๋กœ SQL ๊ฒ€์ƒ‰

S3 ์ฐฝ๊ณ ์— ๊ฐ€์„œ ์ง์ ‘ SQL ๊ฒ€์ƒ‰. ์„œ๋ฒ„ ์—†์ด ์ฟผ๋ฆฌ. ์Šค์บ” ๋ฐ์ดํ„ฐ TB๋‹น ๊ณผ๊ธˆ. Parquet + ํŒŒํ‹ฐ์…”๋‹์œผ๋กœ ๋น„์šฉ 90% ์ ˆ๊ฐ ๊ฐ€๋Šฅ.

๐Ÿ“Š
Amazon QuickSight
์ž๋™ ์ธํฌ๊ทธ๋ž˜ํ”ฝ ์ œ์ž‘์ž

๋ฐ์ดํ„ฐ ์—ฐ๊ฒฐํ•˜๋ฉด ์ž๋™์œผ๋กœ ๊ทธ๋ž˜ํ”„·๋Œ€์‹œ๋ณด๋“œ ์ƒ์„ฑ. SPICE ์—”์ง„์œผ๋กœ ๋น ๋ฅธ ์‘๋‹ต. ML Insights๋กœ ์ด์ƒ์น˜ ์ž๋™ ํƒ์ง€. ์ž„์› ๋ณด๊ณ ์šฉ.

๐Ÿ”ญ
Redshift Spectrum
์ฐฝ๊ณ -์—ฐ๊ตฌ์†Œ ์—ฐ๊ฒฐ ํ†ต๋กœ

Redshift์—์„œ S3 ๋ฐ์ดํ„ฐ๋ฅผ ์ด๋™ ์—†์ด ์ง์ ‘ ์ฟผ๋ฆฌ. ์ฝœ๋“œ ๋ฐ์ดํ„ฐ ๋น„์šฉ ํšจ์œจ์  ๋ถ„์„. Glue Catalog์™€ ์—ฐ๋™ํ•ด ์‚ฌ์šฉ.

๐Ÿ”Ž
Amazon OpenSearch
์ „๋ฌธ ๊ฒ€์ƒ‰ ์—”์ง„

๊ตฌ๊ธ€ ๊ฐ™์€ ์ „๋ฌธ ๊ฒ€์ƒ‰ ๊ธฐ๋Šฅ. ๋กœ๊ทธ ๊ฒ€์ƒ‰, ํ…์ŠคํŠธ ๋ถ„์„, ์‹ค์‹œ๊ฐ„ ๋ชจ๋‹ˆํ„ฐ๋ง ๋Œ€์‹œ๋ณด๋“œ. "์˜ค๋ฅ˜ ๋กœ๊ทธ์—์„œ ํŠน์ • ํŒจํ„ด ์ฆ‰์‹œ ๊ฒ€์ƒ‰."

Domain 4 ๐Ÿ” ๋ณด์•ˆ / ๊ฑฐ๋ฒ„๋„Œ์Šค
๐Ÿชช
AWS IAM
ํšŒ์‚ฌ ์ถœ์ž…์ฆ + ์ง์ฑ… ๊ด€๋ฆฌ

๋ˆ„๊ฐ€ ์–ด๋””์— ๋“ค์–ด๊ฐˆ ์ˆ˜ ์žˆ๋Š”์ง€ ์ •ํ•˜๋Š” HR ์‹œ์Šคํ…œ. Role = ์ง์ฑ…, Policy = ๊ถŒํ•œ ๋ฌธ์„œ, User = ์ง์›. ์ตœ์†Œ ๊ถŒํ•œ ์›์น™์ด ํ•ต์‹ฌ.

๐Ÿ”‘
AWS KMS
์—ด์‡  ๋ณด๊ด€ ๊ธˆ๊ณ 

์•”ํ˜ธํ™” ํ‚ค๋ฅผ ์•ˆ์ „ํ•˜๊ฒŒ ๋ณด๊ด€ํ•˜๋Š” ๊ธˆ๊ณ . SSE-KMS๋กœ S3 ์•”ํ˜ธํ™”. CMK๋กœ ์ง์ ‘ ํ†ต์ œ. CloudTrail๋กœ ํ‚ค ์‚ฌ์šฉ ์ด๋ ฅ ์ถ”์  ๊ฐ€๋Šฅ.

๐Ÿค
AWS Secrets Manager
๋””์ง€ํ„ธ ๋น„๋ฐ€ ๊ธˆ๊ณ 

DB ๋น„๋ฐ€๋ฒˆํ˜ธ, API Key๋ฅผ ์ฝ”๋“œ์— ์ง์ ‘ ์“ฐ์ง€ ์•Š๊ณ  ๊ธˆ๊ณ ์— ๋ณด๊ด€. ์ž๋™ ์ˆœํ™˜(Rotation). ์•ฑ์€ ๊ธˆ๊ณ ์—์„œ ๊บผ๋‚ด ์‚ฌ์šฉ.

๐Ÿ•ต๏ธ
Amazon Macie
๊ฐœ์ธ์ •๋ณด ํƒ์ •

S3์—์„œ ์ฃผ๋ฏผ๋ฒˆํ˜ธ·์‹ ์šฉ์นด๋“œ ๊ฐ™์€ ๋ฏผ๊ฐ ๋ฐ์ดํ„ฐ๋ฅผ ML๋กœ ์ž๋™ ํƒ์ง€. GDPR ์ปดํ”Œ๋ผ์ด์–ธ์Šค ํ•„์ˆ˜ ๋„๊ตฌ. ํƒ์ง€๋งŒ, ์‚ญ์ œ๋Š” ๋ณ„๋„ ์ฒ˜๋ฆฌ.

๐Ÿ“‹
AWS CloudTrail
ํšŒ์‚ฌ CCTV

AWS ๊ณ„์ •์˜ ๋ชจ๋“  API ํ˜ธ์ถœ ๊ธฐ๋กํ•˜๋Š” CCTV. "๋ˆ„๊ฐ€ ์–ธ์ œ S3 ๋ฒ„ํ‚ท ์‚ญ์ œํ–ˆ๋‚˜?" ๊ฐ์‚ฌ·ํฌ๋ Œ์‹ ํ•„์ˆ˜. CloudTrail vs Config ํ˜ผ๋™ ๊ธˆ์ง€.

๐ŸŒ
Amazon VPC
ํšŒ์‚ฌ ์‚ฌ์„ค ๋„คํŠธ์›Œํฌ

AWS ๋‚ด ๋‚˜๋งŒ์˜ ์‚ฌ์„ค ์ธํ„ฐ๋„ท. VPC Endpoint๋กœ ์ธํ„ฐ๋„ท ์—†์ด S3·DynamoDB ์ง์ ‘ ์ ‘๊ทผ. ๋ณด์•ˆ + ๋ฐ์ดํ„ฐ ์ „์†ก ๋น„์šฉ ์ด์ .

Domain 3 ๐Ÿ› ๏ธ ์šด์˜ / ์˜ค์ผ€์ŠคํŠธ๋ ˆ์ด์…˜
๐Ÿ“ก
Amazon CloudWatch
๊ณต์žฅ ๊ณ„๊ธฐํŒ

์„œ๋ฒ„·์„œ๋น„์Šค ์ƒํƒœ ๋ชจ๋‹ˆํ„ฐ๋ง ๊ณ„๊ธฐํŒ. CPU/๋ฉ”๋ชจ๋ฆฌ/์—๋Ÿฌ ์ˆ˜ ํ™•์ธ. Alarm์œผ๋กœ ์ž„๊ณ„์น˜ ์ดˆ๊ณผ ์‹œ SNS ์•Œ๋ฆผ. Logs๋กœ ๋กœ๊ทธ ์ˆ˜์ง‘·๋ถ„์„.

๐Ÿค–
AWS Step Functions
๊ณต์ • ์ž๋™ํ™” ๋กœ๋ด‡ํŒ”

์—ฌ๋Ÿฌ Lambda๋ฅผ ์ˆœ์„œ๋Œ€๋กœ ์—ฐ๊ฒฐํ•˜๋Š” ๋กœ๋ด‡ํŒ”. "1๋‹จ๊ณ„ ์„ฑ๊ณต→2๋‹จ๊ณ„, ์‹คํŒจ→์žฌ์‹œ๋„." ์‹œ๊ฐ์  ์›Œํฌํ”Œ๋กœ. MWAA๋ณด๋‹ค ๊ฐ„๋‹จํ•œ ํ๋ฆ„์— ์ ํ•ฉ.

๐Ÿ“‘
AWS Config
์„ค์ • ๋ณ€๊ฒฝ ์ด๋ ฅ ์žฅ๋ถ€

๋ฆฌ์†Œ์Šค ์„ค์ •์ด ์–ธ์ œ ์–ด๋–ป๊ฒŒ ๋ฐ”๋€Œ์—ˆ๋Š”์ง€ ๊ธฐ๋ก. ๊ทœ์ • ์ค€์ˆ˜ ์ž๋™ ์ฒดํฌ. CloudTrail = "๋ˆ„๊ฐ€ ๋ญ˜ ํ–ˆ๋‚˜", Config = "์„ค์ • ๋ณ€๊ฒฝ ์ด๋ ฅ".

๐Ÿงช
AWS Data Exchange
๋ฐ์ดํ„ฐ ๋งˆ์ผ“ํ”Œ๋ ˆ์ด์Šค

์™ธ๋ถ€ ์—…์ฒด ๋ฐ์ดํ„ฐ๋ฅผ ๊ตฌ๋…·๊ตฌ๋งคํ•˜๋Š” ๋งˆ์ผ“. ๋‚ ์”จ, ๊ธˆ์œต, ์˜๋ฃŒ ๋ฐ์ดํ„ฐ ๋“ฑ์„ API ์—†์ด S3๋กœ ์ง์ ‘ ์ˆ˜์‹ . ์„œ๋“œํŒŒํ‹ฐ ๋ฐ์ดํ„ฐ ํ™œ์šฉ.

 
02 / Service Map

์‹œํ—˜์— ๋‚˜์˜ค๋Š” 60๊ฐœ ์„œ๋น„์Šค ์ „์ฒด ์ง€๋„

 

๋„๋ฉ”์ธ๋ณ„ ์„œ๋น„์Šค ๋ถ„๋ฅ˜ ์ง€๋„. โญ = ๊ณ ๋นˆ๋„ ์ถœ์ œ ์„œ๋น„์Šค.

34%
Domain 1
์ˆ˜์ง‘·๋ณ€ํ™˜
Kinesis Data Streams โญ Kinesis Firehose โญ Kinesis Data Analytics โญ Kinesis Video Streams AWS Glue โญ Glue DataBrew Glue Data Catalog AWS DMS โญ AWS SCT AWS Lambda โญ Amazon SQS โญ Amazon SNS โญ Amazon EventBridge โญ AWS Snowball Edge AWS DataSync AWS Transfer Family Amazon EMR โญ AWS Batch Amazon AppFlow
26%
Domain 2
์ €์žฅ·๊ด€๋ฆฌ
Amazon S3 โญ S3 Glacier S3 Deep Archive Amazon Redshift โญ Redshift Spectrum Redshift Serverless Amazon DynamoDB โญ DynamoDB Streams DynamoDB DAX Amazon RDS โญ Amazon Aurora Amazon ElastiCache Amazon MemoryDB AWS Lake Formation โญ Amazon Neptune Amazon Timestream Amazon Keyspaces Amazon DocumentDB
22%
Domain 3
์šด์˜·์ง€์›
Amazon CloudWatch โญ AWS CloudTrail AWS Config AWS Step Functions โญ Amazon MWAA โญ Amazon Athena โญ Amazon QuickSight โญ Amazon OpenSearch AWS Data Exchange AWS Systems Manager AWS X-Ray AWS CodePipeline AWS Glue Workflows
18%
Domain 4
๋ณด์•ˆ·๊ฑฐ๋ฒ„๋„Œ์Šค
AWS IAM โญ AWS KMS โญ AWS Secrets Manager โญ AWS Parameter Store Amazon Macie โญ Amazon GuardDuty AWS Security Hub Amazon Inspector Amazon VPC โญ AWS PrivateLink VPC Endpoints AWS WAF Amazon Cognito AWS RAM

๐Ÿ“„ ํŒŒ์ผ ํฌ๋งท ๋น„๊ต — ์‹œํ—˜ ํ•„์ˆ˜ ์•”๊ธฐ

ํฌ๋งท ์ €์žฅ ๋ฐฉ์‹ ์ตœ์  ์‚ฌ์šฉ์ฒ˜ ํŠน์ด์‚ฌํ•ญ
Parquet ์ปฌ๋Ÿผ ๊ธฐ๋ฐ˜ Athena, Redshift Spectrum, Glue โญ ๋น„์šฉ·์„ฑ๋Šฅ ์ตœ์ ํ™” 1์ˆœ์œ„
ORC ์ปฌ๋Ÿผ ๊ธฐ๋ฐ˜ EMR, Hive Parquet๊ณผ ์œ ์‚ฌ, Hive ์ตœ์ ํ™”
Avro ํ–‰ ๊ธฐ๋ฐ˜ Kafka, Kinesis, ์ŠคํŠธ๋ฆฌ๋ฐ ์Šคํ‚ค๋งˆ ๋‚ด์žฅ, ์Šคํ‚ค๋งˆ ์ง„ํ™” ์ง€์›
JSON ํ–‰ ๊ธฐ๋ฐ˜ API, ๋กœ๊ทธ ์ˆ˜์ง‘ ์šฉ๋Ÿ‰ ํฌ๊ณ  ์ฟผ๋ฆฌ ๋А๋ฆผ
CSV ํ–‰ ๊ธฐ๋ฐ˜ ์†Œ๊ทœ๋ชจ ๋ฐ์ดํ„ฐ ๋ถ„์„ ๋น„ํšจ์œจ, ๋ฒ”์šฉ์„ฑ ๋†’์Œ
Delta Lake ์ปฌ๋Ÿผ(Parquet) ๋ฐ์ดํ„ฐ ๋ ˆ์ดํฌํ•˜์šฐ์Šค ACID ํŠธ๋žœ์žญ์…˜ + ํƒ€์ž„ ํŠธ๋ž˜๋ธ”
Apache Iceberg ์ปฌ๋Ÿผ(Parquet) Athena, Glue, EMR AWS ๊ณต์‹ ์ง€์›, ์Šคํ‚ค๋งˆ ์ง„ํ™”
 
03 / Question Patterns

๋ฐ˜๋ณต ์ถœ์ œ ๋ฌธ์ œ ์œ ํ˜• 30๊ฐ€์ง€ ํŒจํ„ด

 

์ด ํŒจํ„ด๋“ค์„ ์ตํžˆ๋ฉด ์ƒˆ๋กœ์šด ๋ฌธ์ œ๋„ ํŒจํ„ด ๋งค์นญ์œผ๋กœ ๋น ๋ฅด๊ฒŒ ํ’€๋ฆฐ๋‹ค.

PATTERN 01
์‹ค์‹œ๊ฐ„ vs ๋ฐฐ์น˜ ์„œ๋น„์Šค ์„ ํƒ

ms ๋‹จ์œ„ ์‹ค์‹œ๊ฐ„ → KDS. ์ˆ˜๋ถ„ ๋‹จ์œ„ ๋ฌถ์Œ ์ „์†ก → Firehose. ๋Œ€๊ทœ๋ชจ ๋ฐฐ์น˜ → Glue/EMR. ์„œ๋ฒ„๋ฆฌ์Šค ๊ฐ„๋‹จ ์ฒ˜๋ฆฌ → Lambda.

KDS๋Š” ์ง์ ‘ ์†Œ๋น„์ž ์ฝ”๋“œ ํ•„์š”, Firehose๋Š” ์™„์ „ ๊ด€๋ฆฌํ˜• — ๊ด€๋ฆฌ ๋ถ€๋‹ด ์—†์œผ๋ฉด Firehose ์„ ํƒ
PATTERN 02
๋ฐ์ดํ„ฐ ๋ ˆ์ดํฌ ์•„ํ‚คํ…์ฒ˜ ์„ค๊ณ„

ํ•ญ์ƒ S3 + Glue Data Catalog + Lake Formation ์กฐํ•ฉ. ์ฟผ๋ฆฌ์—” Athena, ๊ฑฐ๋ฒ„๋„Œ์Šค์—” Lake Formation.

๋ฐ์ดํ„ฐ ๋ ˆ์ดํฌ = S3 ๊ธฐ๋ฐ˜. Lake Formation = ๋ณด์•ˆ ๊ด€๋ฆฌ์ž. Glue Catalog = ๋ฉ”ํƒ€๋ฐ์ดํ„ฐ ์ €์žฅ์†Œ
PATTERN 03
์„œ๋ฒ„๋ฆฌ์Šค ETL ํŒŒ์ดํ”„๋ผ์ธ

์„œ๋ฒ„ ๊ด€๋ฆฌ ์—†์ด ETL → AWS Glue. ์‹œ๊ฐ์  UI ํ•„์š” → Glue DataBrew. ๋Œ€๊ทœ๋ชจ ์ปค์Šคํ…€ → EMR.

"์™„์ „ ๊ด€๋ฆฌํ˜•" ํ‚ค์›Œ๋“œ ๋“ฑ์žฅ ์‹œ ํ•ญ์ƒ Glue ์šฐ์„  ๊ณ ๋ ค
PATTERN 04
์ด๊ธฐ์ข… DB ๋งˆ์ด๊ทธ๋ ˆ์ด์…˜

๋™์ข… DB ์ด์ „ → DMS. ์ด๊ธฐ์ข…(Oracle→Aurora) → SCT + DMS. ๋ฌด์ค‘๋‹จ ์‹ค์‹œ๊ฐ„ ๋ณต์ œ → CDC ํ™œ์„ฑํ™”.

SCT = ์Šคํ‚ค๋งˆ ๋ณ€ํ™˜, DMS = ๋ฐ์ดํ„ฐ ์ด๋™ — ์—ญํ•  ๊ตฌ๋ถ„ ์•”๊ธฐ ํ•„์ˆ˜
PATTERN 05
์Šคํ† ๋ฆฌ์ง€ ๋น„์šฉ ์ตœ์ ํ™”

์ž์ฃผ ์ ‘๊ทผ → S3 Standard. ๊ฐ€๋” → S3 IA. ๊ฑฐ์˜ ์—†์Œ → Glacier. CSV → Parquet ์ „ํ™˜ + ํŒŒํ‹ฐ์…”๋‹.

Athena๋Š” ์Šค์บ” ๋ฐ์ดํ„ฐ๋งŒํผ ๊ณผ๊ธˆ → Parquet + ํŒŒํ‹ฐ์…”๋‹์œผ๋กœ ์ตœ๋Œ€ 90% ์ ˆ๊ฐ ๊ฐ€๋Šฅ
PATTERN 06
๋ฐ์ดํ„ฐ ์•”ํ˜ธํ™” ๋ฐฉ์‹ ์„ ํƒ

AWS ๊ด€๋ฆฌ ํ‚ค → SSE-S3. KMS ์ œ์–ด → SSE-KMS. ๊ณ ๊ฐ ํ‚ค ์ง์ ‘ ์ œ๊ณต → SSE-C. ํด๋ผ์ด์–ธํŠธ ์•”ํ˜ธํ™” → CSE.

"๊ทœ์ • ์ค€์ˆ˜ ๊ฐ์‚ฌ ํ•„์š”" → SSE-KMS. CloudTrail๋กœ ํ‚ค ์‚ฌ์šฉ ์ด๋ ฅ ์ถ”์  ๊ฐ€๋Šฅ
PATTERN 07
IAM ์ตœ์†Œ ๊ถŒํ•œ ์„ค๊ณ„

ํ•ญ์ƒ ์ตœ์†Œ ๊ถŒํ•œ ์›์น™. ๋ฆฌ์†Œ์Šค ๊ธฐ๋ฐ˜ vs ์ž๊ฒฉ์ฆ๋ช… ๊ธฐ๋ฐ˜ ์ •์ฑ… ๊ตฌ๋ถ„. Cross-Account → Role Assume.

Lambda/Glue์— ๊ถŒํ•œ ๋ถ€์—ฌ ์‹œ User๊ฐ€ ์•„๋‹Œ Role ์‚ฌ์šฉ — ์„œ๋น„์Šค๋Š” Role๋กœ ์ธ์ฆ
PATTERN 08
DynamoDB ์„ฑ๋Šฅ ๋ฌธ์ œ ํ•ด๊ฒฐ

ํ•ซ ํŒŒํ‹ฐ์…˜ → ํŒŒํ‹ฐ์…˜ ํ‚ค ๋ถ„์‚ฐ ์„ค๊ณ„. ์ฝ๊ธฐ ๋ถ€ํ•˜ → DAX ์บ์‹œ. ๊ฐ‘์ž‘์Šค๋Ÿฐ ํŠธ๋ž˜ํ”ฝ → On-Demand ๋ชจ๋“œ.

ํŒŒํ‹ฐ์…˜ ํ‚ค๋ฅผ ๋‹ค์–‘ํ•˜๊ฒŒ ๋ถ„์‚ฐํ•ด์•ผ ํ•ซ ํŒŒํ‹ฐ์…˜ ๋ฐฉ์ง€ — S3 Prefix ๋ถ„์‚ฐ๊ณผ ๊ฐ™์€ ์›๋ฆฌ
PATTERN 09
Redshift ์ฟผ๋ฆฌ ์ตœ์ ํ™”

DISTKEY → ์กฐ์ธ ๋งŽ์€ ์ปฌ๋Ÿผ. SORTKEY → WHERE์ ˆ ์กฐ๊ฑด ์ปฌ๋Ÿผ. COPY ๋ช…๋ น์œผ๋กœ S3์—์„œ ๋ณ‘๋ ฌ ๋กœ๋“œ.

INSERT๋ณด๋‹ค COPY๊ฐ€ ํ›จ์”ฌ ๋น ๋ฆ„ — S3์—์„œ Redshift ์ ์žฌ ์‹œ ํ•ญ์ƒ COPY ์‚ฌ์šฉ
PATTERN 10
PII ๋ฏผ๊ฐ ์ •๋ณด ํƒ์ง€·์ฒ˜๋ฆฌ

S3 ์ž๋™ ํƒ์ง€ → Macie. ETL ๋‚ด PII ํƒ์ง€·๋งˆ์Šคํ‚น → Glue ๋ฏผ๊ฐ ๋ฐ์ดํ„ฐ ๊ธฐ๋Šฅ. ์‚ญ์ œ·์ต๋ช…ํ™” → Lambda.

Macie๋Š” ํƒ์ง€๋งŒ, ๋งˆ์Šคํ‚น·์‚ญ์ œ๋Š” ๋ณ„๋„ Glue/Lambda ์ฒ˜๋ฆฌ ํ•„์š”
PATTERN 11
์›Œํฌํ”Œ๋กœ ์˜ค์ผ€์ŠคํŠธ๋ ˆ์ด์…˜ ์„ ํƒ

๊ฐ„๋‹จํ•œ Lambda ์ฒด์ด๋‹ → Step Functions. ๋ณต์žกํ•œ DAG → MWAA(Airflow). ์ด๋ฒคํŠธ ๊ธฐ๋ฐ˜ ํŠธ๋ฆฌ๊ฑฐ → EventBridge.

Step Functions = ์‹œ๊ฐ์  ์›Œํฌํ”Œ๋กœ, MWAA = ๋ณต์žกํ•œ ์˜์กด์„ฑ+์Šค์ผ€์ค„๋ง — ์šฉ๋„ ๊ตฌ๋ถ„์ด ํ•ต์‹ฌ
PATTERN 12
์„œ๋น„์Šค ๊ฐ„ ๋””์ปคํ”Œ๋ง(๋А์Šจํ•œ ๊ฒฐํ•ฉ)

1:1 ๋น„๋™๊ธฐ → SQS. 1:N ํŒฌ์•„์›ƒ → SNS→SQS ๊ตฌ์กฐ. ์ด๋ฒคํŠธ ๋ผ์šฐํŒ…·ํ•„ํ„ฐ๋ง → EventBridge.

SNS+SQS ํŒฌ์•„์›ƒ ํŒจํ„ด ์ž์ฃผ ์ถœ์ œ — SNS๊ฐ€ ์—ฌ๋Ÿฌ SQS์— ๋™์‹œ ๋ฐœํ–‰ํ•˜๋Š” ์•„ํ‚คํ…์ฒ˜
PATTERN 13
Athena ์ฟผ๋ฆฌ ๋น„์šฉ ์ค„์ด๊ธฐ

ํŒŒํ‹ฐ์…”๋‹(๋‚ ์งœ/์ง€์—ญ) + Parquet ํฌ๋งท ์ „ํ™˜. Glue Crawler๋กœ ํŒŒํ‹ฐ์…˜ ์ž๋™ ์ธ์‹. ์ฟผ๋ฆฌ ๊ฒฐ๊ณผ ์žฌ์‚ฌ์šฉ.

ํŒŒํ‹ฐ์…˜ ํ”„๋ฃจ๋‹ = WHERE์ ˆ์— ํŒŒํ‹ฐ์…˜ ์ปฌ๋Ÿผ ์กฐ๊ฑด → ์Šค์บ” ๋ฐ์ดํ„ฐ ๋Œ€ํญ ๊ฐ์†Œ
PATTERN 14
์ŠคํŠธ๋ฆผ ์‹ค์‹œ๊ฐ„ ์ด์ƒ ํƒ์ง€

Kinesis → KDA(SQL/Flink) → ์ด์ƒ์น˜ ํƒ์ง€ → SNS ์•Œ๋ฆผ or Lambda ์ฒ˜๋ฆฌ. ์‹ค์‹œ๊ฐ„ ์ง‘๊ณ„๋„ KDA.

KDA ๊ฒฐ๊ณผ๋ฅผ Kinesis/S3/Lambda๋กœ ์ „๋‹ฌํ•˜๋Š” downstream ์•„ํ‚คํ…์ฒ˜ ๊ตฌ์กฐ ์ˆ™์ง€
PATTERN 15
ํฌ๋กœ์Šค ๊ณ„์ • ๋ฐ์ดํ„ฐ ์ ‘๊ทผ

Cross-Account Role Assume + S3 ๋ฒ„ํ‚ท ์ •์ฑ…. Lake Formation์œผ๋กœ ๋‹ค๋ฅธ ๊ณ„์ •์— ํ…Œ์ด๋ธ”·์ปฌ๋Ÿผ ๋‹จ์œ„ ๊ณต์œ .

Lake Formation = ์ •๋ฐ€ํ•œ ํฌ๋กœ์Šค ๊ณ„์ • ๋ฐ์ดํ„ฐ ๊ฑฐ๋ฒ„๋„Œ์Šค — ์ปฌ๋Ÿผ ๋‹จ์œ„ ๊ณต์œ  ๊ฐ€๋Šฅ
PATTERN 16
RDS ๊ณ ๊ฐ€์šฉ์„ฑ vs ์„ฑ๋Šฅ ํ™•์žฅ

์žฅ์•  ๋Œ€์‘(HA) → Multi-AZ(์ž๋™ ํŽ˜์ผ์˜ค๋ฒ„). ์ฝ๊ธฐ ๋ถ€ํ•˜ ๋ถ„์‚ฐ(์„ฑ๋Šฅ) → Read Replica. Aurora Global → ๊ธ€๋กœ๋ฒŒ DR.

Multi-AZ = ๊ฐ€์šฉ์„ฑ ๋ชฉ์ , Read Replica = ์„ฑ๋Šฅ ๋ชฉ์  — ํ˜ผ๋™์€ ์‹œํ—˜ ๋‹จ๊ณจ ํ•จ์ •
PATTERN 17
VPC ๋„คํŠธ์›Œํฌ ๋ณด์•ˆ ์„ค๊ณ„

์ธํ„ฐ๋„ท ์—†์ด AWS ์„œ๋น„์Šค ์ ‘๊ทผ → VPC Endpoint. S3·DynamoDB → Gateway Endpoint(๋ฌด๋ฃŒ). ๋‚˜๋จธ์ง€ → Interface Endpoint.

VPC Endpoint = ์ธํ„ฐ๋„ท ์—†์ด AWS ์„œ๋น„์Šค ์ง์ ‘ ์ ‘๊ทผ → ๋ณด์•ˆ+๋ฐ์ดํ„ฐ ์ „์†ก ๋น„์šฉ ์ด์ 
PATTERN 18
๋ฐ์ดํ„ฐ ํ’ˆ์งˆ ๊ด€๋ฆฌ

Glue Data Quality๋กœ ์Šคํ‚ค๋งˆ·๊ฐ’ ๊ฒ€์ฆ ๊ทœ์น™. CloudWatch + Lambda๋กœ ์ด์ƒ ๋ ˆ์ฝ”๋“œ ์•Œ๋ฆผ. DataBrew๋กœ ๋ฐ์ดํ„ฐ ํ”„๋กœํŒŒ์ผ๋ง.

Glue Data Quality = ETL ๋‚ด ํ’ˆ์งˆ ๊ฒŒ์ดํŠธ ์—ญํ•  — ๋ถˆ๋Ÿ‰ ๋ฐ์ดํ„ฐ๋ฅผ ํŒŒ์ดํ”„๋ผ์ธ์—์„œ ์‚ฌ์ „ ์ฐจ๋‹จ
PATTERN 19
์•ฑ ๋กœ๊ทธ ์ˆ˜์ง‘ ํŒŒ์ดํ”„๋ผ์ธ

์•ฑ → Firehose → S3 → Athena(์žฅ๊ธฐ ๋ถ„์„). ๋˜๋Š” ์•ฑ → CW Logs → Firehose → OpenSearch(์‹ค์‹œ๊ฐ„ ๊ฒ€์ƒ‰).

์‹ค์‹œ๊ฐ„ ๊ฒ€์ƒ‰·์‹œ๊ฐํ™” → OpenSearch, ์žฅ๊ธฐ SQL ๋ถ„์„ → S3+Athena — ๋ชฉ์ ์— ๋”ฐ๋ผ ์„ ํƒ
PATTERN 20
CDC ๋ณ€๊ฒฝ ๋ฐ์ดํ„ฐ ์บก์ฒ˜

RDS/Aurora → DMS CDC → Kinesis → S3/Redshift. DynamoDB ๋ณ€๊ฒฝ → DynamoDB Streams → Lambda.

CDC = DB ๋ณ€๊ฒฝ ๋‚ด์šฉ๋งŒ ์ถ”์ถœ — ์ „์ฒด ํ…Œ์ด๋ธ” ๋ณต์‚ฌ ์—†์ด ์‹ค์‹œ๊ฐ„ ๋™๊ธฐํ™” ๊ฐ€๋Šฅ
PATTERN 21
์„œ๋ฒ„๋ฆฌ์Šค ์•„ํ‚คํ…์ฒ˜ ์ตœ์  ์„ค๊ณ„

S3 + Glue(์„œ๋ฒ„๋ฆฌ์Šค) + Athena + QuickSight. Lambda + Firehose + S3. "์šด์˜ ์˜ค๋ฒ„ํ—ค๋“œ ์ตœ์†Œํ™”" = ์„œ๋ฒ„๋ฆฌ์Šค ์กฐํ•ฉ.

Redshift Serverless, Glue Serverless๋„ ์„ ํƒ์ง€ — "๊ด€๋ฆฌ ์—†์ด" ํ‚ค์›Œ๋“œ ์‹œ ์„œ๋ฒ„๋ฆฌ์Šค ์šฐ์„ 
PATTERN 22
๋Œ€์šฉ๋Ÿ‰ ์ดˆ๊ธฐ ๋ฐ์ดํ„ฐ ์ ์žฌ

์ธํ„ฐ๋„ท ๊ฐ€๋Šฅ·๋น ๋ฆ„ → DataSync. ์ธํ„ฐ๋„ท ๋ถˆ์•ˆ์ •·๋А๋ฆผ → Snowball Edge. ํŽ˜ํƒ€๋ฐ”์ดํŠธ ๊ทœ๋ชจ → Snowmobile.

DataSync = ๋„คํŠธ์›Œํฌ ์ „์†ก ์ตœ์ ํ™”, Snowball = ๋ฌผ๋ฆฌ ๋””๋ฐ”์ด์Šค ์šด๋ฐ˜ — ์ธํ„ฐ๋„ท ์†๋„๊ฐ€ ๊ฒฐ์ • ๊ธฐ์ค€
PATTERN 23
์ปดํ”Œ๋ผ์ด์–ธ์Šค ๊ฐ์‚ฌ ์ถ”์ 

API ํ˜ธ์ถœ ์ด๋ ฅ → CloudTrail. ๋ฆฌ์†Œ์Šค ์„ค์ • ๋ณ€๊ฒฝ → AWS Config. ๋ฐ์ดํ„ฐ ์ ‘๊ทผ ๋กœ๊ทธ → Lake Formation.

CloudTrail = "๋ˆ„๊ฐ€ ๋ญ˜ ํ–ˆ๋‚˜", Config = "์„ค์ •์ด ์–ด๋–ป๊ฒŒ ๋ฐ”๋€Œ์—ˆ๋‚˜" — ๋ชฉ์  ๊ตฌ๋ถ„ ๋ฐ˜๋“œ์‹œ ์•”๊ธฐ
PATTERN 24
๋ฐ์ดํ„ฐ ๋ ˆ์ดํฌํ•˜์šฐ์Šค ๊ตฌ์ถ•

S3 + Apache Iceberg/Delta Lake + Athena or Redshift Spectrum. ํŠธ๋žœ์žญ์…˜ ์ง€์› + ๋Œ€๊ทœ๋ชจ ๋ถ„์„ ๋™์‹œ ๊ฐ€๋Šฅ.

Iceberg = AWS ๊ณต์‹ ์ง€์› — Athena, Glue, EMR ๋ชจ๋‘ Iceberg ํ…Œ์ด๋ธ” ์ฝ๊ธฐ/์“ฐ๊ธฐ ์ง€์›
PATTERN 25
QuickSight ๋Œ€์‹œ๋ณด๋“œ ์ตœ์ ํ™”

Redshift/Athena/S3 → QuickSight. SPICE๋กœ ์ธ๋ฉ”๋ชจ๋ฆฌ ์บ์‹ฑ. Row-Level Security๋กœ ๋ถ€์„œ๋ณ„ ๋ฐ์ดํ„ฐ ํ•„ํ„ฐ๋ง.

QuickSight Q = ์ž์—ฐ์–ด๋กœ ๋ฐ์ดํ„ฐ ์งˆ์˜(ML ๊ธฐ๋ฐ˜) — ์ž„์› ์…€ํ”„์„œ๋น„์Šค ๋ถ„์„ ์‹œ๋‚˜๋ฆฌ์˜ค์— ๋“ฑ์žฅ
PATTERN 26
์‹œ๊ณ„์—ด IoT ๋ฐ์ดํ„ฐ ์ €์žฅ

IoT ์„ผ์„œ·์„œ๋ฒ„ ๋ฉ”ํŠธ๋ฆญ → Amazon Timestream. ์ฟผ๋ฆฌ ์ตœ์ ํ™” + ์ž๋™ TTL. Grafana ์—ฐ๋™ ์‹œ๊ฐํ™”.

"์‹œ๊ฐ„ ๊ธฐ๋ฐ˜ ๋ฐ์ดํ„ฐ" ํ‚ค์›Œ๋“œ → Timestream ์šฐ์„  ๊ณ ๋ ค, ์ผ๋ฐ˜ DynamoDB๋กœ ์ €์žฅ ์‹œ ๋น„ํšจ์œจ
PATTERN 27
DB ์ž๊ฒฉ์ฆ๋ช… ์•ˆ์ „ ๊ด€๋ฆฌ

์ž๋™ ์ˆœํ™˜(Rotation) ํ•„์š” → Secrets Manager. ๋‹จ์ˆœ ์„ค์ •๊ฐ’ → Parameter Store. ํ•˜๋“œ์ฝ”๋”ฉ์€ ํ•ญ์ƒ ์˜ค๋‹ต.

Secrets Manager๋Š” RDS, Redshift ์ž๋™ ๋น„๋ฐ€๋ฒˆํ˜ธ ์ˆœํ™˜ ๊ธฐ๋ณธ ์ง€์› — ์ถ”๊ฐ€ Lambda ๋ถˆํ•„์š”
PATTERN 28
Redshift ๋ฐ์ดํ„ฐ ๊ณต์œ 

Redshift Datasharing์œผ๋กœ ๋‹ค๋ฅธ ํด๋Ÿฌ์Šคํ„ฐ/๊ณ„์ •์— ๋ผ์ด๋ธŒ ๋ฐ์ดํ„ฐ ๊ณต์œ . ๋ณต์‚ฌ ์—†์ด ์ฝ๊ธฐ ์ „์šฉ ์ ‘๊ทผ.

๋ฐ์ดํ„ฐ ๋ณต์ œ ์—†์ด ๊ณต์œ  → ์Šคํ† ๋ฆฌ์ง€ ๋น„์šฉ ์ ˆ๊ฐ + ํ•ญ์ƒ ์ตœ์‹  ๋ฐ์ดํ„ฐ ์œ ์ง€
PATTERN 29
ํŒŒ์ดํ”„๋ผ์ธ ์žฅ์•  ๋ชจ๋‹ˆํ„ฐ๋ง·์•Œ๋ฆผ

CloudWatch Alarm → SNS → ์ด๋ฉ”์ผ/SMS. Glue Job ์‹คํŒจ → EventBridge → SNS. Step Functions → CloudWatch.

๊ณตํ†ต ํŒจํ„ด: ์„œ๋น„์Šค → EventBridge/CloudWatch → SNS → ์•Œ๋ฆผ — ์ด ํ๋ฆ„์„ ์™„์ „ ์•”๊ธฐ
PATTERN 30
S3 ์„ฑ๋Šฅ ์ตœ์ ํ™”

์†Œ๋Ÿ‰ ๋žœ๋ค ์ ‘๊ทผ → Prefix ๋ถ„์‚ฐ. ๋Œ€๋Ÿ‰ ์ ์žฌ → ๋ฉ€ํ‹ฐํŒŒํŠธ ์—…๋กœ๋“œ(100MB ์ด์ƒ). ์›๊ฑฐ๋ฆฌ → Transfer Acceleration.

๋‹จ์ผ Prefix ํ•œ๋„: 3,500 PUT/5,500 GET per sec — Prefix ๋ถ„์‚ฐ์œผ๋กœ ์„ ํ˜• ํ™•์žฅ ๊ฐ€๋Šฅ
 
04 / Study Plan

3์ผ ๋งŒ์— ํ•ฉ๊ฒฉํ•˜๋Š” ๊ณต๋ถ€๋ฒ•

 

๋ฐ์ดํ„ฐ ์—”์ง€๋‹ˆ์–ด๋ง ์‹ค๋ฌด ๊ฒฝํ—˜์ด ์žˆ๋‹ค๋ฉด 3์ผ ์ง‘์ค‘์œผ๋กœ ์ถฉ๋ถ„ํ•˜๋‹ค. ์ˆœ์„œ์™€ ์ „๋žต์ด ํ•ต์‹ฌ์ด๋‹ค.

DAY 1
๐Ÿ—บ๏ธ ์ „์ฒด ๊ตฌ์กฐ ์ดํ•ด + ํ•ต์‹ฌ 20๊ฐœ
  • ์˜ค์ „ (3h) — AWS ๊ณต์‹ DEA ์‹œํ—˜ ๊ฐ€์ด๋“œ ์ •๋…. 4๊ฐœ ๋„๋ฉ”์ธ ๋น„์ค‘·๋ฒ”์œ„ ํŒŒ์•…. ์ด ๊ธ€ ์„œ๋น„์Šค ์ง€๋„ ์ˆ™์ง€.
  • ์˜คํ›„ (3h) — Domain 1 ์ง‘์ค‘: Kinesis 3์ข…, Glue, DMS, Lambda, SQS/SNS/EventBridge. ์‹ค์ƒํ™œ ๋น„์œ ๋กœ ์•”๊ธฐ.
  • ์ €๋… (2h) — AWS ๊ณต์‹ ์ƒ˜ํ”Œ ๋ฌธ์ œ 20๊ฐœ. ํ‹€๋ฆฐ ๋ฌธ์ œ ์˜ค๋‹ต ๋…ธํŠธ.
  • ํ•ต์‹ฌ — KDS vs Firehose, Glue Crawler/Job/Catalog ์—ญํ•  ์™„์ „ ๊ตฌ๋ถ„.
DAY 2
๐Ÿ” ์ €์žฅ·๋ณด์•ˆ·์šด์˜ ์™„์„ฑ
  • ์˜ค์ „ (3h) — Domain 2: S3 ์Šคํ† ๋ฆฌ์ง€ ํด๋ž˜์Šค, Redshift DISTKEY/SORTKEY, DynamoDB ํŒŒํ‹ฐ์…˜ ํ‚ค ์„ค๊ณ„.
  • ์˜คํ›„ (3h) — Domain 4: IAM/KMS/Secrets Manager/Macie/Lake Formation. VPC Endpoint ๊ฐœ๋….
  • ์ €๋… (2h) — Domain 3: CloudWatch, Step Functions vs MWAA. CloudTrail vs Config ๊ตฌ๋ถ„.
  • ํ•ต์‹ฌ — ํŒŒ์ผ ํฌ๋งท ๋น„๊ตํ‘œ ์•”๊ธฐ, SSE-S3/KMS/C ๊ตฌ๋ถ„, Macie vs GuardDuty ์ฐจ์ด.
DAY 3
๐ŸŽฏ ๋ชจ์˜๊ณ ์‚ฌ + ์•ฝ์  ๋ณด์™„
  • ์˜ค์ „ (3h) — Tutorials Dojo ๋ชจ์˜๊ณ ์‚ฌ 65๋ฌธ์ œ. ๋ฌธ์ œ ํŒจํ„ด 30๊ฐœ ๋Œ€์ž…ํ•ด์„œ ํ’€๊ธฐ.
  • ์˜คํ›„ (2h) — ์˜ค๋‹ต ์›์ธ ๋ถ„๋ฅ˜: ๊ฐœ๋… ๋ฏธ์ˆ™ vs ํ—ท๊ฐˆ๋ฆผ vs ์‹ค์ˆ˜. ๊ฐœ๋… ๋ฏธ์ˆ™๋งŒ ์žฌํ•™์Šต.
  • ์ €๋… (2h) — ์•ฝ์  ๋„๋ฉ”์ธ ์ง‘์ค‘ ๋ณต์Šต. ์•„ํ‚คํ…์ฒ˜ ๋‹ค์ด์–ด๊ทธ๋žจ ์†์œผ๋กœ ๊ทธ๋ฆฌ๊ธฐ.
  • ํ•ต์‹ฌ — 720์  = 65๋ฌธ์ œ ์ค‘ 47๊ฐœ ์ด์ƒ ์ •๋‹ต. ํŒจํ„ด ๋งค์นญ ์†๋„ ๋†’์ด๊ธฐ.

๐Ÿ“š ์ถ”์ฒœ ํ•™์Šต ์ž๋ฃŒ

  • AWS ๊ณต์‹: DEA-C01 ์‹œํ—˜ ๊ฐ€์ด๋“œ (aws.amazon.com/certification) — ๋ฌด๋ฃŒ, ํ•„์ˆ˜ ์ •๋…
  • ๊ฐ•์˜: Stephane Maarek์˜ Udemy AWS DEA ๊ฐ•์˜ — ์ž๋ง‰ ์™„๋น„, ํ€„๋ฆฌํ‹ฐ ์ตœ๊ณ 
  • ๋ชจ์˜๊ณ ์‚ฌ: Tutorials Dojo DEA Practice Exams — ์‹ค์ „๊ณผ ๊ฐ€์žฅ ์œ ์‚ฌํ•œ ํ€„๋ฆฌํ‹ฐ
  • ๋ฌด๋ฃŒ ๊ธฐ์ถœ: Examtopics.com DEA ์„น์…˜ — ์ตœ์‹  ๊ธฐ์ถœ ๊ณต์œ , ์ปค๋ฎค๋‹ˆํ‹ฐ ํ•ด์„ค ์ฐธ๊ณ 
  • ํ•ธ์ฆˆ์˜จ: AWS Free Tier๋กœ Glue, Athena, Kinesis Firehose ์ง์ ‘ ์‹ค์Šต ๊ฐ•๋ ฅ ์ถ”์ฒœ

๐Ÿ’ก ํ•ฉ๊ฒฉ ์ „๋žต ํ•ต์‹ฌ ํŒ

๐ŸŽฏ
๋„๋ฉ”์ธ ๋น„์ค‘์— ๋งž๊ฒŒ ๋ฐฐ๋ถ„
Domain 1(34%)์— ๊ฐ€์žฅ ๋งŽ์€ ์‹œ๊ฐ„์„. Kinesis + Glue + DMS 3์ข…์„ธํŠธ๊ฐ€ ์‹œํ—˜์˜ 3๋ถ„์˜ 1์ด๋‹ค.
๐Ÿ”„
์„œ๋น„์Šค ๋น„๊ต๊ฐ€ ํ•ต์‹ฌ
SQS vs SNS, KDS vs Firehose, Glue vs EMR, Step Functions vs MWAA — ๋น„๊ต ์•”๊ธฐ ํ•„์ˆ˜.
๐Ÿท๏ธ
ํ‚ค์›Œ๋“œ → ์„œ๋น„์Šค ๋งคํ•‘
"์„œ๋ฒ„๋ฆฌ์Šค"→Glue/Athena, "์‹ค์‹œ๊ฐ„ ms"→KDS, "๊ฐ์‚ฌ"→CloudTrail, "PII ํƒ์ง€"→Macie. ๋ฐ˜์‚ฌ์  ์—ฐ๊ฒฐ.
โŒ
์˜ค๋‹ต์ด ํ™ฉ๊ธˆ์ด๋‹ค
ํ‹€๋ฆฐ ๋ฌธ์ œ ๋ถ„์„์ด ์ƒˆ ๋ฌธ์ œ 3๊ฐœ ํ‘ธ๋Š” ๊ฒƒ๋ณด๋‹ค ๊ฐ€์น˜ ์žˆ๋‹ค. "์™œ ํ‹€๋ ธ๋‚˜"๋ฅผ ๋ช…ํ™•ํžˆ ํŒŒ์•…ํ•˜๋ฉด ์œ ์‚ฌ ํŒจํ„ด ์ •๋ณต.
๐Ÿ’ฐ
๋น„์šฉ ์ตœ์ ํ™”๋Š” ๋ฐ˜๋“œ์‹œ ์ถœ์ œ
"๊ฐ€์žฅ ๋น„์šฉ ํšจ์œจ์ " ๋‹ต = ์„œ๋ฒ„๋ฆฌ์Šค + Parquet + ํŒŒํ‹ฐ์…”๋‹ + ์ ํ•ฉํ•œ ์Šคํ† ๋ฆฌ์ง€ ํด๋ž˜์Šค ์กฐํ•ฉ.
๐Ÿ”
๋ณด์•ˆ ๋ฌธ์ œ ๊ณต์‹
๋ณด์•ˆ = ํ•ญ์ƒ ์ตœ์†Œ ๊ถŒํ•œ ์›์น™. VPC Endpoint + Secrets Manager + KMS CMK ์กฐํ•ฉ์ด ๊ณ ๋“์  ํ‚ค.
โฑ๏ธ
์‹œ๊ฐ„ ๊ด€๋ฆฌ
170๋ถ„ ÷ 65๋ฌธ์ œ = 2.6๋ถ„/๋ฌธ์ œ. 30์ดˆ ๋‚ด ๋ฐฉํ–ฅ ์•ˆ ์žกํžˆ๋ฉด Flag ๋‹ฌ๊ณ  ๋‹ค์Œ์œผ๋กœ. ํ™•์‹คํ•œ ๊ฒƒ ๋จผ์ €.
๐Ÿ—บ๏ธ
์•„ํ‚คํ…์ฒ˜ ์ง์ ‘ ๊ทธ๋ฆฌ๊ธฐ
์ˆ˜์ง‘→์ฒ˜๋ฆฌ→์ €์žฅ→๋ถ„์„ ํŒŒ์ดํ”„๋ผ์ธ์„ ์†์œผ๋กœ ๊ทธ๋ ค๋ณด๋ฉด ์„œ๋น„์Šค ์—ฐ๊ฒฐ ๊ด€๊ณ„๊ฐ€ ๋ช…ํ™•ํ•ด์ง„๋‹ค.

โœ… ์‹œํ—˜ ๋‹น์ผ ์ฒดํฌ๋ฆฌ์ŠคํŠธ

  • ์‹ ๋ถ„์ฆ 2๊ฐœ ์ง€์ฐธ (์‹ ๋ถ„์ฆ + ์‹ ์šฉ์นด๋“œ ๋“ฑ) — Pearson VUE ๊ทœ์ • ํ™•์ธ
  • ์‹œํ—˜ 30๋ถ„ ์ „ ์ž…์žฅ (์˜จ๋ผ์ธ ์‹œํ—˜ ์‹œ ํ™˜๊ฒฝ ์ ๊ฒ€ ํ•„์ˆ˜)
  • ๋ชจ๋ฅด๋Š” ๋ฌธ์ œ Flag ํ‘œ์‹œ ํ›„ ๋งˆ์ง€๋ง‰์— ์žฌ๊ฒ€ํ† 
  • 720์  = ์•ฝ 72% ์ •๋‹ต๋ฅ . ์™„๋ฒฝํ•˜์ง€ ์•Š์•„๋„ ํ•ฉ๊ฒฉ ๊ฐ€๋Šฅ
  • ์ฒซ ๋ฒˆ์งธ ์ง๊ด€์„ ๋ฏฟ์–ด๋ผ — ์žฌ๊ฒ€ํ†  ์‹œ ๋‹ต ๋ฐ”๊พธ๋ฉด ํ‹€๋ฆฌ๋Š” ๊ฒฝ์šฐ๊ฐ€ ๋” ๋งŽ๋‹ค
๋ฐ˜์‘ํ˜•