Strata Conference + Hadoop World 2012 참관기 김영우 KT...

15
Strata Conference + Hadoop World 2012 참관기 김영우 KT Cloudware (NexR) Brandon.kim@{kt|nexr}.com

Transcript of Strata Conference + Hadoop World 2012 참관기 김영우 KT...

Page 1: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

Strata Conference + Hadoop World 2012 참관기

김영우 KT Cloudware (NexR)

Brandon.kim@{kt|nexr}.com

Page 2: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

1

Page 3: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

튜토리얼

• Building applications with HBase

2

Page 4: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

튜토리얼

• Hadoop Data Warehousing with Hive

3

Page 5: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

이벤트 - 스타트업 쇼케이스

4

Page 6: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

세션

• Paypal

• Akamai

• Facebook

• Last.fm

• Cloudera

• Metamarkets

• Comcast

• Nokia

• WibiData

• Netflix

• Hortonworks

• SAP

• SAS

• Microsoft

• …… 5

Page 7: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

세션 (2)

6

• Hadoop as a Complementary Data Platform at PayPal

Page 8: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

세션 (3)

7

• Trecul : Data Flow Processing Using LLVM-based JIT Compilation on Top of Hadoop

Page 9: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

세션 (4)

8

• Large Scale ETL with Hadoop

Page 10: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

세션 (5)

9

• Facebook's Large Scale Monitoring System Built on HBase

Page 11: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

세션 (6)

10

• Performing Data Science with HBase

Page 12: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

세션 (7)

11

• Data Science on Hadoop: How Cloudera Impala Unlocks New Productivity and Insights

Page 13: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

세션 (8)

12

• Netflix's Evolving Data Science Architecture

Page 14: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

세션 (9)

13

• Beyond Hadoop: Fast Ad-Hoc Queries on Big Data

Page 15: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service

결론

14

• In-memory storage and query engine

• SQL and SQL-like(DSL) tools to analyze big data

• The life cycle of the Big Data