Mysql Bigdata Otn

download Mysql Bigdata Otn

of 52

Transcript of Mysql Bigdata Otn

  • 7/27/2019 Mysql Bigdata Otn

    1/52

    Oracle MySQL Visin &EstrategiaJornada de Actualizacin TecnolgicaBuenos Aires, Argentina

    Pedro.Andrade@oracle .com MySQL Strategic Accounts ~ Latin America & CaribbeanManuel .Contreras@oracle .com MySQL Senior Consultant ~ Latin America & Caribbean

  • 7/27/2019 Mysql Bigdata Otn

    2/52

    Compromiso de Oracle hacia clientes,desarrolladores y usuarios de MySQL*

    - Continuo desarrollo de MySQL Enterprise & Community bajolicenciamiento pblico (GPL)

    - Mayor inversin en investigacin & desarrollo (R&D)

    - Creacin de una Junta Consultiva de Clientes de MySQL

    - Continuidad de opciones de soporte Enterprise (anual o multi-anual)

    * Oracle com mitm ents to MySQL, press re lease :

    http://www.oracle.com/us/corporate/press/042364

    http://www.oracle.com/us/corporate/press/042364http://www.oracle.com/us/corporate/press/042364http://www.oracle.com/us/corporate/press/042364
  • 7/27/2019 Mysql Bigdata Otn

    3/52

  • 7/27/2019 Mysql Bigdata Otn

    4/52

    Softw are Open Sou rce @ Oracle\

    Oracle & So f tw are L ibre

  • 7/27/2019 Mysql Bigdata Otn

    5/52

    mysql.com

  • 7/27/2019 Mysql Bigdata Otn

    6/52

    Base Instalada Oracle

    70% utiliza

  • 7/27/2019 Mysql Bigdata Otn

    7/52

    Enfoque MySQL

  • 7/27/2019 Mysql Bigdata Otn

    8/52

    Oracle LinuxOracle VM

    Oracle Solaris Cluster

    Oracle GoldenGate

    Oracle Secure BackupOracle Database Firewall

    MySQL Enterprise OracleIntegrations/Certifications

    Oracle Fusion MiddleWare

    WebLogic Server Database Adapter for Oracle SOAOracle Business Process ManagemOracle Virtual DirectoryOracle Data Integrator

    Oracle Enterprise PerformanceManagementOracle Identity AnalyticsOpen SSO STS, Open SSO Fedlet

  • 7/27/2019 Mysql Bigdata Otn

    9/52

    MySQL Cluster 7.3 CGE * NoSQL* Cloud computing * Mejor Performance* Procesamiento Active Active

    MySQL Enterprise Server 5.6

    * Mejor performance* InnoDB Full Text Search* HA Scripting

  • 7/27/2019 Mysql Bigdata Otn

    10/52

    Falso:

    MySQL es solo parasistemas pequeos, no apto

    para sistemas con grandemanda transaccional

  • 7/27/2019 Mysql Bigdata Otn

    11/52

    Copyright 2012, Oracle and/or

    MySQL & Big Data ?

    80% of Hadoop users integrate withCloudera Partner Management

  • 7/27/2019 Mysql Bigdata Otn

    12/52

    MySQL en Latinoamrica

  • 7/27/2019 Mysql Bigdata Otn

    13/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    Qu es Big Data?

    Big Data referencia, en el sector de las TI, a los sistemas que manipulagrandes conjuntos de datos (o data sets).

    Las dificultades ms habituales en estos casos se centran en laalmacenamiento , bsqueda , anlisis & visualizacin .

    Big Data es tpicamente definido como altos volmenes de co

    estructurado, recolectado desde fuentes de datos no tradicionales como:web logs, clickstreams, social media, email, sensors, images, video, etc.

  • 7/27/2019 Mysql Bigdata Otn

    14/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    MakeBetter Decisi

    UsingBig Da

    Big Data in Action

    ANALYZE

    DECIDE ACQUIRE

    ORGANIZE

  • 7/27/2019 Mysql Bigdata Otn

    15/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    Where Does MySQL Fit?

  • 7/27/2019 Mysql Bigdata Otn

    16/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    B

    BI Solutions

    ACQUIRE

    ORGANIZ ANALYZE

    DECIDE

    MySQL in the Big Data Lifecycle

    NoSQL A

  • 7/27/2019 Mysql Bigdata Otn

    17/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    NoSQL AMySQL DaMySQL Clu

    MySQL in the Big Data Lifecycle

    ANALYZE

    DECIDE

    ORGANIZE

    ACQUIRE

  • 7/27/2019 Mysql Bigdata Otn

    18/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    MySQL NoSQL APIsDesign Goals

    Fullytransactional /

    ACID

    Blazing FastKey / Value

    Queries

    NoSQLacross

    Dat

    Combined with Schema Flexibility: Online DDL

  • 7/27/2019 Mysql Bigdata Otn

    19/52

    Copyright 2012, Oracle and/or

    Key-value accessBypasses SQL pa

    Implemented via:- Memcached plug-in- Memcached mappe

    InnoDB API- Use existing Memc- Shared process for u

    MySQL 5.6: InnoDBMemcached API

  • 7/27/2019 Mysql Bigdata Otn

    20/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    Performance

    Up to 9x Higher SET / INSERT Throughput

    M SQL Cl t E t i Ch i f N SQL AP

  • 7/27/2019 Mysql Bigdata Otn

    21/52

    Copyright 2012, Oracle and/or

    MySQL Cluster: Extensive Choice of NoSQL AP

    Mix &

    Match

  • 7/27/2019 Mysql Bigdata Otn

    22/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    Import Apache SqMySQL B

    MySQL in the Big Data Lifecycle

    ANALYZE

    DECIDE ACQUIRE

    ORGANIZE

  • 7/27/2019 Mysql Bigdata Otn

    23/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    Qu es Hadoop? Apache Hadoop es un framework de software que soporta aplicadistribuidas bajo una licencia libre.

    Permite a las aplicaciones trabajar con miles de nodos y petabyte

    Hadoop se inspir en los documentos Google para MapReduce y Google FileSystem (GFS).

    Hadoop es un proyecto de alto nivel Apache que est siendo construido yusado por una comunidad global, basado en Java.

    Productos Comerciales, que implementan Hadoop Framework:Cloudera, HortonWorks, MapR, Amazon EMR

  • 7/27/2019 Mysql Bigdata Otn

    24/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    Qu es Sqoop?

    Sqoop is a Command-line interface application for transferring data betweerelational databases and Hadoop.

    It supports incremental loads of a single table or a free form SQL queras saved jobs which can be run multiple times to import updates made to adatabase since the last import.

    Can be used to put data from Hadoop into a relational database.

    Importing Data

  • 7/27/2019 Mysql Bigdata Otn

    25/52

    Copyright 2012, Oracle and/or

    Transactional

    Data

    HDFS StoraSqoop Job

    Map

    Map

    Map

    Map

    Hadoop Cluster

    Sqoop Import

    Gather Metadata

    Submit Map Only JobImporting Data

  • 7/27/2019 Mysql Bigdata Otn

    26/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    Hadoop Ecosystem

  • 7/27/2019 Mysql Bigdata Otn

    27/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    Classic Use-Case, On-Line Retail

    UsersBrowsing

    RecommendationsProf

    PurchHist

    Web Logs:Pages Viewed

    Comments Posted

    Social media updatesPreferences

    Brands Liked

    Telephony Stream

    MySQL Binary Log API

  • 7/27/2019 Mysql Bigdata Otn

    28/52

    Copyright 2012, Oracle and/or

    MySQL Binary Log APIReal-Time Log Scraping

    Provides access to the binary loprogrammatically receive all daas they happen

    CDC process Read-only currently

    Worked example available fromhttp://bit.ly/binlogapi Maintains a Lucene index f

    search engine

    Available from LaunchPad https://code.launchpad.net/mysq

    listener

    Working on integration code for

    Master Slave

    Search DB-X

    Your App

    Hadoop

    http://bit.ly/binlogapihttps://code.launchpad.net/mysql-replication-listenerhttps://code.launchpad.net/mysql-replication-listenerhttps://code.launchpad.net/mysql-replication-listenerhttps://code.launchpad.net/mysql-replication-listenerhttp://bit.ly/binlogapi
  • 7/27/2019 Mysql Bigdata Otn

    29/52

    Copyright 2012, Oracle and/or

    MySQL in the Big Data Lifecycle

    AnalyzeExport DDecide

    ANALYZE

    DECIDE

    A l Bi D

  • 7/27/2019 Mysql Bigdata Otn

    30/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    Analyze Big Data

  • 7/27/2019 Mysql Bigdata Otn

    31/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    Analyze: Apache Hive

    Hive is a data warehouse infrastructure built on top of Hadoopfor prov id in g d a ta sum mar iza tion , query, and analysis.

    Initially developed by Facebook , Apache Hive is now used and developother companies such as Netflix.

    It provides an SQL-like language called HiveQL while maintaining full suppfor map/reduce. To accelerate queries, it provides indexes, including bitmapindexes. Hive stores metadata in databases like MySQL , and otherstorage in an RDBMS, significantly reducing the time to perform semanticchecks during query execution.

    SQL-like queries (Hive QL), which are implicitly converted into map-reduce

    Export Data

  • 7/27/2019 Mysql Bigdata Otn

    32/52

    Copyright 2012, Oracle and/or

    Export Data

    Transactional

    & AnalyticsData

    HDFS SSqoop Job

    Map

    Map

    Map

    Map

    Hadoop Cluster

    Sqoop Export

    Gather Metadata

    Submit Map Only Job

    M SQL O ti l D t b f W b

  • 7/27/2019 Mysql Bigdata Otn

    33/52

    MySQL Operational Database for Web

    MySQL Reporting Database for BI

  • 7/27/2019 Mysql Bigdata Otn

    34/52

    MySQL Reporting Database for BI

    Leveraging Oracle Solutions

  • 7/27/2019 Mysql Bigdata Otn

    35/52

    Leveraging Oracle Solutions For Data Acquired in MySQL

    Acquire Organize Analyze Decide

    Web Data Acquired in MySQL Analyzed with

    oracle Exadata

    Organized withOracle Big Data

    Appliance

    Depo

    M SQL E t i Editi / CGE

  • 7/27/2019 Mysql Bigdata Otn

    36/52

    Copyright 2012, Oracle and/or

    Oracle Premier Lifetime Support

    Oracle Product

    Certifications/Integrations

    MySQL Enterprise

    High Availability

    MySQL Enterprise

    Security

    MySQL Enterprise

    Scalability

    MySQL Ent

    Back

    MySQL Enterprise

    Monitor/Query Analyze

    MySQL

    MySQL Enterprise Edition / CGEHighest Levels of Security, Performance and Scalability

    MySQL Enterprise

    Audit

    MySQL Enterprise Monitor

  • 7/27/2019 Mysql Bigdata Otn

    37/52

    y Q p Replication Monitor

    Un asDBA

    para M

    MySQL Enterprise Monitor

  • 7/27/2019 Mysql Bigdata Otn

    38/52

    Vista nica consolidada delambiente MySQL

    Auto descubrimiento deservidores MySQL,replicacin y topologas

    Alertas y monitoreo adaptable y basado en reglas

    Identificacin de problemasantes de que ocurran

    Reduccin de riesgo ytiempo de inactividad

    y Q p

  • 7/27/2019 Mysql Bigdata Otn

    39/52

    MySQL Enterprise Edition

  • 7/27/2019 Mysql Bigdata Otn

    40/52

    MySQL Enterprise EditionSupport Break / Fix

    Consultative

    Tools Enterprise Monitor Query Analyzer

    Enterprise Backup

    Workbench SE

    DB Enhancements Thread Pool

    External Authentication

    Enterprise Audit

    Thread Pooling

  • 7/27/2019 Mysql Bigdata Otn

    41/52

    Thread Pooling

    Scaling Security and Data Protection

  • 7/27/2019 Mysql Bigdata Otn

    42/52

    Scaling, Security and Data Protection

    MySQL Enterprise Scalability

    MySQL Enterprise Security

    MySQL Enterprise Audit

    MySQL Enterprise Backup

    Oracle Premier Support for MySQL

  • 7/27/2019 Mysql Bigdata Otn

    43/52

    Straight from the Source Largest Team of MySQL Experts

    Backed by MySQL Developers Forward Compatible Hot Fixes MySQL Maintenance Releases MySQL Support in 29 Languages 24/7/365 Unlimited Incidents Knowledge Base MySQL Consultative Support

    pp y Q

    "The MySQL support service hessential in helping us with trouand providing recommendationproduction cluster, Thanks."

    -- Carlos Morales Playful

    Only

  • 7/27/2019 Mysql Bigdata Otn

    44/52

  • 7/27/2019 Mysql Bigdata Otn

    45/52

    MySQL Agosto 2013

    Buenos Aires, Argentina

    Pedro.Andrade@oracle .com MySQL Strategic Accounts ~ Latin America & CaribbeanManuel .Contreras@oracle .com MySQL Senior Consultant ~ Latin America & Caribbean

  • 7/27/2019 Mysql Bigdata Otn

    46/52

    Copyright 2012, Oracle and/or

  • 7/27/2019 Mysql Bigdata Otn

    47/52

    Big Data in Action

  • 7/27/2019 Mysql Bigdata Otn

    48/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    g

    ACQUIRE

    Acquire : Data is captured at sas part of ongoing operational p

    Big Data in Action

  • 7/27/2019 Mysql Bigdata Otn

    49/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    g

    ORGANIZE

    Organize : Data is transferredvarious operational systems anconsolidated into a big data plaHadoop / HDFS (Hadoop DistrSystem).

    Big Data in Action

  • 7/27/2019 Mysql Bigdata Otn

    50/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    g

    ANALYZE

    Analyze : Data stored in Hadoprocessed, either in batches by

    jobs or interactively with technas the Apache Drill or Clouderinitiatives.

    Hadoop may perform pre-proc

    before being loaded into data wsystems.

    Big Data in Action

  • 7/27/2019 Mysql Bigdata Otn

    51/52

    Copyright 2012, Oracle and/or its affiliates. All rights reserved.

    g

    DECIDEDecide : The results of the An

    above are presented to users, enactions to be taken.

    For example, the data maybe lointo the operational MySQL dasupporting a web site, enablingrecommendations to be made treporting MySQL databases usthe dashboards of BI (Businesstools.

    MySQL Enterprise Edition

  • 7/27/2019 Mysql Bigdata Otn

    52/52

    Comprehensive Suite of Management Tools