1

Storage Virtualisatie

Sjef van Ham

Storage Support Meerheide 101 5521 DZ Eersel s.van.ham@storagesupport.nl

26-maart-2009

2

Storage Opslag

DAS

Direct Attached Storage

NAS

Network Attached Storage

SAN

Storage Area Network

3

Wat is een SAN ?

1) Gecentraliseerde opslag op basis van een extern schijvencabinet voor verschillende typen servers

« alles in één doos »gecentraliseerd beheerhoge schaalbaarheid door veel schijfruimtehogere hardware redundantie en databeveiligingsfuncties : RAID,

spare disks

2) Speciaal storage netwerkFibre-Channel

grote afstand (optische kabels )hoge bandbreedte (4Gb)

iSCSI ethernetdirect toepasbaar en flexibellage TCO en infrastructuurkosten

4

Voordelen van gecentraliseerde opslag

• Flexibel en eenvoudig toewijzenvan capaciteit

• Gemiddelde benutting in een DAS-omgeving is < 50% (SAN = 85%)

• Schijf en tape in hetzelfde opslag netwerk (50-75% minder tape drives)

• Minder LAN-verkeer

• Gecentraliseerd beheer

• Beheer met minder mensen(efficiency stijgt met factor 10)

• Opslag, switches en tape toevoegen zonder applicaties stop te zetten

• Zo veel redundantie als gewenst

5

iSCSI Storage

• iSCSI staat voor Internet SCSI (Small Computer System Interface). Dit is een op het Internet Protocol (IP) gebaseerde standaard voor IP netwerken.  Deze technologie is een versmelting van twee technieken die zich in de industrie bewezen hebben. Het gaat om de technologie die ontwikkeld is voor communicatie (ip netwerken) en de technologie bedoeld voor dataopslag , SCSI opslag. Door deze te combineren werd het mogelijk zowel de data als de dataopslagcommando's over ip-netwerken te versturen.

• Een netwerk protocol voor storage netwerken

• Gebruikt de standaard ethernet tcp/ip netwerktechnologie eb hardware

6

Fibre Channel SAN

• Fibre Channels work on a single popular storage networking protocol that offer compatibility to all common storage and database servers. 

• Fibre Channels use the FCP protocol ( Fibre Channel Protocol) which is simply a serial bus SCSI protocol. 

• This FCP (Fiber Channel protocol) works really well in networks with a high bandwidth requirement.

• Fibre Channel is een protocol dat voornamelijk wordt gebruik om data binnen storage netwerken te transporteren. Vaak wordt Fibre Channel geassocieerd met alleen glasverbindingen, maar het protocol kan zowel over glas als koperverbindingen worden gebruikt.

7

iSCSI voordelen door Eenvoud

Geen noodzaak meer om te investeren in FC technologie of FC

kennis

Ethernet is bekende technologie

Ethernet heeft een lagere TCO en infrastructuur

Geen noodzaak meer om te investeren in FC technolog

of FC kosten

Geen FC HBAs meer nodig, optionele iSCSI ethernet kaarten voor

hogere prestaties

8

IP based versus FC based

FC HBA’s Standaard Netwerk ip-kaarten

2-4-8 GB 1GBe-10GBe

• Fibre Kabels UTP kabels

• Fibre Switches Ethernet Switches

2-4-8 GB 1-10 GBe

9

De markt Fibre - iSCSI

Revenue Forecast by Installation EnvironmentRevenue Forecast by Installation Environment

$0B

$2B

$4B

$6B

$8B

$10B

$12B

$14B

2002

2003

2004

2005

2006

2007

2008

2009

$0

$5

$10

$15

$20

$25

$30

$35

$40

GB/$

DAS

FC SAN

NAS

Other SAN

iSCSI SAN

$/GB

10

Storage Requirements for the Traditional Data CenterPerformanceSupports current workloads. No performance degradation

ScalabilityScale capacity and performance without disruption

AvailabilityData stays online during a site failure, recover from disaster

ManageabilitySimple to admister

11

Typical Storage Array Architecture

• Monolithic Array

Not scalable• Controller head

becomes bottleneck• Scales capacity only

Single point of failure

Forklift upgrades

12

WHICH CAN BE COMBINED IN OUR FRAMELESS ARCHITECTURE

Scale when you need, as large as you need it, but view as a single SAN

Number of disks

Per

form

ance

13

Storage Pool

Pages

Disks

RAID

PS Series Array 1

RAID 10, 50 or 5

ArchiveSQL

11

22

NN

Exchange

Switched Gb Ethernet

ArchiveArchive

ExchangeExchange

SQLSQL

Typical iSCSI SAN

14

PS Series Array 2

RAID 10, 50 or 5

Storage Pool

Disks

RAID

PS Series Array 1

Pages

RAID 10, 50 or 5

ArchiveSQL

11

22

NN

Exchange

Switched Gb Ethernet

ArchiveArchive

ExchangeExchange

SQLSQL

33

44

22

44

Automatic and transparent load balancing across arrays

15

The LeftHand Difference

16

• Storage cluster

Aggregates all components for performance

Data is load balanced across all nodes

Predictable scalability

• Grow on your terms

Non-disruptive scalability

No forklift upgrades

Scale everything

Throttle bandwidth

• Create tiers of storage

Each optimized for type of data

Online volume migration

• Simple centralized managementProvisioningMonitoringSecurity

SAN/iQ Storage Clustering SAS

SATA

Centralized Management Console

17

SAN/iQ Network RAID

• Beyond component redundancy

Protects data from array failure

Synchronous replication

Configure on a per-volume basis

Configure on-the-fly, no down time

• High availability

Multiple disks, controllers, or arrays

Zero disruption of data access

Ensures “high availability” for data

SAN/iQ Cluster

A

B

C

D

A

B

C D

B

A

C

D

BA

C

D

18

SAN/iQ Multi-site SAN

• Protect Storage By:

Rack

Room

Floor

Building

Site

• Keep Data Online During:

Facility disruption

Natural disaster

Site maintenance

SAN/iQ ClusterSAN/iQ Multi-site SAN

A D A D

BA BA

C B BC

C D C D

Volumes Remain Online

SAN/iQ Thin Provisioning• Eliminate Initial Over-Purchasing

No Wasted and/or over-allocated capacity

Purchase what you need today

• Delay Future Storage Purchases

Grow capacity as warranted

• Simple to Manage

Enable/Disable with radio button on per-volume basis

Allocate only as data is written to the volume

No Reserve necessary

SAN/iQ Cluster

Full Provisioned Thin Provisioned

50 GB written50 GB written

50 GB written50 GB written

Allocated 200GB

Available 0GB

Used 0GB

Wasted 200GB

Allocated 0GB

Available 200GB

Used 0GB

Wasted 0GB

Allocated 200GB

Available 0GB

Used 50GB

Wasted 150GB

Allocated 200GB

Available 0GB

Used 100GB

Wasted 100GB

Allocated 50GB

Available 150GB

Used 50GB

Wasted 0GB

Allocated 100GB

Available 100GB

Used 100GB

Wasted 0GB

200 GB Volume 200 GB Volume

20

SAN/iQ Snapshots

• Simplified Backup and Recovery

Point-in-time volume copies

Scheduled, Ad Hoc or Scripted

• Functional

Volume rollback

Recover granular data

Backup Integration

• Microsoft VSS

• VMware VCB

• Space Efficient

Thin provisioned always

Delta changes only

No snap reservation

SAN/iQ Cluster

1:00

2:00

3:00

1:00

21

SAN/iQ Remote Copy

• Asynchronous Replication

Per volume basis

Scheduled or manual

Thin provisioned

No reserve space required

• Simple to Manage

Bandwidth management

Failover / Failback Wizard

SAN 1

SAN 2

2:00

1:00

3:003:00

2:00

1:00Baseline Copy

Incremental Copy

Incremental Copy

Recovery Server

22

Network Storage Server (NSS)Intelligent Storage Virtualization• True heterogeneous intelligent storage virtualization

• Application-aware data protection

• WAN optimized disaster recovery services protect operations and save on WAN costs

• Increased storage efficiency through Thin Provisioning of resources

• Your Storage, Your Infrastructure, Your Solution

23

TOTALLY Open Storage Virtualization Platform

DataPhysical

Existing SAN volumes via Storage

Service Enabler

Virtualized SAN volumes

Thin provisioned SAN volumes

Linux Solaris HP-UX AIX Netware

Exchange Oracle VMware

NotesSQL SAPDB2

Windows

Any application

Any operating system

Virtual

Any storage protocol

Any diskarray

24

Control storage management costand complexity

• Consolidate heterogeneous storage management through virtualization

• Minimize storage costs with thin provisioning

• Centralized management of client systems simplifies operations

25

The Solution Starts with Consolidation

• Enhanced storage utilization

• Consolidated storage management

• Opens the door for a host of solutions and innovations

Application ServersFile Servers

Backup SeversCritical Applications

SAN SAN

26

How storage virtualization works

• Quickly create virtual volumes from across or within any physical disk resources

- Simple wizard interface

- Physical LUN and virtual devices up to 16TB

- Expand volumes as needed

• Securely assign volumes to servers through NSS interface Virtual

disks

Physical disks

27

Storage abstraction layer

• Move the storage intelligence and security into the SAN fabric

NSS creates a storage abstraction layer

• Storage services no longer dependent on vendor-exclusive disk functionality

• Consolidates services and operations

Hosts

Fabric

Storage abstraction layer

Disk

28

Thin Provisioning:Better Storage Utilization

• Create a virtual volume to match size of data provisioning request

• Allocate a smaller amount of actual physical disk space

• Additional physical space allocated automatically as needed

• Reduces wasteful over provisioning of storage

• Saves disk space and power consumption

Data

Virtual

Thin provisioned SAN volume

Physical200GB

800GB

“800 GB”

29

Minimize downtime

• Highly available systems ensure continuous operation

•

• Cross-array mirroring for ultimate data protection

• Seamless, zero-downtime data migration

30

NSS high availability deployment model

• NSS appliances deployed in failover pairs

• Each NSS server supports its own set of client servers during normal operations

• If one devices fails, the second device takes over servicing clients

Shared Storage Failover

SAN

31

Data mirroring, zero downtime migration

• Any-to-any storage array synchronous data mirroring

• Ultimate data protection across arrays

• Seamless data migration across storage devices.

Create mirror

Switch primary/mirror status without any break in application processing

Remove mirror (old array)

Primary MirrorPrimaryMirror

Writes acknowledged

from both arrays to

ensure integrity

32

Ensure comprehensive data protection

• Application-aware snapshots provide rapid data recovery

• WAN optimized data replication for disaster recovery and failback

• Host-free, accelerated backup eliminates all backup windows

33

Application aware snapshots

• Up to 256 snapshots per volume

• Instant recovery to any captured

point in time

• Fully mountable as read/write

volumes

• Application agents and

consistency groups for 100%

transactional integrity

MS Exchange Oracle VMware DB2 Informix SAP MS SQL Sybase

Notes/Domino Progress Pervasive SQL

8:00 9:00 10:00 11:00

1:00 5:00 9:00

1:00 1:30 2:00 2:30

Each volume has its own

snapshot schedule

34

WAN Optimized Disaster Recovery

Full replicas

Copy to tape

DR Site

… …

Snapshots• WAN optimized out of the box• Includes WAN data encryption,

compression and QoS

• Easily configured any-to-any remote replication

• Continuous or periodic modes

35

WAN Optimized Data Replication

• Applications and file systems write far more data to disk than actual changes

• NSS scans the changes at a 512 byte level and replicates only the changed data

- Avoids constant re- sending of duplicate data

512 byte

= empty disk sector

= data written by application or file system

= sector with actual data change

A typical 8k write of data. Many systems send all 8k or more. CDP sends only the

truly changed sectors.

512 byte

Disk sectors

36

VMware Advanced Features

• Because continuous uptime is so critical, VMware has created several advanced features designed to help system uptime

- VMware High Availability

- VMotion

- VMware Distributed Resource Scheduler

37

VMware High Availability/Vmotion/Scheduler

• VMware High Availability automatically restarts virtual machines affected by physical server failure

XShared storage pool

38

The Power of the Virtual SAN

• The FalconStor Network Storage Server Virtual Appliance transforms internal disk storage into an iSCSI SAN

- No additional storage network investment needed

• Enables VMware advanced features

• Cost effective, highly available infrastructure for the SMB and ROBO

39

FalconStor NSS Virtual Appliance Architecture

Server Internal RAID

VirtualMachines

VirtualMachines

Virtual Switch

VMFSVolume

FalconStorNSS VA

VMFSVolume

IP Network

Physical Ethernet Adapter

Virtual LUN for VMDK files

40

High Availability via NSS VA Cross-Mirror

Cross-overGigabit connection

NSS-VA Cross-Mirror

Active Access Point

Passive Access Point

Standby NSS VA

Same sizevirtual LUN

Virtual Infrastructure HA supported without SAN storage

To client