RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu [email protected] -IIJ/AS2497 1. Round...

16
RTT matters Matsuzaki ‘maz’ Yoshinobu <[email protected]> [email protected] - IIJ/AS2497 1

Transcript of RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu [email protected] -IIJ/AS2497 1. Round...

Page 1: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

RTTmatters

Matsuzaki ‘maz’Yoshinobu<[email protected]>

[email protected] IIJ/AS2497 1

Page 2: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

RoundTripTime(RTT)

RTT

t0

t1

[email protected] IIJ/AS2497 2

Page 3: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

RTT

• Thelower,thebetter– FasterTCPhandshake– BetterTCPthroughput– FasterTCPrecoveryfromapacketloss

• TherearevariouseffortstoimproveTCPperformanceeveninahighlatencysituation

[email protected] IIJ/AS2497 3

Page 4: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

WiFi isgettingpopular

wirelesswired

Internet

server2

server1

[email protected] IIJ/AS2497 4

Page 5: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

Ifacedatrouble

wirelesswired• RTTwasnotstablefromawirelessclienttotheserver2.L

64bytestime=398.122ms64bytestime=316.330ms64bytestime=337.251ms64bytestime=358.155ms64bytestime=299.480ms64bytestime=387.789ms

server2

server1

[email protected] IIJ/AS2497 5

Page 6: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

let’strytoisolatetheproblem

wireless

64bytestime=169.588ms64bytestime=170.666ms64bytestime=169.793ms64bytestime=168.185ms64bytestime=169.783ms64bytestime=169.957ms

server164bytestime=3.757ms64bytestime=3.789ms64bytestime=3.768ms64bytestime=3.718ms64bytestime=3.644ms64bytestime=3.762ms

1) ThelocalWiFi networklooksprettystable

2) RTTtoserver1looksalsostable

server2

[email protected] IIJ/AS2497 6

Page 7: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

hmmm...

wirelesswired

server2

server1

[email protected] IIJ/AS2497 7

64bytestime=296.040ms64bytestime=296.105ms64bytestime=296.442ms64bytestime=296.186ms64bytestime=296.103ms64bytestime=296.070ms

3) Fromthewiredhostinthesamenetwork,RTTtotheserver2looksstable

Page 8: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

so...

wireless

server1

server2

wired

• ThisstrangebehaviorhappensonlyforthiscombinationL

[email protected] IIJ/AS2497 8

Page 9: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

RTTdistributiontoserver1

fromwiredhosttoserver1 fromwifi hosttoserver1

wired wifi

[email protected] IIJ/AS2497 9

Page 10: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

RTTdistributiontoserver2

fromwiredhosttoserver2 fromwifi hosttoserver2

wired wifi

[email protected] IIJ/AS2497 10

Page 11: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

WiFi APwasbufferingpackets

wirelesswired

Internet

server2

server1

[email protected] IIJ/AS2497 11

• ThiscausedtheunstableRTTL

Page 12: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

MyWiFi adapterdoessleep

• Toreducebatteryusage• Beforesleeping,theclientsendanotificationtothewifi AP,andtheAPkeepspacketsuntiltheclientwakeup

• MyPCwasaskingthebuffering!

[email protected] IIJ/AS2497 12

Page 13: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

WiFi APsendsbeacon

• Beaconinterval– timeintervalbetweenbeacontransmissions– usually100msec,butit’sconfigurable

• TIM(TrafficIndicationMap)– totellanysleepingclientsiftheAPhasanybufferedframespresentforit

• WiFi adaptercansleepbetweenbeacons,andwakeuptocheckabeacon(TIMcanindicateiftheadapterneedtoreceivedataornot)

[email protected] IIJ/AS2497 13

Page 14: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

Thescenario

• Mywifi adapterwenttosleepafter200msecofnotraffic– that’swhytheunstableRTThappensonlywhenIwascommunicatingwithserver2(averageRTTis300msec)

• Basedonthebeaconintervalinformation(whichwas100msecinmycase),itwokeupandreceivedaresponse– that’swhymostRTTdistributioniswithin100msec

[email protected] IIJ/AS2497 14

Page 15: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

Sleepingandbuffering

[email protected] IIJ/AS2497 15

200msecnotraffic

goestosleepuntilthenextbeacon buffered

Page 16: RTT matters - ENOG · RTT matters Matsuzaki‘maz’ Yoshinobu  maz@iij.ad.jp -IIJ/AS2497 1. Round Trip Time (RTT) RTT t0 t1 maz@iij.ad.jp -IIJ/AS2497 2. RTT

Summary• StrangeRTTbehaviorhappensifyourcommunicationis

between:– ahostconnectedtoawifi networkand– afar endhost(RTT>200msec)

• AWiFi adaptergoestosleep– “200msecofnotraffic”seemsacommontrigger

• ThesleepdurationismanageablebysettingbeaconintervalonyourWiFi AP– 100msecwouldbereasonable– Youmightbeabletoreducebatteryusagebysettingitas

1000msec,butthiscouldintroducemoreRTTpenalty– YoucanenableU-APSDifyourAPsupportsitsothatclientscan

actuallyschedulethedurationbyitself.

[email protected] IIJ/AS2497 16