Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf ·...

74

Transcript of Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf ·...

Page 1: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

��� � � � � ��� ��� � � �� � ���

����������������� �!�"�#�%$�&�(')�*�!+,+,���

-/.10325476(.1038:9;.=<�>@?BA�038C03D50�4EF?G8CH=4;IJA38:0LKNM=O%PF8 Q36R4;S=47?T MU4;IV?5MUMW8:H=47<:XZY[=\=]=\(^`_ PF8 Q36R4;S=47?T 254aPb4;03254;IJ<c.=?GXGA

.=D5SWDGA30 ]1d=d=d

Page 2: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

��������������� ��

Y�������� <:.=9�� .=?GX -����59J25MW<C47A�� T 254��GIJ8:9;8:?GS M=O�M��G038CMW?GA .=?BX 9 M=I�� M=IJ.10�4Z<:8:.� B8c<:8C038C47A!��"#%$'&�(*),+-#.0/1&�23&�45#36879� [�:�;=< [=\�> � Y >�;�: �] ��?@��A .=6R4;I3MW?B�%CD� T � - .1I3038c?B� T IJ.=?GA3O M=IJ6 .1038CMW?GA M=OEC�8C47?54;I 8:? 0�4;S=IV.=<:A DG?GX54;IN0�IJ.=?GA3<c.1038CMW?GA!�F 292G#IHKJL+NM8#3OQPSRB� :�T=[=U:�>=[ � Y >�V�V �

: ��?@�XWY�9A�.1IJ6RMW?G.L�9�S�XWY� - MW<:9J2B.=?5M HS�9$ZJ�[\JI]I&�(*)^/ F 2`_Ia\[�b\&�2dc`[1&L]�(ea14fJ�2`_g)*2S+ha\[�4g),+-+ha12`/jiB�LWb-k�- 476RMW8:I \ Y T �3WF6R4;IJ8:9;.=? - .10325476 .1038:9;.=<l� M 9;8C4;0 K��3m IJM H 8:X547?G9 4@? >\� Y >�>�V �V ��nQ�Xo'�pA 2 DG?5S*.=?BXq?@��C�8:<:<:8c.=6(A!�1rs2S+^[1&I_St/=+N)e&�2Q+h&�uB+h&L/jMvJ�b�+N)^/8rj23+ha�w�[1JL+N)e&�2B�=� 8CI�� 2Gx.=DGA34;I��!�!MWA30�MW?B�Y >�>1dzy ] ?GX 47XB8C038CMW?3{\�\ � ^ �X�|� _ .7H 8C47A!�Z}%23a�~�c8J�[\J�4�a�+ha\[�b\a14g)�w�[�&Lt�cBb!�9WF9;.=X5476(8:9qm`I347A3AaY >�T1d �[ ��?@� _ DGI3I34;0�0!���3�,�����L���1�^�N���\�������L����������3�-���=�^�^�\�����e�v�^�-�����9�=�^�^���v��m I3M� B.� ,8:<:8C0 K .=?BX�� 0�M 9J2G.=A3038:9� 4;IJ8C47A!�3A0?0A�m I347A3A�Y >�>=[ �

; � ^ �X�|� _ K ?I� 8:?B� T 254aM��G038:6�DG6 9V25MW8:9 4�M=O 03254a8c?GA�03.=?U0*O M=IbA�0�M��9�B8:?GS(.(- .1I��=M H��GI3M 9 47A3A!�`u9&���)ea�+HKJL+NM3a14�JL+N)^/�b�PG� [=]�;�U [=]�; � Y >=[�: �

T � >\�����%� 8:IJA3.=?5M H3� � ? 0�IJ.=?GA�O M=IJ6(8c?5S . 9 4;I303.=8:? 9;<:.=A3ARM=O A�0�M 9J2B.=A�038:95�BI3M 9 47AJA�47Ag K .� BA�MW<:D50�47<:K9 MW? 038:? D5MWDGA�A3DI ,A�038C03D5038CMW?ZM=O*6R47.=A3D5I347A��%¡¢M3a!&p[-i£&�¤0$¥[1&L]�JI]�)¦(*),+�i�J�2`_ F cvcB(*)^/\JL+N)e&�2vbYR`� ]�T=\=U:1d Y���Y >=[1d �

> ��m��X?E�v§F.=<:6RMWA!�vHka�J�b=t�[�ag¡¢M3a!&p[jiB�5H1.=? P MWA30�IJ.=?GX5? 478:?G25MW<:X8� Pb4!¨ª© M=I��S� Y >=\1d �Y d ��?@�=H1.=?RX54;I'§ M=O A�03.=XB��� �WX547?Q§bMW<:<:.=?BX54;I���C«��n�xMW?G8CSI�¬A 47?U0�IJ.=<5<:8:6(8:0 03254;M=I3476 O M=I 03254 ^ XI¨ .1IJXGA6RM XG47<N� F 2v28#L$'[1&L]�JI]9#v­vR`� \�;�:=U \�>�; � Y >�>�; �Y=Y���nQ� >@0p®MI��¯la=/=+�t�[�a1b¥&�2QuB+h&L/jMvJ�b�+N)^/'$'[�&L/1a1b�b1a1b!� T .103. > ?GA�038C03D50�4!M=O3�GDB?GXG.=6R47?U03.=<L?*47A�47.1IJ9V2B��� MW6 < B.7K��%Y >=[ Y��Y ] �����vna.=<:<c8:.=?I�BD5I=�9�3�,���!������^�^��°'�±���h²��1�e��³µ´G�I²����1¶��`��GIV8:?5S=4;I�� P 4!¨·© M=I��S� Y >�T1d �Y : ��?@� ^ ��na.=<:6 .=?�.=?BXY?E���S��� DG9 K��=Pb4!¨ I347A3DG<:03A�8:?#<:8:?547.1I�¸,<C0�4;IV8:?5S .=?GX��GIJ47XG8:9 038CMW?�03254;M=I3K�� T IV.=?GA!�W�� - ^ � 4;I�� _q¹ �v� .=A38:9 ^ ?5SI� T�: � >=\p< Y d�T �%Y >=[ Y��Y V � T � - 8��=MWAJ2B�Z.¥(ea14�a12S+,J�[jiºb�+h&L/jMvJ�b�+N)^/�/\J�(N/pt�(ht�b�»'),+NM½¼v2vJ�2B/1ag)*2¾��)ea�»0�¢WbXGH .=?G9 47X¿� 4;IJ8C47A�MW?� 03.1038:A�038:9;.=<l� 9;8C47?G9 4EÀÁW��9�B<c8C47XÂm I3M� B.� ,8:<:8C0 K�ÃB� Y >�>�> �Y \ ������Ä|� A347?GXG.=<N���3�,���!������^�^� Å@� Æ|²!�-²!�v�^�^����Ç�È��9���^�^���I��É3���d�e�v�^�-�����9�=�^�^����ÊZ�±�±�Y�1���3�Ë�^�\���^�^���I�\�¬��GIV8:?5S=4;I�!4;IV<:8:?B�I§b478:X547<� 4;I3SI� Y < A�0*47XB8C038CMW? Y >�T=\ � \p< 032 47XG8C038:MW? Y >�>�T �Y [ ��o'���S�3�FIV?GA�0�478:? .=?GXÌ�d� ^ �BEF2G<C47?� 479��S�3� ? 03254 03254;M=IJKNM=O¢� I3M=¨b?G8:.=? 6RM=038:MW?B�9m`2UK A��9?*4;HS� :=[ �T=]�:p<�T�V Y�� Y >�:1d �Y ; �bPE�9C�8C47?54;I=� _ 8�Í 4;I347?U038:.=< A��B.=9 4��B"#IH�JL+NM8#vJ�2B_�$¥M�iIb=#v­`� Y : Y U Y ;pV � Y >=]�: �Y T �bPE�9C�8C47?54;I=� T 254a25MW6RM=S=47?G4;MWDGA 9V2G.1MWA!� F 4�a\[=#S"L#IHKJL+NMG#3ÃvÎ8� T�>�;�U>�:=[ � Y >�:�T �Y > � _ �0C�8:<:<c8:.=6(A!�¥$¥[1&L]�JI]�)¦(*),+�i«»¥),+NM¾4ÏJ�[=+N)*2Lw�J�(±a1b!�0A�.=6E GIV8:X5S=4 Eb?G8:H=4;IJA38C0 K¿m I347AJA!��A .=6E BIJ8:X5S=4Y >�> Y��

T 254a?GM=0�47A 8:? 032G8cA�A�K <c<:.� BDGA .1I34@ ,.=A�47X��GIJ8c6(.1IJ8:<CKRMW? 03254@ MUM��� UKÌÄ|� A�47?GXB.=<N�

Y

Page 3: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

�������������

Y ���� =��������� ����3� �Y��:Y F c9c8(*)^/\JL+N)e&�29b �Y�� ] � MvJL+¥)*b�23&�)*b1a����] � ���! ��"�$#3�&%'�( ����S� )] �:Y *�&+,JL+N)e&�2vb +] � ] , a\¼329),+N)e&�2Ì&�¤�- [1&�»¥29)¦J�2�4�&+N)e&�2 .] � : / &�23+N)¦2St�)h+�iz&�¤Sc8JL+NMvb�J�2`_z+NM3a�c`[1&L]�(ea14 &�¤%�=a\[�b�)±&�29b 0�0] � V 1 &Lt�w¬M92Sa1b�b�&�¤`c8JL+NM9b 0�2: 3 4�B65�#9 7 ��±8�^�� =�!9v��#: ����S�'�� �5��<;=#�G = 4��#v�¿>#9 �� ?(@: �:Y ¡¢M3a|b�+h&I/sMvJ�b=+N)^/�)*2S+ha�w�[\J�(�&�¤ZJQ23&�23~±[\J�2`_L&�4 ¤jt�2`/=+N)e&�2 0�A: � ] ¡¢M3aQ} [�2vb�+ha1)*2v~CBlM9(ea12`]Ia=/EDYc`[�&L/1a1b�b 0�A: � : u9&�4�a�M3&I/pt�b'cZ&I/pt�b 0�FV G 5��8�C (H�:IJ�^�� =�!9v��#K ?MLV �:Y u`+hajck¤jt�2`/=+N)e&�29b 06.V � ] F [p]�),+^[\J�[ji�¤st�2B/=+N)e&�29b O�0V � : HKJ�[=+N)¦2Lw�J�(ea1b O��V � V / &�23+N)¦2St�)h+�iz&�¤Sc8JL+NMvb ON�\ 3 4�B65�#9 7 ��±8�^�� =�!9v��#K± O#v���& �5G�8�C :H�:I��E�v�6%<��K�# PQ)\ �:Y ¡¢M3aq&�23a�~�_�)¦4�a129b�)e&�23J�(3r�+�R&�~^¤N&p[�4�t�(¦J O�+\ � ] u9&�4�a@aTS9J�4EcB(ea1b 2�U\ � : ¡¢M3a|4Ât�(,+N)¦~�_�)¦4�a129b�)e&�23J�(9r�+�R&�~^¤^&p[�4Ât�(¦J 2>0\ � V ¯l&I/\J�('+N)*4�a1b�&�¤�- [1&�»'29)¦J�2�4�&+N)±&�2 2�2[ 3 4�B65�#9 7 ��±V���$W¥��p�L�� ���#K��NXY��#: ����3�� Z[@[ �:Y u`+^[1&�2LwÏb\&�(�tI+N)e&�29b 2>A[ � ] � a�J�D5b\&�(htI+N)e&�2vb 2�.; �C :H�:IT���$W\�G ��$�S�G �]�93������#: ��v�� ^#v���¿ ���%_�$93������`l ��?; �:Y rs2S+^[1&I_St/=+N)e&�25J�2`_�4�&+N),��JL+N)e&�2 �!0; � ] -%J�b�)^/ c`[1&�cZa\[=+N)±a1b �!0; � : a a123a\[\J�(*)h+N)ea1b�&�2Âwa123a\[1JL+h&p[�b �>�; � V , i92:DL)*2\b b0¤N&p[�4Ât�(¦JQJ�2`_�J!cvcB(*)^/\JL+N)e&�2vb �>FT G ��#v�� ��c�3��%'#: ����S�G O�3�d���$W\�G ��$�S�G e�?T �:Y ¡¢M3agf3a�i9294ÏJ�2v~ihYJ�/|¤N&p[�4�t�(¦J �>0T � ] ¡¢M3a / J�4�a\[�&�2v~^HKJ�[p+N)*2v~ a )�[\b�J�23&���¤N&p[�4�t�(¦J ��2> G 5��jKi�^���N#9�lkV#MK�%'#v�YI � �G�monQK$ =��� e�)> �:Y .QS9J�4EcB(eap0�q3&L]�b\a\[=��JL+N)e&�2z&�¤¢JQb�)*2Lw¬(±a�[1J�2`_L&�4 ��J�[�)¦JI]�(±a �(+> � ] .QS9J�4EcB(ea�O�qI[�ajc¢a�JL+ha=_�&L]�b\a\[=��JL+N)e&�2z&�¤ZJQb�)¦2Lw¬(ea�[\J�2`_L&�4 ��J�[�)¦JI]�(ea ��F> � : .QS9J�4EcB(ear2>q`/1&�2S+N)*2`t¬&Lt�b�&L]�b\a\[=��JL+N)e&�2z&�¤¢J�2½} [�2vb�+ha1)*2v~CBlM9(ea12`]Ia=/EDYc`[�&L/1a1b�b A�0

]

Page 4: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

Y d G 5�� � K�#9�� #v��� 3 �5��MK±� ^�M`� ����S�&`l�6�eN�±��9½�c�v�6%<�"K$#�� @�)Y d �:Y u`+h&L/ Db��l]I&�2`_�b�J�2`_�b=+h&L/ D5&�c'+N)e&�29b A�+Y d � ] ¡¢M3a|4ÏJ�[=+N)¦2Lw�J�(eaE/\J�b\a A�FY d � : ¡¢M3aqa��8a=/=+ &�¤lb�+h&L/ Dµ+^[\J�_�)*2Iw A6.Y d � V H�&+N),��JL+N)e&�2 +7UY d � \ 1 a1b=t�(h+Nb + 0Y d � [ rs2`/�(�t�b�)e&�25&�¤%+NM3a|)*2S+ha\[1a1b�+Z[1JL+ha +�O

:

Page 5: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� � �������������!�c���> ? A�0�M 9V2G.=A�038:9 .=?G.=<CK A38:A MW?54ZA�03DBXG8C47A IJ.=?GXGMW6 O DG?B9 038CMW?GANM=O#MW?G4ZH .1IV8:.� B<C4 .=?GX H1.1IJ8CMWDGAÂ� 8:?GXBA M=O8:?U0�4;S=IJ.=<:A#.=?GX X54;IV8CH .1038:H=47Aa03254;I34;M=Os� T 254 .1I3SWDG6(47? 0#M=O�032547A�4 O DG?G9 038:MW?GAa8:A#DGA3DG.=<:<:K 8:?U0�4;I��GI34;0�47X .=A� 038:6R4 �L�,A�M(032G.10*032G4 O DG?B9 038CMW?GA 0325476(A347<CH=47A 9;.=?Ì 4 0325MWDGSW2 0*M=O .=A0�,.1032GA�M=O IJ.=?GX5MW6 �BI3M 9 47AJA�47A!�

§ 4;I34��=<:8*�=4!8:?�M=03254;I .1I347.=A%M=OB6(.10325476(.1038c9;A!�1S=MW8:?5S O I3MW6 03254 XG8:A39 IJ4;0�4`0�MF03254 9 MW?U038:? D5MWDGA%K 8C47<:XGA.g�,.7K < M�Í 8:? A38c6Q�B<:8:9;8:0LK .=?GX A36RM M=032G?547A3A��,.10 032G4E�GIJ8c9 4 M=O 6RM=I34�9 MW6Q�,<:8:9;.10�47X/.=?G.=<CK A38:A!�3A MW6g�B.1I34��0�M"6(.��=4F.=? .=?G.=<:M=S=K��U03254 8:?U0�4;S=IJ.=<������������ ¨ 8:032(03254 A3DG6��������� � � � T 254F8:? 0�4;S=IV.=<BI34 ! DG8CIJ47A`.�6RM=I34I34�¸,?G47X�.=?G.=<CK A38:A O M=I 8C03A XG4�¸,?G8C038CMW?�.=?GXaO M=I�032G4¥�GI3M M=O M=OB8C03AG�GI3M�� 4;I3038C47A!�! ,D50 MW?G9 4!032G8:A�2G.=AG 4;47?#X5MW?5403254F8:? 0�4;S=IV.=<,8:A`47.=A38C4;I 0�M�9;.=<c9;DG<:.10�4��L�58:6(8:<:.1IV<CK��=8:? A�0�M 9J2B.=A�038:9F.=?G.=<CK A38:A K=MWD�¨ 8:<c<L 479 MW6(4F.=9�! DG.=8:?U0�47X¨ 8C032 . 9 MW? H=47?G8:47? 0 XB8�Í 4;IJ47? 038:.=< 9;.=<c9;DG<:DGA�.=Ab."I34!¨ .1IVX O M=IFA�MW6R4a2G.1IVX�¨!M=I��N8:? .=?B.=<CK AJ8:A!�7 �N7 "�`"`�K��±�#( ����3�� � 0�M 9J2G.=A3038:9�.=?G.=<:K A38cA*9;.=?Ì 4�.��v�B<:8C47X 8:? .g¨ 8:XG4 H .1IJ8:4;0LK M=O A38C03DB.1038CMW?GA!�9C 4�A-�=4;039J2 . O 4!¨ 4$# .=6Q�,<C47A 47<CM=¨E�

Y���� MW6R4RXG8�Í 4;I347?U038:.=< 4 ! DG.1038CMW?BA� 479 MW6R4R6RM=IJ4#I347.=<c8:A�038:9Y¨ 2547?z¨!4R.=<:<:M=¨ A�MW6R4"IJ.=?GXGMW6(?547A3AF8:?0325478CI 9 M 4$% 9;8C47?U03A!��A MW?GA38cX54;I�O M=I 4$#5.=6Q�B<C4 03254�O MW<:<CMp¨ 8:?5Sq³��-��Ê'�±��²�È��9���^�^���9�WDGA�47XR.=6RMW?GS M=03254;I.1I347.=A 8:?Â� M��BDB<:.1038CMW?� B8CMW<CM=S=K'&��(*) �,+ y.-0/ �21 � ��{ ) �43 y Y��:Y={

§ 4;I34�� ) � 8cA"03254 A3865;4 M=OF03254�� M��BDG<:.1038CMW? .10(038:6(4 ( � - 8:A�03254 .7H=4;IJ.1S=4/S=I3Mp¨*032 IJ.10�4 M=OF03254� M��,DG<:.1038CMW?B� .=?GX 032G4 � ?5MW8:A�4 � 1 � 6RM X547<:A�IV.=?GX5MW687,DG9 03DB.1038CMW?GA*8:? 032G4 S=I3M=¨*032 IJ.10�4��

] � T 254:9G����³²$;=�±�z²�È��9���^�^���"XG47A39 IJ8� 47A 032G4� 472G.7H 8CMWD5I`M=O .�XGDBA�0'�B.1I3038c9;<C4 A3DGA�� 47?BX547X(8:? .�<:8<! DG8:X=&> ��(? ��+A@CB ? � / �21 � � 3 y Y�� ] {

§ 4;I34�� ? � 8:A 03254*H=47<:M 9;8C0 K(.10`038:6(4 ( M=O 032G4 XGDGA�0Z�,.1I3038:9;<C4��W032G4*O IV8:9 038CMW?R4$# 4;I30�47X(MW? 03254��,.1I3038:9;<C4XGD54`0�MF03254!H 8:AJ9 MWA38C0LK B M=OG03254!<c8<!UDB8:X 8:A @0B ? � � .=?BXa03254 � ?5MW8:A�4 � 1 � A�03.=?GXGA�O M=I�03254 XG8:A303D5I� B.=?G9 4XGD54 0�M*03254 032G4;IJ6(.=<W6RM=038:MW? M=OU032G4`A3D5I3IJMWDG?GXG8:?GS!<:8<! DG8:XF6RMW<C479;DB<C47A 9 MW<:<:8:XB8:?5S ¨ 8C032 03254'�,.1I3038:9;<C4��T 2G8:A 4 ! DG.1038CMW? 8cA O DG?BXG.=6R47?U03.=< 8:?Â�B2UK AJ8:9;A!�: � T 254K�B.1032 M=O�03254 XGDGA�0��B.1I3038:9;<C4/8:? 4$# .=6Q�,<C4 ] 8:A M� BA�4;I3H=47X�¨ 8:032 A�MW6R4 8:?B.=9;9;D5IJ.=9 K���� ?546R47.=A3D5I347A*03254@� 4;I303D5I� 47X A38CSW?B.=<,D � SW8CH=47?� KD ��+ ? � / �CE1 � � 3 y Y�� : {§ 4;I34FE1 � 8:A .1SW.=8:? . � ?5MW8:A�4 �L�I� ?54 8cA 8:?U0�4;I347A�0�47X 8c?R03254� 47A�0 SWDG47A3A O M=I`03254F.=9 03DG.=<GH1.=<:D54 M=O ? � �SW8CH=47?/03254#M� ,A�4;I3H1.1038CMW?GDIHbO M=I dKJMLNJ ( � T 2G8:Ab8:AF9;.=<:<C47X/.PO'���h²��1�±��³d�S�j�*Q!��²�RS& 2GM=¨ 0�M�¸,<C0�4;I.�¨ .7K"03254�?5MW8:A�4TE1 � ��n�.=<:6(.=?".=?GXd� DG9 K y Y >=[ Y={ O MWDG?BX#. <:8c?547.1I%.=<:S=M=IJ8C032G6���¨ 2G8c9J2�¨ .=A .=<c6RMWA�08:6(6R47XG8c.10�47<CKR.��9�B<:8C47X 8:?N.14;I3MWA-�B.=9 4 47?5SW8:?G4;4;IJ8:?5SI��%8c<C0�4;IJ8:?5S�03254;M=I3K 8cA`?5Mp¨�.U7BMWDGIJ8:A32G8c?5Sa.=?GX4$# 0�I3476(47<CK DGA�4;O DG< XG8:A39;8��,<:8:?54��

V ��� 0�M 9V2G.=A�038:9 .=?B.=<CK AJ8:A 9;.=? 2547<�� A�MW<CH=4q MWDG?GXB.1I3KRH .=<cD54��GI3M� B<C476 A!A3DB9J2 .=A�03254EÅE�±�\�N���¬�*²!�B�3�-�*Q$V��²�R�� > O!03254RH .=<cD54"M=O . 2B.1IJ6RMW?G8:9#O DG?G9 038CMW?GW MW? 03254Q MWDG?BXG.1I3K M=O A�MW6R4Q MWDG?GXG47X IJ4;SWDG<:.1II34;SW8CMW?YX Z\[ � y.]_^ Y={(8:Ag� ?5M=¨b?B� 032547? 03254 H1.=<:D54 M=OPW�8c?�03254 8c? 0�4;IJ8:M=I M=O`X)9;.=?¿ 44$#�GIJ47A3A�47X .=A O MW<:<:M=¨ A�&

a y W ycbedf {-{ + W y � {hg y Y�� V {V

Page 6: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

¨ 254;I34 � b d� & + � / � �� 1 H � L � 8:A .=? � 8c? 0�4;S=IJ.10�47X ?5MW8:A�4 � M=I����j��ÊZ�v�^���YRQ���^�^���v��A�03.1I3038c?5S .10� � .=?GX�� X547?5M=0�47A 032G4R038:6R4d¨ 2547?/032G8:A�� I3Mp¨ ?G8:.=? 6RM=038:MW?K¸BIJA�0 I347.=9V2547A 03254d MWDG?GXG.1IJK�� y W2G.1IJ6RMW?G8c9bO DG?G9 038:MW? W 8:A�.RO DG?G9 038CMW? A3.1038cA�O K 8:?5S��NW + d ¨ 8C032��&03254Yo .��B<:.=9;8c.=?B��{

\ ��� 0�M 9V2G.=A�038:9 .=?G.=<:K A38cA�2G.=A%O MWDG?GX#4$# 0�47?BA38CH=4�.��9�B<:8c9;.1038CMW?#?GM=¨ .=XG.7K A 8:?E¸,?G.=?G9 4���W�0 K��,8:9;.=<�GI3M� <<C476 8:A 03254�O MW<:<CMp¨ 8:?5SI�3W 0b038:6(4 ( + d .=?/8:? H=47A30�M=I� BDGK AbA�0�M 9�� A .=?GXÌ MW?GXGA�MW? 03254@¸ ?G.=?G9;8:.=<6(.1I��=4;0!� 8N� 4���� 2G4(XG8CH 8:X547AF2G8:A 8:?G8C038c.=<�9;.��B8:03.=<�� � 8:? 0�M � A32G.1I347A M=O A�0�M 9�� .=?GX b � A32G.1I347A M=O MW?BXGA!� T 254d MW?GXGA�¨ 8:<:<�K 8:47<:X . SWDB.1IJ.=? 0�4;47X 8:? 0�4;IJ47A�0 IJ.10�4 -�� �`¨ 254;IJ47.=A 03254(A�0�M 9��K�GIJ8:9 4 ) � �6R47.=A3D5I347X I347<:.1038CH=4 0�M 038:6R4 d ��8:Aa.=AJA3DG6R47X 0�M A3.1038:A3O K/03254 S=IJM=¨*032 4 !UDG.1038:MW? y Y��:Y={\�lC�8:032 .�=4;47? 4;K=4 MW? 03254 6(.1I��=4;0 03254 8:?UH=47A�0�M=INA�47<:<:A(A30�M 9�� A 0�M� BD5K£ MW?GXGAR.=?GX H 8:9 4 H=4;IVA3.L�%� DB9J2X547.=<:8:?5SWAbI34 ! DG8CI34"?5MN4$# 0�IV. 8:? H=47A3036R47? 03A�� .=?BX/.1IJ4"9;.=<c<C47X£�!²�� V O'�S���3�!�±��³��`o 4;0� � .=?GX b � 403254b.=6RMWDB? 03A M=O A�0�M 9�� A .=?GXg MW?GXGA`2547<:X .10!038:6R4 ( � T 254 0�M=03.=<,H1.=<:D54�� � M=O A�0�M 9�� A .=?GX� MW?GXGA.10*038:6R4 ( 8:A

� ��+ � ) � / b ������� � 3 y Y�� \ {T 254a.=A3A3DB6Q�G038CMW? 032G.10 03254 0�IJ.=XG8:?GSWA*.1I34aA�47<CO < ¸,?G.=?B9;8:?5SR9;.=?5 4 4$#�BI347A3A�47X .=A &

� � ��+ � � ) � / b � � y ����� � { 3 y Y�� [ {Wb? 8c? 0�4;I347A3038:?5SN! D547A�038CMW? 8:A ?5M=¨ &U C�2B.10E¨ MWDG<:X MWD5I�8:?UH=47A�0�M=IE 4g�GIJ4!�B.1I347X 0�Mz�B.7K .10�038c6R4 d O M=I#. A�M < 9;.=<:<C47X Ç%�L�j�1�I²����

�����±���\�`�^�^���v�B8N� 4����503254 IJ8CSW2U0 0�Mg BD5K .10*A�MW6R4a<:.10�4;I*038c6R4�� .RA32G.1I34 M=O A�0�M 9��N.10*.d�BI347X54 <0�4;IJ6(8:?G47XÂ�GIJ8:9 4����T 254FIJ.1038CMW?G.=< .=?GA-¨ 4;I�����A3. K��I¨ .=A O MWDG?GX� UK�� <:.=9��N.=?GX5� 9J25MW<:47A y Y >�;�: { 0325I3MWD5SW2N.=? .=?G.=<CK A38:AM=O 03254|� MWAJA38� B<C4*A347<CO < ¸ ?G.=?G9;8:?5S#A�0�IJ.10�4;SW8C47A <C47.=XG8c?5S�O I3MW6 .=?N8c?G8C038:.=<58:?UH=47A�036R47?U0�� 0�M"03254 A3.=6R4�B.7K=M�Í .=A#03254(M��G038:MW?µ¨ MWDG<:X X5MI� T 25478CI O M=IJ6�DG<:. 8:Aa?GM=¨ 478:?GS DGA�47X MW? A�0�M 9��Z6(.1I��=4;03A�.=<:<M H=4;IF03254q¨!M=IV<:XB�

T 254#S=MW.=< M=O`032G8:A 9 MWDGIJA�4#8cA*0�M�¸BIJA�0 6 .��=4"A347?GA�4�M=O 032G4#.� M H=4"4 ! DG.1038CMW?GA!� .=?GX 032G47? 0�M�¨!M=I���¨ 8C0320325476��7 �¦­ 5�#: ��± Ï���M�± ��"!> ? .=<:< 03254#.� M H=4�4$#5.=6Q�B<C47Ab03254#DB?54$#�,<:.=8:?547X A�K 6Y MW< 1 � M 9;9;D5IVA!�v¨ 2B8:9J2 8:A*0�M� 4#0325MWD5SW2U0 M=O .=A .� 9 MW6Q�B<:4;0�47<CK IJ.=?GX5MW6 �*O DG?G9 038CMW?�M=O ( � 8:?aM=03254;Il¨ M=IJXGA!� 03254!9 MW?U038:? D5MWDGA < 038:6(4!.=?G.=<CM=SWDG4!M=OG.FA�4 ! D547?G9 4M=O 8:?GX54!� 47?GXG47? 0 8:X547?U038:9;.=<:<CK XG8:A�0�IJ8* BD50�47X IJ.=?GX5MW6 H1.1IJ8:.� ,<C47A!�

>@?Z.�¸BIJA�0a.10�0�476Q�B0�0�M 9;.1039V2 032G8cAa9 MW?G9 4!�G0!� 8:0�8:A 0�476Q�G038c?5S 0�M 0�I3K .=?GXZ6(4;4;0�03254RO MW<:<CMp¨ 8:?5SI34 ! DG8CI3476(47? 03A�&Y�� 1 � 8:A 8:?GX54!� 47?GX547?U0 M=O 1 H�O M=I (�#+ L �] � T 254 IJ.=?GXGMW6 H .1IV8:.� B<C47A 1 � y ( ^ d { .=<:< 2G. H=4�03254�AJ.=6R4q�GI3M� B.� ,8:<:8C0 K XG8:A�0�IV8� BD5038CMW?%$Z�: �Ca y 1 � { + d �

§bM=¨ 4;H=4;I��G032547A�4 IJ4 !UDG8:I3476R47?U03A XGM"?GM=00�GI3M XGDG9 4|¨ 2G.10%¨!4q¨ .=?U0!�IC 4aA32G.=<:< A325Mp¨ 032G.10�A3DG9V2 . � 9 MW? <038:? D5MWDGA�8N� 8,� XB�5A�4 !UDG47?G9 4 � 1 � 8:A*?5M=0 6(47.=A3D5IJ.� B<:4 8c? ( �GDG?B<C47A3A�8C0*8:A�8cX547? 038c9;.=<:<CK 5;4;IJMI�o 4;0&$ X547?GM=0�4 032G4��GIJM� B.� B8:<:8:0LK XG8:A�0�IV8� BD5038CMW? M=O 1 � ��¨ 2G8:9V2E KaI34 ! DG8CIJ476R47? 0 ] X5MU47A%?5M=0 X54!� 47?GXMW? ( � >@O 1 � 8:A ?5M=0 . A3D5IJ4#9 MW?GA�03.=?U0 O DG?G9 038CMW?/M=O ( � 032547?/03254;I34R6#DBA�0� 4".NH .=<:DG4�')(G[ A3DG9V2/032G.10

* & +,+�- 1 � J '/. 8cAF?G478C03254;I d ?5M=IRY�� PbM=¨ 9 MW?GA38:X54;I 03254RA�4;0�0 M=O!038:6R4d� MW8:?U03A�¨ 2G4;I34"03254R?5MW8:A�4"8:A\

Page 7: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

<C47A3AF032G.=? '3� >@0 9;.=?µ 4"A325Mp¨ ? 032G.10�¨ 8C032K�GIJM� B.� B8:<:8:0LKZY�03254(A�4;0�0 8cAF?GM=0@o 4! 47A�SWD54R6R47.=A3DGIJ.� B<C4��C�8C0325MWD50�SW8CH 8:?5SR.RO DG<:<S�GIJMUM=Ol¨!4#9;.=? DG?GX54;IVA�03.=?GX 032G8:A�.=A O MW<c<CM=¨ A��

o 4;0 � X547?GM=0�4 03254ko 4! 47A�SWD54 6R47.=A3DGI34 MW? [0� >@O 0 ¨!MWDG<cX 4 6R47.=A3D5IV.� B<C4�� 032547?¾ UK 032548:?GXG4!� 47?BX547?G9 4 I34 ! DG8CI3476R47?U0�Yq¨ 4E¨ MWDG<:X 4$#� 479 0b8:03A*I347<:.1038:H=4#A32G.1IJ4�8:? .=?UK 8:?U0�4;I3H .=< y�� g � {�0�M� 4 * � KN.(9 MW?U038:? D5MWDGA*.=?B.=<CM=SWD54aM=O%03254�<:.=¨�M=O <:.1I3S=4a? DG6Y 4;IVA�&

� y 0�� y�� g � {�{ + * y � @ � { 3 y Y�� ; {� ?�03254 M=03254;I 2G.=?BXB� 8:0%8:Al� ?5M=¨b?#O I3MW6 6R47.=AJD5I34 03254;M=I3K�032B.10 4;H=4;I3K#6R47.=AJD5IJ.� B<C4 A�4;0 b 8:A .1I� B8C0�IJ.1IV8:<CK032G8:9�� A�MW6R4!¨ 2G4;I34Y¨b8C032 I347A�� 479 0b0�M � � 8N� 4����,O M=IF4;H=4;I3K�� Y�.=?/8:? 0�4;IJH .=< y�� g � {b9;.=?Ì 4#O MWDG?BX A3DG9V2032G.10

� ycb � y�� g � {-{�� � y � @ � { 3y 9 Os�G§b.=<c6RMWA y Y >�;pV { T 254;M=I3476 >3>J>\�:Y [ �XWU& � o 4! 47A�SWD54�� A#X547?GA38:0LK 032G4;M=I3476N�¬{\�l� M� K y Y�� ; {\� 0 8:A ?5M=06R47.=A3DGIJ.� B<C4�� T 2G8:A*8cAb.� B.=X5�BI3M�� 4;I30LK M=O 1 � 479;.=DGA34#8:? H 8C4!¨ M=O y Y��:Y={\� y Y�� ] {\� y Y�� : {b.=?GX y Y�� V {\�`¨ 4¨ MWDG<:X <:8��=4 0�MÏ 4a.� ,<C4 0�M 9 MW?GA38cX54;I*8:?U0�4;S=IJ.=<:A�M=O 1 � ��5M=I 032G8:A IJ47.=A�MW?B� <C4;0!DGA .��9�GIJMW.=9J2 03254��GIJM� B<C476 O I3MW6 .�XG8�Í 4;I347?U0!.=?GSW<C4��U> ?GA�0�47.=X M=O 1 � 8C03A�47<:O��<C4;0*DGA 9 MW?GA38:X54;I*XB8CI3479 03<CK 03254�8:?U0�4;S=IJ.=< M=O 1 � �,.=?GX SW8CH=4�8C0*. ?G.=6R4�&

� b � & +� �� 1 H � L � 3

T 254 0325IJ4;4/IJ4 !UDG8:I3476R47?U03A MW?�032G4 4;H .=A38:H=4 M� Q 479 0 1 � 032547?�0�IJ.=?GA3<c.10�4Z8:? 0�M 0325IJ4;4 ! DG8C0�4 A�47?BA38� B<C4I34 ! DG8CI3476(47? 03A O M=I b � ���� 79���GM=Ia.=? K d + ( � J ( � J 3�3�3 J ( � 032G4�IV.=?GX5MW6 H1.1IJ8:.� B<C47A b ������� @ b ��� y�� + d g 3�3�3 g ] @ Y={.1I34�8:?GXG4!� 47?BX547? 0!���� ­`� b � 2G.=AbA�03.1038CMW?G.1I3K 8:?G9 IJ476R47? 03A��G8N� 4����G03254 Q�MW8:?U00�GI3M� B.� ,8:<:8C0 K XG8:A�0�IV8� BD5038CMW? M=O

ycb � ��� H @ b�� ��� H�g b ��� � H @ b�� � � H�g 3�3�3 g b �! � H @ b�� � H1{X5MU47A ?5M=0 X54!� 47?GXNMW? LP^ d �9¨b254;I34 (�" �# " ^ d O M=I%$ + Y g ] g 3�3�3 g ] .1I34�.1I� ,8C0�IJ.1I3K��

���'& �Ca y b � { + d O M=Ib.=<:< ( ^ d �C 4#.=XBX .(?5M=IJ6(.=<c8:A3.1038CMW?�&��� P8�Ca y b)(� { + Y��� 038:<c<N� 032547A�4NO MWDGI#I34 ! DG8CIJ476R47? 03A#X5M ?5M=0�XG4;0�4;IJ6(8:?54 b � �l�5M=IR4$#5.=6Q�B<C4���03254N9 MW6g� 47?BA3.10�47X£m%MW8:AJA�MW?Q3DG6Q���GI3M 9 47A3A�.=<:A3M(A3.1038:Aj¸B47A*0325476��3� D5I%¸,O 032 IJ4 !UDG8:I3476R47?U0�¸ # 47A�032G4q�GI3M 9 47A3A b � DG?G8<! D547<CK y .=A�¨ 8:<:< 479 MW6R4�9;<C47.1Ib<:.10�4;I MW?3{h&��� R`� (+*, b � 8:A�9 MW?U038:? D5MWDGA*.L� A�¨ 8C032Â�GI3M� ,.� B8:<:8C0 K Y��

T 254 A�0�M 9J2G.=A�038c9��GI3M 9 47A3A b � AJ.1038:A�O K 8:?GS#032547A34 I34 !UDB8CI3476R47?U03A 8:A�9;.=<:<C47XN03254.-��,²��`²����3�-���\²�����M=I���j��ÊZ�9�^���GRg���^�^���9�B> ? 03254�?54$# 0*9J2B.��G0�4;I�¨ 4�A32G.=<c< SW8CH=4�.=? 4$#L�B<:8:9;8:0 9 MW?BA�0�IJDG9 038CMW?8�

[

Page 8: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� � �����j�������� ��� ���> ? 032B8:AbA3479 038CMW?�¨!4RA32B.=<:< 9 MW?GA30�IJDG9 0q� I3M=¨ ?B8:.=? 6RM=038CMW?/MW? - d g�� . O M=I A�MW6(4 � � d �`C 4RO MW<:<:M=¨ 03254M=IJ8CSW8c?G.=<B8:XG47.�M=O%P M=I� 4;I30�C�8:47?54;I�8:? 032G4"Y >�:1d � A��9WbA ¨ 4 AJ2G.=<:<BA34;4��G8C0!9;<C47.1IV<CK XG8:A��B<:.7K A 032G4 ?GMW8:A�4 1 �.=A ."IV.=?GX5MW6 ���e�1�^�1� Q��I�^�^��� 8:? 032G4aA�47?GA�4 M=O¥� 9V2¬¨ .1I30 5��BIV.103254;I*032G.=? .(IJ.=?GX5MW6 1�L�3���^�N���9�

0 T

�V�v�'��4 �±�L�G�� �d��9 �ZÎ8�� �5G�z�E�l�G� ����3� � � � ] + \��A MW?GA38:XG4;I�03254 M=I30325MW?5M=IV6(.=<B B.=A38cA � � g � ( g � � g 3�3�3 M=O 03254@§F8:<� 4;I30�A-�B.=9 4�� ( - d g�� . SW8CH=47?Ì UK

� � y ( { +� ]� A38:?�� ]�� (��� y.]G^ Y g d J ( J ��{ 3

�5M=I .RO DG?G9 038CMW? W)(�� ( - d g�� .%03254�9 M 4$% 9;8C47?U03A MW? 032G8:A0 B.=AJ8:A y 8N� 4��,03254E�5MWD5IV8C4;I 9 M 4$% 9;8C47?U03A\{�.1I34#03254¨ 478CSW2 03AY¨ 8C032�¨ 2G8:9V2 03254 O I34 ! D547?G9;8:47A ] + Y g ] g : g 3�3�3 .1I34 I34!�BI347A�47?U0�47X 8:? Wl� P Mp¨@���X¨ 2G8C0�4 ?GMW8:A�4��A325MWDB<:X 9 MW?U03.=8:?�.=<c< O I34 ! D547?G9;8:47AY¨b8C032 4 !UDG.=<%¨ 478CSW2U03A(.=?GX 8:? . IJ.=?BX5MW6 ¨ . K�� T 2G8cA�<:47.=XGA"0�M 03254O MW<:<CM=¨b8:?5S"0�47? 03.1038:H=4#X54�¸,?B8C038CMW?NM=O 1 � &

� 1 � & + ��� ����� � � � y ( { � y dNJ ( J ��{hg y ] �:Y={¨ 254;IJ4 � � g � ( g � � g 3�3�3 8:A ."A�4 ! D547?G9 4 M=O�8:?BX54!� 47?GX547?U0`A�03.=?GXG.1IVX�� .=DGA3A38:.=?NIJ.=?BX5MW6 H1.1IJ8:.� ,<C47A!� P Mp¨@�03254d�GI3M� ,.� B8:<:8C0 K 032B.10F032G4"A34 !UD547?B9 4 � � g � ( g � � g 3�3�3 A325MWDB<:XÌ 4�A2!UDB.1I34�AJDG6(6(.� B<:4#8:A d �G� M 1 � ¨ 8:<:<.=<:6RMWA30 AJD5I347<CK ?5M=0� 4".=? O DG?B9 038CMW? 8:? � ( - d g�� .,�G� D50�¨!4RA32B.=<:<G 4".� B<C4�0�M 6(.��=4(A�47?GA34�M=O y ] �:Y={F8:?03254�A347?GA�4 M=O'� 9J2�¨ .1IJ0 5#XG8:A30�IJ8� BD5038:MW?GA!�­ �N7 �V�( �#: ����3�� o 4;0"!$# y > (&%�{ XG47?5M=0�4a03254�A��B.=9 4aM=O .=<:< A�4 ! D547?G9 47A � + y � � g � ( g 3�3�3 {�( [(' O M=I�¨ 2B8:9J2

) � ) (# & + ��� ��� ] (# � (� +* 3

PbM=0�4Z032G.10�! � 8:A 03254ZA��B.=9 4-, (�y/. {/M=O�A !UDG.1IJ4ZA3DG6(6(.� ,<C4 A�4 !UDG47?G9 47A!��o 4;0 DBA X547?5M=0�4k K0! 032548:?U0�4;IJA�479 038CMW? !Y& +21#"354 ! # g;

Page 9: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

.=?GX� K ! � 03254�DG?G8:MW?! � & + �# 34 !$# 3!�9 MW?GA38cA�03A M=O`03254#IV.��B8:XG<CK X5479 I347.=AJ8:?5S A�4 !UDG47?G9 47A .=?GX&! � M=O`.=<:<�03254�� MW<CK ?GMW6(8:.=<:<CK� MWDG?GX547X MW?547A!�EF?GX54;I*03254q�,.=8CIJ8:?5S

� � g ��� & + ��� ����� � � � g03254�A��B.=9 47A ! # .=?GX�!�� # .1I34a47.=9J2 M=03254;IJAbXGDG.=<N�G.=?BX ! � 8:A 03254#XGDG.=< M=O !��vC 4#2G. H=4a03254aO MW<:<CMp¨ 8:?5S8:?G9;<cDGA38CMW?GA &

! ������� ! � ( � ! � � � ! � y + , ( { � ! � � ! ( � ���� ! 3P 4$# 0�<C4;0 + X547?GM=0�4b03254 8:?L¸ ?G8C0�4��GIJM XGDB9 0!6R47.=A3DGI34bMW? [ ' 032B.10 6(.��=47A � + y � � g � ( g 3�3�3 { 8:?U0�M.(A�4 ! D547?G9 4�M=O%8:?BX54!� 47?GX547?U0 A�03.=?BXG.1IJXz� .=DBA3A38:.=? IJ.=?BX5MW6 H1.1IJ8:.� B<C47A�� > ? .RO M=IJ6�DG<:. &

+ y � � { & + �� � ��� � Y� ] � � � ���� � � � � � 3T 254�O MW<:<CMp¨ 8:?5S <C476 6(. A3.7K A!032G.10 + < .=<:6RMWA30`A3D5I347<:K � � 8:?G9 IJ47.=A�47A A3<CMp¨!4;I!032G.=? ] �W6(.�� 8:?5S 032G4 A2! DG.1I34M=O 0325478CIC! D5M=038C47?U0 A3DG6 6(.� B<C4��

� �!%_% #µ­ �^7 + y ! � � { + +�� � (�� & ��� ��� �(�] ( +*�� + Y�#

�@�����v� � �5M=I ] ( . �%<C4;0�� � & [(' , [ X547?GM=0�4a03254aIJ.=?BX5MW6&H .1IV8:.� B<C4� � y � { & + ��� ��� � (�� ( 3

� 8:?B9 4F032G4 � � � A .1I34�A�03.=?GXB.1IJXz� .=DGAJA38:.=?B�I¨ 4a2G.7H=4#O M=Ib.=<:< ] ( . �a y � � { +

��� ��� Y� ( J � ([ + & �

.=?GX 032G4;I34;O M=IJ4��GO M=Ib.=<:<=� ( . .=?BX ] ( . �8 K 03254#- .1I��=M H 8:?54 ! DG.=<:8C0 K��+�- � � � � . J Y

� a y � � { J �� 3� 8:?B9 4�� � y � { 8:A*8:?G9 IJ47.=A38:?5SR8:? ] O M=I .=<:< � �B8:0 O MW<:<CMp¨ A�032G.10

+�- � � J � O M=I .=<c< ] . + +���1� 3 ' - � � J � .! + <:8:6�#" � +�- � � J � . ^ Y @ �� g

T

Page 10: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

.=?GX 2G47?G9 4+ y ! � � { + +�� �� 3 ' 1� 3 ' - � � J � .! + <:8c6� " � � Y @

�� + Y 3 �

� 8:?G9 4�! � � Z ! � � � .=<:A�M <:8C47Ab8:?�! � ¨ 8C032Ì�GI3M� B.� ,8:<:8C0 K/Y�� P Mp¨@� ! � 9 MW?GAJ8:A�03AbM=O 03254"A�4 !UDG47?G9 47AM=O¥�5MWDGIJ8C4;I 9 MU4$% 9;8:47? 03AFM=O 03254�0�476Q� 4;I347X/XG8:A�0�IJ8* BD5038CMW?GA�� .=?GX 03254"<:.10�0�4;I .1I34#. S=M M X 9;<:.=A3Ab0�M�¨!M=I��¨ 8C0328�9� M�¨ 4aA32G.=<c< 2G47?G9 4;O M=IJ032 DGA�4 ! � .=A�MWD5I*AJ.=6Q�B<C4 A-�B.=9 4 �q� T 254a9 MW?G?5479 038CMW?¨b8C032 03254aA-�B.=9 4 M=OXG8:A30�IJ8� BD5038:MW?GA!8cA�.=A*O MW<:<CM=¨bA!�

o 4;0�� - d g�� . X547?5M=0�4b03254bA-�,.=9 4 M=O 8:?L¸ ?G8C0�47<CK�XB8�Í 4;IJ47? 038:.� ,<C4�O DB?G9 038CMW?GA MW? - d g�� .S¨ 8C032 9 MW6g�B.=9 0A3DI�v� M=IJ0 8c?GA38:X54 y d g���{\�SW O DG?G9 038CMW? W)(�� - d g�� .%X54;0�4;IJ6(8:?G47A�.(A�4 ! D547?G9 4 M=O I347.=< ? DG6Y 4;IVA� � & + � � � g W � & + ���

� � � y ( {4W y ( { �( y.] ( . { 3�5M=I�.=<c<�4;H=47? > ( . � 03254d�GI3M�� 4;I30 K 032G.10 W 8:A > 038:6R47A 9 MW?U038:?UDGMWDGA3<CK XB8�Í 4;IJ47? 038:.� ,<C4#8:6g�B<:8C47A 032G.10� (�! # UK��B.1I3038c.=< 8:? 0�4;S=IV.1038CMW?�&

���� � W #�� y ( { � ( �( + ��� ��� � � � g W # � � ( + ��� ��� � � #��� g W � (

+ ��� ��� � ]��� ( # � � � g W � ( + � �� ( # ) � ) (# 3A MW?UH=4;IJA�47<CK�� � (&!$#�8:6Q�B<:8:47A 032G.10IW # � (&� ( - d g ( .,�WA�M W 8:A > @ Y`038c6R47A 9 MW? 038:? D5MWDGAJ<CKaXG8�Í 4;I347?U038:.� B<C4��PbM=¨@� . A34 !UD547?B9 4 � � g � ( g 3�3�3 8:A�A3.=8:XZ0�M 9 MW?UH=4;I3S=4 0�M/.=? 47<C476(47? 0 � M=O ! y � 8:A#8C03A�47<CO*./A�4 ! D547?G9 4M=O!? DG6Y 4;IJA���{ 8CO!8C0 9 MW?UH=4;I3S=47A�8:?�! # O M=I 4;H=4;I3K > �8� ? 03254"M=03254;Ia2G.=?GXB� . A�4 ! D547?G9 4NW � g W ( g 3�3�3 8:?� - d g�� . 8:A"A3.=8:X 0�M 9 MW? H=4;IJS=4 0�M .=? W (�� - d g�� . 8:O*O M=I(.=<c< > ( . 03254 A�4 ! D547?G9 4 W #��� g W #��( g 3�3�39 MW?UH=4;I3S=47AbDB?G8CO M=IJ6(<CK(0�M W #�� � T 254;I34;O M=I34 03254�0�M�� MW<:M=S=KNMW?�! 8:A�9;.1I3IV8C47X M H=4;IF0�M�� - d g�� .,�­ �¦­ ���>nZ���$ ����S� �3� � ���! ��"��#v� % � ����3�C 4#?GM=¨ X54�¸ ?54QÊ¢�¬�^�h²Y�3���e�!²��1 MW? - d g�� .� K

�1 &������ - d g�� . & y � g W8{ *, ��� ��� � � � � � g W � 3�5M=Id¸ # 47X � ( �q�%032G4 6 .�� �1 y � { &=W *, �1 y � g W8{�8:A". ���¦���^�\� Q��I�^�N���ZMW? - d g�� .,�'§b47?G9 4��¢¨ 8C032 032546R47.=A3DGI34 + 478:?5SZXG4�¸,?547X MW? ��� MWD5I 6 .����1 479 MW6R47A .º�-���3�¬� R ���¦���^�\� Q��I�^�N���9�0� ? 03254 M=03254;I2G.=?GX8�5O M=I0¸ # 47X W)(�� - d g�� . 032G4a6(.��

�1�� & � *, �1 y � g W8{8:A�.�� .=DGA3A38:.=? IJ.=?GX5MW6&H1.1IJ8:.� B<:4|¨b8C032 6R47.=? 5;4;IJM .=?GX H1.1IJ8:.=?G9 4 ) W ) ( &a y �1�� { + a � �� " ��� � " � � " g W � + d

a y �1 (� { + a � �� " ��� ��� ��� � " � � � � " g W � � � � g W � + �� " ��� � � " g W � ( + ) W ) ( 3>

Page 11: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

>@0�O MW<:<CMp¨ A"032G.10"03254 6(.�� W *, �1�� 9;.=? 4N4$# 0�47?GX547X 0�MZ.�§F8:<� 4;I30�A-�B.=9 4 8:A�MW6(4;0�I3K � ( - d g�� . ,� ( y �:g + {\� > ?GX54;47XB� 8COIW " 8:Ab. A�4 ! D547?G9 4�M=O O DG?G9 038CMW?GAb8:?�� - d g�� . A3DG9V2 032B.10 ) W " @ W ) , d�y $ , * {O M=I A�MW6R4UW (&� ( - d g�� .,�G032547? 03254�A�4 ! D547?G9 4 y �1�� { �" ��� 8:A*.�A�.=DG9J2UK < A34 !UD547?B9 4�8:? � (�y �`g + {h&) �1���� @ �1�� � ) ( + a y-y �1���� @ �1�� � { ( { + a y �1 (��� � � � { + ) W " @ W � ) ( 3� M(8C0*2B.=A*.(<:8:6 8C0!� 1�� A3. K��,- M=I34;M H=4;I=�,03254a6 .�� W *, 1�� 8:A�8:A�MW6(4;0�IJ8:9 &

a y 1 (� { + ) W ) ( � W (&� ( - d g�� . 3 y ] � ] {§b47?G9 4�.1SW.=8:? O M=I .=<c<=W'g��%(�� ( - d g�� . &a y 1�� { + d g a y 1 � 1�� { + � W'g�� � 3 y ] � : {

§ Mp¨!4;H=4;I�� 03254�4$# 0�47?GA38CMW?(O I3MW6 �1 MW? � � � - d g�� .B0�M 1 MW? � � � ( - d g�� . 2G.=A`.��GIJ8:9 4�&�¨ 2G4;I347.=A�1�� y W)(�� - d g�� .±{ 8:A`. IJ.=?GX5MW6 47<C476R47?U0`M=O y � - d g�� .±{ � � 1 � y W)(&� ( - d g�� .±{ 8:A0�3���,. IJ.=?GXGMW6 47<C476R47?U0M=O y � ( - d g�� .±{ � + � ( - d g�� .,� 03254(IJ47.=A�MW?µ 478:?5S 032G.10 1 � y � { 8:A MW?G<CK X54�¸,?G47X O M=I@¸ # 47X W ( � ( - d g�� ..=?GX ��� RQ���1� .=<:< � ( ��� T 254�A�4;0bM=O`0325MWA�4 � O M=I�¨ 2B8:9J2 1 � y � { 8:AbX54�¸,?547X O M=IQ���±��W ( � ( - d g�� . 2G.=A6R47.=A3DGI34 d �C 4�476Q�B<:M KN03254 4$# 0�47?BA38CMW? O I3MW6 �1 0�M 1 8:? M=IJX54;I 0�M X54�¸,?54@� I3Mp¨ ?G8:.=? 6(M=038CMW?�&

���Nn¢�"�$ ����3� ����-��ÊZ�9�N��� Rg���^�N���Ì� ;�²!���±�L²|�^�.Rϲ��e�v�h²!�h;���� - d g�� . 8:A 03254�O .=6(8:<CK ycb � { � 3�� � ��� M=O,IV.=?GX5MW6H1.1IJ8:.� B<C47A�� , [�SW8CH=47?� Kb � y � { & + 1 �� �

� ���y � { 3

C 4@¸,?G.=<c<CK A325Mp¨�032G.10*032B8:A�X54�¸,?G8:038CMW? 6R4;4;03Ab.=<c< MWD5I*I34 ! DG8CI3476(47? 03A!��@���` �3 4�$ ����3��­ �¦­ b � b�JL+N)*b-¼Sa1bE+NM3aY/1&�2`_�)h+N)e&�29b���� ?������ �K&�¤Zu9a=/=+N)e&�2'0�#9Hk&p[1a!&��=a\[4q��� e3#�¡ZM3a\[1a�aTSL)¦b�+Nb�J��=a\[�b�)e&�2z&�¤ ycb � { � 3�� � ��� b=t/jMµ+NMvJL+ (+*, b � )*b|/1&�2S+N)*2`t¬&Lt�b�#��� @v# � ),+NMºc`[1&L]¬JI]�)*(*),+�i 0�� ( *, b � MvJ�b�)*2I¼v2v),+hak��J�[�)¦JL+N)e&�2·&��=a\[Ka��=a\[ji +N)*4�az)*2S+ha\[=��J�(qJ�2`_¿)*b

+NM3a\[1a1¤N&p[1a�23&�»'M3a\[1aE_�) �Ba\[1a12S+N)¦JI]�(±a�#

�@�����v� � �5I3MW6 03254/9 MW?GA�0�IJDB9 038CMW? M=O 1 8:0 8:A 9;<C47.1I 032B.10 O M=IN.=?UKYW � g W ( g 3�3�3 g W � ( � ( - d g�� . 03254IJ.=?GXGMW6�H1.1IJ8:.� B<C47A 1 � � g 1 � � g 3�3�3 g 1���� .1IJ4RQ�MW8:? 03<:K � .=DGA3A38:.=?8�¥W A�03.=?GXG.1IJX I347A3DG<:0(8:?º�GI3M� ,.� B8:<:8C0 K03254;M=I3K 47?GAJD5I347A 032G.108,�%Q MW8:?U03<CK�� .=DGA3A38c.=? IJ.=?GX5MW6 H .1IJ8c.� B<C47A�.1I34a8:?BX54!� 47?GX547?U0 .=A A�MUMW? .=A*03254;K .1I34�DG?B9 M=I3I347<:.10�47XB�8c8N� 0325478CI Q�MW8:?U00�GI3M� B.� B8c<:8C0LKNXG8:A�0�IV8� BD5038CMW?NX54!� 47?GXGA MW?B<CK MW? 0325478CI*4$#L� 479 03.1038CMW?GA .=?BX 0325478CI 9 M=IJI34 <<:.1038CMW?GA!�� M 03254 8:?GXG4!� 47?BX547?G9 4RM=O*03254N8:?G9 I3476(47? 03A#M=O�� I3M=¨b?G8:.=? 6(M=038CMW? yi��� 7{�O MW<:<CMp¨ A�O I3MW6 03254M=I30325M=S=MW?B.=<:8C0LK M=O 03254(O DG?G9 038CMW?BARY � ��� ��� � � � + Y � � ��� � � � @ Y � � ��� � y�� + d g 3�3�3 g ] @ Y={\� A38c?G9 4 1 6 .��BAM=I30325M=S=MW?B.=< O DB?G9 038CMW?GA W .=?GX�� 0�M DG?G9 M=I3IJ47<:.10�47X IJ.=?GX5MW6 H .1IJ8c.� B<C47A y UK y ] � : {-{\� T 254(A�03.1038CMW?B.1IJ8C0LKM=O�03254 8:?G9 I3476R47?U03A yi��� ­v{NO MW<:<CMp¨ ANO I3MW6 032G4 O .=9 0 032G.10 032G4Z8:?G?54;I��GI3M XGDG9 03ANM=O�03254 O DG?B9 038CMW?GAY � � � � H ��� � H � y�� + Y g 3�3�3 g ] { XGM ?GM=0 XG4!� 47?BX MW? L �%m I3M�� 4;I3038C47A ���'& .=?GX ��� P .1I34 M� H 8:MWDGA�&a ycb � { + a y 1 � �

� ���{ + d ��a y b)(� { + ) Y � � � � ) ( + ( � T 254Ì�BI3MUM=O M=Oq�BI3M�� 4;I3038C47A ��� R�.=?GX ��� ÃI34 ! DG8CI347A�A3MW6R4@�GI34!�,.1IJ.1038CMW? .=?GX 8cA�X54;O 4;IJI347X 0�M�� 479 038:MW?GA ] � :=U ] � V �

�5I3MW6 y ] � : {*8C0�O MW<:<CM=¨bA�032G.10*O M=I .=<:< L g ( ^ d &a y b H b � { + � Y � � H � g7Y � � � � � + L�� ( 3 y ] � V {

Y d

Page 12: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

­ � & � �3�� ��^���"�$ Jm �3�d`"#: �5� O#v��� �5��8`l�����Ke��% �3���S���� 4���3�� T 254a9 MW?U038:? DG8C0 K M=O¢�B.1032GA ( *, b � y � {�¨ 8:032 � (�� 8:A*. A�MW6R4!¨ 2G.10*AJDI G03<C4 6(.10�0�4;I��

�%8:IJA�0!� <C4;0�DGA!6 .��=4a9;<C47.1I�032G.10 03254 9 MW? 038:? DG8C0 K M=O 032G4 9;DGI3H=4 ( *, b � 8:? � (�y �:g + {!8:A ?5M=0�.10�.=<:<A3D %N9;8C47? 0�0�M 47?GA3D5I34a9 MW?U038:? DG8C0 K M=O%03254@�B.1032BA ( *, b � y � {\���� #%'`"K±��­ �^7v����o 4;0 � + - d g7Y .S¨ 8C032go 4! 47A�SWD54*6R47.=A3DGI34 + ��o 4;0� � y ( ( - d g7Y .±{`X547?5M=0�4*03254��GI3M 9 47A3A� � y � { & + Y � � � � y � { + � d 8CO ( J � �Y 8CO ( � � �

� M� � y � {\�!O .1I O I3MW6 478c?5S 9 MW?U038:?UDGMWDGA!�`6RM H=47A UK�6 .�� 8:?GS . A38c?5SW<C4"Q3DG6Q��.10 . IJ.=?GX5MW6 038:6R4��§bM=¨ 4;H=4;I�� (+*, � � 8:A .R9 MW? 038:? D5MWDGA 9;D5I3H=4�8:? � (�y �:g + {\�,A38c?G9 4) � ��@ � H ) ( + � �H � # + ( @ L y LUJ ( { 3

� 479 MW?GXB� <:4;0aDGA M� BA�4;IJH=4(032G.10�. XG47A39 IJ8��G038:MW? M=O . 9;DGI3H=4 8:? � (�y �:g + {\��A3DB9J2Z.=A ( *, b � � 9;.=??54;H=4;I� 4 A3D % 9;8C47?U0�0�M(47?GA3D5IJ4q�B.1032¬¨b8:A�4a9 MW?U038:?UDB8C0LK�� T 2G8:A 8:A*A32GM=¨ ? K 03254 O MW<c<CM=¨ 8c?5S"4$# .=6Q�,<C4����� #%'`"K±�K­ �¦­`��� T .��=4 y �:g + {�.=A 8:? 03254E�GI34;H 8CMWDGA 4$#5.=6Q�B<C4��GPbM=¨ <C4;0�� � y � {� 4 SW8CH=47?Ì UK

� � y � { + � Y 8CO � @ ( 8:A*8:I3IJ.1038CMW?G.=<d 8CO � @ ( 8:A�IV.1038CMW?G.=< 3

o 4;0UD � y � { + Y"O M=Ia.=<:< � ( ��� ( ( - d g7Y .,�lA <C47.1IV<CK�� ( *, D � y � {b8:A 9 MW?GA303.=? 0!� 2547?B9 4"9 MW?U038:? D5MWDGA O M=I���±� � ( ���I¨ 254;I347.=A ( *, � � y � { 8:A�XG8cA39 MW? 038c?UD5MWDBA!O M=I*.=<:< � ( �q�GP 4;H=4;I3032G47<C47A3A!�5O M=I .=?UKϸ # 47X H1.=<:D54M=O ( ��� � .=?GX D � .1I34�.=<:6RMWA30 A3D5I347<:K 4 ! DG.=<N�GA�MR03254;K 9 M=I3IJ47A-� MW?GX 0�M(03254�AJ.=6R4a9;D5I3H=4�8c? � ( y �:g + {\�

T 2547A�4 M� BA34;I3H .1038:MW?GA*<C47.=XGA DGA�0�M(03254 O MW<:<CMp¨ 8:?5SRX54�¸ ?G8C038CMW?�&���Nn¢�"�$ ����3� � C 4 A3. K 032G.10 .½�GI3M 9 47A3A � � ( � (�y �`g + { y ( ( - d g�� .±{N8cA .�;�²!���1�^��� M=O#.£�GI3M 9 47A3AD � ( � ( y �:g + { y ( ( - d g�� .±{*8CO

� ( ( - d g�� .,& � � y � { + D � y � { O M=I .=<:6(MWA�0 .=<:< � ( � 3T 2G8:A#A3.=8:XB�8¨ 4��GI3M 9 4;47X 0�Mz�GI3M H=4 032G.10�� I3M=¨ ?B8:.=? - M=038CMW? 2G.=A�. H=4;IJAJ8CMW?µ¨ 8:032 9 MW?U038:?UDGMWDGA

�B.1032GA��G.=A 9;<:.=8:6(47X 8:?Â�GI3M�� 4;I30 K ��� R 8:?�m I3M�� MWA38:038CMW? ] � ] ��@�����v� �f�5M=I 03254�O MWD5I3032/6RMW6R47?U0bM=O`.N9 47?U0�4;I347X�� .=DGA3AJ8:.=? IV.=?GX5MW6 H .1IJ8c.� B<C4���¨!4"2G.7H=4ea y ���{ +: � .1I y �¬{ ( �v§b47?G9 4aO M=I*03254E�GI3M 9 47A3A b � ¨!4a2B.7H=4a�� � b � @ b H � ��� + : � ( @ L � ( 3

PbM=¨ ¸ # � ( y d g7Y�� V {R.=?GX£�BD50�� & + Y @ V � � d � T 2547?B�%O M=IR.=<:< L g ( ( - d g�� .,�Z¨ 4 2B.7H=4 UK 03254-/.1I��=M H 8:?G4 !UDG.=<c8C0LK��+�� � b ��@ b H � ^ � ( @ L � ��� J � ( @ L � � � � a�� � b ��@ b H � ���

J�: � ( @ L � ( � � �+ : � ( @ L � � �! g

Y=Y

Page 13: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

A�M(032B.10*O M=Ib.=<:< ] ( . .=?GX dNJ � ] � �+�� � b � � � � (�� � @ b � (�� � � ^ ] � � � � J : � ] � � � �! � g

.=?GX 2G47?G9 4

��� ���( � �� ��� � + � � b � � � � ( � � @ b � ( � � � ^ ] � � ���

J ��� ���( � ����� � : � ] � � ] � � + : ��� ��� ]

� � + :] @ Y * 3

� K 03254�¸BIJA�0�� M=I347< < A .=? 0�47<c<:8 <C476(6(.R8:0�O MW<:<:M=¨ A�032B.10*8CO � XG47?5M=0�47A*03254�4;H=47? 0 � & + � � dSJ � ] � & � b � � � � (�� � @ b � (�� � � ^ ] � � ��� g

032547?̨ 8C032Â�GI3M� ,.� B8:<:8C0 K Y MW?B<CKϸ ?G8C0�47<CKN6(.=? K � � Ab2G.��9� 47?B�3� MRO M=Ib.=<:6(MWA�0 .=<:< � ( ��03254;IJ4a4$# 8cA�03A� y � { ( . A3DB9J2 032G.10 � X5MU47A ?5M=0*M 9;9;D5I*O M=I ] ^ � y � {\�B8N� 4����GO M=I .=<:< ] ^ � y � { ¨ 4�2G. H=4� d J � ] � & � b � � � � ( � � y � { @ b � ( � � y � { � ] � � � 3 y ] � \ {

P Mp¨ ¸ # .=? � O M=I�¨ 2B8:9J2 03254�<c.10�0�4;I 2GMW<:XGA!� .=?GX <:4;0 L .=?GX ( 4�0�¨!MÂ� MW8:?U03Ab8:? 03254"A�4;0�� M=OX5KW.=XG8c9 IJ.1038CMW?G.=<:A M=O T �� & + � � ] � � ����� ] g � ( . g d J � J ] �� g

A3DG9V2 032G.10 � L @ ( � J ] �� � � �E�lA 2GMUMWA�4 ]�^ � y � { A3DG9V2 032G.10 ] � � � � � � J � L @ ( � ] � � �E�8o 4;0� ( . 4�A3DG9V2 032G.10:� ] � � � 2G.=AFXG8:A�03.=?G9 4#<C47A3Ab032G.=? ] � � � 0�M� M=032 L .=?GX ( �3C 4�6(. K 032547?z¨*IJ8C0�403254�XGKW.=XG8:9FI34!�GI347A347? 03.1038CMW?L + � ] � � � / ��

" ���� "] � � � " � �

( + � ] � � � /#�� ��� � " ] � � � � � �0g

¨ 254;IJ4 , g > ( . .=?BX " g � � (�� @ Y g d g7Y��aO M=I $ + Y g 3�3�3 g , .=?BX � + Y g 3�3�3 g > ��!K y ] � \ {'¨ 4b6 .7K ?5Mp¨9 MW?G9;<:DBX54 032G.10� b � y � { @ b H y � { � ��

" ���� " ] � � � " � � � / #�� ��� � � � ] � � � � � � �

J ]Y @ ] � � ] � � � � � �

J ]� � y Y @ ] � � { � L @ ( � � 3

>@0 O MW<:<:M=¨ A%032G.10 032G4 IJ47A�0�IJ8:9 038CMW?"M=O 03254 O DG?G9 038CMW? (+*, b � y � {�0�M���6(. KY 4 4$# 0�47?BX547XR0�Ma. 9 MW?U038:?UDGMWDGAO DG?G9 038CMW? (+*, �b � y � { MW? .=<:< M=O - d g�� .,�Y ]

Page 14: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

> 0FI3476(.=8:?BA 0�M A325Mp¨ 032G.10 �b � 8:AF. H=4;IVA38CMW?/M=O b � �BA�25MUMWA34 ( ( - d g�� . .=?GX/<C4;0 ( � g ( ( g 3�3�3 4".A�4 ! D547?G9 4�8:? � 0�47?GXG8:?GS(0�M ( �3o 4;0 � & [ , [« 4#.g MWDG?GX547X8�G9 MW? 038:? D5MWDGAF.=?GX A�0�IJ8:9 03<CK 8:?G9 IJ47.=A38:?5SO DG?G9 038CMW?B� T 2G47?�� � � ycb � y � {-{ @ � y �b � y � {-{ � ( + y � � { + ) � ycb � { @ � y �b � { ) ( + <c8:6" " � ) � ycb � � { @ � y �b � � { ) ( + d g

A38:?B9 4 (+*, b � 8:A 9 MW?U038:?UDGMWDGA 8:? � (�y �:g + {!.=?GX (+*, �b � 8:A¥� MW8:?U0h¨b8:A�4 9 MW?U038:? D5MWDGA!� .=?GXN03254;I34;O M=I34 .=<:A�M9 MW?U038:?UDGMWDGA*8:? � ( y �`g + {% K� MWDG?GXG47X 9 MW? H=4;I3S=47?B9 4���

§ 47?G9 4;O M=I3032B�L¨ 2G47?NA�� 47.�� 8:?5S#M=O b � ¨ 4 A32G.=<:<,.=<�¨ .7K A�6R47.=? 8C03A 9 MW? 038:? D5MWDGA H=4;IJAJ8CMW? .=?GX X5I3M��03254a038c<:X54 O IJMW6 03254a?5M=03.1038CMW?8�­ ��P ������9�5����� = ��3�d`"#: �5� WF<C0325MWD5SW2 03254��B.1032 M=O8� I3M=¨ ?B8:.=? 6RM=038:MW? 8:A!9 MW? 038c?UD5MWDBA!� 8C0 8:A 4$# 0�I3476R47<CKRI3MWDGSW2B� T 2B8:A 8:A 4$#L�GI347AJA�47X K 03254 O MW<:<CMp¨ 8:?5S5 ,.=A38:9(<C476 6(.L�G¨ 2B8:9J2�¨!4NA32G.=<:< ?G4;47X 0�MK�GI3M H=4��GIJM�� 4;IJ0LK ��� à 8:?�m`I3M�� MWA38C038CMW?] � ] �� �!%_% #µ­ � & ¯la�+ d + ( � �� ( � �� �� ( � �� + � ]IadJ5¤^J�4g)*(Ëi£&�¤Zc8J�[=+N),+N)±&�29bY&�¤�+NM3aQ)¦23+ha\[=��J�(- d g�� .�+NM3JL+¢wa�+Nb|J�[�]�),+^[\J�[�)¦(Ëiϼv23a|¤N&p[ ] , * �S)*2k+NM3a|b\a129b1ad+NMvJL+

<:8:6�#" � 6(. #��� ��� � � ( � �� � � @ ( � �� � + d 3¡¢M3a12

� ( @ <:8:6�#" �� � ��� � � ycb ��� � � � @ b ��� � { ( + � 3

�@�����v� � W� v GI34;H 8:.10�4 � b � + b ��� �� � � @ b ��� �� .=?GX�� ( � + ( � �� � � @ ( � �� �vo 4;0�� � + 6(. # � � ( � � T 2547? � � y � b � { ( @ � ( + a�� � � � y � b � { ( @ � (��

+ a � � " � y � b " { ( y � b � { ( @ ] �Ca � � � y � b � { ( / � (+ � � a y�y � b � { � { / � "��� � a y-y � b " { ( { a y-y � b � { ( { @ ] � � � � � ( � / � (+ � � :Iy � ( � { ( / � "��� � y � (�" { y � ( � { @ � (+ ] � � y � ( � { (J�] � � � � � ( �+ ] � � �0g

Y :

Page 15: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

¨ 254;IJ4".1SW.=8c?k¨!4 2G.7H=4 DBA�47X 03254RO .=9 0a032G.10a03254RO MWD5I3032 6(MW6R47? 0 M=O . 9 47?U0�4;I347X½� .=DGA3A38:.=? IV.=?GX5MW6H1.1IJ8:.� B<C4 �R8:A�SW8:H=47?� UK a � � � � + : � .1I y �¬{ ( �9WFA*<:8:6 �#" � � � + d �G03254aA�03.10�476(47? 0bO MW<:<:M=¨ A!��

C 4#6(. K�¨ IJ8C0�4 03254�6R47AJA3.1S=4aM=OZo 476(6 . ] � : A�K 6E MW<:8c9;.=<:<CK .=A� y � b � { ( + �*( � g y ] � [ {

A3. K 8:?GS 032B.10 � � I3M=¨ ?B8:.=? 6RM=038CMW? 2G.=A ! DG.=X5IV.1038:9/H .1IJ8c.1038CMW?�S=I3M=¨b8:?5S <:8:?547.1IV<CK ¨ 8C032�038:6(4 �L� T 2G8:A4$#L�GI347A3A38:MW?̨ 8c<:< .=9�! DG8CI34".Â�GI3479;8cA�4#6R47.=?B8:?5S XGD5IJ8:?GS 03254RA�4 ! D547<%M=O 032G8:A 9 MWD5IVA�4��B�5M=I 03254R6RMW6R47?U0!�<C4;0*DGA Q�DGA30*A3.7K 032G.10 b � 2G.=A <:.1I3S=4:7,DG9 03DB.1038CMW?GA�MW? . A36(.=<:< A39;.=<:4��B?G.=6R47<CK� b � 8:A M=O M=IJXG4;I � �( ��� �( � 3

T Md�GI3M H=4 �)� à M=O�m I3M�� MWA38C038:MW? ] � ] ¨ 4 ?G4;47X MW?G4F6RM=IJ4|�BI34!�B.1IJ.10�M=I3K <C476(6(.L�¨ 2G8:9V2 .��v�B<:8C47A0�M .RS=47?G4;IJ.=< A�4 ! D547?G9 4aM=O IJ.=?BX5MW6&H .1IV8:.� B<C47A!�� �!%_% #µ­ ��PD¯la�+ � � g � ( g � � g 3�3�3 ]Ia�JYb1a��It¬a12B/1aq&�¤B[1a�J�(¦~j��J�(ht¬a=_Q[\J�2`_I&�4 ��J�[�)¦JI]�(ea1b�bpt/sMk+NMvJL+¢¤N&p[b\&�4�a * � d �

<:8c6�#" � a y � � � � � { + d ¤^&p[�b1&�4�a * � d 3¡¢M3a12k+NMSa\[1a@aTSI)*b�+Nb�JQbpt9]�b\a��9t¬a12`/1a y � � � { ������ +ha12`_�)¦2Lw5+h& d J�(*4�&�b=+Zb=t�[1a1(Ëi�#�@�����v� � A 25M MWA�4(. A3D9 BA�4 ! D547?G9 4(A3DG9V2 032G.10 � ��$��� a y � � � � � � { *��8� K�A 254! K A3254;H � Aa8:?54 ! DG.=<:8C0 K¨ 4�2G.7H=4��,O M=Ib.=<:< > ( . �

+ � � � � � � ^ Y>� J > � a y � � � � � � {�g

.=?GX 032G4;I34;O M=IJ4��GO M=Ib.=<:< > ( . �� � + � � � � � � ^ Y

>� * 3

T 254�¸,IJA�00� M=I347< < A .=?U0�47<:<:8 <:476(6(.R?5Mp¨ 8:6Q�B<c8C47A 032G.10*O M=I .=? K > �

+ � � � � � � ^ Y> O M=I0¸,?B8C0�47<CK 6(.=?UK � � + Y 3

� K < .=XBXG8C038CH 8C0LK 03254a8:?U0�4;IJA�479 038CMW? M H=4;I > M=O%03254 4;H=47?U0� 4;0h¨ 4;47?� GIJ.=9��=4;03Ab.=<cA�MR2G.=A0�GI3M� ,.� B8:<:8C0 K Y &

+ � � > ( . � � ( . � � ^ �F& � � � � � Y>� + Y g

8N� 4������ � � , d .=<:6RMWA�0bA3D5I347<CKN.=A0� , *¾��

C 4#.1I34�¸,?B.=<:<CK IJ47.=X5K 0�Mg¸,?G8:A32NMWD5I��GI3M M=O�M=O¢m I3M�� MWA38:038CMW? ] � ] &

Y V

Page 16: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

�@�����v� �f� KÌo 476(6(.=A ] � : .=?BX ] � Vµy ¨ 8C032 * + ] {�032G4;I34#4$#58:A�03AF.=? 8:?G9 I347.=AJ8:?5S A�4 ! D547?G9 4 y.] � { A3DG9V2032G.10!�GO M=I .=<:6(MWA�0 .=<:< � ( �q�<:8:6� " �

� � ��� � � � b � � � ����� y � { @ b � � � � y � { ( + � 3� 8 # .=? � ( ��O M=I�¨ 2G8c9J2 032G8:A 25MW<:XGA!�Io 4;0

� � � & + 6(. #� � � b � � & + 6(. #��� ��� � � ���� b � � � ����� y � { @ b � � � � y � { ���� 3T 2547? <:8:6 � " � � � � + d KR03254bDB?G8CO M=IJ6 9 MW?U038:?UDB8C0LKRM=O (+*, b � y ¨ 2B8:9J2N8:A`.#9 MW? 038c?UD5MWDBA`O DG?G9 038CMW? MW?03254�9 MW6g�B.=9 0 8:?U0�4;I3H1.=< - d g�� .±{\�B>@0�O MW<:<CM=¨bA�032G.10!�

� � � ��� � � � � b � � ^ � � � ��� � � Y� � �� � b � � (�� Y

� � � � @ , * .=A � , * �

T 2G8:A*9 MW?B9;<:DGX547A 03254#9 MW?GA30�IJDG9 038CMW? M=O'�!IJM=¨ ?G8c.=? 6RM=038CMW?8�B> ? 03254�?54$# 0bA�479 038CMW?GA�¨!4�A32G.=<:< A�4;4032G.10�� I3Mp¨ ?G8:.=? 6RM=038CMW? 8:A 032G4@ BDG8:<cXG8:?5S@ ,<CM 9�� M=O A�0�M 9J2B.=A�038:9a.=?G.=<:K A38cA!�T 254(9 MW?GA�0�IVDG9 038CMW? M=O%� I3M=¨ ?B8:.=?Z6RM=038CMW? 8:?GXGDG9 47A .��BI3M� B.� B8:<c8C0LK 6(47.=A3D5I34RMW? 032G4 A�4;0aM=O .=<:<9 MW?U038:?UDGMWDGA�O DG?G9 038CMW?GA - d g�� . , [0�G¨b2G8:9J2 8cA�9;.=<:<C47X 03254.-5�N²!�S²�� Rϲ����\�L��²��> 0�9;.=?� 4Q�GI3M H=47X 032G.10����±� IJ.=?GX5MW6 H .1IJ8c.� B<C47A 8:? � ( y �:g + { 9;.=?� 4RIJ4!�GI347A�47?U0�47X 8:? . ?G.103D <IJ.=<¥¨ . K .=A#8c? 0�4;S=IJ.=<cA�M=O0�GIJM XGDB9 03A M=O*8:?G9 I3476(47? 03A#M=O�� I3M=¨ ?B8:.=? 6RM=038:MW?B� T 2B8:Aa8:AEC�8C47?G4;I � A��!������

²����L���I�1�^���9� y C�8C47?54;I y Y >�:�T {\��{

Y \

Page 17: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� � ������� ���� � c�������=� ��� ����� ��� � � �\6 ��� � �[��T 2G8cA�A�479 038CMW? A�4;IJH=47A .=A .R6(M=038CH .1038:MW? O M=Ib03254 >@0p®M < 9;.=<:9;DG<:DGA��GI347A�47?U0�47X 8:?Ì� 479 038:MW?GA V .=?GX \ �& �N7 G 5��z 4�B�5�#9 7 ��e8�±�� p�N93��#K �3�d#����3�YI���#3���"�M% �E�l�G� ����3�>@O W � (�� ( - d g�� .�8cA*.RA�0�4!� O DG?G9 038:MW?B�58N� 4����

W � y ( { +� � ��� � � � � �� Y � ��� ��� � � � y ( { y d + ( � ( � �� ( � + ��{hg

032547? O I3MW6 032G4�X54�¸,?G8:038CMW? b � & + 1 � �� � �

8C0�O MW<c<CM=¨ A*032G.10

1�� + � � ��� � � � � �� ycb �������I@ b ��� {hg

¨ 2G8c9J2 8cA��GIJ479;8:A�47<CK¨ 2G.10|¨ 4Y¨ MWDG<:X/6R47.=?z UK 032G4�8:?U0�4;S=IJ.=<�� �� W � y ( { � b � � - M=IJ4;M H=4;I�� 8CO�W � , W 8:?� ( - d g�� .,�5032G47? 1�� , 1�� 8:? � (�y �:g + {¥ UK(032G4F8:A3MW6R4;0�IJ8:9��GI3M�� 4;I30LKRM=O 1 X547A39 IJ8* 47X 8:?�� 479 038CMW? ] � ] �� MSW *, 1 � 6(.��BA�� ( - d g�� . 8:?U0�M�03254@� .=DGAJA38:.=?(IV.=?GX5MW6 H .1IJ8c.� B<C47A MW? y �:g + {\� >@0!8:A!03254;I3O M=I34b?B.103D5IJ.=<0�M X54�¸ ?54 O M=Ib.=<:<=W)(&� ( - d g�� . &

� �� W y ( { � b � y � { & + 1�� y � { 3

& �¦­ G 5�� �g���G =�!�^�YI�� 5�K±�L� '� � `l���B¬�� � > ? Y >1d�T o .=?GS=4;H 8:?Y�GI3M�� MWA�47X�.=?�4 !UDB.1038CMW?#8c?aM=IJX54;I 0�M X547A39 IJ8* 4`03254 6(M=038CMW?�M=OG.��,.1I3038:9;<C4`AJDGA-� 47?GX547X8:?(.�<:8<! DG8:X8��§b4�¨ .=?U0�47X 0�M�SW8CH=4b.�0�I347.1036R47?U0�¨b2G8:9J2Ϩ .=A 6RM=I34bI34�¸,?547X .=?GX 6RM=IJ4b8:? 2G.1IJ6RMW?UKd¨ 8C032Pb4!¨*0�MW?G8:.=? 6R479J2G.=?B8:9;A*032G.=? 03254�.� M H=4d� I3M=¨b?G8:.=? 6RM=038:MW? 6RM X547<N�9o 4;0 ? � X547?5M=0�4#03254aH=47<CM 9;8C0LK M=O03254q�B.1IJ038:9;<C4a.10�038:6R4 ( �9WF9;9 M=IJXG8:?5SR0�M P 4!¨*0�MW? � A A�479 MW?GX <:.�¨�032G4aX54;IJ8CH1.1038CH=4��

� � ? � A325MWDG<cX� 4 4 ! DG.=<0�M(03254aAJDG6&M=O 03254 O M=IV9 47A*.=9 038:?5S(MW? 03254q�B.1I3038:9;<:4 y A�4;4a4$#5.=6Q�B<C4 ] 8:?Ì� 479 038CMW?ZY &I¨ 4a03.��=4�03254a6 .=A3AM=O 03254q�B.1I3038c9;<C4 4 !UDB.=< 0�M Y={\�vo�.=?5S=4;H 8c?�¨*I3M=0�4��( ? � +F@CB ? � / 1 � g

¨ 254;IJ4a03254q¸BIVA�0�0�4;IJ6 MW? 03254aI=� 2B� A!�B6RM X547<:A*03254aO IJ8:9 038CMW? XBD54 0�M 03254#H 8cA39 MWA38C0 K B M=O 03254�<:8<! DG8:X .=?GX03254(A�479 MW?BXZ0�4;IJ6 XG47A39 IJ8� 47A 03254(A3DB6 0�M=03.=< M=O 03254(4;I3IV.1038:9R9 MW<:<:8:AJ8CMW?GAFM=O <c8<!UDB8:X 6(MW<C479;DG<C47Aa.1SW.=8c?GA�003254@�,.1I3038:9;<C4�� 478:?5S"03254aA30�I347?5S=032 M=O%03254�?GMW8:A�4��>@? 032G4aA-�B8CIJ8:0!M=O 03254@�BI3479 47XG8:?5SRXG8cA39;DGA3A38:MW?�¨ 4aI34!¨ IJ8C0�4 03254Eo�.=?5S=4;H 8c? 4 !UDG.1038:MW? .=A

� ? ��+F@CB ? � �( / � b � g yN: �:Y={¨ 2G8c9J2 .1SW.=8:? 8:A�A325M=I3032B.=?GX O M=I 03254�8:?U0�4;S=IJ.=< 4 ! DG.1038CMW?

? ��@ ? H +F@CB� �H ? � � # / ycb �,@ b H�{ yN: � ] {

Y [

Page 18: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

t T

1

� 8CSWDGI34(Y & T 254 O DG?G9 038:MW? W � �8:? � (�y �:g + {\� T 2B8:A%4 !UDG.1038:MW?g¨ .=A`A�MW<CH=47Xg UKÏ�FIJ?BA�0�478:?".=?GX(EF2G<C47?� 479�� y Y >�:1d { 8:?(03254�O MW<c<CM=¨ 8c?5S�¨ . K��?*4!¨ IJ8C0�4 yN: �:Y={�.=A

� y ��� � ? � { + ��� � � b � 3> ? 0�4;S=IJ.1038c?5Sg¨ 4aM� G03.=8:?B�5O M=I d J ( J �Y�

��� � ? ��@ ? � + � �� ���

H � b H gA�Mg¨ 4�¸,?GX

? ��+ ��� � ? � /

� �� �

�� � � H � � b H

+ ��� � ? � / 1�� � g

yN: � : {

¨ 254;IJ4PW � & L *, Y � � � � y L {U4$#� - @CB y ( @ L {�. 8:A*AJ25M=¨ ? 8:?�� 8CSWD5I34(Y��WbA3AJDG6(8:?5S ? � + d �S¨ 4"M� G03.=8:?/03254�O MW<c<CM=¨ 8c?5Sg¸BIVA�0F.=?BX/A3479 MW?GX 6RMW6R47?U03A O M=I 03254Ï� .=DGAJA38:.=?IJ.=?GXGMW6 H .1IV8:.� B<C4 ? � y I3479;.=<:< y ] � ] {-{h&

a y ? � { + d g a y ? (� { + ( ) W � ) ( + ( � �� � ( �

H � � � � L + (] B yY @ � � ( � � { 3

>@SW?5M=IJ8:?5S�O M=I 032G4 6(MW6R47? 0 032G.10 038:6(4FA�0�M��,A�.10�� y � 8:A .1I� ,8C0�IJ.1I3K(.=?GX 9 MWDG<cX� 4F03.��=47? H=4;I3K <c.1I3S=4p{\�¨ 4a03.��=4�03254a<c8:6(8C0 (+, *�&

<:8:6� " � a y ? (� { + (] B 3 yN: � V {

T 2G8cA�9;.=?� 4 I347.=X .=A AJ.7K 8:?5SR032G.10*032G4@�B.1I3038:9;<:4|¨b8:<:< 4;H=47? 03DB.=<:<CK .10�03.=8:? .(9 4;IJ03.=8:? 6R47.=? 47?G4;I3S=K��o 4;0 DGA ?5M=¨ AJ25M=¨�032B.10*03254�.� M H=4#8:?5O M=IJ6(.=< 9;.=<:9;DG<c.1038CMW? 8:A*8:?BX54;47X 9 M=I3I3479 0!��@���` �3 4�$ ����3� & �N7 f3&p[�J�(*( ? � ( [�+NM3alc`[1&I/1a1b�b y ? � { � 3�� � ��� _La\¼323a=_Q]!i��i2¬# 2��¥b\JL+N)*b-¼Sa1b%+NM3a�b�+h&I/sMvJ�b=+N)^/)*2S+ha�w�[\J�(�a��9t�JL+N)e&�2��i2¬#XO��=#

Y ;

Page 19: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

�@�����v� � WbO 0�4;I AJDI BA�038C03DG038CMW?(M=O yN: � : { 8:? 0�M yN: � ] {\�503254 <:.10�0�4;I*8:A!O MWDG?GX 0�M"9 MW?BA38:A�0 M=O ."X54;0�4;IJ6(8c?G8:A�038:9�B.1I30

��� � ? � @ �

��H? � +A@CB

� �H � � � � ? � � #,g¨ 2G8c9J2 8:A�M� H 8CMWDGA3<CK H .=<c8:XB� .=?GX .(A�0�M 9J2B.=A�038:9q�B.1IJ0

1�� � @ 1���� +F@CB � �H 1��

� � # / ycb � @ b H {hg¨ 2G8c9J2�9;.=?� 4 M� G03.=8:?G47X K .��v�B<CK 8:?5S 03254/6(.�� 1 0�M£ M=032 A38:X547A M=O 03254 O MW<:<CMp¨ 8:?5SZ8cX547? 038:0LK 8:?� ( - d g�� . &

W ��@ W�H +F@CB� �H W � � # / Y � H � � y dNJ L J ( J �q{ 3

T 254q�BI3MUM=O�M=O 032G8:A�8:X547?U038C0 KN8:A <C4;O 0*.=A .=? 4$# 4;IJ9;8:A�4���

& � & 3 ��%��j5��B>�� ^` �B>�G o 4;0 DGA .1SW.=8:?N9 MW?GA38cX54;I 03254|� IJ?GA�0�478:? < Eb2G<:47?¬ 479����GI3M 9 47A3A y ? � { � 3�� � ��� .=?GXQ� 4;I3O M=IJ6 A�MW6(4bA3D5S=S=47A3038CH=4O M=IJ6(.=< 6(.=?B8��BDG<:.1038:MW?GA!�

> 0 8cA 0�476Q�G038:?5SR0�MϨ*IJ8C0�4� y ? (� { + ] ? � � ? ��+ ] ? � y @CB ? � �*( / � b � {hg¨ 2G8c9J2B�5DG?GXG4;I�03254aO M=IJ6(.=< .=A3A3DB6Q�G038CMW? 032G.10 ? � .=?GX � b � .1I34�8:?BX54!� 47?GX547?U0 ! DG.=?U038C038C47A!�G<C47.=XBA�0�M� a y ? (� { +A@ ] B a y ? (� { �*( /�] a y ? � { a y � b � {+A@ ] B a y ? (� { �*( 3§bM=¨ 4;H=4;I��1032G8:A IJ47A3DG<C0 8cA O .=<:A�4!AJ8:?G9 4`8C0�¨!MWDB<:X�8:6g�B<CK 032B.10,a y ? (� { 0�47?BXGA 0�M d .=A (+, *�� 9 MW?U0�IJ.=XG8c9 038:?5S

yN: � V {\�C�2G.10%¨ 47? 0%¨*IJMW?5S �|§ Mp¨�A325MWDG<cXg¨ 4 9V2G.=?5S=4 03254FIJDG<C47A!M=O O M=IJ6(.=< 6(.=?G8��,DG<:.1038CMW? M=O XG8�Í 4;I347? <038:.=<:A ���525MWDG<:X¨ 4�I34@Q�479 0F03254#8:?BX54!� 47?GX547?G9 4 .=A3A3DB6Q�G038CMW? ? � ��� � b � � T 2G8:A*8:A 8:?GX54;47X .g� MWA3A38� ,8:<:8C0 K��.=?GXa<:47.=XGA 0�M*032G4`A�M < 9;.=<:<C47X � A�0�M 9J2G.=A�038c9`9;.=<:9;DG<cDGA M=Ov� 0�IJ.10�MW?5M H 8c9��L�p§bM=¨ 4;H=4;I���¨!4`AJ2G.=<:<=?5M=0 IJ4@Q 479 0�032G8:A8:?GXG4!� 47?BX547?G9 4 .=A3A3DG6Q�B038CMW?B�� BD50 8:?GA�0�47.=X(O MW<:<:M=¨ >@0p®Ma.=?GXRI3479 MW?GAJ8:X54;I 032540¸BIVA�0 A�0�4!� � y ? (� { + ] ? � � ? � �o 4;0!DBA 03.��=4FA34;IJ8CMWDGA3<:K#03254 O M=IJ6�DG<:. y � b � { ( + �( 8:? y ] � [ {\� 8:6g�B<CK 8:?5SF032G.10 y � ? � { ( + ( �*( � .=?GX<C4;0*DGA*4$#�B.=?BX � y ? (� { 0�M A�479 MW?BX M=IJX54;I 8c? � ? � &� y ? (� { + ] ? � � ? � /�y � ? � { (+ y ? � / � ? � { ( @ ? (�+ ] ? � y @CB ? � �*( / � b � { / ( �( 3T 2G8cA SW8CH=47A!�BDI� MW? 9;.=<:9;DG<c.1038CMW? M=O%4$#� 479 03.1038CMW?GA��

� a y ? (� { +F@ ] B a y ? (� { �( / ( �*( g<C47.=XG8c?5S 8:?GXG4;47X 0�MN03254"9 M=I3I3479 0 4 !UDB8:<:8� GIV8:DG6 H .=<:DG4 yN: � V {\� PbM=0�4�032G4#M 9;9;D5I3I347?B9 4#M=O 032G4#4$# 0�IJ. 0�4;IJ6 ( �( 9 MW6g�B.1I347X 0�M#03254��GI34;H 8CMWDGA 9;.=<c9;DG<:.1038CMW?B� T 2G8:A 0�4;IJ6 8cA 03254b47A3A�47?U038:.=<,8c?5S=I347XG8C47?U0 0�M"6(.��=4F47?GXGA6R4;4;0!�

T 254 .� M H=4�.1I3SWDB6R47? 0b8:A�2547D5IJ8cA�038:9 .10 032G8:A�A�03.1S=4��9 479;.=DGA34q M=032 b � .=?GX ? � .1I34 O DG?G9 038CMW?GA M=O8:?L¸ ?G8C0�4RH1.1IJ8:.=?G9 4��%.=?GX 2547?B9 4 ?5Mp¨ 254;I34NXG8�Í 4;I347? 038c.� B<C4���� 038:<c<N�B¨!4NA32G.=<:<`A�4;4 032B.10#8C0�6 .��=47AY� 4;I3O 479 0A�47?GA34a8:? 03254aIJ8:SW2 0*8:?U0�4;I��GIJ4;03.1038CMW?B� T 2G8cA%¨ 8:<:<3 4a9;<:.1IJ8�¸B47X 8c?Ì� 479 038CMW?GA V .=?GX \ �Y T

Page 20: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� � � � � ������$E�������,� ���

kj� m��v 4� �C (H�

> ? 032G8:A*A�479 038:MW?�¨!4#A32G.=<:< 4$# 0�47?GX 03254�9 MW?B9 4!�G0*M=O A�0�M 9V2G.=A�038:9#8:?U0�4;S=IJ.1038CMW?� KN.=<c<CM=¨ 8c?5S"03254 O DB?G9 038CMW?W y ( g � {F8:? 03254 8:?U0�4;S=IJ.=< � �� W y ( g � { � b � y � {b0�MÌ 479 MW6(4 A�0�M 9J2G.=A�038c9(.=A@¨ 47<:<N�B§bM=¨ 4;H=4;I���¨ 4 A32B.=<:< A�4;4032G.100W y ( g � {!9;.=?G?5M=00 4 9 MW6Q�B<C4;0�47<CKN.1I� B8C0�IV.1I3K��L BD50 2G.=A*8:? A�MW6R4�¨ .7K 0�MQ 4|¸B0�038:?5S�0�M � *, b � y � {\�T 254 9 MW?GA�0�IJDG9 038:MW?k¨ .=AY�B8CMW?G4;4;I347Xk K�n�8CK=MWA38 >@0p®M 8:? 032G4 Y >�VWd � A".=?GXZ<C47.=XGA�0�M̨ 2B.10�8:Aa?5Mp¨ .=XB.7K A9;.=<:<C47X��1���� �q���,�����L���1�^�N�g����������Ë��\�P��N7 3 =�!`��E�l�G� ��$�S�G C 4#XG4�¸,?54 03254�A�0�M 9J2B.=A�038:9a8:?U0�4;S=IJ.=< M=O .RA�0�4!� O DB?G9 038CMW? M=O%03254aO M=IJ6

y ( g � { + � � ��� � � � � y � { Y � ��� ��� � � � y ( { K

� �� y ( g � { � b � y � { & + � � ��� � � � � y � {�� b ��� � � y � { @ b ��� y � { � 3 y±V �:Y={

T 254�?54$# 0b032G8c?5S 0�M X5M�¨!MWDG<cX5 4�0�M .��9�GIJM #58:6(.10�4 Wk K A�0�4!� O DG?B9 038CMW?GA W � .=?GX X54�¸ ?54 � W � b � 0�M 4 03254a<:8:6 8C0!M=O � W � � b � �v� D50*254;I34q¨ 4�6R4;4;0F.RXG8 % 9;DB<C0LK ���� #%'`"K±�ºP��N7v���¢m!D50 W y ( g � { & + b � y � {\� T ¨ M I347.=A3MW?G.� B<C4 .��9�GI3M # 8c6(.1038CMW?GA�M=O W�.1I34 � .=?GX�� �SW8CH=47?� K

� y ( g � { & + � � ��� � � b ��� y � { Y � ��� ��� � � � y ( {hg� � y ( g � { & + � � ��� � � b ��� � � y � { Y � ��� ������� � y ( {hg

Y >

Page 21: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

¨ 254;IJ4 ( � g ( � g 3�3�3 g ( � .1I34 X54�¸,?547X .=A"8:?½o 476(6(. ] � : 8:?½� 479 038CMW? ] � Vºy .=?BX .1IJ4N?5M=0 � < X54!� 47?GX547?U0\{\�§bM=¨ 4;H=4;I��,O I3MW6 MWDGI*X54�¸,?G8C038:MW? y±V �:Y={�¨ 4�¸,?GX 032G.10� �� � � � b ��@

� �� � � b ��+

� � ��� � � y � b � { ( g¨ 2G8c9J2B� .=9;9 M=IVXG8:?5S#0�M�o 476(6(. ] � : � X5M 47A!?GM=0`0�47?GX 0�M d .=A ] , * ,D50 0�M�03254b9 MW?GA303.=? 0��E� > ? M=03254;I¨ M=IJXGA!�U03254 H1.1IJ8:.1038CMW? M=O 03254��,.1032 (+*, b � 8:A`0�MUM"<:.1I3S=4bO M=I � b � � b � 0�M� 4 X54�¸,?547X 8:?(.#9;.=A3DG.=<3¨ . K��

C 4 ?5M=¨ 8:? 0�IJM XGDB9 4/. I34 ! DG8CIJ476R47? 0 MW? MWDGI O DG?B9 038CMW?TW O M=I 03254Z.��v�GI3M #58:6(.1038:MW? K�A�0�4!�O DG?G9 038CMW?GACW � 0�Mg¨ M=I��N?B8:9 47<CK�����Nn¢�"�$ ����3� � o 4;0�� � X547?GM=0�4 03254 < ¸B47<:X S=47?54;IJ.10�47Xº K � b H � d J LGJ ( ���'o 4;0�� & + � � �¢WA�0�M 9J2G.=A3038:95�GIJM 9 47A3A MW?�032G4Ì�GI3M� ,.� B8:<:8C0 K A-�,.=9 4 y �:g�� g + { M=O@� I3M=¨ ?B8:.=? 6RM=038:MW? 8:A . 6R47.=A3DGIJ.� B<C46(.�� - d g�� . ��� , [0� T 2G4q�GI3M 9 47A3A0¨ 8:<c<3 4�9;.=<c<C47X������1�S�h²��#0�M(03254�O .=6(8c<CK M=O < ¸B47<:XBA y � � { � 3�� � ��� 8:O� *, W y ( g � { 8:A�� � < 6R47.=AJD5IJ.� B<C4 O M=I .=<:< ( ( - d g�� .,�

T 254bA��B.=9 4 � ( y �:g�� � g + {`M=O A2!UDB.1I34 < 8:?U0�4;S=IJ.� B<C4�� � < 6R47.=A3D5IJ.� ,<C4 O DG?G9 038CMW?BA`6(. KQ 4b0325MWD5SW2U0!M=O.=Ab0325MWA�4�O DG?B9 038CMW?GA�M=O � ( � 032G.10 .1I34�O DG<:<:KNX54;0�4;IV6(8:?547X� K 03254�8:?G8C038:.=< A�4;SW6R47?U0 - d g ( . , [S& L *,b H y � {*M=O`03254d� I3M=¨b?G8:.=?/6RM=038CMW?B� > ? M=03254;I�¨ M=IJXGA!� � ( � ( y �:g�� � g + {�¨ 2547? � y � { + � y � � {b.=A A�M MW?.=A b H y � { + b H y � � { O M=Ib.=<:< L ( - d g ( .,�o 4;0�� (�ycb g - d g�� .±{!X547?5M=0�4 03254 A-�B.=9 4FM=O .=<:< .=XG.��G0�47X A�0�M 9J2B.=A�038:9��GI3M 9 47A3A�47A W & - d g�� . � � , [032G.10 .1IJ4�A2! DG.1I34a8:?U0�4;S=IJ.� B<C4�&) W ) (� � � � + � �

� �( � � W y ( g � { ( + y � � {�+* 3T 254a?B.103D5IJ.=< 8:?G?G4;I0�GI3M XGDG9 0 032G.10 6(.��=47A� (�ycb g - d g�� .±{*8:? 0�M .RI347.=<8§F8:<� 4;I30 A-�B.=9 4�8cA

� W'g�� � & + ���� �*( � � W y ( g � { � y ( g � { + y � � {

+ a � ���� W y ( g { � y ( g { �*( 3C 4b?5M=0�4b032G.10 03254 A30�4!� O DG?G9 038CMW?GA � 8:?R032G4 <:.=A�0 4$#5.=6Q�B<C4b.1I34 .=XG.��G0�47X8�UA38:?B9 4 � y ( g � { + b ���O M=I ( ( - ( � g ( � � � {\�GA3MR032G.10 � y ( g � {!MW?G<CKNX54!� 47?GXGA MW?Â�B.=A�0�H1.=<:D547A M=O b �9� ? 03254 M=03254;I 2G.=?BXB� � � 8:A?5M=0 .=XG.��G0�47X8� A38:?G9 4".10 038:6R4 ( ( - ( � g ( � � � {F8C0 .=<CIJ47.=X5K .=?U038:9;8��B.10�47A 032G4d� I3Mp¨ ?G8:.=? 6RM=038:MW? .10 038:6R4

( � � � & � � y ( g � { + b ��� � � y � {\�T 254 ?54$# 0 03254;M=IJ476 8:A .F9 IVDG9;8:.=<�GI3M�� 4;I30 KaM=O,A�0�M 9J2B.=A�038:9�8:?U0�4;S=IJ.=<:A%M=O,.=XB.��G0�47XRA�0�4!�"O DB?G9 038CMW?GA!��@���` �3 4�$ ����3��P��N7 � G 5G�8�C :H�:IJ�± ��%��N =��m � ¯la�+ ]Ia�JQb�+hajck¤jt�2`/=+N)±&�2�)*2�� (�ycb g - d g�� .±{ �8J�2`_Ï(ea�+� � y { y � { & + � �

� y ( g � { � b � y � {]Ia|),+Nb�b�+h&I/sM3J�b�+N)^/�)*2S+ha�w�[\J�(GJ�/!/1&p[�_�)*2LwÌ+h&��$�# 0 �=#Z¡¢M3a12 � � )*b�J�25)*b\&�4�a�+^[-i�q) � � y { ) � � � � + ) )�� � �� � g y±V � ] {

]1d

Page 22: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

),# a�# ��� + y � � { � ���� y ( g � { � b � y � { � ( + ���

� �( � � + y � � { ( y ( g � { 3�@�����v� � � K .=XG.��G0�47XG?547AJA!� � " 8:? y±V �:Y={�8:A��e�3��²��I²!�3�¬²��3� M=O�� b � & + b �������C@ b ��� O M=I d J $ J � �T 254;IJ4;O M=I34

) � � y { ) (� � � � + a � � � � ��� � � � � � b � � ( �+� � ��" � �

� � ��� � � a � � " � � � b " � b � �+� � ��� � � a � � (� y � b � { ( � / ] �

" � � a � � " � � � b " � a � � b � �+� � ��� � � a y�� (� { a �py � b � { ( �

+� � ��� � � a y�� (� {�� ( � g

¨ 254;IJ4E¨ 4�DGA34�032G.10 a y � b � { + d ��a y-y � b � { ( { + � ( � y I3479;.=<:< �)�'&I<c�)� P 8:?K� 479 038:MW? Y={\�G� ? 03254M=03254;IF2G.=?GXB�) ) (� �� � � ��� � + ���

� a � � � � ��� � � � � Y � ��� ��� � � � y ( {�� ( �(+� � ��" � �

� � ��� � � � ���� Y � � � � � ��� � y ( { Y � ��� ��� � � � y ( { �( a y�� " � � {+� � ��� � � � ( � a y�� (� { 3

T 254 0�¨!M 4$#�BI347A3A38CMW?BA�.1I34 03254�A3.=6(4���

P��¦­ "���� p��#9��m �E�l��� ����3�� T M(S=M(O I3MW6 A�0�4!� O DG?G9 038:MW?GA 0�M .1I� B8:0�IJ.1I3KNO DG?B9 038CMW?GA ¨!4#?54;47X 03254aO MW<:<CMp¨ 8:?5SI�� �!%_% #�P �*­·.��=a\[-i�¤jt�2`/=+N)e&�2 W ( � ( ycb g - d g�� .±{Y/\J�2 ]Ia�J!c9c`[1&CSL)¦4ÏJL+ha=_ÌJ�[p]�),+^[\J�[\)*(Ëi£»Za1(*(0]�ikb�+hajc¤jt�2`/=+N)e&�29b0)¦2�� (�ycb g - d g�� .±{1#�@�����v�g�v� ����%'%'#�P��¦­`�vC 4�XG8CH 8:X54F03254@�GIJMUM=O 8:?U0�MR0325I34;4�A�0�4!�,A�M=O%AJDG9;9 47A3A38CH=4#.��9�GI3M # 8:6 .1038CMW?B�3 =�N`D79� ^ H=4;I3K MWDG?GX547X �,.1032¬¨ 8cA�4 9 MW? 038c?UD5MWDBA�� ( � (�ycb g - d g�� .±{ 9;.=? 4 .��9�BI3M #58:6(.10�47X¿ UK .A�4 !UDG47?G9 4aM=O A�0�4!� O DG?G9 038CMW?BA!�

] Y

Page 23: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

�@�����3� � m .1I3038C038CMW? 03254 8:?U0�4;I3H .=< - d g�� .�8:?U0�M ] �B8C479 47A� KZ038:6R47A y ( � { �� ��� 8:? 03254 9;DGA�0�MW6(.1I3K¨ . K�� _ 4�¸,?54

� y ( g � { & + � � ��� � � � y ( � g � { Y � ��� ������� � y ( { 3T 2547?B�GA38c?G9 4 (+*, � y ( g � {�8:A*9 MW?U038:?UDGMWDGA*.=?GX 6 . # � � � ( � � , d O M=I .=<:< � ( �q�I¨!4�2B.7H=4

<c8:6� " �� �� � � y ( g � { @ � y ( g � { � ( �( + d 3

§ 47?G9 4��3 UK� MWDG?GX547X 9 MW?UH=4;I3S=47?G9 4��<:8:6�#" � a �

���� � � y ( g � { @ � y ( g � { � ( �( � + d 3 �

3 =�N`�­`� ^ H=4;I3K� MWDG?GX547X�� ( � ( ycb { 9;.=?E 4 .��9�GI3M # 8:6 .10�47X@ KF.*A34 !UD547?B9 4`M=OL MWDG?GX547X 9 MW?U038:?UDGMWDGAO DG?B9 038CMW?GA�8:?�� ( ycb {\��@�����3� � � DI�9� MWA�4 � � � J � ���5M=I ] ( . � <C4;0 � � 4 . ?5MW? < ?54;SW.1038CH=4 9 MW? 038:? D5MWDGA�O DB?G9 038CMW?M=O�03254/O M=IV6 SW8:H=47?�8c? � 8CSWD5IJ4 ] �%¨ 8C032 03254��GI3M�� 4;I3038C47A � � y � { + d O M=I � �( - d g7Y�� ] .�.=?GX� �� � � � y � { �� + Y�� _ 4�¸,?54� � y ( g � { & + � �

� � � y ( @ L {�� y L g � { � L 3y T 2G8:?I� M=O � � .=AN. � 6RMW<c<:8�¸B4;I � M=O��8��{ T 2G47? ( *, � � y ( g � {R8:A 9 MW? 038:? D5MWDGA O M=I .=<:< � � .=?GX� � � � J � �B- M=IJ4;M H=4;I�� O M=Ib.=<:< � �

<:8:6� " �� �� � � � y L g � { @ � y L g � { � ( � L + d g

A38:?G9 4 � � 9 MW?BA�038C03D50�47Ab.=? .��9�GI3M # 8c6(.10�4�8:X547?U038C0 K��9W SW.=8:?8�9 UK� MWDG?GX547X 9 MW?UH=4;I3S=47?G9 4��<:8:6� " � a �

���� � � � y L g � { @ � y L g � { � ( � L + d 3 �

3 =�N` & � ^ H=4;I3KKW)( � (�ycb g - d g�� .±{ 9;.=? 4 .��9�GIJM #58:6(.10�47X KÏ MWDG?GX547X O DG?G9 038CMW?GA 8:? � (�ycb g - d g�� .±{\�y T 2G8:A�8:A�8c? O .=9 0b.RS=47?54;IJ.=<B�BI3M�� 4;I30LK � ( < A-�B.=9 47A���{�@�����3� � o 4;0 W ( � (�ycb { .=?BX��BD50�� � y ( g � { & + y @ ] {�� y.] � W y ( g � {-{\� T 2547?) W @ � � ) (� � �� � J ���

� �*( � � + y � � { Y � � � � y� W y ( g � { � {4W y ( g � { ( g

¨ 2G8:9V2 0�47?GXGA�0�M d .=A ] , * K X5MW6(8:?G.10�47X 9 MW? H=4;I3S=47?B9 4���

]=]

Page 24: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

0 1/n

� 8CSWD5IJ4 ] & T 254 O DG?G9 038CMW? � � �� ? 03254d B.=A38:A M=O m I3M�� MWA38:038CMW? V �:YR.=?GXko 476(6 . V � ] ¨!4(9;.=?Z?GM=¨ X54�¸,?G4�032G4R> 0p®M < 8:?U0�4;S=IJ.=< M=O. O DG?G9 038CMW? � ( � ( ycb g - d g�� .±{ .=A O MW<:<CMp¨ A!�`W��9�BI3M #58:6(.10�4 �Ì K A30�4!�ZO DB?G9 038CMW?GA � ( � ( ycb g - d g�� .±{\�8N� 4���� � , �R8:? � (�ycb g - d g�� .±{\�IW��9�,<CK� � 0�M#47.=9V2 M=O 032G4 � �9� 8:?G9 4 � � 8:A`.=?N8:A�MW6R4;0�IJK�� 03254 A�4 ! D547?G9 4

� � � 2G.=A*. <:8:6(8C0 8:? � ( y �:g + {\� T 2B8:A 8:A0¨ 2G.100¨ 4��¬² O'�S²�0�MÏ 4 03254a>@0p®M < 8:? 0�4;S=IV.=< � � M=O � &���� � y ( g � { � b � y � { & + y � �L{ y � { + � ( @ <c8:6� " � y � � � { y � { 3§ 4;I34#8:A�.=? 4$#5.=6Q�B<C4 M=O .(A�0�M 9J2B.=A�038:9a8:?U0�4;S=IJ.=<N�

��� #%'`"K±�ÌP �¦­`��� T 2G4 O MW<:<:M=¨ 8:?GS"8cX547? 038:0LK 25MW<:XGA�&���� b � � b ��+

Y] b (� @ Y

] � 3

�@�����v� � C 4 9J25M MWA�4 .=? .=XG.��G0�47XZ.��9�BI3M #58:6(.1038CMW? M=O b � y � {\� ?G.=6R47<CK � y ( g � {bM=O 03254R4$# .=6g�B<C4R8:?� 479 038CMW? V �:Y��3� K X54�¸,?G8C038:MW?B�

� �� � y ( { � b ��+

� � ��� � � b � � b � g¨ 254;IJ4Ϩ 4 DGA�4 03254 AJ25M=I3032G.=?GX ?5M=03.1038CMW? b � & + b ��� .=?GX � b � & + b ������� @ b ��� ��PbM=0�4 032B.10 b " +� ��� ��� " � b � �9C 4a03254;I34;O M=I34�2B.7H=4

b (� + � � � � b � � (+ � " y � b " { ( / ] �

" � � y � b " { y � b � {+ � " y � b " { ( / ] � � b � y � b � {+ � " y � b " { ( / ] ���� � y ( { � b � 3

�5I3MW6 o 476(6 . ] � : 8:?Ì� 479 038:MW? ] � V 8C0�?5Mp¨ O MW<:<CMp¨ A 032G.10� b +

���� b � � b ��+ <:8:6� " �

���� � y ( { � b ��+

Y] ycb (� @ �q{ 3

]�:

Page 25: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

P M=0�4 032G.10 03254 8:?U0�4;S=IJ.=< 8:? 03254F.� M H=4 4$# .=6Q�,<C4F8cA!.=9 03DG.=<c<CKz��� Æ|²���²��3�,O I3MW6f¨ 2G.10 8C0 ¨!MWDB<:XÏ 4O M=I�. A36RM M=032 O DG?G9 038CMW? W£¨ 8C032GW y d { + d ��?G.=6R47<CK'&,� �� W y ( { � W y ( { +�( W y ��{ ( �BC�2B.10 03254R4$# .=6g�B<C4A325Mp¨ A 8:A 032G.10 � A30�M 9V2G.=A�038:9(8c? 0�4;S=IJ.1038:MW?Z8:A M=IJXG8c?G.1I3K 8:?U0�4;S=IJ.1038CMW? 4$#59 4!�G0a032B.10 03254(XG8:.1S=MW?G.=< 0�4;IV6(A6�DGA�0| 4�<C4;O 0bMWD502�L� T 2G8cA�¨ 8c<:<B 4#6(.=XG4Y�GIJ479;8:A�4#8c?�� 479 038:MW? \ �`¨ 254;IJ4E¨ 4"AJ2G.=<:< 47?B9 MWDG? 0�4;I .NO .=A�0�4;I

¨ .7K 0�M 9;.=<:9;DG<c.10�4�A�0�M 9J2G.=A�038c9a8:?U0�4;S=IJ.=<:A!�P�� & � #v�4 ��^��9#K±� > ?¾� 479 038:MW? V � V ¨!4 A32G.=<c<0�GI3M H=4/032B.10 03254 > 0p®M < 8c? 0�4;S=IJ.=<|¨@� I=� 0!� � I3Mp¨ ?G8:.=? 6RM=038CMW? M=O�.=? .=XB.��G0�47XA2! DG.1I34 < 8:?U0�4;S=IJ.� B<:4`A�0�M 9J2G.=A�038c9¥�GIJM 9 47A3A�.=<�¨ .7K A�2G.=A%. 9 MW?U038:? D5MWDGA H=4;IJA38CMW?B�p�5M=I 032G8:AB¨ 4!A32B.=<:<W?54;47X#032548:?U0�4;IJ<:DGXG4FMW? 6(.1I3038:?5SW.=<:47A*X547A39 IJ8* 47X 8c? 032G8:A�A�479 038CMW?8�v�5M=I .RS=47?54;IJ.=< 8c? 0�I3M XGDG9 038:MW? MW? 6(.1I3038c?5SW.=<C47A¨ 4aI34;O 4;I*0�M(03254@ M M��Ï K _ �vC�8:<c<:8:.=6(A y Y >�> Y={\����Nn¢�"�$ ����3� � � K 032G4N9 MW?GXB8C038CMW?G.=< 4$#L� 479 03.1038:MW? .10�038c6R4 ( ( - d g�� .*M=Ob./IJ.=?BX5MW6 H .1IJ8c.� B<C4 � (� ( y �:g + {¨!4 AJ2G.=<:< 6R47.=?�8C03A M=IJ0325M=S=MW?G.=<q�GIJM Q 479 038CMW?�MW?U0�M � ( y �:g�� � g + {\�*03254ZA-�,.=9 4ZM=O#IV.=?GX5MW6H1.1IJ8:.� B<C47A%032G.10 .1I34*XG4;0�4;IJ6(8:?547X� K�032540� I3Mp¨ ?G8:.=?"6RM=038CMW?RD9��0�M 038c6R4 ( ��C 4 X547?GM=0�4 032B8:Al�GI3M Q�479 038CMW? K a y � � � � {\�GM=I� GIJ8C4$7BKNa � y ��{\�> ?�¨ M=IJXGA�� a � y �k{ y � { 8:A 03254� 47A�0!47A3038:6(.10�4 y 8:?N03254 A�47?GA34bM=O%<C47.=A�0�6R47.=? A2! DG.1I34F4;I3I3M=I1{`032G.10*9;.=? 46(.=X54 M=O � y � { MW? 03254q ,.=A38:A M=O 03254q� ?5M=¨ <:47X5S=4aM=O b H y � { O M=I d J LPJ ( ����Nn¢�"�$ ����3� �«WF?/.=XB.��G0�47X��GI3M 9 47A3A�� ( � ( ycb g - d g�� .±{ 8:A 9;.=<:<C47X . RQ���1�^�±��³¬����² y ¨@� I�� 0!�8� I3M=¨b?G8:.=?6RM=038CMW?S{ 8CO

a�H y � � { + � H O M=I d J�L J ( J �E�W 6(.1I3038:?5SW.=<:4"8cAF. � O .=8CI SW.=6R4 � & 03254R4$#� 479 0�47X H1.=<:D54R.10a.=?UK 038c6R4R8:? 03254"O DG03D5I34R8:AF4 !UDB.=< 0�M 032549;D5I3IJ47? 0�H1.=<:D54��GPbM=0�4�032G.10��!IJM=¨ ?G8c.=? 6RM=038CMW? 8:03A�47<CO�8cA�.(6(.1I3038:?GSW.=<C4��GA38:?G9 4 O M=I d J�L`J ( J �E�

a H ycb � { + a H ycb H /�ycb � @ b H {-{ + b H / a H ycb � @ b H { + b H g 479;.=DGA�4 b �,@ b H 8:A 8:?GX54!� 47?GX547?U0*M=O .=?GX 2547?G9 4�M=I30325M=S=MW?G.=< 0�M .=?UK O DG?G9 038CMW?/8:?�� (�y �:g�� H g + {\� 8:?�B.1I3038c9;DG<:.1I�� 0�MÏ� I3Mp¨ ?G8:.=? 6(M=038CMW?B�G 5G�!�v���!% P�� & ¡¢M3a�b�+h&I/sMvJ�b�+N)N/�)*2S+ha�w�[\J�(G&�¤lJ�25J�_LJ!cZ+ha=_�b�+hajck¤jt�2`/=+N)±&�2�)¦b�Jd4ÏJ�[=+N)*2Lw�J�(±aE»¥),+NMz/1&�2v~+N)*2`t¬&Lt�b'c8JL+NMvb�#

�@�����v� � T 2G8:A O MW<:<CMp¨ A*XG8CIJ479 03<CK O I3MW6 03254�O .=9 0*032B.10�� I3M=¨ ?B8:.=? 6RM=038CMW? 2G.=A*9 MW?U038:?UDGMWDGA0�B.1032GAb.=?GXA3.1038:A-¸B47A 032G4 6(.1IJ038:?5SW.=<C4 �GI3M�� 4;I30 K y DGA�4 03254 XG4�¸,?G8C038CMW?�M=OG03254 A�0�M 9J2G.=A�038c9!8:?U0�4;S=IJ.=< M=OB.FA�0�4!�"O DB?G9 038CMW?SW8CH=47? 8c? y±V �:Y={*8:?Ì� 479 038CMW? V �:Y={\��

T 254(O MW<:<CMp¨ 8:?5S�� M=¨ 4;I3O DG< 0�M MW<¥¨b8:<:< 2547<�� DBA@�GI3M H=4 032B.10�03254(>@0p®M < 8:?U0�4;S=IJ.=<!M=OE���9¶g�GIJM 9 47A3A#8:?� (�ycb g - d g�� .±{0� MWA3A�47A3A�47A .(9 MW? 038c?UD5MWDBA�H=4;IJA38CMW?8�G 5G�!�v���!% P���P � G 5�� � ��� %'#9�� ��^��9M#K±�8�^���NXY��#Ki�$ Jm � rj¤ � � )*b¥J@4�J�[=+N)*2Lw�J�(ea|»¥),+NMÂ/1&�2S+N)*2St�&Lt�bc8JL+NM9b��G+NM3a125¤N&p[�J�(*( * ^ Y@J�2`_ � � d �

+�- A3D9���� � � � � � � � ^ � . J Y� � a y � � � � � { 3]�V

Page 26: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

�@�����v� �fC 4(6 .7K .=AJA3DG6R4"032G.10 a y � � � � � {��*¾� M=032G4;I�¨ 8:A�4�03254"A�03.10�476R47?U0�8:AF0�IJ8CH 8:.=<:<:KN0�IVD54��So 4;0D � & + � � � � � � T 2547?B� A38:?B9 4 � *, � � � � 8:A . 9 MW?UH=4$#ZO DB?G9 038CMW?B� ¹ 47?BA�47? � Aa8:?G4 !UDG.=<c8C0LK SW8CH=47A 032G.10eD � 8:AA3DI < 6(.1I3038:?5SW.=<:4�& O M=I .=<:< dSJ L J ( J �Y�a�H y D � { + a�H y � � � � � { ^ � a�H y � � { � � + � � H � � + D�H 3

>@0FO MW<:<CMp¨ A 8:?K�B.1I3038:9;DB<:.1Ib032B.10:a y � � H � � {��* O M=Ia.=<:< L ( - d g�� .,�8o 4;0aDGA XG8:A39 I34;038cA�4#038c6R4�.=?BXK¸BIJA�0�GI3M H=4 .#XG8cA39 I34;0�4FH=4;IJA38CMW? M=O 03254 _ MUM� 8:?G4 !UDG.=<c8C0LK�� T M"032G.10 47?GX�¨!4�¸ # ] ( . .=?GX��BD50 ( � + � ��� ] �� + d g7Y g 3�3�3 g ] �vo 4;0 � y � { XG47?5M=0�4a03254�AJ6(.=<:<C47A�0 H1.=<:D54 M=O�� O M=I�¨ 2G8:9V2 D � � ^ � � �,8CO 032G8cA M 9;9;D5IVA*.10.=<:<N�3� 03254;I�¨ 8:A34���,D50�� y � { + *�� T 2547?5¨!4�6 .7K¨*IJ8C0�4��5A38c?G9 4 - � + � . (�� � � �

+�- 6(. #��� � � � � � � � � ^ � . +����� � +�- � + � .

J ����� � Y� � a y Y � � � � � D � � {J ����� � Y� � a�� Y � � � � � a y D � � � � � { �

+����� � Y� � a y Y � � � � � D � {

J Y� � a y D � {+

Y� � a y � � � � � { 3§b4;I34��G03254aA�479 MW?BX 8:?54 ! DG.=<:8C0 K DGA�47A 032G4aA3DI < 6(.1IJ038:?5SW.=<C4��GI3M�� 4;I30 K .10�038:6(4 ( � � T MRS=4;0 03254aA3.=6R4 O M=I9 MW?U038:?UDGMWDGAa038:6(4�� <C4;0 � X547?GM=0�4 03254(4;H=47?U0 - 6 . # ��� � � � � � � � � ^ � .,� T 2547?k¨ 4 2G. H=4% � Z ( Z � Z ��:Z �� �G.=?GX A�MI� ( *, � � 478:?5SR9 MW?U038:?UDGMWDGA!�

+�- A3DI���� � � � � � � � ^ � . + + � ��� � � ( � + <:8:6�#" � + y ( { JY� � a y � � � � �¬{ 3 �

P���P � �3�� ��^���"�$ Jm �3�d`"#: �5� C 4 A32G.=<:<5DGA34 03254 6 .1I3038:?5SW.=<C4b8:?54 ! DG.=<:8C0 K#M=O T 2G4;M=I3476 V � V 8:?�� 479 038:MW? V � : 0�ME�GI3M H=4 03254b4$# 8cA�0�47?G9 4 M=O.a9 MW?U038:? D5MWDGA H=4;IVA38CMW?RO M=I`MWD5I A�0�M 9J2G.=A�038c9*8:?U0�4;S=IJ.=<:A!� T ¨!M�A30�M 9V2G.=A�038:9��GI3M 9 47A3A�47A�� � .=?BX�� � .1I34F9;.=<:<C47XH=4;IJA38:MW?GA�M=O�47.=9V2 M=03254;IR8CO�� � y � {a.=?BX�� � y � {�.1I34N4 !UDG.=<!O M=I�.=<:< ( ( - d g�� .�.=?BX .=<:6RMWA30�.=<:< � ( ���y I3479;.=<:< _ 4�¸ ?G8C038CMW? ] � : 8c?z� 479 038CMW? ] � : {\�G 5G�!�v���!% P��¦R·¯la�+�W ( � (�ycb g - d g�� .±{1#3¯¢a�+

� � y � { + � �� W y L g � { � b H y � { 3

¡¢M3a12k+NMSa\[1a@aTSI)*b�+Nb�J��=a\[\b�)e&�2� � &�¤� � b=t/jMµ+NMvJL+ (+*, � � y � {%)¦b|/1&�23+N)*2`t¬&Lt�b�¤^&p[�J�(¦4�&�b�+¥J�(*( � ( �q#]=\

Page 27: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

�@�����v� � T 2540� MW8:?U0 M=O 032G4��GI3M M=O 8cA 0�Ma03D5IJ?(9 MW?U038:? DG8C0 K�8:? � (�y �:g + { 8c? 0�Ma9 MW?U038:? DG8C0LK"M=OS�B.1032GA!� T 2G8:AI34 ! DG8CI347A�A34;H=4;IJ.=< 47A�038c6(.10�47A!�o 4;0 � ( � ( ycb g - d g�� .±{% 4a.=? .��v�GI3M #58:6(.1038:MW? M=O WK K A�0�4!� O DG?G9 038CMW?BA!�Im`D50

� � y ( g � { + � �� � y L g � { � b H y � { 3

� K£o 476(6(. V � : 8:?º� 479 038CMW? V � : � � � 8:A".K�B.1032�¨ 8:A�4 9 MW?U038:?UDGMWDGA"6(.1I3038:?5SW.=<:4NO M=IR.=<:< ] � T 254 A3.=6R425MW<:XBA`O M=I!032G4FXG8�Í 4;I347?B9 47A � � @ � #E� T 254;IJ4;O M=I34�� K _ MUM� � A 6(.1IJ038:?5SW.=<C4 8:?54 ! DG.=<:8C0 K y ¨ 8C032 * + ] .=?GX� + ��{ .=?BX 03254a>@0p®M < 8:A�MW6R4;0�IJK��9¨!4#2G.7H=4

+� AJDI���� � � � � � � y ( { @ � # y ( { � ^ ��� J Y

� ( a �py � � y ��{ @ � # y �q{-{ ( �+

Y� (���� a � y � y ( { @ # y ( {-{ ( � �(

+Y� ( ) � @ # ) (� � �� � � ��� � g

¨ 2G8c9J2N0�47?GXGA 0�M d .=A ] g > , * 479;.=DBA�4 � 8:A .ÏA .=DG9V2 K A�4 ! D547?G9 4��IC 4a9;.=? 03254;IJ4;O M=I34a9V25M MWA�4a.=?8:?G9 IJ47.=A38:?5SRA�4 ! D547?G9 4 ] � g ] ( g ] � g 3�3�3 M=O ?G.103D5IV.=< ?UDG6Y 4;IJA�A3DG9V2 032G.10

+� AJDI���� � � � � � � � � � y ( { @ � � � y ( { � � ] � � � J ] � � 3

� K 03254�¸BIJA�0�� M=I347< < A .=? 0�47<c<:8 <C476(6(.R8:0�O MW<:<:M=¨ A�032B.10

+� AJDI���� � � � � � � � � � y ( { @ � � � y ( { � � ] � � O M=I 8:?L¸ ?G8C0�47<CK 6 .=? K ��� + d 3

§b47?G9 4aO M=I .=<:6RMWA�0b.=<:< � 03254;I34a4$#58:A�03A � y � { AJDG9J2 032B.10*O M=IF.=<:<=� ^ � y � {\�A3D9���� � � � � � � � ��� y ( g � { @ � � � y ( g � { � J�] � � gA�M(032B.10*O M=I , ��� � � y � {\�

A3DI���� � � � � � ��� y ( g � { @ � � � y ( g � { � J �� ��� � � ] � � J ] � � � � � 3

T 2G8cA*8:6Q�B<c8C47A 032G.10 ( *, � � � y ( g � {�.=A:� , *)9 MW?UH=4;I3S=47A DG?G8:O M=IJ6 <CK(0�M A3MW6R4�O DG?G9 038CMW? ( *, � y ( g � {\�¨ 2G8c9J2Z6�DGA�0a032G4;I34;O M=IJ4g 4(9 MW? 038:? D5MWDGA�� > 0�I3476(.=8:?GAa0�M A325Mp¨ 032G.10 � y ( g � { 8cAa. H=4;IJA38:MW?ZM=O�� y ( g � {\�T 2G8cA�9;.=?� 4aX5MW?54q K��G.10�MWD � Ab<C476 6(.L�B?G.=6R47<:K O M=I .=<:< ( ( - d g�� . &�� � � y ( g � { @ � y ( g � { � ( + y � � { + �

� <:8c6�8:?5O� " � � � � � y ( g � { @ � y ( g � { � ( + y � � {J <:8c6�8:?5O� " �

�� � � � � y ( g � { @ � y ( g � { � ( + y � � { + d 3 �

�5I3MW6 ?GM=¨�MW?̨!4�AJ2G.=<:< .=<�¨ .7K A*03.��=4S� �� W y L g � { � b H 0�M 6R47.=? . ( < 9 MW?5038c?GD5MWDGA H=4;IJAJ8CMW? M=O 032548:?U0�4;S=IJ.=<N�C 4 2B.7H=4 9 MW6Q�B<C4;0�47X MWD5IR9 MW?GA�0�IVDG9 038CMW? M=O A�0�M 9J2G.=A�038c9 8:?U0�4;S=IJ.=<:A�� > ? � 479 038:MW?GA \=UT ¨ 4 A32G.=<:<8:?UH=47A�038CSW.10�4#0325478CI*6(.=8:?Â�BI3M�� 4;I3038C47A!�

]=[

Page 28: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� � ������� ���� � c�������=� ���c ��� � � � � � �������� �=� �Y� ���> ? 032G8:Ab9J2G.��G0�4;I|¨ 4�A32G.=<:< 0�I347.10 03254�> 0p®M < O M=IJ6�DG<:.L�,. A�0�M 9J2G.=A�038c9�9J2B.=8:? IJDB<C4 032G.10b8:A M=O S=I347.10b2547<*� 8:?03254aO M=IJ6(.=< 6 .=?G8��BDG<c.1038CMW?NM=O%A�0�M 9J2B.=A�038:9a8:?U0�4;S=IJ.=<:A��

C 4�A3.7K 032G.10Z.��GI3M 9 47A3A � � 8:A .D�1�,���!������^�^� �±�v�h²,³��j��� 8CO(032G4;I34 4$# 8:A30 y A !UDG.1IJ4 < 8:? 0�4;S=IV.� B<C4.=XG.��G0�47XS{ �GI3M 9 47A3A�47A�� � g ? � ( � ( ycb g - d g�� .±{�AJDG9J2 032B.10!�GO M=IF.=<:< ( ( - d g�� .,�� ��+ � � / � �

� � H � L / � �� ? H � b H 3 y \ �:Y={

T 254 ¸BIVA�0 8:?U0�4;S=IJ.=< MW?R03254�I�� 28� A!�W8:A M=O3¸,?G8C0�4 H .1IV8:.1038CMW?B�� 478:?5S|�B.1032�¨ 8:A�4*XB8�Í 4;IJ47? 038:.� ,<C4 .=<c6RMWA�0 4;H=4;I3K <¨ 254;IJ4�� T 254aA�479 MW?GX 8:? 0�4;S=IV.=< 8:A�.=? >@0p®M < 8:?U0�4;S=IJ.=< .=?GX 03254;I34;O M=I34a.(6(.1I3038c?5SW.=<C4��9W X5479 MW6Q� MWA38C038CMW? M=O.��GI3M 9 47A3A 8c? 0�M .a6(.1IJ038:?5SW.=<C4�.=?GXR.��GIJM 9 47A3A M=O3¸,?G8:0�4 H1.1IJ8:.1038:MW?R8:A 9;.=<:<C47XR.EÅ����*Q�V��£²�¶¬²��|�¬²��\� R��L���\�.V�^�N���9��m`I3M 9 47A3A�47A`8c? � ( ycb g - d g�� .±{ 032G.10!2B.7H=4 A3DG9J2 .�X5479 MW6Q� MWA38:038CMW?(.1I34 9;.=<c<C47X � A�476 8 < 6(.1I3038:?GSW.=<C47A2�L�^ ! DG.1038CMW? y \ �:Y={�8:A�9 MW?UH=47?G8C47?U03<CK I34!¨*IJ8:0�0�47? 8:? XG8�Í 4;I347?U038:.=< O M=IV6 &

� � � + � � �( / ? � � b � 3 y \ � ] {

��� #%'`"K±�KR �N79���G> ?z� 479 038CMW? V � ] 8C00¨ .=A A325Mp¨ ? 032G.10 03254q�GI3M 9 47A3A b)(� A3.1038:Aj¸,47A�03254a4 ! DG.1038CMW?� ycb (� { + �( / ] b � � b � 3 y \ � : {

R �N7 G 5��8�S�G�>IT����%£�L�G 4���S��#K\�C :H�(I��c�v�6%<�"K$#?*47<c.1038CMW? y \ � : { 8:A .=?#8:?GA�03.=?G9 4 M=OG.*S=47?54;IJ.=< 9V2G.=8:?�IJDG<C4 O M=I O DG?G9 038CMW?GA M=O A30�M 9V2G.=A�038:9!8:? 0�4;S=IV.=<:A 032G.10%9;.=? 4 A�03.10�47X .=A!O MW<:<:M=¨ A�& � 03254bXG8�Í 4;I347?U038:.=<G6�DGA�0� 4*4$#�,.=?GX547X(0�M�A�479 MW?GX M=IJX54;I .=?GX(4;H=4;I3K M 9;9;D5IJI347?G9 4M=O y � b � { ( 6�DGA�00 4 I34!�B<:.=9 47X5 UK �( �L�v§b4;I34�8:A 03254E�GI3479;8:A�4 IVDG<C4��G 5G�!�v���!% R �N7 � �C :H�:I��E�v�6%<��K�# � �'¯la�+�� � ]IagJzb�+h&I/sMvJ�b�+N)N/d)*2S+ha�w�[\J�(,#l¯la�+ ��& - d g * { �G[ , [ ]Ia+h»¥)^/1aY/1&�2S+N)*2St�&Lt�b�(ËiK_�) �8a\[1a123+N)eJI]�(ea�#8¡¢M3a12k+NM3a�c`[1&I/1a1b�b�� � & + � y ( g � � {%b�JL+N)*b�¼Sa1b

� � ��+� �� ( y ( g � � { �*( /

� �� � y ( g � � { � � � /

�(� ( �� � ( y ( g � � { y � � � { ( g y \ � V {

»'M3a\[�a y � � � { ( )*bq+h&5]Laqa���J�(ht�JL+ha=_ÂJ�/!/1&p[!_�)*2LwK+h&Â+NM3a|4Ât�(,+N) cB(¦)^/\JL+N)e&�2�+,JI]�(ea�q�( � b ��*( d d

� b � d �*(),# a�# ��»¥),+NMk+NM3a , &�&L]¬~^H�a�iLa\[�_La=/1&�4EcZ&�b�)h+N)e&�2 �i�¬# 0 �4q

� � � + � � �( / ? � � b �y � � � { ( + ? (� �*( 3

]�;

Page 29: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

>@? 0�4;IV6(A�M=O 03254 4$#L�B<:8:9;8C0 O M=IJ6 y \ � ] {�M=O � � �9¨ 4�9;.=?�¨ IJ8C0�4 y \ � V { .=A� � � + � �� �*( / ? �� � b �

¨ 8C032� �� +

� �� ( y ( g � � { /

� �� � y ( g � � { � � /

�(� ( �� � ( y ( g � � { ? (�

? �� +� �� � y ( g � � { ? � g

¨ 2G8c9J2 8:? 03D5IV? A�03.=?GXGA�O M=I� � + � � / ���

� � �H � L / ���� ? �H � b H 3

T 254 032B8CIJXN0�4;IJ6 8c? 03254 I�� 2B� A!�5M=O y \ � V {*8:A*9;.=<:<C47X � 032G4a> 0p®M 9 M=I3I3479 038CMW? �L�C 4#A32G.=<c<3�BI3M H=4 T 254;M=I3476 \ �:YaH 8:."032G4aO MW<c<CM=¨ 8c?5S#4$# 0�47?GA38:MW? M=OZo 476(6(. ] � : 8:?Ì� 479 038CMW? ] � V �� �!%_% #µR �*­ªrj¤ � )*b�J@c`[�&L/1a1b�b�)*2�� ( ycb g - d g�� .±{ �¢+NM3a12

� � ��� � � ��� y � b � { ( @ , ���� � �*( )*2 � (�y �`g + {0J�b ] @ , *�#

�@�����v� � C 4�<C47. H=4�032G8:A�.=Ab.=? 4$# 4;IJ9;8:A�4���

C 4b?5Mp¨ SW8CH=4*032G4��GI3M M=O,M=O T 2G4;M=I3476 \ �:Y�� > 0Z¨ 8c<:<L 4*.q B8C0 A-�=4;039V2 K�� BD50 032G4 X54;03.=8:<:A`.1I34*47.=A38:<:K¸,<:<:47XN8c?B��@�����v� � C 4�A32G.=<c< DGA�4 03254@ K ?5M=¨ A303.=?GXG.1IJX ?GM=03.1038CMW?

� ( � + � ( � �� + ( � �� � � @ ( � �� g .=?GX � b � + � b � �� + b � � �� � � @ b � � �� g¨ 254;IJ4 03254q� MW8:? 03A y ( � �� { �� � � ¨ 8C032

d + ( � �� ( � �� �� ( � �� + � O M=I ] + Y g ] g : g 3�3�3O M=IJ6 .aA34 !UD547?B9 4 M=OB�B.1I3038:038CMW?GA M=O - d g�� .S¨ 25MWA�4 6 . 5;47A � � + 6(. #��� ��� � � ( � �� 0�47?BX(0�MP5;4;IJM#.=A ] @ , *��C 4#AJ2G.=<:< S=47?54;IJ.=<:<:K�¨*IV8C0�4 � � O M=I�� ��� �Y��8� 8CIJA�0!�S¨ 4(6(.7K/.=A3A3DG6R4"032G.10 �3� �

�� � � �

�� d � � � �

� � � � � � �� d � .=?GX � � �

� d � � .1I34R.=<:<l MWDG?GX547X8�B>@O`03254;K/.1I34R?5M=0!�032547?K¨ 4"A30�M�� 03254d�GI3M 9 47A3A .=A A�MUMW? .=A 03254".� BA�MW<cD50�4"H .=<:DG4#M=O MW?G4�M=O!0325476 I347.=9J2G47A 03254"H .=<cD54 1 �.=?GX .1O 0�4;I�¨ .1IJXGA�03.��=4#03254�<:8c6(8C0 1 @ , *��

]�T

Page 30: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

] �BPb4$# 0!�,DGA38:?5S T .7K <CM=I � A 03254;M=I3476 ¨ 4aM� G03.=8c?� y �0g � � { @ � y d g � � { + � � y � y ( � � � g � � � � { @ � y ( � g � � {-{

+ � � � �� ( y ( � g � � {�� ( � / � � � �

� � y ( � g � � {���� �/ �( � � � ( �

� ( ( y ( � g � � { y � ( � { ( / � � � ( �� ( � � y ( � g � � {�� ( � ��� �

/ �( � � � ( �

� � ( y ( � g � � { y � � � { ( / � � � � g¨ 254;IJ4�� � + M � � � ( � � (�/ � ��� � � ( � O M=I .=<:< � �: � T 2G4�¸BIJA�0�0�¨!M(0�4;IV6(A 9 MW?UH=4;I3S=4E 479;.=DGA34 � � , d &

� � � �� ( y ( � g � � {�� ( � @ , ���

�� �� ( y ( g � � { �( g� � � �

� � y ( � g � � {���� � + � � � �� � y ( � g � � { y � � � ( � / ? � � b � { /��Iy Y={

@ , ����

� �� � y ( g � � { � � �( /

����

� �� � y ( g � � { ? � � b � 3

V � T 254 032G8CIVX�.=?BX#032G4�O MWD5IJ032#0�4;IV6 0�47?GX"0�M`5;4;I3MI���5M=I`8c?GA�03.=?G9 4��=8COB8c?#032G4 O MWD5I3032�0�4;IJ6 ¨ 4*A3DI ,A�038C03D50�4��� � + � � � ( � / ? � � b � �G032547? .(0�4;IJ6

� � � ( �� ( � � y ( � g � � { ? � � ( � � b � + & � � � � � ( � � b � y \ � \ {

.1IJ8:A347A!�I� DG0!�I 479;.=DBA�4 � � 8:A�� ��� < 6R47.=AJD5IJ.� B<C4 .=?GX � � � � J � O M=I*.=<:< � �,8C0 O MW<:<:M=¨ A 032G.10 y \ � \ { 0�47?BXGA 0�M5;4;I3Mg 479;.=DGA34a � � � � � � � ( � � b � ( � + � � a y�� (� { y � ( � { � @ , d 3

\ � T 2G4�¸BO 032 0�4;IV6 .1SW.=8:? 9 MW?UH=4;I3S=47A�&�( � � � ( �

� � ( y ��� � { ( + �( � � � ( �

� � ( y ( � g � � { y � � � ( � / ? � � b � { ( /��Ly Y={+

�( � � � ( �

� � ( y ( � g � � { � � (� y � ( � { ( / ] � � ? � � ( � � b � / ? (� y � b � { ( � /��Ly Y={@ ,

�(����

� ( �� � ( y ( � g � � { ? (� �(

K�o 476(6(. \ � ]5y IJ479;.=<:< 03254�6�DG<C038*�B<:8:9;.1038CMW? 03.� B<C4a8c? T 254;M=I3476 \ �:Y={\��

]�>

Page 31: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

R �¦­ 3 ��%��z� � #%'`�Ke� ��� #%'`"K±�KR �¦­`���9C 4�9;.=? ?5M=¨ S=47?54;IJ.=<:8cA�4 y \ � : {�.=A�O MW<:<CMp¨ A�&

� ycb �� { + ]=b � � �� � b � /Y] ]¥y.] @ Y={ b � � (� �( g y \ � [ {

y DGA�4 T 254;M=I3476 \ �:Y@¨ 8C032 � y ( g � { + � � � � ��� d ��{

��� #%'`"K±��R � & ��� - M=I34"S=47?54;IJ.=<c<CK��3¨ 4R2G.7H=4RO M=I 4;H=4;I3K 0�¨ 8:9 4"9 MW? 038c?UD5MWDBA3<CK XG8�Í 4;I347?U038:.� B<:4aO DB?G9 038CMW?W &�[ , [0�� W ycb � { + W � ycb � { � b � /

Y] W � � ycb � { �( 3 y \ � ; {

��� #%'`"K±�ªR ��P8���¥C�8C032 03254 2547<*� M=OF>@0p®M�� A O M=IJ6�DG<:. y \ � [ {(8C0 8:Ad� MWA3AJ8� B<C4 0�M ! DG8:9�� <CK 9;.=<:9;DG<c.10�4 .=?8:?U0�4;S=IJ.=< <:8��=4 � �� b)(� � b � � 8c?N6�DG9V2 032G4 AJ.=6R4�¨ . KN.=A M=IJXG8c?G.1I3K(8:?U0�4;S=IJ.=<:A!�LC 4 6(.��=4a.�SWD547A3A O M=I�032548:?GXG4�¸,?G8C0�4R8:?U0�4;S=IJ.=<N�%9;.=<:9;DG<:.10�4N8C03AaX54;IJ8:H .1038CH=4��%.=?GXµ¨b254;I34 ?54;47XG47Xµ¨ 4 .��9�B<:K/. 9 M=I3I3479 038CMW?B��>@? 032549;.=A�4�.10F2G.=?GX¨ 4@¨ MWDG<:X SWD547A3A*03254�8:?U0�4;S=IJ.=< 0�Mg 4aA�MW6(4;032G8:?5S(<:8*�=4 b �� �BA�MQ¨ 4�9;.=<:9;DB<:.10�4 ? ��� Y={h&

� ycb �� { + : b (� � b � /º: b � y � b � { ( + : b (� � b � / : b � �*(+�� b (� � b ��+

�� � � b �� � @ b � �(

+������ b (� � b ��+

�� b �� @

���� b � �*( 3

��� #%'`"K±�KR �¦R`���G> ? 03254aA3.=6(4@¨ . K 8C0*8:A�O MWDG?GX 032G.10���� A38:? b � � b ��+ Y @ 9 MWA b � @ Y

]���� 9 MWA b � �*( 3

��� #%'`"K±��R �*ÃB���'o 4;0 W 4 XG8�Í 4;I347? 038c.� B<C4��lC 4 9;.=? I34!¨*IJ8:0�4 1�� + � �� W y ( { � b � .=A"O MW<:<CM=¨bA!� y DGA�4T 254;M=IJ476 \ �:Y@¨ 8:032 � y ( g � { + W y ( { � � � ��� d � ? ��� Y={h&� y W y ( { b � { + � y W y ( {-{ b � / W y ( { � b �

+������ W y ( { � b � + W y ��{ b � @ W y d { b � @

���� W � y ( { b � �( 3

T 2G8cA 8:A`.E�B.1I3038:.=<B8:? 0�4;S=IV.1038CMW? O M=IJ6�DG<:. O M=I!032G4b8:?U0�4;S=IJ.1038CMW? M=O O DG?B9 038CMW?GAZ¨ 8:032(I347A-� 479 0 0�Md� I3M=¨b?G8:.=?6RM=038CMW?8�

:1d

Page 32: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

��� #%'`"K±�KR ���3���vo 4;0 DGA*A�MW<:H=4 03254�A�0�M 9J2G.=A3038:9aXG8�Í 4;I347?U038:.=< 4 ! DG.1038CMW?� � � +�� � � � b � g

¨ 2G8c9J2�8:A . A-� 479;8:.=< 9;.=A�4 M=O�03254 S=I3Mp¨*032�4 ! DG.1038CMW? 8:? ^ #5.=6Q�B<:4 Y 8:?ª� 479 038CMW? Y��0C 4 0�I3K � � +4$#L� y � b � {1�G.=?GX M� B03.=8:?�¨ 8C032 032G4a2547<�� M=O 03254 >@0p®M < O M=IJ6�DG<:.(032G.10� � ��+�� � � � b � /

�( � ( � � �*( 3

T 2G8cA*8:A�M� H 8:MWDGA3<CK S=I3Mp¨ 8:?5S(0�M M O .=A�0�& 03254#A3479 MW?GX 0�4;IJ6 8:? 032G4�I�� 2B� A����v¨ 2G8c9J2 8:A 03254a>@0p®M < 9 M=I3I3479 038CMW?8�6�DGA�00 4a9 MW6Q� 47?GA3.10�47XB�vC 4a03254;I34;O M=I34a0�I3K ?54$# 0�� ��+ 4$#L� y @ � ( { � � �I¸,?BXG8:?5S� � ��+F@ � � � � � � � �( / � � � � � � �

+F@ � � � �*( /�y � � � � b � /Y] � ( � � �*( {

T 254 �*( 0�4;IV6(A 9;.=?G9 47< 8CO � +�( � ( .=?GX¨!4@¸,?GX 03254�A3MW<:D5038CMW?

� ��+ 4�� � � � �( � � � 3T 2G8cA%�GI3M 9 47A3A�8:A*9;.=<:<:47X 03254�²����L���S²!�v�^�N����Rg�����^�±��³¬���*²��

R � & G 5��j%<�"K$ �� IT�"�i%£��� 4���3��#K �C :H�:I��E�v�6%<��K�#

G 5G�!�v���!% R � & ¯la�+ b�y ( g � { + y b � y ( g � {hg b ( y ( g � {hg 3�3�3 g b # y ( g � {-{Â]Ia^-�[�&�»'29)eJ�2½4�&+N)e&�2 )*2 [ # �/1&�29b�)¦b�+N)*2LwY&�¤ > )¦2`_LajcZa12`_La12S+8/1&�c8)ea1b�&�¤�-�[�&�»'29)eJ�2Q4�&+N)e&�28#�¯¢a�+ � y ( g � { + y � � y ( g � {hg 3�3�3 g � � y ( g � {]Ia�+NM3a|b�+h&I/sMvJ�b=+N)^/|)*2S+ha�w�[\J�(`w¬)h�=a12�]�i

� � " y ( { + � " y ( { �*( /#�� ��� ? " � y ( { � b � y ( { y $ + Y g 3�3�3 g ] {hg y \ � T {

¤N&p[�b\&�4�a0cB[1&L/1a1b�b\a1b�� " y ( {0J�2`_ ? " � y ( { )*2�� ('ycb g - d g�� .±{!# F ]v]�[1a���)¦JL+ha �i�¬# F��|)*2k+NMSad�=a=/=+h&p[|2S&+,JL+N)e&�2� � + � �( / ? � b 3

¯la�+ ��& - d g�� . � [ � @ , [ � ]La�J�� ( ~^¤jt�2`/=+N)e&�28#L¡¢M3a12Â+NM3alc`[1&I/1a1b�b � y ( g � { & + � y ( g � � y ( {hg 3�3�3 g � � y ( {-{b�JL+N)*b�¼Sa1b@+NM3a|b�+h&I/sM3J�b�+N)^/E_) �Ba\[�a123+N)¦J�(8a��9t�JL+N)e&�2

� � " y ( { +� � "� ( y ( g � � { �( /

��� ��� � � "� � � y ( g � � { � � � y ( { / �

(��� ����� � ( � "

� � � � � � y ( g � � { � � � y ( { � � � y ( {y $ + Y g 3�3�3 g * {hg

y \ � > {

»'M3a\[�a�+NM3a%c`[1&I_St/=+ � � � � � � MvJ�b@+h&Ì]Ia|a���J�(ht�JL+ha=_�J�/!/1&p[!_�)*2IwÌ+h&Â+NM3a|[pt�(ea1b� b � � b � + � � � �*(� b � �( + y �( { ( + d 3

: Y

Page 33: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

^ ! DG.1038CMW? \ � > 8:A 03254F6#DG<:038 < XG8:6R47?BA38CMW?G.=< H=4;IJA38CMW? M=O >@0p®M�� A!O M=IJ6�DG<:.L�W.=?BX(9;.=?Ï 40�GIJM H=47X 8c?R03254A3.=6R4q¨ .7K .=A*8:03A MW?54 < XG8:6R47?BA38CMW?G.=< 9 MWDG?U0�4;I��B.1I30!�9� 4�9;.1IJ4;O DG< 0�MQ�=4;4!� 0�IJ.=9�� M=O .=<:< 03254a8:?GXB8:9 47A!� T 25447.=A38C47A30 9;.=A�4�8:A > + ] � * + Y����� #%'`"K±��R �*6B��� � � �� = ��!K `����B�� � � �vo 4;0�� � y � { + ) b � y � { ) �¨ 254;IJ4 b � 8:A > < XG8:6R47?GAJ8CMW?G.=<9� I3Mp¨ ? <8:.=? 6RM=038CMW? .=?BX ) ) 8:A 03254 ^ DG9;<:8cX547.=? ?GM=IJ6��IW��v�B<CKR03254 >@0p®M < O M=IV6#DG<c.#0�MR032G4FO DG?G9 038:MW? - & [ # @ ,[ � & � *, ) � ) �9C 4�9 MW6Q�BD50�4 � �� d � + d �

�.=?BX � � �� d � � +

�� @

d ��� � �`� MQ¨!4@¸,?GX

� � +#�� ��� b �� � b � / �

(#�� ��� � Y� @

b)(�� ��� �( +#�� ��� b �� � b � / > @ Y

] � �( 3�5M=IF?5M=03.1038CMW?G.=< 9 MW?UH=47?G8C47?B9 4E¨ 4�2G.7H=4#X5I3M��9� 47X 254;I34 032G4a.1I3SWDG6R47?U03A ( .=?GX � �

T 254 ?54$# 0(03254;M=I3476�SW8CH=47A .k¨ .7K 0�M 9 MW?BA�0�IJDG9 0 6 .1I3038:?5SW.=<C47A(MWD50RM=Oq�!IJM=¨ ?G8c.=? 6RM=038CMW?B�¥WO DG?G9 038CMW? W�MW? [ # 8:A 9;.=<:<C47X«���� Rg���9�N� 8CO � W + d �0¨ 254;I34 � X547?5M=0�47A 03254ko�.��B<:.=9 4 M�� 4;IJ.10�M=I� #" ��� � �� d �� �

G 5G�!�v���!% R ��P«rs¤ W & [ # @ , [·)*b0MvJ�[�4�&�29)^/��G+NM3a12 W ycb � {%)*b�Jg4ÏJ�[=+N)*2Lw�J�(±a�#�@�����v� � C IJ8C0�4 MWD50� W ycb � { +

#�" ���

� W� � " y b�y ( {-{ � b " y ( { /

�(#�" ���

#�� ��� � ( W� � " � � � ycb�y ( {-{ � b " y ( { � b � y ( { 3

T 254RA�479 MW?BXk�B.1I30a8:?/03254RI=� 2B� A!� 8:A:5;4;I3M5 479;.=DGA34 � b " y ( { � b � y ( { + � " � �( .=?GX��NW + d � > ? 0�4;S=IJ.1038:MW?K 8C47<:XGAW ycb � { @ W ycb � { +

#�" ���

� ��

� W� � " y b�y ( {-{ � b " y ( { 3

T 2G8cA�8:A�.=? >@0p®M < 8:? 0�4;S=IV.=< .=?GX 2G47?G9 4�.R6(.1I3038c?5SW.=<C4���

C 4�9;.=? DG?GX54;IJA303.=?GX T 254;M=I3476 \ � V 8c? 03DG8:038CH=47<CK .=A O MW<c<CM=¨ A��vW 2G.1IJ6RMW?G8c9 O DG?B9 038CMW? W 2G.=A 03254�GI3M�� 4;I30 K 032G.10#8C03A�H .=<cD54 8:?Z.Ì� MW8:? 0 � 8:Aa03254 . H=4;IJ.1S=4 M H=4;IR8C03AaH1.=<:D547AaMW? .=?UKZA-�B254;IJ4(.1I3MWDG?GX � �T 2G8cA��GI3M�� 4;I30LK���0�M=S=4;03254;I�¨ 8C032 03254 O .=9 0#032G.10#6�DG<C038 < XG8:6R47?GAJ8CMW?G.=<l�!IJM=¨ ?G8c.=?Z6RM=038CMW? 8:A�8:A3M=0�I3M��B8:9��4$#L�B<:.=8:?GA%¨b2 KKW ycb � { 8cA*. � O .=8:I*SW.=6R4 �L�

T 254 O MW<:<CM=¨b8:?5S"0�479J2G?B8:9;.=< 4$# 0�47?GA38CMW? M=O >@0p®M�� A*O M=IJ6�DG<:. y \ � ; {0¨b8:<:<3 4aDBA�4;O DB< <:.10�4;I*MW?B�

fk"

f "

� 8CSWD5I34 : & T 254 S=IJ.��B2 M=O W � �� .��9�GI3M # 8:6 .1038:?5SNW � � 2G. H 8c?5S(.FQ3DG6Q�8�:=]

Page 34: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� �!%_% #µR �*Rªr�+�R&�b b�¤N&p[�4�t�(¦J�¤^&p[�Jd¤st�2B/=+N)e&�2Ì&�¤�-�[�&�»'29)eJ�2�4�&+N)e&�2

W ycb � { + W ycb � { / � �� W � ycb H\{ � b H / �

(� �� W � � ycb H1{ � L y \ �:Y d {

b�+N)*(¦(8M3&�(^_�b�)*¤�W & [ @ , [D)*b�A � a��=a\[ji8»'M3a\[�aEJ�2`_5A ( &Lt9+Nb�)^_LaqJϼv29)h+ha�b\a�+ ��� � g 3�3�3 g������ �¢»'),+NM W � �]I&Lt�2`_La=_�&�25b1&�4�a�23a1)�w¬M`]I&Lt�[�M3&&I_Ï&�¤ +NM9)*b�b\a�+-#

�@�����v� � T .��=4 W � (�A ( y [�{�A3DG9V2 032G.10`W � @ , W .=?GX W �� @ , W � .=A`� , *��3 M=032/DG?G8:O M=IJ6 <CK��G.=?GXA3DG9V2 032G.10*O M=I � �(���� � g 3�3�3 g���� �*&

� W � �� y � { @ , W � �Ny � { .=A � , *� W � �� y � { � J � 8:? .(?G478CSW2¬ MWD5IV25MUM X M=O ��� � g 3�3�3 g������ 3y � 8CSI� : A32GM=¨ Ab03254�S=IJ.��B2 M=O W � �� .��9�GI3M # 8:6 .1038:?5S A�MW6(4SW � � ¨ 8C032/. Q3DG6Q�G��{0�5M=I W � ¨ 4�2G. H=4"03254�>@0p®MO M=IJ6#DB<:.

W � ycb � { + W � ycb � { / � �� W �� ycb H\{ � b H / �

(� �� W � �� ycb H1{ � L 3

> ? 03254 <:8:6(8:0#.=A � @ , * 032G8:A�4 ! DG.=<:8C0 K 0�47?BXGA!� 0�4;IJ6 K 0�4;IJ6 8:? � ( y �:g + {\� 0�M y \ �:Y d {\� > ?GX54;47XB�03254 XB8:A�03.=?G9 47A ) W � ycb � { @ W ycb � { ) .=?GX ) W � ycb � { @ W ycb � { ) 0�47?GX 0�M d UK 03254 DB?G8CO M=IJ6(8C0 K M=O 032549 MW?UH=4;I3S=47?G9 4 W � , Wl�B03254"?5M=IJ6 XG8�Í 4;I347?G9 4 ) � �� W �� ycb H1{ � b H @ � �� W � ycb H\{ � b H ) 0�47?BXGAF0�M d K 03254DG?G8:O M=IJ6 8C0LK(M=O 03254a9 MW?UH=4;I3S=47?G9 4 W �� , W � �,<:DGA > 0p®M�� Ab8:A�MW6R4;0�IJK��B.=?GX 03254�XB8�Í 4;IJ47?G9 4a � � �

� W � �� ycb H\{ � L @� �� W � � ycb H\{ � L � ( J ( � �

��� � W � �� ycb H y � {-{ @ W � � ycb H y � {-{ � ( + y � � { � L

0�47?GXGA*0�M d KNX5MW6 8:?G.10�47X 9 MW?UH=4;I3S=47?G9 4�9 MW6E B8c?547X�¨ 8C032 032G4aO .=9 0 032G.10+ � � � y � g L { (���� - d g ( .U& b H y � { (���� � g 3�3�3 g����� � + d 3 �

R ��P �\�B�#MK ���%£� �v� � ���! �����#v� %'�( ����3�WFA .=? .��v�B<:8:9;.1038CMW? M=OGo 476(6(. \ � \ ¨!4 A32G.=<c<v�GIJM H=4 T .=?G.�� . � A O M=IJ6�DG<:.#O M=I 03254 <CM 9;.=<,038:6R47A M=O�� I3Mp¨ <?G8:.=? 6(M=038CMW?B�G 5G�!�v���!% R �*à � G #3��# ��# � ¯la�+ ( *, b � ]IaqJÂ&�23a�~�_�)*4�a129b�)e&�2vJ�(�- [1&�»'2v)¦J�2Ì4�&+N)±&�28#3¯¢a�+ � _Ia123&+ha+NM3a�¯¢a�]Ia1bjw3t¬a|4�a�J�b=t�[1aq&�2 - d g�� .h#¢¡¢M3a12k+NM3a�(¦)*4g),+� � & + <:8:6

� �Y] � � � � L ( - d g ( .U& b H�( y @ �g ��{��

aTSI)*b�+Nb�)*2 � ( y �:g + {�J�2`_�)*b�a��It¬J�('+h&� ��+ � b � � @ � b � � @ � �� A�SW? ycb H\{ � b H 3

y T 2G8c?I� M=O � � .=AF03254�XG47?GA38C0 K5� 4;IFDG?B8C0 <C47?5S=032/M=O 032G4#0�M=03.=< 038:6(4�A-� 47?U0b9;<CMWA34�0�MN03254"M=IJ8CSW8c? DI�/0�M038:6R4 ( ��{:�:

Page 35: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

−ε ε�%8:SWD5I34 V & T 2G4FO DG?G9 038:MW? � y ( {\��@�����v� � �5M=I�� � d �B9 MW?GAJ8:X54;I*03254 O DG?G9 038:MW?

� y � { + � � � � 8CO � � � ^ ��( � � / � ( � � � 8CO � � � �*g

.=A A325Mp¨ ? 8:?z� 8CSI� V � T 2547? � 8cA|A ( � 4$# 9 4!�G0 8:? 03254Y� MW8:?U03A�� @ �g � �¬� .=?BX 8C0b8:A�A � 4;H=4;I3K¨ 254;I34�MW?[0�GW��9�B<CK�o 476(6 . \ � \ 0�M(S=4;0�(� �� � � � ycb H1{ � L + � ycb � { @ � ycb � { @ � �

� � � ycb H1{ � b H g y \ �:Y=Y={¨ 254;IJ4 � � y � { .=?GX � � � y � { .1I34aSW8:H=47?� UK

� � y � { + � A3SW? y � { 8CO � � � ^ �� � � 8CO � � � �

.=?GX� � � y � { +

� Y > � � y � { 8:O � �(�� @ �g � � 3PbM=¨@�!03254 <:8:6 8C0R.=A ��� d M=O 03254/<N� 2B� A!� M=O y \ �:Y=Y={ 8:AQ�GIJ479;8:A�47<CK � � �`- M=I34;M H=4;I=� ¨ 4 0�IJ8:H 8:.=<c<CK 2G. H=4

� ycb � { , � b � � .=?GX � ycb � { , � b � � .=A ��� d �`§b47?G9 4�8:0bA3D %N9 47A 0�M��GI3M H=4#032G.10F03254�8:? 0�4;S=IV.=<�8:? 03254I�� 2B� A��5M=O y \ �:Y=Y={*9 MW? H=4;IJS=47Ab0�M 03254a.��9�GI3M��BIJ8:.10�4a<:8:6 8C0�&� �� � � � ycb H\{ @ A�SW? ycb H1{ � � b H @ , d 8:? � ( y �:g + { 3

T M A�4;4@¨ 2UKN03254a<:.10�0�4;Ib8cA 0�IJD54��G47A�038c6(.10�4 � �� � � � ycb H\{ @ A�SW? ycb H\{ � � b H

(+

� �� Y > � � ycb H\{ � Y� b H @ A�SW? ycb H1{ � � b H (

+ a � � �� Y > � � ycb H1{ � Y� b H @ A�SW? ycb H\{ � ( � L �

J � �� + y b H�( y @ �*g ��{\{ � L

@ , d .=A ��� d g:�V

Page 36: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

¨ 254;IJ4#8:? 03254�A3479 MW?GX 4 ! DG.=<:8:0LK�¨ 4�DGA34�03254�> 0p®M < 8cA�MW6R4;0�I3K�� 8:? 032G4�8:?G4 !UDG.=<c8C0LK¨ 4#DGA�4#032G.10 � b H � �8:6Q�,<:8C47A 032G.10 � � � � b H @ A�SW? ycb H\{ � J Y��1.=?GX#03254 <:.=A�0�A303.10�476R47? 0 2GMW<:XGA8 479;.=DGA34`03254�� .=DGA3AJ8:.=?�IV.=?GX5MW6H1.1IJ8:.� B<C4 b H y L � d {!2G.=A ¸,?G8C0�4 X547?GAJ8C0LK�� >@0 O MW<:<CMp¨ A 032G.10 � � 4$#58:A�03A�.=?GX 9;.=? 4b4$#L�GI347AJA�47X .=A�8:?N03254A�03.10�476R47?U0 M=O 03254 032G4;M=I3476���

P M=0�4#032G.10*O M=I A36RM M=032 O DG?G9 038CMW?GACWl�� W y ( { � @ � W y d { � @ � �

� A3SW? y W y L {-{ W � y L { � L + d 479;.=DGA�4

��( � W y ( { � + A�SW? y W y ( {-{ W � y ( { y W y ( { #+ d { 3

T 2 DGA!� 03254 <:M 9;.=< 038:6(4 8:AR.=? >@0p®M < 9 M=I3I3479 038CMW? 0�M 032G8:A"I347<c.1038CMW?B� 9;.=DGA�47X UK 03254 O .=9 0(032G.10 � � b � � #+A�SW? ycb � { � b � &G8:O b � �,.=A3A�47A 03254 M=IJ8CSW8c?NXBD5IJ8:?5S#03254 038:6R4 8:?U0�4;I3H1.=< � ( � �5032G47? � b ��� � � @ b ��� � ?54;47X ?5M=0 4 4 !UDB.=< 0�M A�SW? ycb ��� {�� b ��� � T 2G4aXG8�Í 4;I347?G9 4 8:A*.(6(47.=A3D5I34 M=O 03254 038:6(4aA-� 47? 0*9;<CMWA34a0�M(03254 M=IJ8:SW8:?B�

T 254 4$#58:A�0�47?G9 4aM=O%03254a<CM 9;.=< 038:6(47A�M=Ol� I3Mp¨ ?G8:.=? 6(M=038CMW?�¨ .=A��GI3M H=47X� K�o��4;H K 8:? 03254(Y >�:1d � ADGA38c?5S 2G.1IVX 47A�038c6(.10�47A!� T 254N.� M H=4 .��9�GIJMW.=9J2 8:A�A325M=I30�4;IR.=?GX 6RM=IJ4N47<:4;SW.=? 0!�ZC�2G.10R8:A�X547A39 IJ8� 47X.� M H=4F8:A 03254 <CM 9;.=<5038:6(4*.10 03254*M=IJ8:SW8:?�&�� ��+ � � y d {\� > ?(.a9 MW6Q�B<:4;0�47<CK�.=?B.=<CM=S=MWDGA'¨ .7K"MW?54b9;.=?g�GI3M H=403254a4$#58:A�0�47?B9 4 M=O%032G4�<CM 9;.=< 038:6R4 � � y � { .10 .=?UK A38C0�4 � ( [ �T 254g�GIJM 9 47A3AE�B<:. K Aa.Ì�=4;K I3MW<C4 8c?Z6(.=?UK .��v�B<:8:9;.1038CMW?BAa.=A3A�M 9;8:.10�47X£¨ 8C032k� I3M=¨b?G8:.=? 6(M=038CMW?B�

�5M=IF8:?GA�03.=?G9 4��58C0*8cA�DGA�47X 0�M X54�¸ ?54��B.1032 6R47.=A3D5IJ47A�032G.10 6RM X547< 03254q 472G. H 8CMWDGI�M=O�� MW<CK 6R4;I�9J2G.=8c?GA!�o 4;0 + � X547?5M=0�4�03254�C�8C47?G4;I`6R47.=A3D5IJ4�MW?R03254�038:6R4*8c? 0�4;I3H1.=< - d g�� .,���%86#".a? DG6Y 4;I � � d � .=?GX X54�¸,?54.(?54!¨ 6R47.=A3D5I34�� �� MW?��B.1032 A-�,.=9 4@ UK A�4;0�038c?5S

� � ��� + � y { + YD ��

4$#L� � @ � � � � (� y � { y { �*� � g¨ 254;IJ4GD �� 8:A 03254 ?5M=IJ6 .=<:8:A38:?GS 9 MW?GA�03.=?U0!��C�2G.10 03254Z6(47.=A3D5I34�� �� X5M 47A 8:A I34!¨ .1IJX¾�B.1032BA 032G.10A-�GIJ47.=X 0325476 A�47<CH=47AFMWD50 9 MW6Q�B.1I347X/0�MÂ�!IJM=¨ ?G8c.=? 6RM=038:MW?B�3C 4"6(. K 032G8:?9�NM=O + � .=A 6RM X547<:8:?GS(032544;I3IJ.1038c9 A��B.1038:.=< XG8:A�0�IV8� BD5038CMW?�M=OB03254%� MW<CK 6R4;I .=?GX�M=OB03254 4$#L� MW?547? 038c.=<L¨!478CSW2U0 O .=9 0�M=I!.=A 6RM XG47<:8:?5S 8C03AA�038�Í ?547A3A M=I A347<CO < IJ4!� 47<c<C47?G9 4�� T 254��B.1IJ.=6R4;0�4;I � 8cA!032G4aA�0�I347?5S=032 M=O%03254 A�47<CO < I34!� 47<:<C47?G9 4�� >@0 8cA�� ?5Mp¨ ?032G.10

<:8:6� " � � �� �� � � �� ( - � y � { @ �*g � y � { / ��. � + Y � � � d

O M=I A�MW6R4�9 MW?BA�03.=? 0 � y � {\�B9;.=<:<C47X 032G4����\¶ R��S�,���^�N�d�h�I²�²��aM=O%03254@� MW<CK 6R4;I�� SW8CH=47?5 UK� y � { + A A�0 � �� 3

y � 4;4K?@� H1.=? X54;I�§ M=O A�03.=XB� ��� X547? §bMW<:<:.=?GXG4;I .=?GXºCD��nÏxMW?B8CS y Y >�>�; {\��{ T 254Ì� I3Mp¨ ?G8:.=?�6(M=038CMW?9 M=I3I347A�� MW?BXGA 0�M � + d .=?GX 2G.=A 5;4;IJM A-� 4;47XB�

:=\

Page 37: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� � ������� ���� � ���� � ���������� ��� � �M�c��� W ���,�����L���1�^�N�Â��� Æ�²���²��v�^�N����²�È��9���^�^��� O M=Ia.��GI3M 9 47A3A�� y ( {�¨ 8C032 H .=<cD547A 8:? [ � 8:AF.=? 4 !UDG.1038:MW? M=O!03254O M=IJ6

� � " y ( { +�� " y ( g � � { �*( /#�� ��� " � y ( g � � { � b � y ( { y $ + Y g �� g ] { 3 y [ �:Y={

§b4;I34�� b�y ( { + ycb � y ( {hg b ( y ( {hg �� g b # y ( {-{(8:A .=? > < XG8:6R47?GAJ8CMW?G.=<%� I3M=¨ ?B8:.=? 6RM=038:MW?B�`8N� 4���� .=? > <03DI�B<:4�M=O 8c?GX54!� 47?GX547?U0l� I3Mp¨ ?G8:.=? 6RM=038CMW?GA MW? [0� T 2G4�O DG?B9 038CMW?GA � " .=?GX " � O I3MW6 [�� [ � 0�MP[¿¨ 8C032$ + Y g ] g 3�3�3 g ] .=?GX � + Y g ] g 3�3�3 g > O M=IV6 .�¸B47<:X � M=O ]`< H=479 0�M=IVA .=?GX .d¸,47<:X M=O ] � > < 6(.10�IV8:9 47A!�W �GI3M 9 47A3A�� ( � ( ycb g - d g�� .±{*O M=I�¨ 2B8:9J2 y [ �:Y={ 25MW<:XBA*8:A 9;.=<c<C47X .5�1�^�-����³Â�!���Ë�L�^�N��� M=O 03254#4 !UDB.1038CMW?B�> ? 6RM=IJ4��B8c9 0�M=IJ8:.=<B<c.=?5SWDG.1S=4�� A3DG9J2N."A�MW<:D5038:MW? 8:A!9;.=<:<C47XN.=? �1���Vj��� Æ���\�N���d¨ 8C032����1� �� � .=?GX���� Æ����1�^���Rg���^�1� � �� �>@?/032G8:A A�479 038:MW?z¨ 4RA32G.=<:<�O M=IJ6#DB<:.10�4R. IJ47A3DG<C0FMW?/03254"4$# 8:A30�47?G9 4R.=?GX/03254RDG?G8<! D547?547A3A M=O`>@0p®M <XG8�Í DGA38:MW?GA!� >@0Y¨ 8c<:<Z 4 9 MW?UH=47?G8C47?U0#0�M 476Q�,<CM K 03254NO MW<:<CM=¨b8:?5S ?5M=03.1038:MW? O M=I�03254N?GM=IJ6(A#MW? H=479 0�M=IJA.=?GX 6 .10�IJ8:9 47A�&

) � ) ( & + ��" ��� �

(" y � ( [ � { ) ) ( & + ��" ���

#�� ��� (" � + ( -9y � { y ( [ ��� # { 3WF<:A�MI�!¨ 4'¨!MWDB<:Xa<:8��=4 0�Mb03.��=4!8:?U0�M*.=9;9 MWDG?U0�.=?a8:?B8C038:.=<19 MW?GXG8C038:MW? � y d { + D@�!¨b254;I34 D 8:A .=?`[ � < H1.=<:D547XIJ.=?GXGMW6 H1.1IJ8:.� B<:4�8:?GX54!� 47?GXG47? 0*M=O`03254�� I3Mp¨ ?G8:.=?/6RM=038CMW?8�SWF<:< 8c? .=<:<N�3¨!4�47?G<:.1IJS=4#MWD5I|�GI3M� ,.� B8:<:8C0 KA-�B.=9 4R.=?GX/MWD5I A-�,.=9 4RM=O`.=XG.��G0�47X��GIJM 9 47A3A347A .=AbO MW<:<CMp¨ A!�SC 4(9J25M MWA�4(.��GI3M� ,.� B8:<:8C0 K 6R47.=A3D5I34 $ MW?[ � .=?GX��BD50 � � & + [ � � � #

� �� & +� y [ � { ��� #� y ( ( - d g�� .±{+ � & + $ + �

# D & � � , [ � & y � g � { *, ��

� ( ycb g - d g�� .±{ � & + ��� (&� ( y [ � g $�{ � ( y �:g�� � g + { � # � ( - d g�� . [ � �� *, � d� " y � { 8:A�� �� < 6R47.=A3DGIJ.� B<C4 � 3

T 2G8cA�9J2G.=?5S=4�M=O ?GM=03.1038CMW?� 478:?5SRDG?GXG4;IJA�0�M M XB�L¨ 4�A32G.=<c< XGI3M�� 03254q�GIV8:6R47A�.1SW.=8:?B�à �N7 3 =���3��9� 4�MKi�Y ��$�S�G

G 5G�!�v���!% à �N7 fl) S�� � d #�¯la�+ � & - d g�� . � [ � , [ � J�2`_ & - d g�� . �0[ � , [ ��� # ]La¥4�a�J�b=t�[\JI]�(ea¤jt�2`/=+N)e&�29b��Ib\JL+N)*b�¤*iI)*2Iw�+NMSa�w�[1&�»�+NMk/1&�2`_�)h+N)e&�29b) � y ( g � { ) � ) y ( g � { ) J � y Y / ) � ) { y ( ( - d g�� . � � ( [ � {J�bE»Za1(*(8J�bY+NM3a|¯G) c8b�/sM9)h+��Y/1&�2B_�),+N)e&�29b) � y ( g � { @�� y ( g��I{ ) � ) y ( g � { @ y ( g��9{ ) J X ) � @ � ) y ( ( - d g�� . � � g�� ( [ � {hg

:=[

Page 38: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

¤N&p[%b1&�4�a c¢&�b�),+N),�=a|/1&�2vb�+,J�23+Nb��«J�2B_ XK#L¯la�+ ycb � { � 3�� � ��� ]Ia > ~�_�)*4�a129b�)e&�2vJ�(M- [1&�»'2v)¦J�2�4�&+N)e&�25J�2`_(ea�+"$�]IaZJ c`[1&L]�JI]�)*(*),+�iq4�a�J�bpt�[1a &�2P[ � »')h+NM � � ) � ) ( $ y �� { +*¾#I¡¢M3a12�+NM3a¥b�+h&L/jMvJ�b�+N)^/%_�) �Ba\[1a12S+N)¦J�(a��9t�JL+N)e&�2 � A�# 0 ��MvJ�b�JÌt�29) �It¬a@/1&�2S+N)*2`t¬&Lt�b�J�_LJ!cZ+ha=_�b\&�(�tI+N)e&�2 � y ( { w¬)h�=a12�+NMvJL+�+NM3a�(¦J¬»�&�¤ � y d {�)*ba��9t�J�('+h&�$'#

�@�����v� � T 254q�GIJMUM=O%9 MW6R47A 8:? 032GI34;4@�B.1I303A��� ���l�9�NÈ!�v²��S²����!��� DI�v� MWA34 � g � ( � ( ycb g - d g�� .±{".1I34 A�MW<cD5038CMW?GA�M=O y [ �:Y={d¨ 8:032 9 MW?U038:? D5MWDGAQ�,.1032GA!�y A MW?U038:? DG8C0LK�¨ 8:<c<3 4��GI3M H=47X 8:?Â�,.1I30 : {\�3m!D50

� � " y ( { & + � " y ( g � � { @�� " y ( g � � {� " � y ( { & + " � y ( g � � { @ " � y ( g � � { 3W��9�B<CK 8:?5S 03254 8:?G4 !UDG.=<c8C0LK y ' / � { ( J ]Iy ' ( / � ( {aO M=I�IJ47.=<!? DG6Y 4;IVA 'Z.=?BX � �%03254N8c?GX54!� 47?GX547?G9 4M=O 03254�9 MW6Q� MW?547?U03AbM=O bÂy ( {\�B032G4QA .=DB9J2UK < � 9V2¬¨ .1I25R8:?54 ! DG.=<:8:0LK y � �� � y L { � L { (eJ ( � �� � y L { ( � L O M=I .=?� (\< O DG?G9 038CMW? �v� 03254b6�DG<C038 < XG8:6R47?GAJ8CMW?G.=< > 0p®M < 8cA�MW6R4;0�I3K .=?BXg¸,?B.=<:<CK�03254|o�8��BA39V2G8C0 5 9 MW?BXG8C038CMW?B�¬¨!4�¸,?GX

a � ) � ��@ � � ) ( & +��" ���

a �py � " y ( { @ � " y ( {-{ ( �

+��" ���

a����� � �

� � � " y L { � L /#�� ��� � �

� � " � y L { � b � y L {��� ( ��J ] ��

" ���a�� � � �

� � � " y L { � L � ( /�� #�� ��� � �

� � " � y L { � b � y L { �� ( ��+ ] ��

" ���a � � � �

� � � " y L { � L � ( � / ] ��" ���

a�� #�� ��� � �

� y � " � y L {-{ ( � L ��J ] ( � �

� a � ��" ���

� � " y L { ( � � L / ] � �� a

�� ��" ���

#�� ��� � " � y L { ( �� � L

+ ] ( � �� a y ) � � y L { ) ( { � L / ] � �

� a y ) � y L { ) ( { � LJ ]Iy ( / Y={ X ( � �

� a ) � H @ � H ) ( � L 3� MR03254�O DG?B9 038CMW? W & ( *, a � ) � ��@ � � ) ( AJ.1038:Aj¸B47A 03254#8:? 0�4;S=IV.=< 8:?54 ! DG.=<:8C0 K

dNJ W y ( { J � �� W y L { � L y ( ( - d g�� .±{ y [ � ] {

O M=I*03254�9 MW?GA303.=? 0 + ] X ( y � / Y={\�� �!%_% #kÃ��*­ � ;����3�� #KiK� ^K±�!%_% # � rj23a��9t�J�(*),+�i � A�#XO���)*4EcB(¦)ea1b�+NM3JL+�W + d #

:�;

Page 39: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

�@�����v� � m`D50�� y ( { + � �� W y L { � L � T 2G47?�� y ( {�8:A�A � .=?GX�� �^y ( { + W y ( { J �� y ( {\� T 254;I34;O M=I34��( � 4

� ��� � y ( { � + 4 � ��� y W y ( { @ �� y ( {-{ J d 3� 8:?B9 4�� y d { + d � 8C0"O MW<c<CM=¨ A�032G.10R4 � ��� � y ( { J d 8:6Q�B<:K 8:?GS�� y ( { J d �¥� M�¨!4 2B.7H=4 d J W y ( { J�� y ( { J d .=?GX 2G47?G9 4PW y ( { + d �

T 2UDBA!�I¨!4#2G.7H=4`a � ) � ��@ � � ) ( + d O M=I .=<:< ( ( - d g�� .,�G>@?5�B.1I3038:9;DG<c.1I��� ( ( - d g�� . � � & � � y � { + � � y � {!O M=IF.=<:6RMWA�0*.=<:< � 3PbM=¨ <:4;01 & + � � ( � � � ( ( - d g�� .�� � & � � y � { #+ � � y � { � 3T 2547? 1 8:A`.a9 MWDG?U03.� B<C4 DG?B8CMW?"M=O ?UDG<c<5A�4;03A!� A�M + y 1 { + d �¬�5M=I � 1 ¨ 4 2G.7H=4bO M=I .=<:< ( ( - d g�� . ���q�

� � y � { + � � y � { g.=?GX A38:?G9 4 � � .=?GX � � 2G.7H=4 9 MW?U038:? D5MWDGAY�B.1032GAY¨!4 9 MW?G9;<:DGXG4 032G.10�O M=I".=<:6RMWA30#.=<:< � 03254 4 !UDB.=<:8C0LK4$# 0�47?GXGA�0�M .=<c< ( ( - d g�� .,� T 2G8cA�9 MW6Q�B<C4;0�47A 03254q�GI3M M=O�M=O DG?G8 !UD547?G47A3A!�� �GÇ ���e�1�h²!�3�\²=�9C 4�A32G.=<:<3¸,?GX . A�MW<:D5038CMW? M=O y [ �:Y={% K 8C0�4;IJ.1038:?GSR03254a6(.��

� ( ycb g - d g�� .±{ , � ( ycb g - d g�� .±{ & � , E�X54�¸,?G47X UK

E� ��+ D / � �� � y L g � H\{ � L /

� �� y L g � H�{ � b H 3

o 4;0bDGA*A�03.1I300¨b8C032 03254a9 MW?GA303.=? 0��GI3M 9 47A3A � �� & + D@�G.=?BX X54�¸,?54 IJ479;D5IJA38CH=47<:K� � � � �� & + E� � �� y � ^ d { 3

T 254a9;.=<c9;DG<:.1038CMW? 8:?5�B.1I30aYa9;.=?� 4aDGA347X 0�M 9 MW?G9;<:DBX54 032G.10a � E� � @ E� � ( � J � �

� a � ) � H @ � H ) ( � L O M=Ib.=?UK � H g � H ( � ( ycb { 3>@0�4;IJ.1038CMW? M=O%032G8:A IJ47A3DG<C0�K 8C47<:XGA��UO M=I � ^ Y�.=?GX 03254�9V25MW8:9 4 E� � + E� � �� .=?GX E� � + E� � � � �� �

a � � � � � �� @ � � �� ( � + a � E� � �� @ E� � � � �� ( �J � �

� a � � � �H @ � � � � �H ( � � LJ � � �

� � L � � � � H � � �� � L � � ( �� � H �

� � L � a � � � �H � @ D ( �J � ( �� � � y ( ( - d g�� .±{hg

:�T

Page 40: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

¨ 254;IJ4q¨!4�8c?GA�4;I30E�� � �H � + D / � �

� � y L ghD�{ � L /� �� y L ghD�{ � b H

.=?GX�� 8:A SW8:H=47?5 K� & + A3D9�

� 3�� � � � a� � �

� � y L ghD�{ � L / � �� y L ghD|{ � b H

( �

J ] A3D9�� 3�� � � � � a � � �

� � y L ghD|{ � L ( � / a � � �

� y L ghD�{ � b H ( � �

J ] � ( � ( a y Y / ) D ) { ( / ] ��� ( a y Y / ) D ) { (J ] � ( y � ( / ��{ a y Y / ) D ) { ( g

¨ 2G8c9J2�8:A8¸ ?G8C0�4¥ Ka03254 S=I3Mp¨*032"9 MW?GXG8C038:MW?#.=?GX�03254 I34 ! DG8CI3476(47? 0�032G.10�D 2G.=A�¸,?G8:0�4`H1.1IJ8:.=?G9 4��1P Mp¨�<C4;0� + � (�ycb g - d g�� .±{-{ < <:8:6 � " � �

� � � T 254 4$# 8:A30�47?G9 4 M=O 032G8:A <:8:6 8C0`O MW<:<CMp¨ A¥ 479;.=DGA34 �T��� � ( � � � � * y A .=DB9J2UK A34 !UD547?B9 4p{\� T 2547?E� + � � ( ycb g - d g�� .±{ < <:8c6� " � �

� � � E + � ( ycb g - d g�� .±{ < <:8:6� " � ��� � � � + � 3

� M � 8:A�.(A�MW<cD5038CMW? M=O y [ �:Y={\�� ���Z���v�^�±�9�L�±�^¶5���S�5�����\�`�h²����S²����!�G� K T 2G4;M=I3476 V � \ 03254��B.1032GA ( *, � � y � { 9;.=?Ì 4#.=AJA3DG6R47X 0�M� 49 MW?U038:?UDGMWDGA O M=Ib.=<:6RMWA�0�.=<:< � ( �q� T 254 O .=9 0*032B.10�03254aA�MW<:D5038:MW?N8cA�.=XG.��G0�47X 8:A�8:6 6R47XG8:.10�4 O I3MW6&032549 MW?GA�0�IVDG9 038CMW?B�

à �¦­ �!# �º ��Ki�Y ����S�G C�2G.10�¨ 4 2B.7H=4 A325Mp¨ ? 8:?¾� 479 038CMW? [ �:Y 8cA(032G.10 03254;I34/4$# 8:A303A .¿�1�^�-����³ �!���Ë�L�^�N����M=O y [ �:Y={\��8N� 4���� .A�MW<:DG038CMW?R032G.10 8:A`.=?N.=XG.��G0�47X O DG?G9 038CMW?G.=<GM=O 03254�� I3Mp¨ ?G8:.=? 6RM=038CMW?B�U>@? 03254b<:8:0�4;IJ.103D5I34*MW?NA�0�M 9J2G.=A3038:9XG8�Í 4;I347?U038:.=<54 ! DG.1038CMW?GA!M=O 0�47? .�XG8�Í 4;I347?U0'� MW8:? 0`M=O H 8C4!¨�8:A 03.��=47?8� ?B.=6R47<CK"MW?54�¨b254;I34 032G4�� I3M=¨b?G8:.=?6RM=038CMW?N8C03A�47<:O 8:A`.=<:A3M�9 MW?GAJ8:X54;I347XNDG?I� ?5M=¨b?B� T 2G8cA`<C47.=XGA!0�M".#A�M < 9;.=<c<C47XKÊ�²����Y�����Ë�I�^�^��� M=O A�0�M 9J2G.=A3038:9XG8�Í 4;I347?U038:.=< 4 ! DG.1038CMW?GA!�G8,� 4����B.(A�MW<:DG038CMW? 8:? XG8:A30�IJ8� BD5038:MW?B����Nn¢�"�$ ����3� � W Ê�²����K�!���Ë�L�^�N��� M=O y [ �:Y={R8cA�.��,.=8CI ycb � g � � {\� 6R47.=A3D5IJ.� ,<C4�¨E� I�� 0!� A�MW6R4¸,<:0�IJ.1038CMW?y� � { � 3�� � ��� MW? A�MW6R4��GIJM� B.� B8:<:8:0LK A-�B.=9 4 y ��� � � + {\�*A3DG9V2�032G.10 b � 8:A > < XG8c6R47?GA38CMW?B.=<�� I3M=¨b?G8:.=?6RM=038CMW? .=?GX A3DG9V2 032G.10 y [ �:Y={*25MW<:XGA��

T 254q�=4;KÂ� MW8:? 0�254;IJ4�8:A 032G.10*032G4�¸,<C0�IJ.1038CMW? ?G4;47X ?5M=0� 4 y � � { � 3�� � � � + y-ycb H�{ H 3�� � � � {h&G8CO 8C0*8:A!�032547?�¨ 4�2G. H=4#.RA�0�IJMW?5S A�MW<:DG038CMW?B����Nn¢�"�$ ����3� �

Y��B�3�^�-����³Â�L�9�NÈ!�v²��`²1��� 8:A�DG?G8 !UD547?G47A3A M=O . A�0�I3MW?5S(A�MW<cD5038CMW?B�] �%-z²����g��v�^È��9²!�S²1�\� 25MW<cXGA�8CO�.=<c<`¨!47.�� A�MW<:DG038CMW?GA�2G. H=4�03254aA3.=6(4�<:.�¨E�

:�>

Page 41: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

�!K 03254 O MW<:<CMp¨ 8:?5S"4$#5.=6Q�B<C4q¨ 4�8:<c<:DGA�0�IJ.10�4 03254aXB8�Í 4;IJ47?G9 4q 4;0h¨ 4;47? 032547A�4�0h¨ M 9 MW?G9 4!�G03A����� #%'`"K±��à �N79��� � G #v��# ��# � � T 2G8:A`4$# .=6Q�,<C4F8cA`I347<c.10�47X 0�M"MWD5I 4$#5.=6Q�B<C4bM=OG� I3M=¨ ?B8:.=? <:M 9;.=< 038:6R4F8:?� 479 038CMW? \ � V �3o 4;0 b � 4 .g� I3Mp¨ ?G8:.=? 6(M=038CMW? .=?GX XG4�¸,?54

Eb � & +� �� A�SW? ycb H\{ � b H 3

� 8:?B9 4 � Eb � + A�SW? ycb � { � b � ¨ 4�2G. H=4��v K >@0p®M�� A*O M=IJ6�DG<:."8:?�o 476(6(. \ � V �� y Eb (� { + ] Eb � � Eb � /�y � Eb � { (

¨ 8C032 y � Eb � { ( + A�SW? ycb � { ( y � b � { ( + y � b � { ( + �( ��§b47?G9 4 Eb � 8:A . 6(.1I3038:?5SW.=<:4K¨b8C032 !UDG.=XGIJ.1038:9H1.1IJ8:.1038CMW? ( y A�4;4�� 479 038CMW? ] � V {h&Eb (� @ ] � �

� Eb H � Eb H + ( 3� 8:?B9 4 Eb � A3.1038:A-¸B47A 03254 I34 ! DG8CIJ476R47? 03A yi��� 7{ USyi��� Rv{ M=Og� 479 038CMW? Y��*8C0 6�DGA�0� 4 . � I3M=¨b?G8:.=?6RM=038CMW?8�

T D5IV?G8:?5S"6(.10�0�4;IJAb.1I3MWDG?GXB� b � 8:A�8:03A�47<CO .RA�MW<:D5038CMW? M=O 03254aA30�M 9V2G.=A�038:9#XG8�Í 4;I347? 038c.=<,4 ! DG.1038CMW?� b ��+ A3SW? ycb � { � Eb � g y [ � : {

A38:?B9 4 b � + ���� � b H + ���� A�SW? ycb H\{ ( � b H + � �� A�SW? ycb H\{ � Eb H=��� 479;.=DGA�4 4;H=4;I3K A�MW<cD5038CMW? M=O y [ � : { 8:A.�� I3Mp¨ ?G8:.=?�6RM=038CMW?8�¥¨ 4 2G. H=4K¨ 47.�� DG?B8<!UDG47?547A3A!�'§bM=¨ 4;H=4;I��% 479;.=DGA�4 @ b � M� UH 8CMWDGAJ<CK 8cA .=<:A�M .A�MW<:DG038CMW?/M=O y [ � : {\� 03254;IJ4(.1I34"0h¨ M A�MW<:D5038:MW?GA M=O y [ � : {FO M=I . SW8CH=47?��GI3M 9 47A3ATEb � � >@?/M=03254;I@¨ M=IJXGA��3¨ 4X5M(?5M=0b2G.7H=4�A30�I3MW?5S DG?B8<!UDG47?547A3A!�T .�� 8:?5SR032G8cA�.1I3SWDG6R47?U0*MW?54�A30�4!� O DGI303254;I0¨ 4q¸,?GX y 9 Os� T 254;M=IJ476 \ � [ {h&

Eb�y ( { + � b�y ( { � @ � b�y d { � @ � � g¨ 254;IJ4 � � 8:A 03254#<CM 9;.=< 038c6R4a.10*03254aM=IV8CSW8:?B�I� K 8C03A*X54�¸,?B8C038CMW?B� � � 8:A�.=XB.��G0�47X 0�M(032G4�¸,<C0�IJ.1038CMW?

y� � { � 3�� � ���S=47?54;IJ.10�47XÌ UK y � b � � { � 3�� � ��� �3§ 47?G9 4#A�M(8:A Eb � �G>@0*O MW<c<CM=¨ A 032B.10 E� � Z � � �I¨ 254;I34

y E� � { � 3�� � � �8:A 03254d¸ <C0�IJ.1038CMW? S=47?54;IV.10�47Xµ K y Eb � { � 3�� � � � �8§bM=¨ 4;H=4;I��%A38:?G9 4 b � 8:A ?5M=0 � � < 6R47.=A3DGIJ.� B<C4 y 8C03AaAJ8CSW? 8:A?5M=0 XG4;0�4;IJ6(8:?547X K � � {\�,8C0�8:A*?5M=0 E� � < 6R47.=AJD5IJ.� B<C4��

P M=0�4(032B.10 y [ � : { 8:A .=? >@0p®M < XG8�Í DGA38CMW?K¨ 8:032 � y ( g � { + d .=?GX y ( g � { + A�SW? y � {\� T 2G4"<c.10�0�4;I�8:A?5M=0�o�8��BA39V2G8C0 5��L¨ 2G8c9J2 8:A0¨b2 K T 254;M=I3476 [ �:YaX5M 47A*?5M=0 .��9�,<CK��

VWd

Page 42: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� � ������$� ��0�\ c��� �� �Y�� � � �����=�>���� � �� �� �=���,���\T 254�S=MW.=< M=O 032G8cA A�479 038CMW?/8:A 0�M SW8CH=4�.(O DG?G9 038CMW?G.=<�.=?G.=<CK 038:9aX547AJ9 IJ8��G038CMW? M=O%>@0p®M < XG8�Í DGA38:MW?GA�032G.10|¨ 8:<:<.=<:<CMp¨ DGA�0�MÏ GIJ8:?5S�� M=¨ 4;I3O DG< .=?G.=<CK 038:9 0�M MW<:A*8:?U0�Mg�B<:. K��� �N7 ���� =��������� ����3�&#v��� %'�( �� �:#: ����S�WF? >@0p®M < XG8�Í DGA38CMW? � d� y ¨ 8C032 8:?G8C038:.=< 9 MW?BXG8C038CMW? � d� + � ( [ � {*8:A*. - .1I��=M H5�GI3M 9 47A3Ab8:? 9 MW?U038:?UDGMWDGA038:6R4�� >@OI¨!4 A3DI�9� MWA�4`032G.10�032G4¥¸B47<cX � M=OGXGIJ8CO 0 H=479 0�M=IJA .=?GX#03254¥¸B47<:X M=OBXG8�Í DGAJ8CMW?a6(.10�IJ8c9 47A%.1IJ4� M=032038:6R4 < 8c?GX54!� 47?GX547?U0!� 8,� 4������ d� 8:A 032G4aA�MW<:D5038CMW? A303.1I3038:?5S(.10 � M=O 03254aA�0�M 9J2G.=A�038c9aXG8�Í 4;I347?U038:.=< 4 !UDB.1038CMW?

� � � + � y � � { �*( / y � � { � b � y,; �:Y={y ¨ 254;IJ4 � .=?BX A3.1038:A�O K 03254�S=I3Mp¨*032 .=?GX 032G4�o�8��BA39V2G8C0 5#9 MW?BXG8C038CMW?GAb6R47?U038CMW?547X/8:? T 254;M=I3476 [ �:Y={\�032547? 032G8:Aa-/.1I��=M H��GI3M 9 47A3A�8:A#A�03.1038CMW?G.1IJK y + 038:6R4 < 2GMW6RM=S=47?54;MWDGA\{a.=?GX 9;.=?� 4 9J2G.1IV.=9 0�4;IJ8:A�47X£ UK8C03A�0�IV.=?GA38C038CMW?Â�BI3M� B.� B8:<c8C038C47A

� � y � g b { & + +%- � d� ( b . y ( ^ d {hg¨ 254;IJ4 b IJDG?GA 0325I3MWD5SW2�03254�� M=I347< A3DI BA34;03A M=OU[ � � T 2547A�4/0�IJ.=?GAJ8C038CMW? �GI3M� B.� B8c<:8C038C47A(AJ.1038:A�O K�03254MW?54 < �B.1IV.=6R4;0�4;IqA�2G.��B6(.=? < naMW<:6RM=S=M=I3M H 4 ! DG.1038CMW?

� � � H y � g b { + �� 3 � � � y � g � �I{�� H y ��g b { 3 y,; � ] {

WF? .=<C0�4;IJ?G.1038:H=4@¨ . K 0�M 9J2B.1IJ.=9 0�4;IJ8:A�4�.=? >@0p®M < XG8�Í DGA38CMW? 8:A� UK 8C03A*.=9 038:MW? MW? .(AJD % 9;8C47?U03<CK IV8:9J2 9;<c.=A3AM=O O DB?G9 038CMW?GA W &[ � , [ � �,Pb.=6R47<:K��B8COG¨ 4�X54�¸ ?54 ) � UKy ) � W8{ y � { & + a y W y � d� {-{ +

�� 3 � � � y � g � �9{4W y �I{hg y,; � : {

032547? y,; � ] {*<C47.=XGA�0�M

) � � H + ) �� ) H g y,; � V {

8N� 4����503254 0�IJ.=?BA�O M=IV6(.1038CMW?GA y ) � { �� � O M=IJ6 .5���S²�V*�L���j� Rϲ��h²��@��²$Rd��³��-���p�3�S� DG9V2 ."A�476(8CS=I3MWD9� 8cA XG4;0�4;I <6(8:?G47X UK 8C03A�³²��S²!�j���,��� E�BXG4�¸,?547X K:W & + <:8:6� � �

Y( y ) � W @ W8{�g y,; � \ {

¨ 2G8c9J2 X547A39 IJ8* 47A 03254 .=9 038CMW? M=O 03254aA�476 8CS=I3MWDI� M H=4;IF8:?L¸,?B8C0�47A38:6(.=<G038:6R4 8:?U0�4;I3H .=<cA!� >@?¨ 2B.10 O MW<:<CMp¨ A¨ 4 6 .��=4 032G4 .� M H=4 M� ,A�4;I3H1.1038CMW?GA 6RM=I34%�GI3479;8cA�4!.=?GX�¨ 4�A�03DGX5K 03254�8:?U0�4;I��B<c.7Kq 4;0h¨ 4;47?"03254�XG8�Í DGA38CMW?� d� �B8:03A�S=47?54;IJ.10�M=I� .=?BX 8C03A*A�476(8:S=I3MWDI� y ) � { �� � �� �¦­ � #v 4�±V`l���M`'���� ��±� o 4;0 ( ^ d ��.=?BX O M=I L ^ ( <C4;0�� � dH X547?5M=0�4(03254 A�MW<:D5038CMW? M=O 03254 A�0�M 9V2G.=A�038:9 XG8�Í 4;I347?U038:.=< 4 !UDB.1038CMW?y,; �:Y={%¨b8C032 8:?G8C038c.=< 9 MW?BXG8C038CMW? � � d� + � �� �!%_% # � �^7 � 3 4#: ����3��#9�6�$ Jm � ¡¢MSaYcB[1&L/1a1b�b\a1b L *, � � dH J�2`_ L *, � dH � � J�[1a�a��It¬J�(0)*2 (¦J�»Á¤N&p[LP^ ( #

V Y

Page 43: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

�@�����v� � T 2547A�4q�BI3M 9 47AJA�47A*.1I34�A3MW<:D5038CMW?GA M=O%03254a4 ! DG.1038CMW?BA� � � dH +�� y � � dH { � L / y � � dH { � ycb H @ b � {� � dH � � +�� y � dH � � { � L / y � dH � � { � ycb H � � {

I347A-� 479 038CH=47<:K��5O M=I LP^ ( �v� 8:?G9 4 b H @ b � .=?GX b H � � .1I34Y�!IJM=¨ ?G8c.=? 6RM=038CMW?GA MW? - ( g�� .,�9 M=032 A�03.1IJ038:?5S.10 d � 03254(0h¨ MÌ�BI3M 9 47AJA�47A�2G. H=4 03254 A3.=6R4 <:.=¨ Kz¨ 47.��ZDG?G8 !UD547?G47A3A y ¨ 2G8:9V2Z8:A 8:6g�B<:8C47XK K A30�I3MW?5SDG?G8 !UD547?G47A3A M� G03.=8:?547X 8c? T 254;M=I3476 [ �:Y={\��

�@���` �3 4�$ ����3� � �¦­ � � #9���� � `����`¥���� Jm � ¯la�+�� d� y ( ^ d {�_La12S&+ha�+NM3a�b1&�(htI+N)e&�2¿&�¤ � +�# 0 �k»'),+NM)*29)h+N)¦J�(�/1&�2B_�),+N)e&�2 � d� + � #Qfl) S ( ^ d #Z¯¢a�+ � � y [ � {Â]IaK+NM3a�b�c8J�/1a5&�¤�J�(*(|/1&�23+N)¦2St¬&Lt�bQ¤st�2B/=+N)e&�29b[ � , [¿+NMvJL+�+ha12`_Y+h&gU%JL+9)*2I¼v2v),+�i�#�¡¢M3a12E¤^&p[�J�(¦( L ^ d +NM3a�/1&�2`_),+N)e&�2vJ�(¬aTS�cZa=/=+,JL+N)e&�2`a y W y � d� � H { � � � {_LajcZa12`_�b�&�2 � ( �·&�29(Ëik�p)eJ � d� #Lrj25¤±J�/=+ �

a y W y � d� � H { � � � { + y ) H W8{ y � d� { 3�@�����v� � � 8 # ( ^ d �v�GM=I � ( [ � .=?BX L ^ ( �B<C4;0

� H y �9{ & + � � �H � � 3T 2547?8�G.=9;9 M=IJXG8:?5SR0�M�o 476(6(. ; �:Y�� �'H y �I{�.=?GX � �H 2G.7H=4�03254�A3.=6R4#<:.�¨@�9§b47?G9 4��GO M=Ib.=<c<=W (�� � y [ � {\�

a y W y �'H y �I{-{-{ + a y W y � �H {-{ + y ) HhW8{ y �I{ 3� ? 032G4 M=03254;I 2G.=?BXB� 03254 IJ.=?BX5MW6 H1.1IJ8:.� B<C4 � H y �9{"X54!� 47?GXGA�MW? � ( �&MW?G<CK H 8c. 03254Ì� I3M=¨b?G8:.=?6RM=038CMW? # *, b��vy � { @ b � y � { O M=I�# ^ ( �GA�M �'H y �I{ 8cA�A�0�M 9V2G.=A�038:9;.=<c<CKN8c?GX54!� 47?GX547?U0!M=O � � �9� KNA30�I3MW?5SDG?G8 !UD547?G47A3A ¨!4�6�DGA�0*2B.7H=4��BO M=I LP^ d �

� H y � d� { + � d� � H .L� A����A38:?B9 4� M=032 A38:XG47A .1IJ4 A3MW<:D5038CMW?GA!M=O%03254 A3.=6R4 A�0�M 9J2G.=A�038c9 XG8�Í 4;I347? 038c.=<,4 ! DG.1038CMW? y,; �:Y={ O M=I LP^ d ¨ 8C0328:?G8:038:.=< 9 MW?GXG8C038CMW? � � y � d� { + � d� �vWbA�� d� 8:A�� � < 6R47.=AJD5IJ.� B<C4��I¨ 4�?5Mp¨ 2G. H=4

a � W y � d� � H � � � { � y � { + � � � 3 � W � � H y � d� y � {-{ y � � { � + y � � � { + y ) H W8{ y � d� y � {-{�g¨ 254;IJ4 � I34!�GI347A�47?U03A�03254�IJ.=?GX5MW6(?G47A3A% 4;O M=I34 038c6R4 ( .=?BX � � 032G4aIJ.=?GX5MW6 ?547A3A�.1O 0�4;I 038:6R4 ( �

���Nn¢�"�$ ����3� � o 4;0 4 .£� .=?B.=9J2�A-�B.=9 4��¥W��!���e�3�^��¶º�����3�^�e�9�9����z���`²$V¦�L���-� Rϲ!�h²��z�!²�Rd��³��j���p�D�� �����v�^�j�¬���^�N���I����� 8:A . O .=6(8:<CK y ) � { �� � M=O <:8:?547.1IbM�� 4;IV.10�M=IJA ) � & , A3.1038:A�O K 8:?5S 032G4#O MW<:<CMp¨ 8:?5SI34 ! DG8CI3476(47? 03A�&�O3 79� ) ) � W ) J ) W ) O M=Ib.=<:< ( ^ d ��W)( �O3 ­`� ) � W + W/O M=I .=<:<=W)( �O3 & � ) � � H + ) � � ) H�O M=I .=<:< ( g L ^ d �O3 P8�*032G4a6(.�� y ( g W8{ *, ) � W 8:A�Q�MW8:?U03<CKN9 MW?U038:? D5MWDGA - d g *¿{ � , �

V ]

Page 44: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

C 4#9V25M MWA�4 + � � y [ � {\� T 254a?G.103D5IJ.=< ?GM=IJ6 MW? 032G8cA�A-�B.=9 4�8:A*03254aA3DI�GIJ476#DG6 ?GM=IJ6) W ) & + A3D9�d 3 � � W y � { � 3�5M=I:W)()� � y [ � { ¨ 4aX54�¸,?G4

y ) � W8{ y � { & + a y W y � d� {-{'g¨ 254;IJ4 � d� y ( ^ d { X547?5M=0�47A 03254aA�MW<:DG038CMW? M=O y,; �:Y={%¨ 8C032 8c?G8C038:.=< 9 MW?GXG8:038CMW? � d� + � �G 5G�!�v���!% � � & ¡¢M3aQ&�cZa\[\JL+h&p[�b ) � »'),+NM ( ^ d ¤^&p[\4 J��!&�)*23+N(�i£/1&�2S+N)*2St�&Lt�b�&�23a�~�cGJ�[\J�4�a�+ha\[Yb1a14g)¦~w�[1&Lt�c£&�¤'/1&�2S+^[\J�/=+N)e&�29b�� � y [ � { , � � y [ � {1#�@�����v� � C 4@�GI3M H=4@�GI3M�� 4;I3038:47A Y U¬V 8:? _ 4�¸,?G8:038CMW? ; � ] �Y���� 8 # ( ^ d .=?GX W)()� � y [ � {\�¬C 4 A325Mp¨ 032G.10 03254bO DG?B9 038CMW? ) � W .1SW.=8:?N<:8C47A!8:?%� � y [ � {\�¬ K(A325Mp¨ 8:?5S032G.10 8C0F8:A 9 MW? 038:? D5MWDGA .=?GX 0�47?GXGAF0�M d .10 8c?L¸,?G8C0 K�� T 2G4�8:?G4 !UDG.=<c8C0LK ) ) � W ) J ) W ) 8:AbM� UH 8CMWDGAbO I3MW603254�XG4�¸,?G8C038CMW?NM=O ) � ��Z���v�^�±�9�L�^�^¶�É�A 25M MWA�4 � g�� ( [ � .=?GX/9 MW?GA38:XG4;Ib03254Y�GI3M 9 47A3A�47A�� d� .=?GX � �� � T 254Y B.=A38:9�47A�038:6(.10�4"8:?� 479 038CMW? [ �:YaK 8C47<:XGA

a ) � d� @ � �� ) ( J�] � ) � @ � ) ( / � �� a ) � dH @ � �H ) ( � L �

O M=I A�MW6R4�9 MW?BA�03.=? 0�E�9m!D50�038:?5S � y ( { & + � �� a ) � dH @ � �H ) ( � L �I¨ 4�6(. K�¨ IJ8C0�4 032G8:A�.=A��( � y ( { J ] ) � @ � ) ( /�] � y ( { 3

� M��( � � � ( ��� � y ( { J ] ) � @ � ) ( � � ( ��� 3

§b47?G9 4��B.=A � y d { + d �

�� ( ��� � y ( { J ) � @ � ) ( Y

�3Y @ � � ( ��� � gM=I

�� y ( { J ) � @ � ) ( � � ( ��� @ Y � 3C 4�032 DGA�M� B03.=8:? 032G.10

a ) � d� @ � �� ) ( J ] ) � @ � ) ( / ] �� y ( { J ] ) � @ � ) ( � ( ��� 3 y,; � [ {PbM=¨ 9V25M MWA�4�� � d �S� 8:?B9 4`W 8cA�DG?G8CO M=IJ6(<CK 9 MW? 038:? D5MWDGA*MW? [ � �5032G4;I34a4$#58:A�03A*. � � � d A3DB9J2 032G.10

� � � g�� � ( [ � & ) � � @ � � ) J � � + � � W y � � { @ W y � � { � J �] 3

V¬:

Page 45: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

>@0�O MW<:<:M=¨ A�032B.10*O M=I � g�� ( [ � ?GM=0 6RM=I34 032G.=? �U& + � � � � � � ��� � ] � ] ) W ) .��,.1I300¨!4#6(.7K 47A�038:6 .10�4��� y ) � W8{ y � { @ y ) � W8{ y �9{ ��� + ��� a y W y � d� {-{ @ a y W y � �� {-{ ���J a � W y � d� { @ W y � �� { �J �

] / ] ) W ) + � ) � d� @ � �� ) � � � �J �

] /½V ) W ) Yy � � { ( � ( ��� ) � @ � ) (

�g¨ 254;IJ4N032G4 032G8CIJX 8:?54 ! DG.=<:8C0 K DGA�47A"032G4 -/.1I��=M H 8c?54 !UDB.=<:8C0LK .=?GX y,; � [ {\�¥C 4 9 MW?G9;<cDGX54 032G.10 ) � W�8:ADG?G8:O M=IJ6 <CK(9 MW? 038c?UD5MWDBA*.=A�¨ 47<:<N��%���3�-�������¾�,���£���Y�±� O'�v�±�^¶�&`>@0 A3D % 9 47A 0�M��BI3M H=4 032G.10 03254;IJ4 4$#58:A�03A . � � d A3DG9V2 032G.10 O M=IN.=<:<( ( - d g � .�¨ 4a2G.7H=4

<c8:6� d � " � y ) � W8{ y � { + d 3

> ?GX54;47XB� 03254RA3.=6R4R032G47? 25MW<:XGAFO M=Ia.=<:< ( K 03254(A�476 8CS=I3MWDI���GI3M�� 4;I30 K��B§ 47D5IV8:A�038:9;.=<:<:K A-� 47.�� 8:?GSI�3¨ 46�DGA�0��GI3M H=4 032G.10�03254 XG8�Í DGA38CMW? 9;.=?G?5M=0�47A39;.�� 4 0�M 8c?L¸,?G8C0 K/8c? .̸,?G8C0�4 038:6R4��lC 4 A�03.1I30d¨ 8C032 0325447A�038:6 .10�4a � d � � � �� @ � d � �� ( J � ( �� � X ( y Y / ) � ) { (

O M=I%032G4 8C0�4;IV.10�47A�M=OB03254 6 .�� � *, E� 8:?d� 479 038CMW? [ �:Y��=A�03.1I3038:?GSbO I3MW6 03254 9 MW?BA�03.=? 0¢�GIJM 9 47A3A � d �� + � �� 8:?B9 4�� d� + � / � � y � d � � � �� @ � d � � { y 479;.=DBA�4 y � d � �� , � d� .=A � , * {\�B8:0�O MW<:<:M=¨ A 032G.10

a ) � d� @ � ) ( J X � y Y / ) � ) { ( y,; � ; {

¨ 8C032 X �C+ X ( y � � � � ( � � � �Ë{ ( � P Mp¨ 9J2GMUMWA�4 � � d �8o 4;0 � � d 4RA3DG9V2 032G.10 � W y � � { � J ( O M=I.=<:< � � ( [ � ¨ 8C032 ) � � ) ^ � �B.=?GX <C4;0 � � d 4aA3DB9J2 032G.10�Y [ X f ) W ) �( �¬� T 2547?8�I UK 03254a0�IV8:.=?5SW<C48:?54 ! DG.=<:8:0LK 8:? [ � .=?GXK K�A 254! K A3254;H � AF8c?54 !UDB.=<:8C0LK��3¨!4R2G. H=4RO M=I .=<:< � ( [ � ¨ 8:032 ) � ) � ] � � Y.=?GX .=<c< ( ( - d g � . & ) y ) � W8{ y � { ) J �

] / ) W ) +%- ) � d� ) � .J �

] / ) W ) + � ) � d� @ � ) � �( ) � ) �

J �] / ) W ) V) � ) ( a ) � d� @ � ) (

J �] / ) W ) V) � ) ( X f y Y / ) � ) { (

J �] / ) W ) V X f � Y) � ) / Y � (

� 3� 8:?B9 4 ��8:A�.1I� ,8C0�IJ.1I3K��5032G8cA0�GI3M H=47A*03254a9;<:.=8c6��

V�V

Page 46: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

] �v�5IJMW6 03254a8:?B8C038:.=< 9 MW?GXG8C038:MW? � d� + � 8C0*8:A M� H 8CMWDBA�032G.10 y ) � W8{ y � { + a y W y � d� {-{ + W y � {\�: � T 2G4 A3476(8CS=I3MWDI���BI3M�� 4;I30LK M=O ) � 8cA�.R9 MW?GA�4 ! D547?G9 4aM=O%03254a-/.1I��=M H��GIJM�� 4;IJ0LK M=O � � �BPF.=6R47<CK��5O M=I.=<:< L g ( ^ d .=?GX .=<:< � ( [ � &

y ) � � H W8{ y � { + a � W � � d� � H ���+ a � a � W � � d� � H � � � � ���+ a y�y ) HhW8{ y � d� {�{+ y ) � y ) H W8{s{ y � { 3

V � T M��BI3M H=4 03254"Q�MW8:? 0 9 MW? 038:? DG8C0 K M=O 03254 6(.�� y ( g W8{ *, ) � Wl�`8C0 8:? O .=9 0 A3D %N9 47A(0�M AJ25M=¨ 032G.10) � W @ , W/.=A ( � d �B>@?GXG4;47XB� O M=IF.=<:< L � ( ^ d �) ) � W @ ) H�� ) + ) ) � y W @ ) H � � �L{ ) J ) W @ ) H � � � ) J ) W @ � ) / ) � @ ) H � � � ) 3PbM=0�4�032G.10 O IJMW6 y,; � ; { 8C0%O MW<:<:M=¨ A 032G.10 <:8c6 � � � a ) � d� @ � ) ( + d �=P Mp¨ .1SW.=8:?"03.��=4�� � d ��o 4;0 � � d 4A3DG9V2�032G.10 ) � @ � ) � +�� � W y � { @ W y �I{ � ��� ] ��o 4;0 ( � � d 4 A3DG9V2�032G.10 a ) � d� @ � ) ( � � ( � V ) W )O M=I d J ( J ( � � T 2547? O M=I ( ( - d g ( � .G¨ 4�2G. H=4��,.1SW.=8:?5 UK5A 254! K AJ254;H � A 8:?54 ! DG.=<:8C0 K��

� y ) � W8{ y � { @ W y � { � + ������ y W y � d� y � {-{ @ W y � {-{ + y � � { ����J �

] /�] ) W ) +%- ) � d� y � { @ � ) ^ ��.J �

] / ] ) W )� ( a ) � d� @ � ) ( � 3 �

� � & ;��L�G���#MK��$ ��±� O�3�&9v�L������#: 4�3�p C 4 ?54$# 0"XG47A39 IJ8� 4 A�MW6(4� ,.=A38:9(032G4;M=I3K O M=I#MW?G4 < �B.1IJ.=6R4;0�4;I A3476(8CS=I3MWDI�,AaMW? � .=?G.=9J2�A��B.=9 47A!� y C 4I34;O 4;I*0�M(03254E M M��NM=O ^ �X��� _ . H 8:47A y Y >�T1d {*O M=I*O D5I3032G4;I*X54;03.=8:<:A!��{���Nn¢�"�$ ����3� � T 2G4 XGMW6(.=8:?"M=O . S=47?54;IJ.10�M=I� M=O . MW?54 < �B.1IJ.=6R4;0�4;I A�476(8CS=IJMWDI� y ) � { �� � MW?(.q� .=?G.=9V2A-�B.=9 4 8:A�XG4�¸,?547X K

_ MW6 y q{ & +� W)( ���� <:8:6� � �

�� y ) � W @ W8{ 4$#58:A�03A�� g

.=?GX O M=I W 8:? 032B8:A�X5MW6(.=8:?8��:W X547?5M=0�47A 03254a<:8:6 8C0!�T 2G8:A�X54�¸ ?G8C038CMW? <C47.=XGA*0�M(03254 O MW<:<CM=¨b8:?5SI��@���` �3 4�$ ����3� � ��PD¯la�+ ]IaÂ+NMSaYwa123a\[\JL+h&p[Ï&�¤0J �!&�)*2S+N(Ëi½/1&�2S+N)*2`t¬&Lt�bd&�23a�~�c8J�[\J�4�a�+ha\[db\a14g)�w�[1&Lt�c

y ) � { �� � &�2ÌJO-%J�23J�/sMKbhc8J�/1a #G¡¢M3a12�*) � _ MW6 y �{�)*b|_La129b\a|)¦2 ���*)*) � ) � (ea�J��=a1b _ MW6 y �{�)*2S�1J�[�)eJ�23+ q ) � y _ MW6 y q{�{ Z _ MW6 y �{ �V \

Page 47: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

�*)*)¦) � � W ( _ MW6 y �{ & ) � :W + ) � W + �� � ) � W¢#�@�����v� � y 8e{\�9�5M=I:W)( .=?BX � � d ¨!4�XG4�¸,?54W & +

Y�� � ) � W �*( 3

T 2547? <c8:6 � � W + Wl�5A�M � W � � � d g W)( ��8:A*XG47?GA�4a8:? �9� D500¨!4#.=<:A�M 2G. H=4Y�y )�� @ Y >�{ W +

Y�y )�� @ Y >�{ Y

�� � ) � W �*(

+Y��� � � � �!

�) � W �*( @

� � ) � W �( �

+Y��� � � �� ) � y ) W8{ �*( @

� �� ) � W �( �@ , Y

� y ) W @ W8{ .=A � � d 3� M W ( _ MW6 y �{��B.=?GX 2547?G9 4 _ MW6 y �{*8:A�X547?GA�4a8c? �y 8:8e{\� y 8c8:8e{\� > O�W)( _ MW6 y q{1�G032547?

Y�y )�� @ Y >�{ y ) � W8{ + ) � � Y

�y )�� @ Y >�{ y W8{ � , ) � W'g .=A � � d 3

� M ) � W�( _ MW6 y q{ .=?GX ) � W + ) � Wl� T 254�8:XG47? 038C0 K ) � W + �� � ) � W O MW<:<:M=¨ A O I3MW6 03254�X54�¸ ?G8C038CMW?M=O E�

� 8:?G9 4 ) � 8:A 03254aA�MW<:DG038CMW?NM=O 03254 XG8�Í 4;I347?U038:.=< 4 !UDB.1038CMW? �� � ) � W + ) � Wz¨ 8C032 8:?G8:038:.=<B9 MW?GXB8C038CMW?

) � + Y >1�B8C0*8:A�9;DBA�0�MW6(.1I3K 0�Mg¨*IV8C0�4

) ��+ � ��� 3T 254"?54$# 0F03254;M=I3476 SW8CH=47A DGAF.=?/4$#�,<:8:9;8C0*O M=IJ6�DG<:. O M=I 03254�S=47?54;IJ.10�M=I M=O`.=?/>@0p®M < XG8�Í DGA38CMW? MW?.N<:.1I3S=4"A3DI BA�4;0bM=O`8C03AFX5MW6(.=8:? y ?G.=6R47<:K�� .=<:< O DB?G9 038CMW?GA 032G.10 .1I34#0�¨ 8:9 4"9 MW? 038c?UD5MWDBA3<CK XG8�Í 4;I347?U038:.� B<C4.=?GX 2B.7H=4�9 MW6Q�,.=9 0bA3DI�v� M=IJ0\{\�

G 5G�!�v���!% � �¦R·¯la�+ y ) � { �� � ]LaQ+NM3a@&�23a�~�c8J�[1J�4�a�+ha\[|b1a14g)�w�[1&Lt�c£&�2)� � y [ � {�J�b�b\&I/�)¦JL+ha=_K+h&ÏJ�25r�+�R&�~_�) �Zt�b�)±&�2g»'),+NMÏ/1&�a��5/�)ea123+Nb � J�2`_ #p¯¢a�+ ·]Ia�+NM3aZwa123a\[\JL+h&p[�&�¤ y ) � { �� � #I¡¢M3a12 � (� y [ � { Z _ MW6 y q{ �J�2`_�¤N&p[�J�(*(=W)(�� (� y [ � { q

y :W8{ y � { + � " � " y � {� W� � " y � { /

�( � " � y y � { y � { � { " � � ( W

� � " � � � y � { 3 y,; � T {

�@�����v� � _ 47?5M=0�4�03254 I=� 2B� A!�5M=O y,; � T {% K � Wl�I�!K >@0p®M�� A*O M=IJ6�DG<:.d¨ 4�2G.7H=4

� W y � � { + � "� W� � " y � � { � � " y ( { /

�( � " � � ( W

� � " � � � y � � { � � " y ( { � � � y ( { 3V [

Page 48: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� 8:?B9 4 � � " y ( { + � " y � � { �*( / � � " � y � � { � b � y ( {\�9¨ 4�2G.7H=4

� � "c� � � + � � � " � � b � � � �� � � � b � � +

� � � " � � � � �*( + y � { " � �( 3EFA38:?5SR03254a9 MW?BXG8C038CMW? � d� + � �I¨ 4�9 MW?G9;<:DBX54 032G.10*O M=I .=?UK W ()� (� y [ � {\�

W y � d� { @ W y � { +� ���" � � W

� � " y � dH { " � y � dH { � b � y L { / � �� � � W � y � dH { � L 3 y,; � > {

T 254�¸,IJA�0%�B.1I30*MW? 03254aI�� 2B� A��G8:A�.(6(.1I3038c?5SW.=<C4a.=?GX 03254;IJ4;O M=I34y :W8{ y � { + <:8:6� � �

�� y a y W y � d� {�{ @ W y � {-{ + <:8:6� � � a � � � � �

� � � W � y � dH { � L � 3 y,; �:Y d {� 8:?B9 4� � W/8:A*.(9 MW?U038:? D5MWDGA�O DG?G9 038CMW?8�¨ 4�2G. H=4�.=<:6RMWA30 A3D5I347<:K

<:8:6� � �Y(� �� y � W8{ y � dH { � L @ , y � W8{ y � { g

.=?GX A38:?B9 4 � W 8:AY MWDG?GX547X£¨ 4 9;.=? .��v�B<CK X5MW6 8:?G.10�47X 9 MW? H=4;IJS=47?G9 4 0�M 03254 I�� 2B� A!� M=O y,; �:Y d {".=?GX9 MW?G9;<:DBX54 032G.10 y :W8{ y � { + y � W8{ y � {\��

T 254;M=I3476 ; � \ A325Mp¨ A�032G.10bMW?)� (� y [ � { 03254�S=47?54;IJ.10�M=I� .=9 03AF.=A . A�479 MW?GX < M=IVX54;IbXG8�Í 4;I347?U038:.=<M�� 4;IJ.10�M=I��3¨ 8C032 .Q¸,IJA�0 < M=IJX54;I��B.1I30 9 MW6(8c?5S(O I3MW6 03254�XGIJ8CO 0*.=?GX . A3479 MW?GX < M=IJX54;I��B.1I30 9 MW6 8:?5SRO I3MW603254aXG8�Í DGAJ8CMW?B� T 2G8:A O DG?GXG.=6R47?U03.=< O .=9 0*O M=IV6(A�.Q GIJ8cX5S=4� 4;0�¨!4;47? 03254 03254;M=I3KNM=O¢�B.1I3038:.=< XG8�Í 4;I347?U038:.=<4 ! DG.1038CMW?GA*.=?BX 03254aA�03DGXGK M=O XG8�Í DGA38CMW?BA!�>@?"S=47?54;IV.=<G8C0 8:A XG86% 9;DG<C0%0�Ma9;.=<:9;DG<:.10�4 03254�4;H=MW<:D5038CMW?RA3476(8CS=I3MWDI� ) � �� ,D50 8:?R. O 4!¨ 4$# 9 4!�G038:MW?G.=<9;.=A�47A!��A3DG9J2 .=A 032G.10 M=O 03254��FIJ?GA30�478:? < EF2G<C47?� 479��5�GI3M 9 47A3A!� 032G4(XG8�Í 4;I347? 038c.=<�4 ! DG.1038CMW? �

� � ) � + ) � 9;.=?5 4 4$#L�B<:8:9;8C03<:K A�MW<CH=47XB��@���` �3 4�$ ����3� � �*ë¯la�+ B J�2B_ ]Ia�c¢&�b�),+N),�=a�2`t�4Â]Ia\[�b ��J�2`_ (ea�+ y ) � { �� � ]Ia�+NM3aÌb\a14g)�w�[1&Lt=c &�¤/1&�2S+^[\J�/=+N)e&�29b�� � y [�{ , � � y [�{@J�b�b\&L/�)eJL+ha=_z+h&�+NM3a|b=+h&L/jMvJ�b�+N)^/@_) �Ba\[�a123+N)¦J�(Ga��9t�JL+N)e&�2

� � � +F@CB � � �( / � b ��3 y,; �:Y=Y={¡¢M3a12�¤N&p[|J�(¦(=W (�� � y [�{qJ�2 � ( [ �

y ) � W8{ y � { +Y � B�'y Y @ � � ( � � { � �� �

4$#L� � @ B y � � � � � @ �I{ ( ( y Y @ � � ( � � { � W y �I{ � � 3

��� ����>�± �� m IJM H=4a032G8cA%�GI3M�� MWA38C038CMW? K 9J25479�� 8:?GS(4$#�,<:8:9;8C03<CK 032G.10*O M=I .=<:< ( ^ d��*(*) � W + ) � y W8{ g

¨ 254;IJ4� 8:A*03254 S=47?54;IJ.10�M=IFM=O�032G4��FIJ?GA30�478:? < EF2G<C47?� 479��g�GI3M 9 47A3A!�BSW8CH=47? O M=I W)( � (� y [�{� K:W y � { & +F@0B � W � y � { /

�( ( W � � y � { 3

� 47<CM=¨«¨!4#A32G.=<:< SW8CH=4#.RA�0�M 9V2G.=A�038:9E�GI3M M=O��V�;

Page 49: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

�@�����v� � � 8CIJA�0�?5M=0�4a032B.10*03254�A�MW<cD5038CMW? � d� M=O y,; �:Y=Y={�¨ 8C032 8:?G8:038:.=<,9 MW?BXG8C038CMW? � d� + � 8:A*SW8CH=47?� K� d� + � � � � � / 1 � � g

¨ 254;IJ4eW � y � { + Y � � � � y � { � � d � � � � y A Os� yN: � : {\��{|�5M=I ( ^�d � <C4;0�� � X547?GM=0�4#03254g� .=DGAJA38:.=?/X547?GA38C0 K¨ 8C0326R47.=? d .=?BX H1.1IJ8:.=?G9 4 ( ) W � ) ( + ( y Y @ � � ( � � { � ] B �G.=?BX(O M=I W ()� (� y [�{\� <:4;0 ®W XG47?5M=0�4b032G4��5MWD5IV8C4;I0�IJ.=?GA3O M=IJ6 M=O Wl�GA�M 032G.10

W y � { +Y] � � �� � �

" � d ®W y � { � � gT 2547?8� AJ8:?G9 4ea y � " ��� ��� � { + ®� � y � {\�B¨!4(2B.7H=4�� DGAJ8:?5SÂ�GDI B8:?B8�� A 032G4;M=I3476 .=?GX 03254Q�BI3M�� 4;I30LK 032G.10 03254�5MWD5IV8C4;I*0�IJ.=?GA3O M=IJ6 M=O%.(9 MW?UH=MW<:D5038:MW?��GI3M XGDG9 0 4 ! DG.=<:A�03254E�GI3M XGDG9 0 M=O�032G4E�5MWD5IJ8:4;I*0�IJ.=?GA�O M=IJ6(A��

y ) � W8{ y � { + a � W y � d� { �+

Y] � a � � �� � �

" ����� ®W y � { � � �+

Y] � � �� �

a � � " � d� � � � � " ��� � � � ®W y � { � �+

Y] � � �� � �

" � d� � � � ®� � y � { ®W y � { � �+� �� �

� � y � � � � � @ �I{4W y �9{ � � 3

y,; �:Y ] {

� K¨*IJ8C038:?GS#MWD50 03254 O DB?G9 038CMW?�� � ¨ 4aM� G03.=8c? 03254�A�03.10�476(47? 0!��

� ��P �=mG� �Y�^� � ��c�3��%<�"K�#<#v��� #(`"`"Ki�±�#: ��$�S�G §F.7H 8:?5S 032UDBA 8:X547?U038�¸B47X 03254 S=47?54;IJ.10�M=I .=AJA�M 9;8c.10�47X�¨ 8C032 > 0p®M < XB8�Í DBA38CMW?GA!� ¨ 4Z?54$# 0 O M=IJ6�DG<:.10�4 .=?8:6Q� M=I303.=?U0 O M=IV6#DG<c. O M=I��1�,�1���I²�� >@0p®M < XG8�Í DGA38CMW?BA!� W �1�,�\�¬�3�e�³¾�^� Rϲ ��O M=I y � d� { �� � 8:A . IV.=?GX5MW6H1.1IJ8:.� B<C4RA3DB9J2 032G.10 O M=I�.=<:< ( ^ d 032G4R4;H=47? 0 - � J ( . & + � � ( � � � y � { J ( � 8:A .=? 47<C476R47?U0aM=O 03254A38CSW6 . < .=<CS=4! GIJ. � � S=47?G4;IJ.10�47X5 K y � dH { H 3�� � � � �G 5G�!�v���!% � ��� � �=mG� �Y�^� � ��c�3��%<�"K�# � ¯la�+ � ]Ia�J�_�) �Zt�b�)e&�2�)*2 [ � »'),+NM�wa123a\[1JL+h&p[ Y#L¯¢a�+ ��]IaJQb�+h&�cvcB)*2Lw5+N)*4�a�»¥),+NM a y �v{ +*�#G¡¢M3a12�¤N&p[|J�(*(=W ()� (� y [ � {0J�2`_ÂJ�(*( � ( [ � �

a d y W y � f {�{ + W y � { / a d � � f� y :W8{ y � H\{ � L � 3

�@�����v� � T 2G4 03254;M=I3476&8:A 8:?U03DG8C038CH=4��¬ BD50!8:03A¥�GIJMUM=O 8:A!IJ.103254;I 0�479J2B?G8:9;.=<N�C 4 <:8:6(8C0 MWDGIJA�47<CH=47A 254;I34b0�M.RH=4;I3K GIV8C4;O A-�=4;039V2B��!K .��9�,<CK 8c?5S y,; � > {�0�M 03254�A�0�M��9� 47X��BI3M 9 47AJA ( *, � d��� f .=?BX <C4;0�038:?GS ( 0�47?BX 0�M 8:?I¸,?G8C0 K .1O 0�4;I <

¨ .1IJXGA!�I¨ 4q¸,?GX=&W y � df { + W y � { / � f

��" � � W

� � " y � dH { " � y � dH { � b � y L { / � f� y :W8{ y � dH { � L 3

V¬T

Page 50: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

WbO 0�4;I�03.�� 8:?5S"4$#L� 479 03.1038:MW?GA%¨!4 S=4;0�032G4 A303.10�476R47? 0!�,A38:?G9 4 A�0�M��9� 47X 6(.1I3038c?5SW.=<C47A A�03.1I3038:?GS".10 d 2G. H=44$#L� 479 03.1038:MW? d � y � 4;4 _ K ?I� 8:? y Y >=[�: {\��{�

T 254 A38:6Q�B<:47A�0 4$#5.=6Q�B<C4bM=O ."XG8�Í DGA38CMW?(8cA�� I3Mp¨ ?G8:.=?N6RM=038CMW? 8C03A�47<:O & � ��+ b � y � � d � � $ � {\�>@03A�S=47?54;IJ.10�M=I 8:A Y�� ] 038c6R47A�03254@o�.��B<:.=9;8:.=? ���IC 4#8:?UH=47A�038CSW.10�4a0�¨!M��GI3M� B<:476(A!�

��� #%'`"K±� � �^7v���lA MW?GAJ8:X54;I��!IJM=¨ ?G8c.=? 6RM=038CMW? b��� & + ' /Yb � A303.1I3038:?5S .10�'�( [ � �8o 4;0 � � ) ' ) �C�2G.10 8:A 03254#.7H=4;IJ.1S=4�038:6R4 b��� A�� 47?BXGA 8:?GA38:XG4b03254E B.=<:< X�� + � � ( [ � & ) � ) J � � �3 �MKi�Y ��$�S�I&�A�25MUMWA34 W ( � (� y [ � {FAJDG9J2 032B.10PW y � { + ) � ) ( O M=I ) � ) J �d�8o 4;0�� �� X547?5M=0�4(032G4d¸BIJA�0038:6R4F03254q� I3M=¨b?G8:.=?N6RM=038CMW? 2G8C03A!03254 A-�B254;IJ4 � X � � T 2547? � �� 8:A ."A�0�M��9�B8c?5S�038:6(4��Lm!D50 �K& + � �� � �.=?GX .��v�B<CK _ K ?I� 8:? � A O M=IJ6#DB<:.L�50�M(M� G03.=8:?

a y W ycb �f {-{ + W y 'L{ / a � � f�

�( y �NW8{ ycb �H { � L �

+ ) ' ) ( / ] a y �v{hg¨ 254;IJ4q¨!4�DBA�4 032G.10 �

( �NW � ] �3�� UH 8CMWDGA3<:K�� a y W ycb��f {-{ J � ( � T 254;IJ4;O M=I34a y �v{ J �

� � � ( @ ) ' ) ( � 3WFAb032B8:A 25MW<cXGA DG?B8CO M=IV6(<CK 8:?�E� 8C0bO MW<:<:M=¨ Ab032G.10 a y � �� { J �

� � � ( @ ) ' ) ( � *��3§b47?G9 4 � , � �� .=A� , * UKR6RMW?GM=0�MW?54b9 MW?UH=4;I3S=47?G9 4��I� D50`032G47?g¨ 4 6#DBA�0!2G. H=4 W ycb��f { , ) b��f��� ) ( + � ( .=A � , *��.=?GX A3M(8:? O .=9 0

a y � �� { +�� � � ( @ ) ' ) ( �

KNX5MW6 8:?G.10�47X 9 MW?UH=4;I3S=47?G9 4��

��� #%'`"K±� � �¦­`���3o 4;0 � ( [ � 4a.Q� MW8:?U0�MWD503A38:XG4 03254@ B.=<:<�X � �9C�2G.10b8cA�03254@�GIJM� B.� B8:<:8:0LK(032G.10b03254� I3M=¨b?G8:.=? 6RM=038:MW? A�03.1I3038:?GS(8:? � 4;H=4;Ib2G8C03A � X � �3 �MKi�Y ��$�S�I&lC 4 9;.=?G?5M=0"DGA�4 _ K ?I� 8:? � A�O M=IV6#DG<c. XG8CIJ479 03<CK��G 479;.=DGA�4�¨ 4NX5M/?5M=0�� ?5Mp¨ ¨ 254;03254;I�03254� I3M=¨b?G8:.=?/6RM=038CMW?z¨ 8:<:< 4;H=4;I 2G8:0 � X � y 8N� 4����`¨ 254;03254;I��� *¿{\�,> ? M=IVX54;Ib0�MNM� G03.=8:?/.�¨!47<:< < X54�¸,?547XA�0�M��9�,8:?5S 038:6R4��B¨ 4 ?54;47XZ.5 B8CS=S=4;I@ B.=<c<�X & + � � ( [ � � ) � ) J � � 47?G9;<CMWAJ8:?5S 03254g� MW8:?U0 � �8o 4;0 � � 4 03254E¸BIJA�0�4$#58C0*038:6(4 O I3MW6 03254�.=?G? DG<:DBA� � & + X X � A�03.1IJ038:?5S(O I3MW6 � � T 2547? 9;<C47.1IJ<:K � � + � � � � �� � PbM=¨ 03.��=4% +

�( �Â� 032G4(S=47?54;IJ.10�M=I�M=O0�!IJM=¨ ?G8c.=?Z6RM=038CMW?B��.=?GX A3D9�9� MWA�4"032G.10W � & � , [ � A3.1038:Aj¸,47A�03254aO MW<:<CMp¨ 8:?5S�I34 ! DG8CI3476R47?U03A�&

y 8±{ �NW � + d �B8N� 4�����W � 8:A�2G.1IJ6(MW?G8:9��y 8:8±{KW � y � { + Y O M=I ) � ) + �d�y 8:8c8e{ W � y � { + d O M=I ) � ) + � �C 4�032G47?¸,?GX

+� b �� � �

+ � � + a � W � � b �� � � � + W � y � {hg¨ 254;IJ4�032G4d¸BIJA�0 4 ! DG.=<:8C0 K/DGA347A y 8:8e{b.=?GX y 8:8:8±{*.=?GX 032G4(A�479 MW?GX 4 ! DG.=<:8C0 K DGA347A _ K ?I� 8:? � AFO M=IJ6�DG<:. 8:?9 MW6Y B8:?G.1038CMW?K¨ 8:032 y 8e{\� > ?G9;8:X547?U03.=<:<CK�� 032G8:Ab4 ! DG.1038CMW? A3. K A 032G.10 W � 8:AbDB?G8<! D547<CK X54;0�4;IJ6(8c?547X 8CO 8C04$#58:A�03A!�

V¬>

Page 51: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

P 4$# 0!�v¨ 4a<C4;0 � , * 0�M M� G03.=8:?+

� � �� +* � + + � � � ^ ) � ) & � �� � � � g 479;.=DGA�4R.=?UKÌ�B.1032/M=O�� I3Mp¨ ?G8:.=? 6RM=038:MW? 032B.10a2G8C03A � X � 6#DGA30| 4� MWDG?GX547XB�3�5I3MW6 03254"<:.10�0�4;Iq¨ 48:? 03D5IV? M� G03.=8:?

+� � �� +* � + + ��� � � � - � �� � � .! + <:8:6 " � +

� � �� � � �

+ <:8:6 " � +� b �� � �

+ � � + <:8:6 " � W � y � { 3T 2 DGA!� 032G4 MW?G<CK 032B8:?5S 032G.10#I3476(.=8:?BAa0�MK 4 X5MW?54 8cAa0�M 9;.=<:9;DG<:.10�4N032G8:A#<:8:6(8C0!� 8,� 4����G¨ 4N6�DGA�0�A�MW<CH=4y 8e{ <\y 8:8c8e{\�

�5M=I ] + ] ¨!4q¸ ?GXB�5.1O 0�4;IFA�MW6R4a9;.=<:9;DB<:.1038CMW?�&W � y � { +

<CM=S ) � ) @ <CM=S �<CM=S � @ <CM=S � , Y .=A � , * 3

�5M=I ] #+ ] �GMW? 03254�M=03254;I 2G.=?GX8�I¨!4q¸ ?GX�&W � y � { +

) � ) ( � � @ � ( � �� ( � � @ � ( � � , � Y 8CO ] + Yy ) � ) � �E{ ( � � 8CO ] ^ : 3

>@0 O MW<:<CMp¨ A 032G.100� I3M=¨b?G8:.=? 6RM=038CMW?�¨ 8:032 ] + Y M=I ] + ] 8:A|�-²��!�L�\��²�� 0!�BA38:?G9 4 8C0%¨ 8c<:<B2G8:0 .=?UKNA��B254;I34¨ 8C032Â�BI3M� B.� B8:<c8C0LK Y��3� DG0*O M=I ] ^�: � I3M=¨ ?B8:.=? 6RM=038CMW? 8:Aq�^�j���I�\�,²��v�^�

\1d

Page 52: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� � � �[�\ � �,� �+�M�c��� � �U�� �0� ��� > ?Z032G8:A#A�479 038CMW?�¨!4N0�I347.10�0�¨!M/O M=IJ6#DB<:.=AaO I3MW6 032G4 03254;M=I3K M=O*XB8�Í DBA38CMW?GA!�` M=032ZM=O0¨b2G8:9J2 X547A39 IJ8* 4¨ .7K A*0�M(0�IJ.=?BA�O M=IV6 XG8�Í DGA38CMW?BA .=?BX .1I34@�GI3M H=47X DGAJ8:?5S"> 0p®M < 9;.=<c9;DG<:DGA!�6 �N7 G 5�� ���>mG�"%'#v��ITk8#9��c�3��%<�"K�#G 5G�!�v���!% 6 �N7 � �G�NmG��%'#v�YITkV#9��E�v�6%<��K�# � fS&p[ � ( [ � �3(ea�+ � d� ]La@J�2�r1+�R&�~�_) �¢t�b�)e&�2µ»')h+NM�wa12v~a\[\JL+h&p[ J�2`_z)*29)h+N)¦J�(�/1&�2`_�),+N)e&�2 � d� + � #8¯¢a�+���&'[ � , - d g *¿{g]IaÏ/1&�23+N)¦2St¬&Lt�b �lJ�2`_z(±a�+ ) �� W ¤N&p[W)( � � y [ � {%J�2`_ ( ^ d ]Ia�w¬),�=a12�]!i

y ) �� W8{ y � { + a ��W y � d� {U4$#L� � @ � �� � y � d� { � # � � 3

¡¢M3a12 y ) �� { �� � )¦bdJ �!&�)*2S+N(Ëi¿/1&�2S+N)*2St�&Lt�bdb\a14g)�w�[1&Lt=c¾&�2 � � y [ � { �*)*2¾+NM3a�b\a129b\aÂ&�¤ , a\¼v2v),+N)e&�2 +�#XO��»'),+NM�wa12Sa\[\JL+h&p[� @ �S#�@�����v� � > 0b8:A*?5M=0 XB8 % 9;DG<C0 0�MNA325M=¨E�9 UKN03254a0�479V2G?G8<! D547AbDGA�47X 8:? 032G4@�GI3M M=O M=O T 254;M=I3476 ; � : �,032G.10) �� W <:8C47A .1SW.=8:? 8:?�� � y [ � {\� .=?BX 032B.10�03254��GI3M�� 4;I3038C47AFY�� ] .=?BX V 8c? _ 4�¸,?G8:038CMW? ; � ] 2GMW<:X y ?5M=0�4 032G.10� 8:A�?5MW? < ?54;SW.1038:H=4p{\�B>@0*8:A*8:<:<cDG6(8:?G.1038c?5SI� 25Mp¨!4;H=4;I��,0�M(4$#L�B<:8:9;8C03<:Kg�GI3M H=4Ym IJM�� 4;IJ0LK : �

�5M=I d J�L J ( �G<C4;0D dH � & + 4$#L� � @ � �H � y � H d� { � # � 3

m IJM�� 4;IJ0LK : 8c? _ 4�¸,?G8C038:MW? ; � ] 8:A@�GIJ47A�4;I3H=47X XGD54(0�M/03254��B.1I3038:9;DG<c.1IaO M=IV6 M=O�03254��GI3M 9 47A3A D d� � ��> ?O .=9 0!�,<C4;00W ()� � y [ � {\� T 2547?� ) �� � H W � y � { + a � D d� � � H W � � d� � H � �

+ a � D d� � D � ��� � � H W � � d� � H � + a � D d� � a � D � ��� � � H W � � � � ��� � H � � � + a � D d� � � y � d� { �+ y ) �� �L{ y � {�g¨ 254;IJ4

� y �9{ + a � D �� � � H W y � � �� � H { � � � + a � D �� H W y � �H { + y ) �H W8{ y �I{ KNA�03.1038:MW?G.1IJ8C0 K��`� M(8:?BX54;47X

� ) �� � H W � y � { + y ) �� � ) �H W8{ y � { 3o 4;0"DGA@¸ ?G.=<:<CK A325Mp¨ 032G.10 @ � 8:A�032G4 S=47?54;IJ.10�M=IRM=O y ) �� { �� � � T M/032G.10#47?BX�¨ 4N9;.=<c9;DG<:.10�4

y X5I3M��v�B8:?5S�03254�DI�v� 4;I�8:?BX54$# � {h&� y D � � W y � � {-{ + W y � � { � D � � / D � � � W y � � {

+ � @ � y � � { W y � � { /�y :W8{ y � � { � D � � �( / D � � � y � � { ��� W y � � {'g � b � � 3 yNT �:Y={

\ Y

Page 53: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

§b4;I34@¨ 4�DGA�4 >@0p®M�� A*O M=IJ6�DG<:.".=?GX � � � +�� y � � { �( / y � � { � b � 0�M 9 MW6Q�BD50�4

� W y W y � � {-{ + � "� W� � " y � � { � � " y ( { /

Y] � " � � ( W

� � " � � � y � � { � � " y ( { � � � y ( {+ � "

� W� � " y � � { � " y � � { �( /

�" � � W

� � " y � � { " � y � � { � b � y ( {Y] � " � � ( W

� � " � � � y � � { y � { " � y � � { �*( gyNT � ] {

¨ 254;IJ4 03254�¸BIJA�0�.=?GX 032G8CIJX 0�4;IJ6 .1IJ4��GIJ479;8:A�47<CK y :W8{ y � � { �( .=9;9 M=IVXG8:?5S/0�M T 254;M=I3476 ; � \ � T .�� 8:?5S4$#L� 479 03.1038:MW?GA*MW?� M=032 AJ8:X547A M=O yNT �:Y={\�3¨ 4aS=4;0� a y D � � W y � � {-{ + a y - @ � W / W . y � � { D � � �( { 3

> ?/AJ25M=I30!� � y ) �� W8{ + ) �� y-y @ �I{4W8{ �( �`¨ 2G8:9V2/6(47.=?GAF032G.10� @ � 8:A 8:?GX54;47X 03254"S=47?54;IJ.10�M=IaM=O!03254A�476(8:S=I3MWDI� y ) �� { �� � y I3479;.=<:<8m`I3M�� MWA38C038CMW? ; � Vvy 8:8:8±{-{\��

C 4 9;.=? SW8CH=4 03254 A3476(8CS=I3MWDI� y ) �� { �� � . 9;<C47.1IQ�GI3M� B.� ,8:<:8:A�038c9 8:?U0�4;I��GI34;03.1038:MW?B� T 254Â� MWA38C038CH=4? DG6E 4;I � y �I{a8:A H 8C4!¨ 47X .=A�. � 2G. 57.1IJX IJ.10�4 � .10 � ( [ � � 03254��GI3M� B.� B8c<:8C0LKÌ� 4;I#DG?G8C0 038:6(4(O M=I#03254XG8�Í DGA38:MW?k�GI3M 9 47A3A�0�Mz 4 � � 8:<c<C47X �L��o 4;0RDGA�4$# 0�47?GX 03254 A�03.10�4 A-�B.=9 4 [ � K . AJ8:?5SW<C4g� MW8:?U0 � � 03254� 9 M % ? � A�03.10�4��S¨ 254;I34 03254#A�K A30�476 47?GXGAbDI� .1O 0�4;I� 478:?5SQ� 8:<:<:47XB� T 2547? 8C0*9;.=?Ì 4�A325Mp¨ ? 032G.10b03254;I344$#58:A�03A*.(A30�M��9�B8:?5S"038:6(4��`�G03254 � � 8:<:<:8:?GS#038:6(4 �L�BA3DG9V2 032G.10*03254q�BI3M 9 47AJA�� d� SW8CH=47?Ì UK� d� & + � � d� 8CO ( J �

� 8CO ( � �A3.1038:A-¸B47A

a y W y � d� {-{ + a � W y � d� {U4$#� � @ � �� � y � d� { � # �"� g

�GI3M H 8cX547Xg¨ 4FXG4�¸,?54 W y � { & + d � T 254��GI3M M=O M=O 032G8:A`I34 !UDB8CI347A`.=? 4$#L�B<:8:9;8C0!9 MW?GA�0�IJDG9 038:MW? M=O 03254|� 8:<:<:8:?GS038:6R4��`�v¨ 2G8:9V2¨!4�AJ2G.=<:< ?5M=0*SW8CH=4#254;I34����� #%'`"K±�Q6 �N79��� T 2G4 �54;K ?G6(.=? < na.=9 O M=IJ6�DG<:.�¨ .=A�M=IV8CSW8:?G.=<:<:KFO M=IJ6�DG<:.10�47X".=A .F?5MW? < IJ8CS=M=IJMWDGA � �,.1032 <8:?U0�4;S=IJ.=<GO M=IJ6�DG<:.��a8c?N!UDB.=? 03DG6 6R479J2B.=?G8:9;A' KQ?@��54;K ?B6(.=?B�U.=?BXQ¨ .=A <:.10�4;I!I34;O M=IV6#DG<c.10�47X 8:?R0�4;IV6(AM=O XG8�Í DGAJ8CMW?GA' K -£�Ina.=9�� T 254F9 MW?B?5479 038CMW?¨ 8C032 !UDB.=? 03DG6&6R479V2G.=?G8:9;A 9;.=? 4bA303.10�47X .=A O MW<:<:M=¨ A!�U> O� � 8:A�� I3Mp¨ ?G8:.=? 6RM=038:MW?B�U032G47? 032G4bS=47?54;IV.10�M=I*M=O y ) �� { �� � 8:A �

( � @ �v� T 2G8:A!8:A y @ Y={ � 03254q§b.=6 8:<C0�MW?M�� 4;IJ.10�M=I*M=O%.d�B.1I3038:9;<C4 8:? .d� M=0�47? 038c.=< � 8:? [ � �9WF9;9 M=IJXG8c?5S"0�M�� 9J25I�xMWXG8:?5S=4;I�� 03254 4;H=MW<:D5038:MW? 8:?N038:6R4M=O 03254Y¨ . H=4RO DB?G9 038CMW? � ( � ( y [ � {*X547A39 IJ8* B8:?5S(A3DB9J2 .g�B.1IJ038:9;<C4#8cA SW8CH=47?z K � *, � �� ���3¨b254;I34 � ��8:A�.RS=IJMWDI� M=O DG?G8C03.1IJK(M�� 4;IJ.10�M=IJA*SW8:H=47?� UK� �� + 4$#� ��$ ( � �( � @ � ��� y ( ( [�{ 3

T 2G8cA�S=I3MWD9��9;.=? 4NM� G03.=8:?G47X£ K .=?B.=<CKU038c9N9 MW?U038:? DG.1038CMW? 8:? ( 8c? 0�M 03254 9 MW6Q�B<:4$# X5MW6(.=8c? M=Ob03254A�476(8:S=I3MWDI�

) �� + 4$#� � ( � �( � @ � � � y ( ( - d g *¿{-{ 3\=]

Page 54: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

��� #%'`"K±�z6��¦­`���SA MW?BA38:X54;I�03254q�,.1I3038:.=< XG8�Í 4;I347?U038:.=< 4 ! DG.1038CMW?�

� ( # y � g ( { + �)# y � g ( { / � y � {�# y � g ( {hg � ( [ � g ( ^ d g yNT � : {

¨ 8C032 8c?G8C038:.=< 9 MW?GXG8:038CMW?GA# y � g d { + Y � � ( [ � 3 yNT � V {

§b4;I34��/� 8:A%032540o .��B<:.=9;8c.=?�.=9 038c?5S MW?"03254�A-�B.1038:.=<UH .1IV8:.� B<C4 .=?GX ��� y � { & � ( [ � �*8:A .�¸B47<:X�M=OBIV.=?GX5MW6H1.1IJ8:.� B<C47A 032B.10��B<:. K A�032G4 I3MW<C4 M=O ."IJ.=?GX5MW6 6R47XG8:DG65� _ 4!� 47?GXG8c?5S"MW? 03254a9J2GMW8:9 4a032G.10 8cA*6(.=X54 O M=I03254Y�GI3M� B.� B8c<:8C0LKN<:.�¨ M=O 032G8:A*IJ.=?GX5MW6 ¸B47<:XB� yNT � : {b9;.=?z 4�DGA�47X 8:? H1.1IJ8CMWDGAb.1I347.=A M=O 9V25476(8:A30�I3K .=?GX B8CMW<:M=S=K��`�GM=I�8:?GA�03.=?B9 4�� # y � g ( {FX547A39 IJ8* 47Ab03254S7BMp¨ M=O!2547.10a8c?/. 6R47XB8:DG6 ¨ 8C032/IJ.=?GX5MW6 <CK <CM 9;.10�47XA�MWD5IV9 47A*.=?GX A38c?I� A��

W O M=IJ6(.=<,A�MW<:D5038:MW?"M=O yNT � : { .=?GX yNT � V { 9;.=?� 40¨*IJ8C0�0�47?(XGM=¨ ?Ϩ 8C032R03254b2547<��(M=O 03254��G4;K ?G6 .=? <na.=9 O M=IJ6�DG<:. &

# y � g ( { + a � 4$#L� � � �� � ycb dH { � L

� � 3T 2G8cA�I34!�GI347A347? 03.1038CMW? 4$#�BI347A3A�47A # y � g ( {*8:? 0�4;IJ6(AbM=O .Ï� I3Mp¨ ?G8:.=? 6RM=038CMW? A303.1I3038:?5SN.10 � .=?GX 8:A 03254A�03.1I3038c?5SÏ� MW8:?U0 O M=IF.NX54;03.=8:<:47X .=?G.=<CK A38:A M=O 03254� 472G.7H 8CMWD5IbM=O 03254�IV.=?GX5MW6�¸B47<:X�� # y � g ( { & � ( [ � �.=A (+, *�� y � 4;4�A .1IJ6RMW?B.R.=?GX - MW<:9J2G.=?GM H y Y >�>�V {-{\�

�%8c?G.=<:<CK�� 8CO �(O .=8:<:A 0�MQ 4 ?5MW?G?54;SW.1038CH=4��B032547?N03254@�54;K ?G6(.=? < na.=9 O M=IJ6�DG<:.�6(.7K A�038:<c<,25MW<cXB��GM=I8:?GA303.=?G9 4��%8:0�A3D % 9 47A�032G.10 �µ 4Ï MWDG?GX547X O IJMW6 47<CMp¨@� T 2G8:A�SWDG.1IJ.=?U0�4;47AR032G.10"03254Â�GI3M�� 4;I3038C47A#8:?_ 4�¸,?G8C038:MW? ; � ] 25MW<:XB�6 �¦­ G 5�� � #%�����3�YI � #v�4 ��^�YI7;=�±�� #v��� �º�E�v�6%<��K�#� I3M=¨b?G8:.=? 6RM=038CMW? A�03.1I3038:?5S .10 � ( [ � 9;.=?µ 4"I34!�GIJ47A�47? 0�47X ?G.103D5IJ.=<c<CK MW? 03254Ï�GI3M� B.� B8c<:8C0LK A��B.=9 4y �:g�� g + d {\�9¨b254;I34 � + � y - d g�� . , [ � { 8cA�03254#A��B.=9 4aM=O 8C03A0�,.1032GA!� � 8cA�03254 < .=<CS=4! BIJ.(S=47?54;IV.10�47X K 03254 9 K <:8c?GX54;I A�4;03A � � ( � � ' J � y ( { J � � y ' g � ( [0� ( ( - d g�� .±{\�%.=?GX + d 8cA 03254Q�GI3M� ,.� B8:<:8C0 KXG8:A30�IJ8� BD5038:MW?(MW? � - d g ( . M=O ycb d� & + � / b � { � 3�� � ��� 9 MW?GA�0�IVDG9 0�47X 8:?5� 479 038CMW? ] �IC 4@¨ .=?U0*0�M(9 MW6Q�,.1I3403254 �GI3M� B.� ,8:<:8C0 K XB8:A�0�IJ8� ,D5038CMW? + d ¨ 8C032#032G.10 M=OB.=?5M=03254;IZ�GIJM 9 47A3A X54;IV8CH=47X�O I3MW6 8C0!�1?G.=6R47<CK���� I3M=¨b?G8:.=?6RM=038CMW?5¨ 8C032 .(X5IV8CO 0!�

o 4;0�� d� X547?5M=0�4a03254aA3MW<:D5038CMW? M=O� � d� +�� y � d� { �( / � b � g � d� + � g yNT � \ {

¨ 254;IJ4 � 8:A  MWDG?GX547X .=?GXÂo�8��BA39V2G8C0 5 9 MW? 038:? D5MWDGA�� T 254|�GI3M 9 47A3A � d� 8:?GXBDG9 47A!.d�BI3M� B.� B8:<c8C0LK(6R47.=AJD5I34+ d � MW?����G 5G�!�v���!% 6 �¦­ � � #%£�����3�YI � #9�4 ��±�YI7;=�±�� #v��� � �E�v�6%<��K�# � f3&p[lJ�(*( � ( [ � +NM3a`c`[1&L]�JI]�)*(*),+�i|4�a�J�~b=t�[�a1b + d J�2B_ + d � J�[�ag4ÂtI+�t�J�(*(�i�JI]�b\&�(htI+ha1(Ëiº/1&�2S+N)*2`t¬&Lt�b�»'),+NM 1 J�_L&�2v~i*|) D�&I_�iI4 _La\[�),��JL+N),�=adw¬),�=a12]!i

� + d �� + d� ycbedH { H 3�� � ��� � + 4$#L� � � �� � � y bedH {'g � bedH � @ �

(� �� ) � y bUdH { ) ( � L � 3

\�:

Page 55: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

�@�����v� � � 8 # � ( + � � T 2G4N8:XG47. M=Ob03254��GI3M M=Ob8:A#0�MZA325Mp¨ 032G.10�� d� 2G.=A�03254 A3.=6R4 XG8:A30�IJ8� BD5038:MW?DG?GXG4;I + d .=A b d� 2G.=A(DG?GXG4;I � � + d �Z¨ 254;IJ4 � � X547?GM=0�47A(03254Ì?b.=X5MW? < PF8��=M X5K 6 X54;IJ8CH1.1038CH=4 M=O 0325403254;M=I34765� >@? M=032G4;Ig¨!M=IVXGA!�Z¨ 4 A32G.=<:< A325Mp¨ 032G.10(O M=I(.=<:< dYJ ( � J ( ( J �� J ( � J � .=?GX .=<:<W � g W ( g 3�3�3 W � ( � � y [ � {h&a d y W � y � � � { � �� � W � y � �! {-{ + a d � � � W � � b d� � � � �� � W � � b d� ��� 3 yNT � [ {

> ?GX54;47XB�I K 032G4�X54�¸,?G8:038CMW?NM=O + d � 03254a<,� 2B� A!�G8:A�4 ! DG.=< 0�M�� W � y � y ( � {-{ � �� � W � y � y ( � {-{ + d � y � � {

.=?GX 032G4 I�� 2B� A!�G8:A*4 !UDG.=< 0�M�� W � y � y ( � {-{ � �� � W � y � y ( � {-{ � � y � { + d y � � {'g

¨ 2G8c<C4�03254FO DG?B9 038CMW?GA � *, W � y � y ( � {-{ � �� �NW � y � y ( � {-{ S=47?54;IJ.10�4F03254 < .=<CS=4! GIJ. � ¨b2547? ( � g 3�3�3 g ( �.1I34aIVDG?G?G8:?GSI��C 4�AJ2G.=<:<`�GI3M H=4 yNT � [ {% K A325M=¨b8:?5SR032G.10� M=032 AJ8:X547A�.1I34a4 ! DG.=< 0�M

) � � � W�) ��� � � � � �� ) � � � � � y W � { �� ��� y � { 3 yNT � ; {

o 4;0 DGAbA303.1I30�¨b8C032 03254"<N� 2B� A��BM=O yNT � [ {\�8� 8CIJA�0�¨!4"?5M=0�4�032G.10!� O M=I .=<:< d JML J ( J �E�,.=<c< � 8:?03254*.=<CS=4! BIJ.�� H M=O` MWDB?GX547X�� H < 6R47.=AJD5IJ.� B<C4 O DG?G9 038CMW?BA MW? � .=?GXR.=<:<�W (�� � y [ � {\�� K#032G4��GI3M�� 4;I30 KM=O 9 MW?GXG8C038:MW?G.=< 4$#� 479 03.1038CMW?GAb.=?GX 03254a-/.1I��=M H��GI3M�� 4;I30LK�¨ 4�2G.7H=4#032G.10a dGy � W y � � {-{ + a d � a y � W y � � {-{ � � H �

+ a d � � a y W y � � {-{ � � H �+ a d � � y ) � � HhW8{ y � H1{ � 3>@OB¨!4F.��9�B<CK"032G8:A`I347A3DG<:0 I34!� 47.10�47XG<CK"0�M�03254��BI3M XBDG9 0�W � y � � � { � �� �NW � y � � {\��¸BIJA�0'�BI3M Q 479 038c?5S�MW?U0�M

� � � � �G032547? MW?U0�M�� � � � �B.=?GX .=<:< 032G4@¨ . K X5M=¨ ? 0�M�� � � �5032547?5¨!4aM� B03.=8:? yNT � ; {\�P 4$# 0F9 MW?BA38:X54;Ib03254#I=� 2B� A!�GM=O yNT � [ {\�`¨ 2B8:9J2 8:A 6RM=IJ4#XG8 %N9;DG<C0*0�M 2G.=?GXG<:4��IC 4"AJ2G.=<:< A32GM=¨ 032G.108C0*8:A�.=<cA�M(SW8CH=47?� K yNT � ; {\� 8:? 032GI34;4aA�0�4!�BA�&

3 =�N`D79���5M=Ib.=<:< dNJ ( J � .=?GX�� (�� � &a d y � � � { + a d y � � � { 3 yNT � T {

§ 47?G9 4�03254aI�� 2B� A��5M=O yNT � [ { X5M 47A*?5M=0*X54!� 47?GX MW? � y .=A <CMW?5S(.=A � ^ ( � {\�3 =�N`�­`���5M=Ib.=<:< dNJ L`J �Y� � (�� H*.=?GX W)(�� � y [ � {h&

a dEy � W ycb � { � � { + a dEy � y ) � � H W8{ ycb H\{ � � { 3 yNT � > {

3 =�N` & ��C 4*.��9�B<CK yNT � > {%IJ4!� 47.10�47XB<CK���¸BIJA�0l¨ 8C032 ( + ( � � L + ( � � � � � (�� � � � �1032547?�¨ 8C032 ( + ( � � � �L + ( � � ( � � (�� � � � �B9 MW?U038:? DG8:?5SR.=<:< 032G4@¨ . K X5M=¨ ? 0�M ( + ( � �G.=?GX5¨!4aM� B03.=8:? yNT � ; {\�

\�V

Page 56: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

T 2UDBA!�50�M 9 MW6Q�B<:4;0�4a03254q�GI3M M=O 8C0�I3476(.=8:?BA 0�Mg�GI3M H=4 yNT � T {�.=?GX yNT � > {\��@�����v�g�v�Y7 �Bm`D50 � � & + 4$#L� y D � {�¨b8C032� D ��+ � � y b � {�g � b � � @ �

( ) � ycb � { ) ( �( 3T 2547? � � 8:A�.=AbX54�¸,?547X .� M H=4#.=?GX >@0p®M�� A*O M=IJ6#DB<:."SW8CH=47A

� � ��+ 4$#L� y D � { � D � /�( 4$#� y D � { y � D � { ( + � � � � y b � {�g � b � � g

¨ 254;IJ4 0h¨ M/0�4;IJ6(A�9;.=?G9 47<  479;.=DBA�4 y � D � { ( + ) � ycb � { ) ( �%>@0�O MW<:<CM=¨bAa032G.10 ( *, � � 8:A#. 6(.1I3038c?5SW.=<C4��T 254;IJ4;O M=I34��5O M=I � (�� � �a d y � � � { + a d y a y � � � � � � {-{

+ a d y �`a y � � � � � {-{+ a d y � � � { 3�@�����v�g�v��­`� P M=0�4#032G.10!�9 K > 0p®M�� A O M=IJ6�DG<:.L�

� y � � W ycb � {-{ + W y b � { � � � / � � � W ycb � { /�y � � � { y � W ycb � {-{+ � � � W ycb � { � � y b � {�g � b � � / � � W ycb � {'g � b � � / � � �

�( �NW y b � { �( / � � y b � {'g � W ycb � { � �( �

O MW<:<CM=¨b8:?5Sa.�9;.=<c9;DG<:.1038CMW?(AJ8:6(8:<:.1I 0�M yNT �:Y={ .=?BX yNT � ] {\�L§ 47?G9 4��UO M=I dSJ LPJ ( y ¨ 8C032 � (�� H�{¢¨ 4 2G. H=4�� K yNT � T {\�

��( a dEy � � � W y b � {�{ + �

�( a dEy � � � W ycb � {-{+ a d y � � � y :W8{ ycb � {�{+ a dEy � y :W8{ ycb � { � � {'g

¨ 254;IJ4 �& +�( � / � � g � � 8cA 03254"S=47?54;IJ.10�M=I�M=O y � � {\� T 254;I34;O M=I34"03254(<N� 28� A!� .=?BX 03254RI�� 2B� A!� M=O yNT � > {2G. H=4#03254"A3.=6R4�X54;IJ8CH1.1038CH=4Y¨ 8C032 IJ47A-� 479 0 0�M ( O M=I .=? K ( ^ Le^�d �8� 8:?B9 4a03254;K .1I34#4 !UDB.=< O M=I ( + L �03254;K 6�DGA�00 4 4 !UDB.=< O M=IF.=<:< ( ^�L ^ d �

T 254ÂA�.=6R4;I3MW? < -/.1I3038:? < � 8CIJA3.=?5M H O M=IV6#DG<c. 8:A�. S=47?54;IJ.=<c8:A3.1038CMW?£ UK£� 8CIJA3.=?5M H y Y >=[1d {�M=O*03254M=IJ8CSW8c?G.=< O M=IJ6#DB<:.(M=O�A .=6(4;I3MW? .=?BX -/.1I3038:? y Y >�V�V {bO M=I . 0�IV.=?GA3<:.1038CMW? 8:?5C�8C47?54;I A-�B.=9 4��S¨ 2G8c9J2�¨ 4?5Mp¨�SW8:H=4 .=A�.�A-� 479;8:.=< 9;.=A�4��9o 4;0 � 4 .#A2! DG.1I34 8:?U0�4;S=IJ.� B<C4FO DG?G9 038CMW? - d g�� . , [ � .=?BXN9 MW?BA38:X54;I 03254A32G8:O 0�47X ?5MW8cA�4 E1 SW8:H=47?� UKE1�� & + � �=g W � / 1�� 3

A <C47.1IV<CK 032G8cA�9 M=I3I347A-� MW?GXGA 0�M .(A32G8CO 0�8:? 03254�.=AJA�M 9;8c.10�47XÌ� I3M=¨b?G8:.=? 6RM=038CMW? SW8CH=47?5 KEb ��+

� �� � y L { � L / b ��3

PbM=¨@�BAJ8:?G9 4 032G8:A�AJ2G8CO 0�47X��!IJM=¨ ?G8c.=? 6RM=038CMW? AJ.1038:Aj¸B47A�032G4aA�0�M 9V2G.=A�038:9#XG8�Í 4;I347?U038:.=< 4 !UDG.1038:MW?� Eb ��+ � y ( { �*( / � b � g

\=\

Page 57: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

03254ÌA .=6R4;IJMW? < - .1IJ038:? < � 8CIVA3.=?5M H O M=IJ6�DG<:./A3. K AR032B.10�032G4��BI3M� B.� B8:<c8C0LK XG8:A30�IJ8� BD5038:MW?GA + .=?GX E+ .1I34I347<:.10�47X5 UK� E+� + + 4$#L� � ���� � y ( { � b �=@

�(���� � y ( { ( �( � + �

��� � �� � � � � 3T 2G8cAE? .=XGMW? < Pb8*�=M X5K 6 X54;IJ8CH1.1038CH=4 9;.=?½ 4 DB?GX54;IJA�0�M M X .=A". ! D5M=038C47?U0�M=O|� .=DGA3AJ8:.=? X547?BA38C038C47A!�%.=A03254 O MW<:<CM=¨b8:?5S#.=?B.=<CM=S=KNAJ25M=¨ A��Lo 4;0�Ì 4b03254 A�03.=?BXG.1IJX5� .=DGA3AJ8:.=? X547?GA38C0 K(MW? 03254 I347.=< <:8c?54��U.=?GX � �8:A�8C03A*0�IJ.=?GA3<:.10�4�M H=4;Ib. XG8:A�03.=?G9 4�$ ( [0� 032547?

� � y � {� y � { + �

� �� d � � � ��� �� d � + � ( � d � �� � � 3

\=[

Page 58: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� � � � � c� � � ��� ��� �+�[� � � � ����� � �6� �T 254gn�.=<:6(.=? < � DG9 K̸,<C0�4;I�8:A .=? .=<CS=M=IJ8C032G6 032B.10q¸,<C0�4;IJA MWDG0 IJ.=?GX5MW6 4;I3IJM=IJA M 9;9;D5I3IJ8:?GS 8c? 032G4(M� <A�4;I3H1.1038CMW? M=Ob./A�0�M 9J2G.=A3038:9Â�GI3M 9 47A3A!�lC�2G47?£�,D50#MW? ./O .=A�0R9 MW6Q�BD50�4;I��%03254 .=<CS=M=IJ8:032G6 O MW<:<CMp¨ A�03254M� BA�4;IJH .1038CMW?BAR8:? � I347.=< 038:6R4 � & .10R47.=9J2 6RMW6R47?U0R8C0d�GI3M XGDG9 47A�03254 47A�0d� MWAJA38� B<C4 47A�038:6(.10�4 M=OF03254.=9 03DG.=< H1.=<:D54 M=O 032G4|�BI3M 9 47AJA�DG?GX54;I M� BA�4;I3H1.1038CMW? y SW8CH=47? 9 4;IJ03.=8:?Â�GI3M� B.� ,8:<:8:A�038c9*.=A3A3DG6g�G038CMW?GA!MW? 03254�GI3M 9 47A3A*8:03A�47<CO�.=?BX MW? 03254aM� ,A�4;I3H1.1038CMW? 4;I3I3M=IVA\{\�

T 254q¸,<:0�4;I 8:A*9;.=<:<:47X � <:8:?547.1Ih�Q 479;.=DGA�4a03254�47A�038:6(.10�47AFX54!� 47?GX <:8:?G47.1IJ<CK MW? 03254aM� BA34;I3H .1038:MW?GA!�> ? O .=9 0!��03254 6RM X547< MW?�¨ 2G8:9V2 03254 .=<CS=M=IJ8:032G6 8:Aq ,.=A�47XZ8:AaAJ8C03DG.10�47XZ8:? .5§b8c<� 4;I30 A-�B.=9 4(M=O�Q�MW8:? 03<:K� .=DGAJA38:.=? IJ.=?GX5MW6 H1.1IJ8:.� B<C47AY¨ 8C032 6R47.=? 5;4;I3MI� > ? AJDG9J2 ./A-�B.=9 4 8:?GX54!� 47?GXG47?G9 4 8:A#4 !UDB8CH .=<:47? 0�0�MM=I30325M=S=MW?B.=<:8C0LK��S�5M=IF03254aS=47?54;IJ.=< ?5MW?G<:8:?G47.1I�03254;M=I3K M=O A�0�M 9V2G.=A�038:9@¸,<C0�4;IJ8c?5Sd¨!4aIJ4;O 4;Ib0�M 03254@ M M�� M=Ona.=<:<c8:.=?I�BD5I y Y >�T1d {\�

T 254Q B.=A38c9�8cX547. M=O <c8:?547.1I|¸,<C0�4;IJ8c?5S 8:A� 47A�0aDG?GX54;IVA�0�MUM XK UK . A38:6g�B<C4�4$# .=6Q�,<C4��8�5I3MW6 03254;I34¨ 4�A32G.=<:<S BDB8:<:X DI� 03254aO DG<:< 6RM X547< M=O¢na.=<:6(.=? .=?GX5� DG9 K��� �N7 ��� #M% `�K±��79�Q� � ��� ��#( ����3� �v� #k 4�^��9�Ke����#v������% �:#9�6�$#�"K±�o 4;0 � 4 .Ï� .=DGAJA38:.=?NIJ.=?GX5MW6 H1.1IJ8:.� B<:4�¨ 8:032N6(47.=? d .=?BX H1.1IJ8:.=?B9 4�' ( �v� DI�9� MWA�4b032G.100¨ 4 9;.=?B?5M=0M� BA�4;IJH=4�� XG8:I3479 03<CK��I BD50�MW?B<CKϨ 8:032 A�MW6R4aA36(.=<c<G� .=DGA3A38c.=? 4;I3I3M=I� �G8:?GXG4!� 47?BX547? 0 M=O ���5032G.10b2G.=A6R47.=? d .=?GX H1.1IJ8:.=?G9 4 > ( �3� MQ¨ 4aM� BA34;I3H=4

DM& + � / � 3C 4#.1IJ4#8:?U0�4;I347A�0�47X 8:? 03254E 47A�0�47A3038:6(.10�4 ®� M=O � B.=A�47X MW? MWD5I M� BA34;I3H .1038:MW? M=O D .=?GX 03254#.� M H=4.=A3A3DB6Q�G038CMW?GA�� >@0"8cA#IJ47.=A�MW?G.� B<C4 0�M 8:?U0�4;I��GI34;0 � 47A�02� .=A"03254 I34 ! DG8CI3476(47? 0�032G.10ea y-y � @ ®�µ{ ( {Y 46(8:?B8:6(.=<N�¨ 2G8:9V2 <C47.=XGA�0�M

®� & + a y � � � y D�{-{'g8N� 4����G032G4�M=I30325M=S=MW?B.=<8�GI3M Q�479 038CMW? M=O � MW?U0�M � ( y �:g�� y D�{�g + {1�v¨ 2G4;I34 � y D�{ 8:A�03254 < .=<CS=4! GIJ.(S=47? <4;IJ.10�47XÌ UK DE� T 2G8:A�8:A 4 ! DG8CH1.=<C47?U0�0�Mg�GI3M Q�479 038:?5S � MW?U0�M 03254 MW?54 < XB8:6R47?GA38:MW?G.=< A-�B.=9 4 [ DE��@���` �3 4�$ ����3� � �N7Á¡¢M3ad]Ia1b�+¥a1b�+N)¦4ÏJL+ha@&�¤ � )¦b w¬),�=a12�]!i��*b1a!a f¢)�wv#����

®� +a y � D�{a y D ( { D +

' (' ( / > ( D 3

�@�����v� � m`D50�_& +

' (' ( / > ( D 3

T 2547?8�I 479;.=DBA�4:a y �� { + d �a�� y � @ �Q{ D � + a � � > ( � @ ' ( �' ( / > ( � � � / � � � + d 3

� M y � @ �Q{ � DE�v�5M=I`Q MW8:?U03<CK5� .=DGA3AJ8:.=? IJ.=?GXGMW6 H1.1IJ8:.� B<C47A%¨b8C032 6R47.=? 5;4;I3MI�,M=IJ0325M=S=MW?G.=<:8C0 K y 8N� 4����.� BA�47?B9 4*M=O 9 M=I3I347<:.1038CMW?S{%8:6Q�B<:8:47A%8c?GX54!� 47?GX547?G9 4��¬� M y � @ ��{ ��� DE�=>@0 O MW<:<CM=¨bA 032G.10� @ � ��� � O M=I\�;

Page 59: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

W = (0, m) Z = (a, m)

X^

X = (a, 0)

� 8CSWD5I34 \ &I?*47<c.1038CH=4q� MWA38C038CMW?GA!M=O �£� � � D .=?GX ®� 8c? 03254aA��B.=9 4 A-�B.=?G?547X� K � .=?GX � �v�FIJ0325M=S=M <?G.=<:8:0LK 9 M=I3I347A-� MW?GXBA*0�M 8:?GX54!� 47?GX547?B9 4�� _ 8:A�03.=?G9 47AF8:? 032G4Y�B<c.=?54�9 M=I3I347A�� MW?BX 0�M XG8:A�03.=?G9 47AF8:? 6R47.=?A2! DG.1I34��.=<:< � (-� ( y �`g�� y D�{hg + {\� .=?BX A38c?G9 4 � ( � ( y �:g�� y D�{hg + { 8C0FO MW<:<CM=¨bA 032G.10 � + a y � � � y D�{-{ + & ®�y A�4;4E� 8CSI� \ {\�

T 254a6(47.=? A2! DG.1I34aXG8:A303.=?G9 4q 4;0h¨ 4;47? � .=?GX ®� 9;.=?� 4 I347.=X M�Í O IJMW6 � 8CSI� \ &) � @ ®� ) ( + ) � ) ( @ ) ®� ) ( + ' ( @ ' �

' ( / > ( +' ( > (' ( / > ( + � Y

' ( /Y> ( � � 3

PbM=0�4�032G.10 ) � @ ®� ) J 6(8:? y '�g > {\�� �¦­ ��� #M% `�K±�K­`�Z���N`¥�N#: p�N�&��l ���� �:#: ����3� �3�d#µ 4�^��9MK±�K��#v���"�M% �:#9�6��# �Ke�Pb4$# 0!�G<C4;0 DGA 6R47.=A3DGI34�� A�4;H=4;IJ.=< 038:6R47A ¨ 8:032 8N� 8,� XB�L� .=DBA3A38:.=?NM� BA�4;IJH .1038CMW?N4;I3IJM=IJA � � g � ( g 3�3�3 g � � �.=<:< 8:?BX54!� 47?GX547?U0!M=O ��� T 2G8:A SW8CH=47A DGA�03254aA�4 ! D547?G9 4�M=O%MWDG039 MW6R47A

D � + � / � � g y�� + Y g �� g �9{ 3WbSW.=8:?�¨ 4�.=A-� O M=I 03254q 47A�0�47A�038:6(.10�4 ®� � ,.=A�47X MW? 032547A34aM� BA�4;I3H1.1038CMW?GA��G 5G�!�v���!% � �¦­f¡¢M3ad]Ia1b�+¥a1b�+N)*4�JL+ha@&�¤ � J�¤s+ha\[ �Ì&L]�b1a\[=�1JL+N)±&�29b�)*b w¬),�=a12£]�i

®� � & + a y � � � y D � g 3�3�3 ghD � {-{ + ' (' ( / �� > (

�� Y�

��� ��� D � �� 3

PbM=0�4 032G.10 ®� � , ��.=<:6RMWA�0RA3DGI347<CKZ.=A � , *��� 479;.=DGA34 �� � �� ��� � � @ , d .=<:6RMWA�0RA3D5IJ47<CKZ.=A� @ , *¾� T 2 DGA!� O IJ4 !UD547?U0�M� BA�4;IJH .1038CMW? .=<:<CMp¨ A�DGA�0�M(IJ4;0�IJ8C4;H=4�� ¨ 8C0325MWDG0 4;IJI3M=I��

C 4#A32G.=<c<B�GI3M H=4 T 254;M=IJ476 > � ] 8c? 0h¨ MϨ .7K A!�`�%8:IJA�00¨ 4#A32G.=<c< SW8CH=4#. XG8CI3479 00�GIJMUM=Os�vWbO 0�4;Ib032G.10¨ 4aA32G.=<:< SW8CH=4a."IJ479;D5IJA38CH=4q�BI3MUM=O%A3D5S=S=47A�038c?5S(.d¨ . K 0�M 8:6Q�B<:476R47? 0 032G8cA 47A�038:6(.1038CMW?Â�BI3M 9 47XBD5I34 8:? .6(.=9V2G8:?54a8:? � IJ47.=< 038:6R4 �L�

\�T

Page 60: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� �e���� �@�����3� � WbAF03254��GI3M� ,<C476 8:AF<:8:?G47.1I��,.=?GX/.=AF03254;I34"8:AF?5M IJ47.=A�MW?/0�M��GIJ4;O 4;I .=? K MW?54M=O 03254UD � 0�M .=?5M=03254;I=�B<C4;0*DGA�0�IJKN.=A MWD5I� 47A�0�47A�038:6 .10�4

� � + � ���� ��� D �

O M=I A3MW6R4/9 MW?BA�03.=? 0 � � �%WbSW.=8:?B�%¨!4/I34 ! DG8CI34 a y�y � @ � � { D " { + d¾y $ + Y g 3�3�3 g �9{\��� MI�  479;.=DGA�4a y � D " { + a y � ( { + ' ( �

d + a y=y � @ � � { D " { + a�� ��

� @ � ���� ��� D � �� D " �� + ' ( @ � �

��� ��� a y D " D � { 3PbM=¨

a y D " D � { + a � y � / � " { y � / � � { � + � ' ( 8CO $ #+ � ' (�/ > ( 8CO $ + � �

¨ 2G8c9J2 SW8CH=47A��� ��� a y D " D � { + ��' ( / > ( 3

EFA38:?5SR032G8cA I347A3DG<C0%¨ 4aM� G03.=8:?� � + ' (��' ( / > ( +

Y�

' (' ( / �� > ( 3

T 254;IJ4;O M=I34�� � + ®� � 8:O � � 8cA SW8CH=47? 03254�.� M H=4aH .=<cD54���

���>���p 4� �S� �E�����3� � T 2G4 S=MW.=< M=O%032G8:A%�GI3M M=O 8:A 0�MQ¸,?GX .(I3479;D5I3I347?B9 4 I347<:.1038CMW? 8:? � O M=I ®� � �T 2G8cA*8:AFX5MW?54E K 6R47.=?GAbM=O .��GI3M 9 47XGD5I34a032B.10F8:A 47A3A�47?U038:.=<�0�MN<:8c?547.1I0¸,<C0�4;IV8:?5S &GMW?54�8:X547?U038�¸B47A�¨ 2G.108:Ad�S²!Ê 8:? 47.=9V2ZM=O 03254(9 MW?GA�479;DG038CH=4(M� BA�4;IJH .1038CMW?BAq UK 6R47.=?GAaM=O 032G4(A�M < 9;.=<:<C47Xº�±�9�3��;����^�N���K�3�-���\²����y 1 � { � � �B>@? 0�4;IJ6 A�M=O � � �503254@�GI3M Q�479 038CMW? MW?U0�M�� � & + A-�B.=? y D � g 3�3�3 ghD � { 8:? 032G4�A-�B8CIV8C0!M=O¢� 8CSI� \ &

� � � + a y � � � y D � g 3�3�3 ghD � {-{hg1 � 8:A�X54�¸ ?547X .=A*O MW<:<CMp¨ A�&

1 � & + D � @ � � � � y D � { + D � @ � � � � y � / � � { + D � @ � � � � y ��{ + D � @ ®� � � � 3T 254 1 � g 3�3�3 g 1 � � � .=<:<,<:8C4 8c?(03254 A-�B.=9 4�� � � � �¨ 254;I347.=A 1 � 8cA`M=I3032GM=S=MW?G.=<B0�MR8C0!�U> 0!O MW<c<CM=¨ A!032G.10 032541 � .1IJ4�M=I30325M=S=MW?B.=<N�B�58:?G9 4�XG8c6 y � � { + � �B032G4#H1.1IJ8:.� B<:47A 1 � g 3�3�3 g 1 � O M=IJ6 .=? M=I30325M=S=MW?B.=<� ,.=A38:A*M=O� � � T 254;I34;O M=I34

®� � & + � � � +��� ��� a y � 1 � {a y 1 (� { 1 � yN> �:Y={

\�>

Page 61: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

¨ 8C032 032G4�9 MU4$%N9;8C47? 03AbX54;0�4;IJ6(8c?547X UKN03254aM=IJ0325M=S=MW?G.=<:8C0 K��BI3M�� 4;I30LK��BPbM=¨E�a y � 1 � { + a � � � � / � � @ ®� � � �

+ a � � � � @ ®� � � � + a � � � @ ®� � � � ( � + & (� � �

y ®� � � � � � @ ®� � � � 479;.=DGA�4 ®� � � � + � � � � ��{ .=?BXa � 1 (� � + a � � � / � � @ ®� � � � ( � + > ( / (� � � g

y 479;.=DGA�4 � � � � .=?GX�� � � ®� � � � {\� T 2B8:A SW8CH=47A DBA�.RI3479;D5IJAJ8CMW? O M=I ®� � &®� � � � + ®� � / (�> ( / (� � D � � � @ ®� �

+ � > (> ( / (� � ®� � / � (�> ( / (� � D � � � g

¨ 254;IJ4!03254 I�� 2B� A�� 8:A .F9 MW? H=4$#R9 MW6Y B8:?G.1038CMW?8�pC 4*.1I34 .� B<C4 0�M 9;.=<:9;DG<:.10�4 (� UK#6R47.=?GA%M=OB03254 I3479;D5IVA38CMW?

(� @ (� � � + ) � @ ®� � ) ( @ ) � @ ®� � � � ) ( + ) � @ � � � ) ( @ ) � @ � � � � � ) (+ ) � � � @ � � � � � ) ( + ) ®� � � � @ ®� � ) ( + a y � 1 � � � { (a y 1 (� � � { + ��> ( / (� 3

T 2G8cA 4 !UDG.1038:MW? 9;.=?� 4aA38:6Q�,<:8�¸B47X� UK 9J2B.=?5SW8:?5SR0�M(032G4aI3479;8��GIJM 9;.=< M=O � � � &Y (� � � +

Y (�� Y / (�> ( � +

Y (�

/ Y> ( g

¨ 254;IJ4 (� + ' ( �9C 4�032UDGA0¸,?GX O M=I � 03254aI347<c.1038CMW?

(� + > ( ' (> ( / ��' ( 3 yN> � ] {

>@O yN> � ] {*8:A�A3DI BA3038C03D50�47X 8:?U0�M yN> � ] {\�B032G47?�¨!4@¸,?GX 03254 O MW<:<CMp¨ 8:?5S"I3479;D5IVA38CMW? I347<:.1038:MW? O M=I ®� � � � &®� � � � + � > (�/ ��' (

> ( /¾y � / Y={ ' ( � ®� � / � ' (> ( /�y � / Y={�' ( � D � � � 3 yN> � : {

T 2G8cA I347<:.1038CMW? 4$#L�GI347A3A�47A!03254F?54!¨ 47A3038:6(.10�4b.=A .#9 MW? H=4$# 9 MW6E B8c?G.1038CMW?(M=O 03254 MW<:X 47A�038:6(.10�4 .=?GX 03254?54!¨�M� ,A�4;I3H1.1038CMW?B�I¨ 2G8c9J2 8:A*9;<:47.1IJ<CK DBA�4;O DB< O M=I 9;.=<c9;DG<:.1038CMW? 8c? I347.=< 038:6R4���

[1d

Page 62: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� � & ��� #M% `�K±� & �Z��S�� ��^�������G ���l �����:#: ����S�&�3�d#v� �g���� 7 =���^��I�� 5"K±�� ¥���� `����B�� � C 4R?5M=¨ .��9�,<CK 03254�.� M H=4RI3479;D5IJA38:H=4E�GI3M=S=IV.=6 0�M 03254�M� BA�4;I3H1.1038CMW?GD � M=O`.=?µ�FIJ?GA30�478:? < EF2G<C47?� 479���GI3M 9 47A3A � � &

� � � +F@ � � � �*( / � � b � y � � � .=DBA3A38:.=?B� � � ��� b � { yN> � V {.=?GX

� D ��+ � � � �*( / � � � � y D � + d {\� yN> � \ {§b4;I34 b � .=?GX�� � .1I34�8:?BX54!� 47?GX547?U0%� I3Mp¨ ?G8:.=? 6RM=038CMW?GA!�,.=?GX � g � g ��g ��( [ .1IJ4@�B.1IJ.=6R4;0�4;IVA!�,PbM=0�4032G.10 � � �B<:. K Ab03254RA3.=6R4"I3MW<C4".=AF03254R8N� 8N� XB�,IJ.=?GX5MW6 H1.1IJ8:.� B<C47A � � 8:? 03254��GI34;H 8CMWDGAb4$# .=6g�B<C4�� .=?GXD � �B<:. K A 032G4FIJMW<C4bM=O�D � � T 254��,.1IJ.=6R4;0�4;IJA � .=?GX � .1I34 03254 X5IJ8CO 0 .=?GXN03254 XG8�Í DGA38CMW? 9 MU4$% 9;8:47? 03A�M=O03254 M� BA34;I3H=47X��GI3M 9 47A3A � � �IC 4#9;.=? 032G8:?I� M=O � .=A*A�MW6R4E� 8:?BX M=O 9 MWDI�B<c8:?5S"9 MW?GA�03.=?U0*032G.10 8:?BXG8:9;.10�47A25Mp¨ A�0�I3MW?5S 03254q�GI3M 9 47A3A D � 8:A*8:? 7 D547?G9 47X� UK � � � T 2G4q�B.1IJ.=6R4;0�4;I �E�,<:.7K A�03254 I3MW<:4 M=O > �G 5G�!�v���!% � � & � � �^���N#9�lkV#MK�%'#v�YI � �G�monQK$ =��� � ¯¢a�+0+NM3ad} [�29b�+ha1)¦2v~CB�Mv(ea12S]Ia=/ DYc`[1&I/1a1b�b � � J�2`_),+Nb�&L]�b\a\[p�1JL+N)e&�2gcB[1&L/1a1b�b0D � ]La�w¬),�=a12µ]!i � .�# � ��J�2`_ � .�# ���=#�¡¢M3a12�+NM3a c`[1& �!a=/=+N)e&�2 ®� � &�¤ � � &�2S+h& � � �+NM3aY/�(±&�b\a=_�(*)*2Sa�J�[�bhc8J�2Ì&�¤ y D H { ��� H � � �vb�JL+N)¦b-¼Sa1b@+NM3aqb�+h&L/jMvJ�b�+N)^/E_�) �8a\[1a123+N)eJ�(Ga��It�JL+N)±&�2

� ®� � + � @ � @� (� ( y ( { ( � ®� � �( /

�� ( y ( { ( � D � 3 yN> � [ {»'M3a\[�a y ( { ( b�JL+N)¦b-¼Sa1b@+NM3aE&p[!_�)*2vJ�[-iÌ_�) �8a\[1a12S+N)¦J�(Ga��It¬JL+N)e&�2

��( y ( { ( +F@ ] � y ( { ( / � ( @ � (� ( y ( { � 3 yN> � ; {

^ ! DG.1038CMW? yN> � [ { 8cA!032G4 .=?B.=<CM=SWD54 M=O 03254 I3479;DGIJA38CMW? yN> � : { 8:? ^ #5.=6Q�B<:4 ] .� M H=4�� ^ !UDB.1038CMW? yN> � ; { ¨ 8:<:< 4�A3MW<CH=47X .10b03254"47?GX M=O`032B8:AbA3479 038CMW?B�SC 4(A32G.=<:<G BDG8:<:X DI� 032G4��BI3MUM=O M=O T 254;M=I3476 > � : H 8:. A34;H=4;IJ.=<<C476(6 .=A!�

>@? M=IJX54;I"0�M 9;.=<:9;DG<:.10�4 ®� � �¢¨!4�¸BIJA�0�8:X547?U038CO K/032G4N8:?B?5M H1.1038CMW?£�GI3M 9 47A3A�M=O D � .=A#032G4N9;<CMWA347A�0.=?G.=<CM=SWDG4a0�M .=? M=I3032GM=S=MW?G.=<8 B.=AJ8:A!� T 2G8:A S=M 47A .=A O MW<c<CM=¨ A��Lo 4;0

? � & + � � /� � � �

� � � H @ ®� H � L 3 yN> � T {

T 2547?8�GA38:?G9 4PD ��+ � � � / � � �� � H � L �9¨!4#9;.=?�¨*IJ8C0�4

? ��+Y� � D �'@ � � �

�®� H � L � 3

§b47?G9 4� � ? � + � D ��@ � ®� � �( + y Y > @ � � { � D � g yN> � > {

�GI3M H 8cX547X�¨!4R03.��=4 � � y 032G4g�GI3M Q�479 038CMW? MW?U0�M � � { � Q3DGA�0@ 4;O M=I34 � �( � A�M 032B.10 � � � � �C+ d ���!479;.=DBA�4M=O yN> � > {\� ? � 8c?GX54;47X X547A34;I3H=47A 032G4�?G.=6R4#M=O 8c?G?5M H1.1038CMW?Ì�GI3M 9 47A3A�&B8C0b8:A�MW<:.10�47A O I3MW6 03254aM� BA34;I3H .1038:MW?GA032G.10��,.1I300¨ 2G8:9V2 8:A*8:?BX54!� 47?GX547?U0!M=O%03254@�B.=A30!�T 254R8:X547. M=O!032G4��BI3MUM=O`M=O T 2G4;M=I3476 > � : 8:A ?5M=¨ 0�M�¨ IJ8C0�4 ®� � .=A . A30�M 9V2G.=A�038:9R8:?U0�4;S=IJ.=< M H=4;I03254 8c?G?5M H1.1038CMW?Q�BI3M 9 47AJA ? � � .=?G.=<CM=S=MWDGA`0�M�03254 4$#�B.=?BA38CMW? yN> �:Y={ 8:?R03254*M=IJ0325M=S=MW?G.=<9 ,.=A38:A y 1 � {\� T 2G8:A

¨ 8:<c<3 4 X5MW?54#8:?�o 476(6 . > � \ .=?GX I34 ! DG8CIJ47A 03254aO MW<:<CM=¨b8:?5S"O .=9 0�&[ Y

Page 63: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� �!%_% # � ��P ? � )*b�J - [1&�»¥29)¦J�2�4�&+N)e&�2G#�@�����v� � T 254 O .=6 8:<CK � ? � � � 3�� � ��� 8:A�Q�MW8:?U03<CK¾� .=DBA3A38:.=?B� >@0 03254;I34;O M=I34ZA3D %N9 47A 0�M�A325M=¨ 032G.10 032549 M H1.1IJ8:.=?B9 4#8:A 03254#A3.=6R4a.=A*O M=I .g� I3Mp¨ ?G8:.=? 6RM=038CMW? y 9 Os� y ] � V {-{h& a y ? � ? H\{ + L � ( y L g ( ^ d {\��%8:IJA�0 ?5M=0�4R032G.10 ? � ( � � � .=?BX 032B.10 ? H @ ? � � � � O M=I L ^ ( 479;.=DGA34 ? H @ ? � + � H� � ? � +� H� - � � � / � � y � � @ ®� � { � #".%8:A M=I3032GM=S=MW?G.=< 0�M � � UK 9 MW?GA�0�IJDB9 038CMW?B� T .�� 8:?GSR4$#� 479 03.1038CMW?GA�¨!4�S=4;0

a y ? � ? H\{ @ a y ? (� { + a y ? � y ? H @ ? � {�{ + d g� MSa y ? � ? H { + a y ? (� {\�9C 4�?G4$# 0 9;.=<c9;DG<:.10�4a03254aXG4;IJ8CH1.1038CH=4 M=O ? (� &

� y ? (� { + ] ? � � ? � /�y � ? � { ( + ] ? � � ? � / �*( 3T .�� 8:?GSR4$#� 479 03.1038CMW?GA�¨!4�S=4;0

� a � ? (� � + ] a y ? � � ? � { / �( + �*( g 479;.=DGA�4 ? � ��� � ? � �G> ? 0�4;S=IV.1038CMW? ?5Mp¨�K 8C47<:XGA 03254aXG47A38CI347X I347AJDG<C0�&

a y ? � ? H { + a y ? (� { + ( + ( � L y LP^ ( { 3 �

C 4#?5Mp¨ 6(.��=4a03254�O MW<:<:M=¨ 8:?GS"9;<c.=8:6��I¨ 2G8c9J2 8:A 03254#.=?G.=<CM=SWD54 M=O yN> �:Y={\�� �!%_% # � �*R f3&p[�J�(*( � (&� ('y �:g�� g + { �G+NM3a0cB[1& ��a=/=+N)±&�2 � � &�2S+h& � � J�/=+N)*2Lw�&�2�� )*b%w¬),�=a12�]!i

� � � +� �� W � y L { � ? H g

»'M3a\[�a:W y L { & + a y � ? H1{1#Irj2Ïc8J�[=+N)^/pt�(¦J�[�� W � (&� ( y - d g ( .±{1#T 254d�GI3M M=O!8:A XG4;O 4;I3IJ47X 0�M <:.10�4;I��8WF? 4$#�B<c.=?G.1038CMW?/O M=I�032G8:AF03254;M=I3476 9;.=?µ 4"SW8CH=47?µ UK/9 MW6 <

�B.1IJ8c?5S"03254�8:?U0�4;S=IJ.=<B¨ 8:032 03254aA3DG6� � � +

��� ��� a y � 1 � { 1 � g¨ 254;IJ4 y 1 � {R8:A .=?�M=I30325MW?GM=IJ6(.=<� ,.=A38:A y a y 1 (� { + Y={\� T 2G4 9 MW? 038c?UD5MWDBA .=?G.=<CM=SWDG4 8:AR032G4 O M=IJ6(.=<4$#L�GI347A3A38:MW?

� � � +� �� a y � 1 H\{ 1 H � L y ¨ 8C032 1 H + ��� �

� H {

+� �� � �� L a y � ? H1{ � � ? H 3

T Mg�BI3M H=4Eo 476(6(. > � \ ¨!4�?G4;47X 03254aO MW<:<CMp¨ 8:?5S�0�479J2G?B8:9;.=< <C476 6(. &� �!%_% # � ��à ¡¢M3a|¤N&�(*(e&�»')*2Lw�+NMI[1a!aqbhc8J�/1a1b�J�[�a@a��It¬J�(B¤^&p[�J�(*( ( ^ d q[=]

Page 64: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

y 8±{ � � �y 8:8±{ � � �� W y L { � DIH � W)(&� ( y - d g ( .±{ � �y 8:8c8e{ � � �� � y L { � ? H � � (�� (�y - d g ( .±{ �¬#�@�����v� �&Y��L� 8CIJA�0 ¨ 4 AJ25M=¨�032G.10 y 8:8e{ 8:A .�9;<:MWA�47X <:8:?547.1I A-�B.=9 4��Io 4;0CD¾ 4F03254FM�� 4;IV.10�M=I � (�y - d g ( .±{ ,� (�y �:g + {*X54�¸,?547X .=A:D W + ���� W y L { � D H � T 2547?B�I 479;.=DGA�4 y � D H { ( + � ( � L �� ( ) W ) ( J ) D W ) ( J � � ( / � ( a � � �

� � (H � L � � ) W ) ( 3> ?GX54;47XB�I K 032G4a> 0p®M(8cA�MW6R4;0�I3K .=?GX 03254#8:?GX54!� 47?GX547?B9 4bM=O � .=?BX�� �I¨!4�2B.7H=4

a � � � �� W y L { � D H � ( � + a � � � � �

� W y L { � H � L / � � �� W y L { � � H � ( �

+ � ( a � � �� W y L { � H � L � ( / � ( ) W ) ( 3

T 254�¸,IJA�0 0�4;IJ6 8c? 03254aI�� 2B� A��G<:8C47A% 4;0h¨ 4;47? d .=?GX� ( � � �

� W y L { ( � L � a � � � �� � (H � L �"� 3

T 2G8cA*8:6Q�B<c8C47A 032G.10 D &�� (�y - d g ( .±{ , ? .=? y D|{*8:A� MWDG?BX547X .=?GX 2G.=Ab.Ï MWDG?GX547X 8c? H=4;IJA34��,A�M�? .=? y D�{8:A�9;<CMWA347XB�] �SA <:47.1IJ<CK�� � � 8:A*9 MW?U03.=8:?547X 8:? y 8:8e{¥ 479;.=DGA�4��BO M=I .=<c< d J LPJ ( �

DIH +� �� Y � � H � y #B{ � D � + D �3Y � � H � � (Ì? .=? y D�{ 3

A MW?UH=4;IJA�47<CK��UA3DI�9� MWA�4�032G.10 W + <:8:6 � " � W � ¨ 8C032NW � A38:6Q�,<C4�� T 2547? D W � ( A-�,.=? � y DIH\{ ��� H � � l��¨ 2G8c9J26R47.=?GA 032G.10 D W � 8:AN. <:8:?547.1I 9 MW6Y B8:?B.1038CMW? M=OSDIH!� dTJ LYJ ( � §b47?G9 4GD W ( � � �!A�M 032G.10 .=<:A�M� � � ?b.=? y D�{\� T 2 DGA!� y 8e{ + y 8c8e{\�: �9�| UH 8CMWDGAJ<CK�� y 8:8c8e{ 8:A 9;<CMWA�47X� 479;.=DGA�4 ? & � ( y - d g ( .±{ , � ( y �`g + { & � *, ���� � y L { � ? H 8:A!.=? 8:A3MW6R4;0�I3K��C 4�� ?GM=¨�032G.10 ?b.=? y ? { Z¿? .=? y D|{\� A38:?G9 4 ? H ( � ��+ ?b.=? y D�{ O M=I .=<c< dSJ LPJ ( � T M�AJ25M=¨�4 !UDB.=<:8C0LKM=O y 8e{ .=?BX y 8:8c8e{�¨!4�6#DBA�0 A325Mp¨ 032B.10:DIH�(�? .=? y ? {�O M=I .=<:< d J LeJ ( �,PbM=¨@� MW6(8C0�038:?GS �Z.=?GX ��O M=I03254�6(MW6R47? 0!�v¨!4�6 .7K¨*IJ8C0�4

� DIH + � ? H /®� H � L + � ? H / � �

H� � H y.- { � D � � � L g

O M=I A�MW6R4 ��H�(&� ( y - d g L .±{0 479;.=DBA�4 ®� H�( A-�B.=? y-y D�{ ��� � � H\{\�,A�M(032G.10!�GO M=I .=<:< � (&� ( y - d g ( .±{\�

� �� � y L { � ? H +

� �� � y L { � D H @

� �� � �

H� � H y.- { � D � � � y L { � L

+� �� � y.- { � D � @

� �� � � �

���H y.- { � y L { � L � � D � 3

[�:

Page 65: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

� KZ03254 03254;M=I3KZM=O�� MW<:0�4;I3IJ./8:? 0�4;S=IV.=<`4 ! DG.1038CMW?GA���8C0�8:AE� MWA3AJ8� B<C4RO M=I�.=?UK.# ^&d .=?GX y � H1{ ��� H � � 0�M9J2GMUMWA�4 �NA3DG9V2 032G.10� y.- { @

� ����H yc- { � y L { � L + Y > � � � � yc- { y d JY-UJ ( { 3

T 2547? D � + ���� Y > � � � � yc- { � D � + � �� � y L { � ? H (Ì? .=? y ? {\��

�@�����3� �v��� �!%_%'# � �¦R`� EbA34#03254�4 ! DG.=<:8C0 K M=O y 8e{*.=?BX y 8:8c8e{!O IJMW6 o 476(6(. > � [ 0�M M� G03.=8:?/.O DG?G9 038CMW? � (&� ( y - d g ( .±{�A3DG9V2 032G.10� � � +

� �� � y L { � ? H 3

T 2547?8�5O M=I dSJ # J ( �I¨ 4q¸,?GX K 032G4�8:A�MW6R4;0�IV8:9|�GI3M�� 4;I30LKNM=O 8:? 0�4;S=IV.1038CMW?5¨@� I=� 0!� ? � y o 476(6(. > � V {\�W y #`{ & + a y � ? � { + a y=y � � �Y{ ? � {

+ a ��� � �� � y L { � ? H � � � �

� Y > � � � � yc- { � ? � � �+ � � g7Y > � � � � � + � �

� � y - { � - g¨ 2G8c9J2 8:6Q�,<:8C47A W � + �3�vC 4a032 DGA*9 MW?G9;<cDGX54 032G.10 W � (&� ( - d g ( .�.=?GX � � � + � �� W ��y L { � ? H!�

P Mp¨·¨ 4�9;.=?5�GIJM H=4 T 2G4;M=I3476 > � : ��@�����v� � � K�o 476(6(. > � \ ¨ 4�6(. K¨*IJ8C0�4®� ��+ � � � ��+

� �� W �� y L { � ? H g

¨ 254;IJ4 W � y L { & + a y � � ? H�{��8o 4;0aDGA 9;.=<:9;DB<:.10�4 W � y L {bO M=I d J L J ( DGA38:?GSN032G4(A�MW<:D5038CMW?/M=O yN> � V { O M=I� � �9¨ 2B8:9J2 9;.=?� 4q¨*IV8C0�0�47? .=A

� � + �� �� 4 � � � � H � � b H / 4 � � � � � 3

C 4#2B.7H=4�&W � y L { + a y � � ? H\{

+ a � � � � � H / � � �H� � � � @ ®� � � # �"�

+� � �

H� a � � ��� � � @ ®� � � #

+� � �

H� a � 4 � � � � � � � � � � � @ ®� � � � #

+� � �

H� 4 � � � � � � a-� � � � @ ®� � ( � � # 3

[�V

Page 66: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

_ 8�Í 4;I347? 038c.1038:?5SR032G8:A 4$#L�GI347AJA38CMW?¨@� I�� A�� L ¨ 4 S=4;0W �� y L { +

� � 4 � � � � H � a � � � H @ ®� H ( � + &� � 4 � � � � H � y L { ( 3

T 2G8cA�6R47.=?GA�032G.10 ®� � A3.1038:Aj¸B47A*03254aA�0�M 9J2G.=A�038c9�XG8�Í 4;I347?U038:.=< 4 !UDB.1038CMW?�&� ®� � +

� � �� � ��( W �� y L {

� � ? H � �( / W �� y ( { � ? �+F@ � ®� � �( / W �� y ( { � Y� � D � @ � � ®� � �( �+ � @ � @

� (� ( y ( { ( � ®� � �( /�� ( y ( { ( � D � g

¨ 2G8c9J2 8:A yN> � [ {\� T MQ¸ ?G8:A32 03254@�GIJMUM=O�M=O T 2G4;M=I3476 > � : ¨ 4�6�DGA�0%¸,?GX .=? 4$#L�GI347AJA38CMW? O M=I y ( {��5SW8CH=47? K

y ( { ( & + a � � � ��@ ®� � ( � + a � � (� � @ a � ®� (� Sg¨ 254;IJ4 y DGA�4@o 476 6(. > � \ {a � � (� � + 4 � ( � � a � � (� � / � ( � �

� 4 � ( � � � H � � L +�� ��( a � � (� � +A@ ] �=a � � (� � / � ( g

.=?GX��*( a � ®� (� + �

�(� �� W �� y L { ( � L

+� �� ] W �� y L { ��*( W �� y L { � L / W �� y ( { (

+ @ ] � � �� W �� y L { ( � L /

� (� ( y ( { �+ @ ] �=a y ®� (� { /

� (� ( y ( { � 3>@0�O MW<:<:M=¨ A�032B.10 y ( { ( AJ.1038:Aj¸B47A yN> � ; {\� .=?GX T 2G4;M=I3476 > � : 8cA%�GI3M H=47X8�

>@? 03254 9;.=A�4 0�I347.10�47X .� M H=4��I¨ 254;IJ4 ��� � ���l� .=?GX � .1IJ4 9 MW?BA�03.=? 03A�� yN> � ; { 9;.=?� 4bA3MW<CH=47X y ¨ 8C032 y d { + 'L{!0�M(SW8:H=4

y ( { ( +� � @ � � ( 4$#� � � ('y � ( @ � � { ( � � ( �Y @ � 4$#L� y � ( y � ( @ � � { ( � � ( { g

¨ 254;IJ4� � + Y

� ( � @ � � ( @ � � � ( � ( / � ( � ( � ( + � ( � @ � � ( / � � � ( � ( / � ( � (

[=\

Page 67: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

.=?GX� +

' ( @ � �' ( @ � ( 3

T 2G8cA�8:A 47.=A38:<CKN9J25479��=47XK UK A3DI BA3038C03D5038CMW?B� T 254 O M=IJ6�DG<:.=A*.1IJ4a?5M=0*47.=A�K��3 BD50 4$#�,<:8:9;8C0!�C 4#?5M=0�4 032G.10 T 254;M=I3476 > � : I3476(.=8:?BA H .=<:8cX�¨b2547? �¥� � � �/.=?BX ��.1I34a.=<:<CMp¨!47X 0�M X54!� 47?GXNMW?038:6R4��

[=[

Page 68: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

��� � � � � � ����� ����� � ��� � � � � � � ��� � �* � E� � � �=��� � � ���

� m8���3� 3 65��MK±�� �#v���0�d�± 45��� � K�#9��> ? Y >�;�: � <:.=9��/.=?GXk� 9V25MW<C47A|�BDI B<c8:A32547X .��B.�� 4;I y .1O 0�4;I 0�¨!M I34@Q�479 038CMW?GA1{*9 MW?U03.=8:?G8:?GSN.NO M=IJ6#DB<:.(O M=I03254*O .=8CI��GIJ8:9 4�M=O . ^ D5I3M�� 47.=?(9;.=<:<GM��G038CMW?(MW? A�0�M 9�� A!� T 2B8:A O M=IJ6#DB<:. ?5M=¨�O M=IJ6(A 03254� B.=A38:A M=OS�BIJ8:9;8:?5S�GIJ.=9 038c9 4aMW? 032G4aM��G038CMW? 6(.1I��=4;0!�B>@0 8:A .Q¸,?54�4$# .=6Q�,<C4 M=O .��9�B<:8:47X A�0�M 9V2G.=A�038:9#.=?G.=<CK A38:A!�G.=?BX 6(.1I�� A03254@ 4;SW8:?B?G8:?5S#M=O .=? 4;IJ.Q¨ 4;I34@ B.=?I� A 476Q�B<:M K��GI3M� B.� B8c<:8:A�03A 032G.10 .1IJ4q¨!47<:< H=4;IJA�47X 8:? >@0p®M 9;.=<:9;DB<:DGA!�W y ^ DGI3M�� 47.=?3{ 9;.=<:<,M��G038CMW? MW?NA�0�M 9�� A 8:A!03254bIJ8CSW2U0!�¬ BD50 ?5M=0 03254 M� B<c8CSW.1038CMW?B�U0�MY BDGK".10 A�MW6R4FO D503D5I34038:6R4 ��."A32G.1I34 M=O A�0�M 9�� .10%�GIJ8:9 4��½�� M=032 � .=?GX � .1I34|¸ # 47XN.=2547.=XB�v� 8c?G9 4F.10 038:6(4 � 03254FH1.=<:D54M=O 03254aA�0�M 9�� 6(. K� 4a2G8:SW254;I�032G.=?��½�BA3DB9J2 ."IJ8:SW2 0 < 0�M < BDGK 8c? 8C03A�47<CO%2G.=A*.RH1.=<:D54�� T 2G4q�GI3M� B<C476&M=O032G8:A�A3479 038CMW? 8:A & � C�2G.10F8:A�.RI347.=A�MW?B.� B<C4q�GIJ8c9 4 O M=I*032B8:A IJ8CSW2U0 � �7�Î��N7 3 4�B��B �] �S���l O#v���� 7 4�B�� �`� ����3�� o 4;0 ycb � { � 3�� � ��� 4*A�03.=?GXG.1IVXg� I3M=¨ ?B8:.=?(6RM=038CMW? MW?R03254��BI3M� B.� B8:<c8C0LK�A-�B.=9 4 y �:g�� g + {'¨ 8C032�¸,<:0�IJ.1038CMW?y � � { � 3�� � � � �SC 4R6RM X547< 03254��GIJ8c9 4aM=O MW?54�A32G.1I34�M=O . 9 4;IJ03.=8:?µ���,��� �#MW? 03254Y¸,?G.=?B9;8:.=< 6(.1I��=4;0� K .=?>@0p®M < XG8�Í DGA38CMW? y ) � { � 3�� � ��� MW?R03254*8:?U0�4;I3H1.=< y d g * {\�UX547AJ9 IJ8� 47X� UK�03254*A�0�M 9J2G.=A3038:9*XG8�Í 4;I347?U038:.=< 4 !UDB.1038CMW?

� ) ��+ ) � y $ �*( / � b � { 3 y Y d �:Y={T 254 9 MW?GA303.=? 0 $ ( [ y DGA3DG.=<:<:Kg� MWA38C038CH=4p{!X547A39 IV8� 47A`03254 IJ47<:.1038CH=4 IJ.10�4 M=O%I34;03D5IJ?NM=O%03254aA32G.1IJ47A!� T 2549 MW?GA�03.=?U0 � d 8:AR9;.=<c<C47X 03254 ;��������^�±�Ë�±�^¶ .=?BX�6R47.=A3D5IJ47A"03254 A3865;4 M=OF03254 IJ.=?BX5MW6 7,DG9 03.1038:MW?GAR8:?03254aA�0�M 9��NH1.=<:D54��v� 2G.1I347A M=O%A�0�M 9��NI34!�GI347A�47?U0*A�MW6R4 IJ47.=< .=A3A�4;0!�5O M=I�4$# .=6Q�,<C4��B.1I3038:.=< Mp¨ ?54;IJA32B8�� M=O .9 MW6Q�B.=?UK�� T 254;K 9;.=?Ì 4q MWD5SW2U0�M=I A�MW<cX .10 .=?UK 038:6(4 ( .10 03254a9;D5I3I347?U00�GIJ8c9 4 ) � �o 4;0 DGA A3DI�9� MWA�4#032G.10 MW?/03254�6 .1I��=4;0a9 4;I303.=8:?/M=03254;IaA�479;DGIJ8C038C47A!� 9;.=<:<C47X Q����3���\� .1IJ4". H .=8c<:.� B<C4032G.10FK 8:47<:X . IJ8:A-� <C47A3A I34;03D5IJ? IJ.10�4 - ^�d � T 2G8cA 8:AF9 MW6Q�B.1IJ.� ,<C4�0�M 03254"8:?U0�4;I347A�0FMW?Ì B.=?9� .=9;9 MWDG? 03A��T 254 H1.=<:D54 � � M=O .d MW?GX AJ.1038:Aj¸B47A�032G4�XG8�Í 4;I347?U038:.=< 4 !UDG.1038:MW?

� � � + � � y.- �*( { 3 y Y d � ] {T 254 ! D547A�038CMW?K¨ 4(.1I34(.=XGX5IJ47A3A38:?5S 8:A�&`§bM=¨ 6�DG9J2µ¨!MWDG<cXz¨ 4Q 4Y¨b8:<:<:8:?GS(0�M��B.7K .10 038:6R4 d O M=I 03254IJ8CSW2U0a0�Mz BD5K .10�038:6R4 � MW?54 A32G.1I34(M=O*A30�M 9��Z.10�03254��GIJ8:9 4�� � d ¸ # 47X .=2547.=X �Â� DG9V2 . IJ8CSW2U0�8:A

[�;

Page 69: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

9;.=<:<C47XN.�Ç0�L�j�\�9²����z�1�,��� �Q�1�S�^�^���9� T 254*038:6(4 � 8:A!9;.=<c<C47X(03254g²����3�±�\¶Q�^�.Rg²!�U032G4��GIV8:9 4 � 8:A!9;.=<:<C47X 03254²��²��-�!�e�!²��3�1�N�\²�� T 2G8:A M��G038:MW?Â�GIJ8:9;8:?GS��BI3M� B<C476 03D5IJ?BA�MWD50�0�Mg 4a.Q�GIJM� B<C476&M=O A�0�M 9V2G.=A�038:9�9 MW? 0�I3MW<,�

Wb?5M=032G4;I 0LK� 4 M=OBM��B038CMW?"8:A%03254�� Rϲ��1�^�\���g���,��� �E�\�S�^�N���9�¬¨ 254;I34 03254 038:6R4 .10¢¨ 2G8:9V2#032G4 A32B.1I347A9;.=?z 4E MWDGSW2 0F8:A ?5M=0�¸ # 47X5 4;O M=IJ472G.=?GX5 ,D50*MW?G<CK 2G.=Ab.=? D9�9� 4;I <:8:6(8:0!� T 254@�GIV8:9;8:?5SQ�GIJM� B<C476 O M=IWF6R4;IJ8:9;.=? A�0�M 9���M��G038:MW?GA 9 MW? 03.=8c?GA!�*.��B.1I30 O I3MW6). A�0�M 9J2B.=A�038:9 9 MW?U0�I3MW< 47<C476R47?U0!� .=<:A3M . 2B.=<C038:?5S�GI3M� ,<C476�� > 0b8:A 03254;I34;O M=I34�6RM=IJ4aXG8 % 9;DG<:0!� .=?BX�¨!4a<:47.7H=4#8:0*.=A38:X54��

T 254bA3MW<:D5038CMW? 0�M#03254 ^ DGI3M�� 47.=?(M��G038CMW?��GIJ8c9;8:?5S@�GIJM� B<C476 8cA SW8CH=47?� KR03254|� <:.=9�� .=?GX�� 9J2GMW<C47AM��G038CMW?z�GIJ8c9;8:?5SRO M=IJ6#DB<:. y Y d � V {b.��9� 47.1IJ8:?5S .10b03254#47?GX M=O`032G8:A�� 479 038:MW?B�SWFAb032G8:A*O M=IJ6�DG<:.(XGMU47AF?5M=0<CM M��d¨ 25MW<C47<CK#0�IJ.=?GA-�,.1IJ.=? 0 .10Z¸BIJA30`A38CSW2U0!��¨ 4bA32G.=<c<58:? 0�IJM XGDB9 4�03254 I347AJDG<C0 8:?R032GI34;4 A�0�4!�BA��WIJ.=8:A38c?5S 03254<C4;H=47< M=O 9 MW6Q�,<C4$# 8:0LK A3<CM=¨b<CKÏ KN8c? 0�I3M XGDG9;8c?5S#032G4�8:?5S=I347XB8C47? 03A MW?G4q UK MW?54��7�Î��¦­ G 5��j%'#9�� ��^��9M#K±�5�#9 =�o 4;0bDGA%¸BIJA30 AJDI�9� MWA�4 032G.10� M=032 03254aA30�M 9����GIJ8:9 4 .=?GX 032G4@ MW?GX��GIJ8:9 4a.1I34#6(.1I3038:?5SW.=<:47A�& $ + - + d8:? ^ !UDB.1038CMW?GA y Y d �:Y={!.=?GX y Y d � ] {\�I�5M=I� MW?GXBA 032G8:A!A38:6Q�B<:K#6R47.=?GA`032G.10 0325478CI'�GIV8:9 4 8:A!9 MW?GA�03.=?U0�&U03254;K.1I34"03254(A�0�M 9�� < 6(.1I��=4;0�4 !UDG8:H .=<C47?U0FM=O� B.=?9� ?5M=0�47A!�8�5M=IaA30�M 9�� Aa8:0 6(47.=?GA 032G.10 0325478CI��GIJ8c9 4Y 472G. H=47A<:8��=4 032G4 4$#� MW?547?U038:.=< 6(.1IJ038:?5SW.=<C4 O MWDG?GX 8:?zA�2G.��G0�4;I \ &

) ��+ ) � 4$#� � b ��@ �( ( ( � 3

> ?Z032G8:A#A�03.1038CMW?G.1IJKµ¨!M=IV<:XZMWD5I�M��G038CMW?��GIJ8:9;8c?5S��GI3M� B<:476 8:A�47.=A�K�& . O .=8CIY�GIJ8:9 4%� .10#038c6R4 d M=O*03254IJ8CSW2U0�0�Mg BDGK .10*038:6(4�� .RA32G.1IJ4 M=O A30�M 9�� .10 03254@�GIJ8c9 4�� 8cA�S& + a � y ) � @ �µ{ � � g y Y d � : {

¨ 254;IJ4 � � A�03.=?BXGA�O M=Ib6(. # y d g � {\� >@?BX54;47XB�G8CO%03254#A30�M 9�� H .=<:DG4 ) � 03D5IJ?BA�MWD50*0�M� 4a<c.1I3S=4;I 032G.=? 032544$# 4;IJ9;8:A�4%�GIJ8c9 4 �½�1032547?"03254�25MW<:XG4;I%M=O,03254�M��G038CMW?"6(.��=47A`.��GI3M�¸B0%M=O ) � @ � K@ BD5K 8:?5SF03254�A32G.1IJ4 M=OA�0�M 9��(.10!03254��GIJ8c9 4 � 032G.10`254 8cA 47? 038:03<C47X(0�MI� .=?GXR032547? 8:6(6R47XG8c.10�47<CK#A�47<c<:8:?5S 8C0`.1SW.=8c? .10!8:03A 9;D5I3I347?U0H1.=<:D54 ) � �3� ? 03254 M=03254;Ib2B.=?GXB�58CO ) � J �½�5032547? 2G8cA M��G038CMW? 4$#L�B8CI347A�.=Ab.Q¨ M=I3032G<C47A3A�9 MW?U0�IJ.=9 0!�� 8:?G9 4@¨ 4�� ?5Mp¨ 032G4E�GIJ8c9 4@�GI3M 9 47A3A ) � 0�M� 4�.=? 4$#L� MW?547?U038:.=< 6(.1IJ038:?5SW.=<C4��9¨ 4"9;.=? 4$#L�B<:8:9;8:03<CK4;H1.=<:DG.10�4a03254�M��G038CMW?Â�GIJ8c9 4�� &

� + a�� y ) � @ �k{ � �+ a � � ) � � � � � � �� � � � @ � � �+� �� � � ) � ��� � �� � � � @ � � � � � � y�� { � �

+� ������� � � �� � � � � ) � � � � �� � � � @ � � � � � y�� { � �

+ ) � � � � � � <CM=S ) �� / Y] ( � � @ � � � � � � <CM=S ) �� @

Y] ( � � g

y Y d � V {

¨ 254;IJ4 ��� & # *, �� � � � �� � 8:A 03254N?5M=IJ6(.=<`XG8:A�0�IJ8* BD5038CMW? O DB9 038CMW?k¨ 8C032 6R47.=? d .=?BXZH1.1IJ8:.=?G9 4 � �

.=?GX � � +�

� (�� � � � * y @ � ( � ] � {F8:Ab03254R.=A3A�M 9;8:.10�47X X547?GAJ8C0LK O DG?G9 038CMW?8�,> ? y Y d � V {�¨!4R2G. H=4(6(.=X54"DGA�4M=O 03254 4 ! DG.=<:8C038C47A

� �� �� � � � y�� { + � � y�� @ � {hg

[�T

Page 70: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

.=?GX� �d � � y�� { � � + ��� y @ � { 3

T 254 .� M H=4 M��B038CMW? �GIV8:9;8:?5S O M=IJ6#DB<:.Z9 M H=4;IVA 032G4 9;.=A�4)$ + - + d �%� DGI��GIJ8:AJ8:?5SW<CK�� 8C0 .=<:A3M 9 M H=4;IJA03254 9;.=A�4 $ #+ d g - + d �`8N� 4���� $��,<:.7K A(?5M I3MW<:4 8:? 03254�¸,?G.=< I347AJDG<C0!� > ? O .=9 0!� 032G4 O DB<:<%� <c.=9�� .=?GX� 9V25MW<C47AbM��G038CMW?z�GIJ8:9;8:?GSRO M=IJ6�DG<:. 8:A*M� G03.=8c?547XÌ K A3DI ,A�038C03D5038:?GS�� � � � � O M=I � 0�MN03.��=4RX54;H .=<cDG.1038CMW?8:?U0�M .=9;9 MWDG?U0!� > 0�¨ .=A 032G8:A A3D5I��GIV8:A38:?5S XG8:AJ.��9� 47.1IJ.=?G9 4 M=O�$ O I3MW6 03254 O M=IJ6�DG<:. 032G.10N9;.=DGA�47X 03254XG8 %N9;DG<C038C47A 032G.10�� <:.=9�� .=?GXz� 9V25MW<C47A�4$#L� 4;IJ8C47?G9 47X 8:? S=4;0�038c?5S(0325478CI I347A3DG<C0�.=9;9 4!�G0�47X8�

Wb?GX 8:?GX54;47XB� O M=Ib.FQ3DGA�038�¸,9;.1038CMW? M=O 032547A�4�A303.10�476R47? 03A|¨ 4�?54;47X . 9 MW?GA38:X54;IV.� B<C4 4$# 0�47?BA38CMW? M=OMWD5I*032G4;M=I34;038:9;.=<8 ,.=9�� S=I3MWDG?GXB�7�Î�� & G 5��z�NW¥�� O�v�| 7 4�B��o =��#(���±��9>@O¥¨ 4(?5M=¨ XGI3M�� 03254(.=A3A3DB6Q�G038CMW?/032G.10�$ + d �B ,D50��=4;4!� - + d � 03254(8:?U03DG8C038:H=4�.1I3SWDB6R47? 0a<:47.=XG8:?5S0�M y Y d � : {% BI347.�� A�XGM=¨ ?B� > ?GX54;47XB�58CO $ � d �5032547? 03254;IJ4 8cA�.=? DI��¨ .1IJX X5IJ8:O 0 8:?N03254aA�0�M 9��NH .=<cD54 032G.106(.��=47A � X5MW<:<:.1IVA�.10 038:6R4 d � 8:?54 ! DG8CH1.=<C47?U0 0�M � X5MW<:<:.1IVA*.10 038:6(4�� �L�`� 8c6Q�B<CKg ,DG8:<:XG8c?5S#8:? . XG8:A39 MWDB? 0O .=9 0�M=I � � � � 8:A*8:<c< < O MWDB?GX547XB� .=?GX¨ 8:<:< 8:? O .=9 0*03D5IJ? MWDG0*0�MQ 4a8:?G9 M=I3I3479 0!�IC 4#A32G.=<:< 2G. H=4a0�M 9 MW?GAJ8:X54;IA�4;IJ8:MWDGA3<CK 03254 X54�¸ ?G8C038CMW? M=O . � O .=8CIg�BIJ8:9 4 �L� >@0 8:A(I347.=A�MW?G.� B<:4 0�M� B.=A34 A3DG9V2 . XG4�¸,?G8C038CMW? MW? 03254! D547A�038CMW? ¨ 2B.10R47<:A�4 9 MWDG<cX 4 X5MW?G4�¨ 8C032 .Z9;.��B8:03.=<��/XBD5IJ8:?5S/03254 8c? 0�4;I3H1.=< M=OF038:6R4 - d g�� .,� T 2G8:A GIJ8c?5SWA DGA�0�M(03254#A3DI Q�479 0�M=O0�^�j�����e��³��

� DI�9� MWA�4 032G.10`. X547.=<:4;I`8:?RA�479;D5IV8C038C47A 47?U0�4;IJA 03254 6 .1I��=4;0`.10 038:6R4 d ¨ 8C032".a9;.��B8C03.=< ��¬§b40 BD5K A.=?/.=6RMWDG?U0�' � M=O A�0�M 9��/.10b032G4#9;D5I3IJ47? 0��GIJ8:9 4 ) � �3�=4;4!�B8c?5S 03254#I347A�0 � � & + � @ ' � ) � 8:? 2G8cA�� M 9��=4;08:? 03254 O M=IJ6 M=O0 ,.=?I� ?GM=0�47A!� T 2G47? .10�032G4 038:6R47A ( � ( ( ( � �� ( � y + ��{a254 I34!� 47.103A#03254O MW<:<CM=¨b8:?5S��BI3M 9 47XBD5I34��po 4;0 $ ( � d g7Y g ] g �� g ] @ Y ����W 0 038:6(4 ( " � � MWD5I X547.=<C4;I=�3Q3DGX5SW8:?GS 03254%�B.=A�0 A�0�M 9��H1.=<:D547A ) � � y d J ( J ( " � � {\� X5479;8:XG47A`0�M"9J2G.=?GS=4F2G8cA`.=6RMWDG?U0`M=O�A�0�M 9��(O I3MW6 ' � � 0�M ' � � � � UKQ ,D5K 8c?5S M=IA�47<:<c8:?5SI�;>@OG254!9V25MUMWA347A 0�M� BDGK 6(M=I34`032G.=?�2G8:A�9;.��B8C03.=< 9;.=?��B.7K O M=I��1254¥ M=I3I3Mp¨ A 6(MW?54;K�� y 032 DGA 6(.�� 8:?5S�h� � � ?54;SW.1038CH=4p{\�%.=?GXk�=4;4!�BA#8:? 6(8:?GX 032B.10�2G8:A <CMW.=? 6#DGA30q 4Q�,.=8:X� B.=9�� 8:? XGD54R9 MWD5IJA�4���A3.7K .1O 0�4;I038:6R4 �Y� P 4;H=4;IJ032547<C47A3A!�%2G8:A 0�IJ.=XB8:?5SWAa6�DGA�0q 4Â�!²!� V O'�3���3���e�³�� 8N� 4���� MWD5I#X547.=<:4;I�A-� 47?GXGA ?5M 6(MW?54;K��.=?GX/M� G03.=8:?BAb?5M 6RMW?54;K O IJMW6 MWD503AJ8:X54�� M=03254;I 032G.=?/03254"<CMW.=?GA .=?GX A�0�M 9�� 0�IV.=XG8:?5SWAF6R47?U038CMW?547XB�8� M2G8:A*0�M=03.=<%9;.��,8C03.=< y � �L���1� !���Ë�^� ;����Ë�v² �¬{%Q�DGA30� 4;O M=IJ4 (�" � � 6�DGA�0� 4�4 !UDG.=< 0�M 03254Y� M=I30�O MW<c8CMRH .=<cD54�Q3DGA�0.1O 0�4;I 032G8:A�6(MW6R47? 0 M=O%038c6R4�&

' � � ) � � � � / �h� � + ' � � ��� ) � � � � / �h� � � � g y $ + d g7Y g �� g ] @ Y={ 3 y Y d � \ {^ 6g�B<CM K 8:?5S"03254a?GM=03.1038CMW? M=O¥A 2G.��B0�4;I ] �

y � ( { " & + (�" � � @ ( " y ���k{ " & + � � � � �I@ � � � g¨ 4�6(.7K¨*IV8C0�4 y Y d � \ {*.=A

y � 'L{ " y ) � � /�y � ) { " { /�y � � { " + d 3 y Y d � [ {C 4�?5M=0�4�032G.10*032G8:A 4 ! DG.1038CMW? 4$#L�GI347AJA�47A*.Q� 8:?GXNM=O � 038:6R4aX547<:. K � &B03254a.=6RMWDG?U0 ' � � M=O%A30�M 9��� MWD5SW2U0.10a038:6(4 (�" MW?G<CK 2G.=Aa8:03A 4�Í 479 0�.10�038:6(4 (�" � � � T 2G8cA X547<:.7K�¨ 8c<:< IJ476(.=8:? 4;H=47? .1O 0�4;I#03254 9 MW?U038:?UDGMWDGA038:6R4a<c8:6(8C0 8:A�03.��=47?B�v¨ 2547? 8C00¨b8:<:<,SW8CH=4aIJ8:A34 0�M .=? >@0p®M < 0�4;IJ6��

P Mp¨ 9 MW?GA38cX54;I�03254@� M=I30�O MW<:8CM"H1.=<:D54 � � .10*038:6(4 ( &� � & + ' � ) � / � � 3

[�>

Page 71: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

C 4#?GM=0�4a032G.10 8:? 032G4a9;.=A�4�M=O A�47<CO < ¸,?G.=?G9;8c?5S"0�IJ.=X54�&y � �E{ " & + � � � � ��@ � � �

+ ' � � ��� ) � � ��� / � � " � � @ ' � � � � � @ � � �+ y ' � � ����@ ' � � { y ) � � ���I@ ) � � { /�y �h� � � �I@��h� � { /�y ' � � ���I@ ' � � { ) � � / ' � � y ) � � � ��@ ) � � {+ y ��'L{ " y � ) { " /�y � � { " /�y � 'I{ " ) " / ' " y � ) { "T 254;IJ4;O M=I34 y Y d � [ { 9;.=?� 4q¨*IJ8:0�0�47? 9 MW?G9;8:A�47<:K .=A

y � �Y{ " + ' " y � ) { " 3PbM=¨@�=A38:?B9 4!03254;IJ4 8cA�?5M 47A3A347? 038:.=< <:8c6(8C0 0�M 03254 O I34 !UDG47?G9 KaM=OG0�IJ.=XG4�� 032G4 �,.1I3038C038CMW?#M=O - d g�� .GS=47?54;IV.10�47X KR03254FA34 !UD547?B9 4 M=O 038:6(47A d + ( � ( � ( ( �� ( � � � ( � + � 9;.=?� 4 6(.=X54 .1I� B8C0�IV.1IJ8:<CKE¸,?54��>@0*8:A�03254;I34;O M=I34aIJ47.=A�MW?G.� B<C4 0�M 6(.��=4a03254aO MW<:<CMp¨ 8:?5SR8:XG47.=<:8:A3.1038CMW?8����Nn¢�"�$ ����3� � W ��²�� hV O'�3���3�!�±��³£�^�j�����e��³ �1�^�-���h²,³�¶ 8:AR.��B.=8CI y '�g � {"M=O A2! DG.1I34 < 8:?U0�4;S=IJ.� B<C4 .=XB.��G0�47X�GI3M 9 47A3A�47A*MW? - d g�� .�¨b8C032 9 MW? 038c?UD5MWDBA0�B.1032GA!�GAJDG9J2 032B.10*03254�A3DB6 � � & + ' � ) � / � � AJ.1038:Aj¸B47A

� � � + ' � � ) � 3 y Y d � ; {

C 4 .1I34 ?5Mp¨ 8:? .�� MWA38C038CMW? 0�MZX54�¸ ?54�¨ 2G.10d¨ 4 6R47.=? K 03254 � O .=8CIQ�GIV8:9 4 � M=OF. 9;<c.=8:6 M=IM��G038CMW?8�¬o 4;0 � & - d g * { , - d g * {' 4b6R47.=A3D5IJ.� ,<C4��¬� K(.��������.R �,� � y ) � {¢¨!4F6R47.=? 032G4*IJ8CSW2U0`0�M�9;.=A328:? .10*038c6R4�� 03254�.=6(MWDG? 0 � y ) � {\�9¨ 2B8:9J2 X54!� 47?GXBA MW? 03254�9;D5IJI347? 0*A30�M 9��NH1.=<:D54 ) � .10*038:6R4��E����Nn¢�"�$ ����3� �ÏW 9;<:.=8c6 0�M � y ) � {�8:A 9;.=<:<C47X���²����L�3�¬���v�G8CO,03254;I34 4$#58:A�03A . A�47<CO < ¸,?G.=?G9;8c?5SbA�0�IV.10�4;S=K y '�g � {A3DG9V2 032G.10�¨b8C032Â�GI3M� B.� ,8:<:8C0 K Y��

� � & + ' � ) � / � � + � y ) � { 3� K 03254� ����e�%�S�\�N�\²�� y � y ) � {-{ M=O ."I347XGDG?GXB.=? 0�9;<:.=8:6 0�M�� y ) � {�¨ 4�6R47.=?

� y � y ) � {-{ & + � � + ' � ) � / � � 3� M�� y � y ) � {-{ + �(8:O � 9 MWDG<:XÌ 4�DGA347X .=AF03254"A�03.1I3038:?GS 9;.��B8C03.=<&� + ' � ) � / � � O M=I . 0�IV.=XG8:?5S

y '�g � { 032G.10*47?GXGA DI��¨ 8C032 � y ) � { ¨ 8C032 9 4;IJ03.=8:? 0 K��7�Î���P � � �� �:#: ����3�> ?(03254�¸,?G.=?G9;8:.=<B<:8C0�4;IJ.103D5IJ4�03254b.� M H=4 X54�¸,?B8C038CMW?R8:A!DGA3DG.=<:<:K#6RM=038CH1.10�47X� UKR03254 O MW<:<:M=¨ 8:?GSa.1I3SWDG6R47?U0y .(A�M < 9;.=<c<C47X���� Q��^�^�j�=³�²b.1I3SWDG6R47?U0\{\�

� DI�9� MWA�4#032G.10a9;<:.=8:6(AF0�M � y ) � {�¨!4;I34"0�IJ.=XG47X .10 038:6R4 d .10 .Â�BIJ8:9 4 * 2G8CSW254;IF032G.=? �� T 2547?8C0�¨!MWDG<cXÌ 4E� MWA3AJ8� B<C4 0�M 6(.��=4".=? DG?¬ MWDG?BX547X .=?GX IJ8:A-� <C47A3A��GI3M�¸B0 y .=? � .1I� B8C0�IJ.1S=4 �¬{� K A�47<:<c8:?5S ]A3DG9V2 9;<c.=8:6(AaO M=I�03254N6 .1I��=4;0Y�BIJ8:9 4 * � 032547? 0�M IJ47A�4;I3H=4 .=? .=6RMWDB? 0 ] � .=A�8:?G8C038:.=<`9;.��B8C03.=<!O M=I�03254A�47<CO < ¸,?G.=?B9;8:?5S A30�IJ.10�4;S=K y.] '�g ] � {�� K 8C47<cXG8:?5S�¨ 8C032K�GI3M� B.� ,8:<:8C0 K Y�03254(.=6(MWDG? 0 ] � y ) � {F?54;47X547X/0�MA3.1038:A3O K#03254�9;<:.=8:6(A�� .=?GX"032G47?"0�Mq� M 9��=4;0 032G4*XG8�Í 4;I347?G9 4 ]¥y * @ ��{\�¬A MW?UH=4;IJA�47<CK��U8COG03254�6(.1I��=4;0¥�GIJ8:9 4* M=O 03254 9;<c.=8:6 ¨ MWDG<:X� 4(<CM=¨ 4;I�032B.=?��� 032547? MW?54 9 MWDG<:Xk BDGK ] 9;<:.=8c6(A .=?GXZ.��9�,<CK 032G4 A�0�IJ.10�4;S=Ky @ ] '�g @ ] � {�K 8:47<:XG8:?5SF.=?(8:6(6(47XG8:.10�4�SW.=8:?"M=O ]¥y � @ * { .10 038:6R4 d ��W 0 038:6R4 � MW?G4*9 MWDG<:XR9;.=?G9 47<BMW?54�� A

; d

Page 72: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

X54! G03A@ UK 4$# 479;D5038:?5S 03254 ] 9;<:.=8:6(A 0�M � y ) � {\� >@0�A32GMWDG<:XK 4(.=XG6(8C0�0�47X 032B.10�032G8:A A3479 MW?GX A�0�IV.10�4;S=K��8:?UH=MW<CH 8:?5S ?54;SW.1038CH=4 A32B.1I34R25MW<:XG8:?GSWA y M=IQ�\��������!���*²1�bM=O A�0�M 9��9{\� 8:A A�MW6R4!¨b2G.10a6RM=I34R.1I3038�¸ 9;8:.=<%032G.=?03254q¸,IJA�0!�I� D50 9;<C47.1IJ<:K��503254@� MWA3A38� ,8:<:8C0 KRM=O%.1I� ,8C0�IJ.1S=4�8:A�?GM=0*O .=8:I��T 2G8:A�9 MW?G9;<:DGXG47A#032G4 6RM=038CH1.1038CMW? M=O _ 4�¸,?G8C038:MW?�Y d � : �`>@? 479 MW?5MW6(8c9 032G4;M=I3K MW?G4NM=O 0�47? S=M 47AMW?54 A�0�4!� O D5I303254;I".=?GX .=A3A3DG6(47A#032B.10".1I� B8C0�IJ.1S=4 8:? O .=9 0(X5M 47A"?5M=0�M 9;9;D5I=�%>@0"8:A#9;<c.=8:6R47X 032G.10"03254

� MWA3A38� ,8:<:8C0 K(M=O .1I� B8C0�IV.1S=4E¨ MWDG<:X 8:6 6R47XG8:.10�47<CK� 4#DGA347X� UK MW?G4�M=O 03254Y�B.1I3038C47A MW? 03254�6(.1I��=4;0!� .=?GX032G8:A%¨ MWDG<:X A34;0*03254�6(.1I��=4;0��GIJ8:9 4 4 ! DG.=< 0�M 03254 O .=8:I��GIJ8:9 4��7�Î��¦Rf��� 4�"K p

G 5G�!�v���!% 7�Î��^7�¯la�+ � ( � � y d g * {1# }%2£J�b�+h&I/EDµ4ÏJ�[ D�a�+E»'),+NM3&LtI+@]I&�2`_bE&p[E)*2S+ha\[1a1b�+ �*),# a�# � »'),+NM- + d ����+NM3aq¤±J�)�[¥cB[�)^/1a�JL+�+N)*4�a UY&�¤¢JÂ/�(¦J�)*4 +h& � y ) � {0JL+�+N)*4�a � � d )*b� y � y ) � {-{ + a y � y � � {-{hg

»'M3a\[�a y � � { � 3�� � ��� )*b�+NM3aKaTS�c¢&�2Sa123+N)¦J�(|4ÏJ�[=+N)¦2Lw�J�(ea�»'),+NM c8J�[\J�4�a�+ha\[ b�+,J�[=+N)*2IwºJL+ ) � �0),# a�# �@+NM3ab\&�(ht9+N)e&�2Ì&�¤�+NMSa�b�+h&I/sMvJ�b�+N)N/@_�) �8a\[1a12S+N)¦J�(Ga��It¬JL+N)e&�2

� � � + � � y � b � { »')h+NM � � + ) � 3 y Y d � T {

� �3����K�K�#9��mª7�Î��¦­�rj2£+NMSaEJI]�b1a12`/1aY&�¤�]L&�2B_�b|&p[q)*2S+ha\[1a1b�+|+NM3aq¤^J�)�[0c`[�)^/1aEJL+�+N)¦4�a Ug&�¤¥J�2k&�cZ+N)e&�2½+h&JQb�M3J�[1aq&�¤�b=+h&L/ DÌJL+�+N)*4�a �«)¦b

� � y ) � @ �µ{ � � + a � y � � @ �µ{ � � g»'M3a\[�a � � )*b�+NM3a¥aTS�cZ&�23a12S+N)¦J�(¬4ÏJ�[p+N)*2Lw�J�(ea�&�¤G¡¢M3a!&p[1a14 06U�# 0�#I¡ZM3al[�)�w¬MS+vM3J�2`_|b�)N_Lal)*bBw¬)h�=a12daTS�cB(*)^/�)h+N(Ëi]!i � 06U�# � �=#

�@�����v� � W��9�GIJM #58:6(.10�4N03254 O DG?B9 038CMW? � *, y � @ �µ{ � UK ./A34 !UD547?B9 4 � � ( � � y d g * {�.=X .��9�B<:KT 254;M=IJ476 Y d �:Y���

C 4#?5Mp¨�SW8CH=4a03254E�GI3M M=O M=O T 254;M=I3476 Y d �:Y���@�����v� � o 4;0 & + ( � ( � �� d X547?5M=0�4a03254�S=47?54;IJ.10�M=I M=O 03254aXB8�Í DBA38CMW? � � 8:? y Y d � T {\� .=?GX X54�¸,?G4

W � & + � � � � � � � g y ( ( - d g�� .±{ 3_ 4�¸,?54�."0�IV.=XG8:?5S(A�0�IV.10�4;S=K y ' g � {  K' � & + W �� y ) � { .=?GX �h� & + W � y ) � { @ ) � W �� y ) � { 3T 2547? ' � ) � / � � + W � y ) � { + � y ) � {\�G- M=I34;M H=4;I=� y ' g � { 8:A�A347<CO < ¸ ?G.=?G9;8:?5S�A38:?G9 4F03254 0�M=03.=<B� M=I30�O MW<:8CMH1.=<:D54 � � A3.1038:A-¸B47A

� � � & + � W � y ) � {+ � � W ��( � y ) � { �( / W �� y ) � { � ) � /

�( W � �� y ) � { y � ) � { (

+F@ y :W � { y ) � { �( / ' � � ) � /�( ( ) (� W � �� y ) � { �(+ ' � � ) � 3

; Y

Page 73: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

>@0�O MW<:<:M=¨ A�032B.10*03254aO .=8CI0�GIJ8c9 4 .10 038:6R4 d 8:A*SW8CH=47?� K� y � y ) � {-{ & + ' � ) � / � � + W � y ) � { + � � � � � � y ) � { + a � � y ��� �� { 3 �

P M=0�4 032G.10 03254;I34 8:A%?5M $ 8:?#032G8:AG�GI3M M=O���W��9�B.1I347?U03<CK 03254 O .=8CI��BIJ8:9 4!.10%038:6R4 d 8:A�?GM=0%8:? 7,D547?G9 47X K $ T M5 4;SW8:? 0�M DG?GXG4;IJA�03.=?GX 032G8cA O .=9 0!�8¨ 4(03.��=4 03254(9;.=A�4�� y � { + � ��A <C47.1IV<CK 03254 O .=8CIq�BIJ8:9 4R.10038:6R4 d M=O .#A32G.1I34F.10!038c6R4 � 8:A Q3DGA�0 ) � �U?5M=0�a y ) � {h& ) � 8:A .=D50�MW6(.1038c9;.=<:<CK(. � 6 .1I3038:?5SW.=<C4FDG?GX54;I � �I�

^ #L�B<:8:9;8C0 9;.=<:9;DG<c.1038CMW?RM=O 03254 A�0�IJ.10�4;S=KRO M=I 03254*9;.=A34 � y � { + y � @ �k{ � M=O .aA30�M 9���M��B038CMW?RK 8C47<:XGA' �=+ � � � � � � � � <CM=S ) �� / �

( ( y � @ ( { � .=?GX

�h��+F@ � � � � � � � � �G<:M=S ) �� @�( ( y � @ ( { � 3

T 2547A34 4$#�BI347A3A38CMW?BA X547A39 IJ8* 4 .bA36RM M=032�A�0�4;4;IV8:?5S 6R479V2G.=?G8:AJ6�� 6RM H 8:?GS O I3MW6�03254!8:?G8C038:.=<1H1.=<:D54 y ' � g � � {0�M(03254@¸,?G.=< H1.=<:D54 y ' � g � � {\�BSW8CH=47?5 Ky ' � g � � { + � y d g d {hg 8CO ) � J ��

y Y g @ �µ{hg 8CO ) � � �£�T 2 DGAF03254Q�B.=8CI y ' � g �h� {F.=<�¨ . K A�6RM H=47A#8:?GA38:XG4 - d g7Y .�� - @ � g d .,��03254RA�0�IJ.10�4;S=K .=<�¨ .7K Aa8:?UH=MW<CH=47Aq M=I <I3Mp¨ 8:?5S"M=O�6(MW?54;KN8c? M=IVX54;I�0�MQ BD5K D9�N0�M MW?54 A38:?5SW<C4 A32G.1IJ4FM=O A�0�M 9��S�G> ?N9;.=A347A�¨ 254;IJ4b03254 M��B038CMW? 8:A9J2G47.��8�GI347<:.1038:H=47<CKN6�DG9V2 2G.=A*0�MÏ 4� M=I3I3Mp¨!47X 8:? M=IJX54;I*0�M 8:6(8C03.10�4a032G4q¨!M=I�� 8:?5SWA*M=O�03254�M��G038CMW?B�7�Î��*à ���G>Ki�� 4���3� �v�d �5��8�^�� =��p� 7 Ï��#: =�C 4 9 MW6Q�B<C4;0�4 MWD5I�0�I347.1036R47?U0RM=O*03254�� <:.=9�� .=?GXº� 9J2GMW<C47A"6RM XG47<¥ K 8:?G9;<cDGXG8:?5S MW?GXGA���A�479;D5IV8C038C47A032G.10 K 8C47<:X . IJ8cA-� <:47A3AFI34;03D5IJ?B� T 2G4��BI347A�47?G9 4RM=O 032547A�4Q MW?GXGAFMW? 032G4(6(.1I��=4;0�<C47.=XBA 0�M . 9 MW?GA�03.=?U0X54;H1.=<:DG.1038CMW?8� T 254;I34;O M=I34��B6R47.=AJD5I347X 8c? � X5MW<:<:.1IVA*.10 038:6(4 d �L�,03254�4$# 4;IJ9;8cA�4@�GIJ8c9 4 M=O 03254aM��G038CMW?̨ 8:<:<MW?G<CK 6R47.=AJD5I34 � � � � � �,>@?U0�4;I347A�038c?5SW<CK��B032B8:A 8:A 03254�MW?G<CK 9J2G.=?GS=4 y 8:? 03254Y� <:.=9�� .=?GXk� 9J2GMW<C47A\{ IJ47A3DG<C0XGD54�0�M�.a?5MW? 5;4;IJM#8:?U0�4;I347A�0 IV.10�4�&U8CO .1SW.=8:? � � X547?5M=0�47A 032G4*4$#� MW?547?U038:.=<G6 .1I3038:?5SW.=<C4�¨ 8C032d�B.1IJ.=6(4;0�4;I .=?GX ) � 03254aA�0�M 9�� H1.=<:D54a.10*038:6(4 d �G032547?

� � y ) � @ �µ{ � � + a � y � � @ � � � � � { � � 3T 2G8cA I347A3DG<C0%¨ 8c<:< 9 MW6R4aMWD50 .=A .(9 MW6E ,8:?547X 4�Í 479 0 M=O .=? DI�¨ .1IVX X5IJ8CO 0 .=?GX .(XG8cA39 MWDG?U0!�

>@? 03254��GI347A�47?G9 4NM=O0 MW?GXGA!��./A347<CO < ¸ ?G.=?G9;8:?5S A30�IJ.10�4;S=K 8:A#0�MK 4NX54�¸,?547X .=A".Ì�,.=8CI y '�g � {aM=O.=XG.��G0�47XÂ�BI3M 9 47AJA�47A%¨ 8C032N9 MW? 038c?UD5MWDBA%�B.1032GA�A3DG9V2N032G.10�03254 0�M=03.=<B� M=I30�O MW<:8CM�H1.=<:D54 � � & + ' � ) � / �h� � �A3.1038:A-¸B47A� � ��+ ' � � ) � / �h� � � �23

;1]

Page 74: Faculteit der Natuurwetenschappen, Wiskunde en Informatica - …maassen/lectures/stochan.pdf · 2008-04-19 · Y = 3 Y :Y F c9c8(*)^/\JL+N)e&29b Y ] MvJL+¥)*b 23&)*b1a ] ! " $# 3

G 5G�!�v���!% 7�Î�� & }%2�Jdb�+h&I/EDÂ4ÏJ�[ D�a�+0»')h+NM�b=+h&L/ Db�J�2B_5]I&�2`_b|+NMSa�¤^J�)�['c`[�)N/1a�JL+0+N)*4�a UE&�¤lJ�/�(¦J�)*4+h& � y ) � {0JL+�+N)*4�a � � d )*b

� y � y ) � {-{ + ��� � a y � y � � {-{hg

»'M3a\[�a y � � { � 3�� � ��� )*bq+NM3a�b\&�(�tI+N)e&�2Ì&�¤ +NM3a�b�+h&I/sMvJ�b=+N)^/@_�) �8a\[1a12S+N)¦J�(Ga��9t�JL+N)e&�2� � ��+ � � y.- �*( / � b � { »'),+NM � � + ) � 3

�@�����v� � o 4;0 b & + - � �

� d / ( � ( � �� d � 4 03254aS=47?54;IV.10�M=I M=O 03254�XG8�Í DGAJ8CMW? � � .=?GX XG4�¸,?54

W � & + � � � � � �� � � � � g y ( ( - d g�� .±{ 3o 4;0 03254aA�0�IJ.10�4;S=K y '�g � {% 4 SW8CH=47?5 K

' � & + W �� y ) � {�.=?GX � � & +Y� �� W � y ) � { @ ) � W �� y ) � { � 3

y ?*479;.=<c< 032G.10 � �C+ � � � K y Y d � ] {\��{ T 2547? ' � ) � / � � � � + W � y ) � { + � y ) � {\� - M=I34;M H=4;I=� y '�g � { 8:AA�47<CO < ¸,?G.=?B9;8:?5S"A38:?G9 4� � � & + � W � y ) � {+F@ ycb @ - {4W � y ) � { �*( / W �� y ) � { � ) � /

�( W � �� y ) � { y � ) � { (

+ � @ ycb @ - {4W � y ) � { /�( ( ) (� W � �� y ) � { � �( / W �� y ) � { � ) �

+ - � W � y ) � { @ ) � W �� y ) � { � �( / W �� y ) � { � ) �+��h� � � � / ' � � ) � 3>@0�O MW<:<:M=¨ A�032B.10

� y � y ) � {-{ & + W � y ) � { + � � � �� � � � � y ) � { + a � � � � � � y � � { � 3 �

� �3����K�K�#9��mª7�Î���P ¡¢MSa|¤±J�)�[ c`[�)^/1a�&�¤ZJdb�+h&I/EDz&�cZ+N)e&�2Ì)*b

� � y ) � @ �k{ � � + ��� � a � y � � @ �µ{ � � + a � y � � @ � � � � �k{ � �

+ ) � � � <:M=S ) �� /�y.-0/ �( ( {�� � @ � � � � � � � <:M=S ) �� /�y.- @

�( ( {�� � 3

�@�����v� � T 254ϸBIJA�0�4 !UDG.=<c8C0LK 8:A T 254;M=I3476 Y d � : ��032G4NA�479 MW?BX 4 ! DG.=<:8C0 K O MW<:<:M=¨ A�O I3MW6 03254NO .=9 0#032G.10� ��+ � � � � � �9¨ 2G8c<C4b032G4a032G8CIJXN4 ! DG.=<:8C0 KN8cA y Y d � V {\�

;�: