e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$...

59

Transcript of e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$...

Page 1: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

������������ ����� �������������������� !���"�#��$ %�&�(')���#*,+.-/�102�� 3�#��02�����1��+�4

52687�689;:=<(>@?A:B9;>#CD:3E�FG:=<;H&IJ68K�L�>1M�6NCOI�M&7.PQ>#RSIJCD>UTV>#W#W1:=>

X�Y[Z8\3Y[]�^`_(]�a�bc_edf_hg(bcihjed�j(Z�klX�_(m,npo(\qje\rbc_(Z�jed�s�Yj(][Z�bcZegj(Z�k

t�]h\rb uQiDbcjed�v[ZN\wYhdxdfbyg8Y[Z#izYOs�j({h_(]je\q_(][|} j�~h~`j(i��Joe~;Yh\=\�~�v�Z�~[\qb�\ro(\wY�_w^��#Yi��JZ�_edf_hg(|D�"X�j(mO{`]zbckDg8Y� } t��;�����(���2��t

�O���h�[�z�N�D����$�N�;� �(¡3�h¢�£f¤;¥N¦B§f¨©¦q�(¤Dª�« ¬3�N�D¬­¡3�h®;¥e§x�D¡q£f¯[�D¬°£±¤�«)�(¡q£f«N²w£f�e§f�[¦³§f�[�;� ¬3¤l�D�(�(¡3¤z´e£fµ��D¬q£f¤;«¦3²w�(�hµ��[¦¶ª��e£x²w�·�¸¡3���[¹�¥e£±¢D�z§f�h«�¬º¬3¤»«(�h¬qª�¤;¡3¼(¦�ª�£f¬3��¤;«(�º§x�z¨;�h¡¶¤D½��e£x�(�e�h«l¥(«e£±¬¾¦h¿2²h�z§y§±�[�À�ÁqÂ;ÃeÄyÅ;ÆÇÉÈhÅ;ÊcÇxË�Ì�ͶÁ[ÊcÎ2Ë;ÆwÏ[ÐhÑ"Ò=«Ó�N�D¡3¬q£x²¾¥e§x�D¡[¿�¦q¬�D«N�(�D¡¾�Ô¦°µ�¤�¤�¬3�(«(�[¦3¦�½c¥(«N²¾¬q£f¤;«N�z§x¦Õ§±�[����¬3¤��¦°¥(ÖJ²w§x�;¦3¦�¤D½2¡3�h®;¥e§x�D¡°£±¯[�¸¬q£f¤;«$«(�h¬rª�¤;¡w¼×¦h¿�¬3�(�Vª��¾§y§�¼e«(¤Dª�«ÔØÙ�;��£x�z§�Ú��;¦B£x¦QÛ�¥(«N²¾¬q£f¤;«N¦¶�D�(Ü�(¡3¤z´�£fµ��¸¬q£f¤;«�¦3²3�(�hµº�[¦hÑ�ÝÞ�e£É¦��N�D�N�h¡"¦q�(¤DªQ¦Ù¬3�N�D¬¶¡3�h®;¥e§x�D¡°£±¯[�¸¬q£f¤;«�«(�h¬qª�¤;¡3¼(¦��h«N²¾¤;µº�N�;¦3¦�$µ"¥N²3�UÖ(¡3¤��;�e�h¡º¡�D«(®;�O¤D½V�D�(�(¡3¤z´e£fµ��D¬q£f¤;« ¦3²3�(�hµº�[¦h¿2£f«N²w§f¥N��£f«(®ßµ��¸«�¨l¤D½¶¬3�(�O�8¤;�(¥(ܧx�D¡"®;�h«(�h¡�z§��;�(��£f¬q£f¢;�Oµ�¤(�e�¾§É¦º�D«N��¦°¤;µ��­¤D½�¬3�(��«(�h¥(¡¾�z§�«(�h¬rª�¤;¡w¼×¦hÑàÒ=«á�N�D¡3¬q£x²¾¥e§x�D¡[¿2ª��£f«�¬3¡w¤×�e¥N²¾�O«(�hª!²w§x�;¦3¦q�[¦,¤D½¶¦qµ�¤e¤;¬3�(«(�[¦3¦Õ½â¥(«N²¾¬q£f¤;«N�`§É¦ã¬3�N�D¬¶§f�[�;�á¬w¤Ô��£yä#�h¡3�h«�¬�²w§x�;¦3¦°�[¦V¤¸½ÖN�;¦B£x¦,½c¥(«N²¾¬q£f¤;«N¦hÑ$å¶�(��£f¬q£f¢;�Ô¦q�e§y£f«(�[¦­�;¦,ª��¾§y§Q�;¦"¦q¤;µº��¬3�h«N¦°¤;¡V�(¡3¤(�e¥N²¾¬�¦q�e§y£f«(�[¦­²h�D«�Ö8�¤;Ö(¬�z£f«(�[�·½â¡3¤�µæ�¸�(�(¡3¤;�(¡q£x�D¬3�»²w§x�;¦w¦q�[¦�¤¸½Õ¦qµ�¤e¤;¬3�(«(�[¦3¦�½â¥(«N²¾¬q£f¤;«N�`§É¦�ÑçÛ�¥(¡3¬3�(�h¡3µ�¤�¡3�;¿2¬3�(�¦3�Dµ��º®;�h«(�h¡�z§y£f¯[�D¬q£f¤;«l¬3�N�¸¬V�¾´(¬3�h«N�(¦"Ø��;��£x�z§QÚ��;¦B£x¦"Û(¥(«N²¾¬q£f¤;«N¦ºèrØ�Ú�Û&鶬3¤$ê�¨e�N�h¡�Ú��;¦B£x¦Û(¥(«N²¾¬q£f¤;«N¦�èrê�Ú�Û&éë�`§É¦°¤"§f�[�;�(¦�½c¡3¤;µ!�;�(��£f¬q£f¢;�,µ�¤(�e�¾§É¦Ù¬3¤�¡°£É�e®����D�(�(¡3¤z´e£fµ��D¬q£f¤;«Oµ�¤(�e�¾§x¦h¿²¾¤;«e¬�z£f«e£f«(®A��¦�¦°�N�[²w£x�z§Q²h�;¦q�[¦"Ú&¡3�¾£fµ��D«#ìí¦,�e£f«(®;�º½â¥(«N²¾¬°£±¤�«N¦h¿�¦q¤;µº�"½â¤�¡3µ�¦¶¤¸½Ùîë¡3¤;ïq�[²¾¬q£f¤;«î2¥(¡¦°¥e£±¬VØÞ�h®;¡3�[¦3¦B£f¤;«á�D«N��¦q�h¢;�h¡¾�z§�¬q¨e�N�[¦�¤D½�«(�h¥(¡�z§2«(�h¬qª�¤�¡3¼×¦�Ѷ���"�(¡3¤;�8¤�¦q�"¬3¤O¥N¦q�"¬3�(�¬3�h¡3µñð�Á[ÌNÁzÆqÅ;ÄyÇfÈhÁò³À�ÁrÂ�Ã�ÄyÅ;ƾÇfÈhÅ;ÊcÇ�Ë;ÌáͶÁ[ÊcÎ2Ë;ÆwÏ[ж½c¤;¡,¬3�e£x¦VÖ(¡w¤��;�á²w§É��¦3¦"¤D½Q�D�(�(¡3¤z´e£fµ��D¬q£f¤;«¦3²w�(�hµ��[¦&¬3�N�D¬�½c¤D§y§±¤DªU½c¡3¤;µ��D«��¾´(¬3�h«N¦B£f¤;«O¤¸½J¡3�h®;¥e§x�D¡°£±¯[�¸¬q£f¤;«#Ñ�ÒB«�¬w�(���(¡3¤;ÖN�DÖe£y§y£x¦q¬q£x²�£f«e¬3�h¡3Ü�(¡3�h¬�D¬°£±¤�«�¤D½�¡3�h®;¥e§x�D¡q£f¯[�D¬°£±¤�«#¿2¬3�(����£yä#�h¡3�h«e¬ã²w§x�;¦w¦q�[¦,¤D½�ÖN�;¦B£x¦�½â¥(«N²¾¬q£f¤;«N¦"²¾¤;¡w¡3�[¦q�N¤�«N��¬3¤��£yäó�h¡w�h«�¬V²w§x�;¦3¦°�[¦¶¤D½��(¡q£f¤;¡¶�(¡3¤;ÖN�DÖe£y§y£f¬q£f�[¦"¤;«$¬3�(���D�(�(¡3¤z´e£fµ��D¬q£f«(®­½c¥(«N²¾¬q£f¤;«�¦q�N�;²¾�[¦�¿p�D«N�¬3�(�h¡3�¾½c¤;¡3�¶¬3¤���£yä#�h¡3�h«e¬Q¬q¨e�N�[¦�¤D½�¦qµ�¤e¤;¬3�(«(�[¦w¦��;¦3¦q¥(µº�(¬q£f¤;«N¦hÑ

Ò=«­¦q¥(µ�µ��D¡w¨;¿���£yä#�h¡3�h«�¬2µ"¥e§f¬q£y§x�z¨;�h¡�«(�h¬rª�¤;¡w¼×¦1ª�£f¬3��¤;«(�Ù�e£É�(�e�h«º§x�z¨;�h¡[¿;ªÙ�e£É²w��ª���²¾¤D§fܧf�[²¾¬q£f¢;�¾§f¨»²h�z§y§�ôQ�h«(�h¡�`§õ£f¯h�[�³Ø��h®;¥e§x�D¡q£f¯[�D¬q£f¤;«$ö��h¬qª�¤;¡3¼(¦h¿e²¾¤;¡3¡3�[¦q�8¤;«N�­¬3¤���£yä#�h¡3�h«�¬�²w§É��¦3¦q�[¦¤D½J�(¡°£±¤�¡¦��D«N�º�;¦3¦q¤(²w£x�D¬3�[��¦qµº¤�¤;¬w�(«(�[¦3¦1½â¥(«N²¾¬°£±¤�«N�z§x¦2£f«��¶²w§x�;¦w¦B£x²h�z§#¡3�h®;¥e§x�D¡q£f¯[�D¬q£f¤;«º�(¡q£f«N²w£±Ü�e§f�;Ñ�Ý��(¡w�h�¶Ö(¡3¤��;�O²w§x�;¦3¦°�[¦Q�D¡w�Õ�eé�Ø��;��£x�z§�Ú��;¦B£x¦�Û(¥(«N²¾¬q£f¤;«N¦Þ¬3�N�D¬Q²h�D«OÖ8�V®;�h«(�h¡¾�z§y£±¯h�[�³¬3¤ê�¨e�N�h¡�Ú��;¦r£É¦�Û(¥(«N²¾¬°£±¤�«N¦h¿;Ö�é#¦q¤;µ��&¬3�h«N¦q¤;¡��(¡3¤(�e¥N²¾¬�¦°�e§õ£f«(�[¦h¿(�D«N�,²zéó���(��£±¬°£±¢��Q¦q�e§y£f«(�[¦2¬3�N�D¬²h�D«OÖN�¶®��h«(�h¡�z§y£f¯h�[�O¬3¤�¦3²w�(�hµ��[¦&¤D½p¬3�(�¶¬q¨e�N�¶¤D½�¡q£x�e®;�V�D�(�(¡3¤z´e£±µ­�D¬q£f¤;«#¿e�e£f«(®;��½â¥(«N²¾¬°£±¤�«N¦�D«N�O¦q�h¢;�h¡¾�z§p�N�h¡¾²¾�h�(¬3¡3¤;«(Ü�§y£f¼;�"«(�h¥(¡�z§p«(�h¬qª�¤;¡3¼(¦&ª�£f¬3�O¤;«(�hÜc�e£x�(�e�h«$§x�z¨;�h¡[Ñ

÷qø2ù;úyû2ü�ý�ü�þ3ÿ��2ú����Ný�ü;üeþýhÿ������ ����������������������� �!��"$#&%���� ')($#�ü�ý�*zþ3û,+ 4.-�/ +�0 - # 4.-�-�1 '�23�"þýhÿ4�yúõþwÿ3%[þwÿ=û=ú����5��67 ù�úõû2üeýhüeþ3ÿ�ý�ü;ü�þ¾ýhÿ=þ�8�ý�û39;:cø<23:=9"þ?>@� 4?A�B�C # 4�-�-�B '

Page 2: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

� ��������� �����������

�������������! #"$�&%'�)(+*�,%'�.-�/0 213���)(#1.%�4$�,%'�25063��-� �1.%' � �13�7 )%0(98:/';=<>��%��2�3?@�357;A�2/CBD��EF%'BHG3<>��(+��%'�JI.���/0�.(9?K-L���2�&-M?@��B�%��L"H��%C(N��(7 2/JI.�O��PQ6F?>40%'<@���L R 2/JBS63<> �?>40%'��?T%� 2�7;A63�.�� �?>/C�U%�G3G3�2/�E!?>B�%� 2?@/C�+V! 21.%� ?T(WV3 2/J �13�OG3�2/0I3<>��BX/';R%�G3G3�2/�E!?>B�%� 2?@�35J%S(9B�/$/0 21�;A63�.�W 2?>/0��;A�2/CBY(NG.%'�Z(9�J-F%' )%!V3 213�O��EF%'BHG3<>��(W[\13�O?>�! 2���2G3���� )%� 2?>/0�]/�;^%��U%'G3G3��/�EL?@B�%' �?>/C�M(2�)13��B��7?@�� 2����B�(�/';��3�� N*/0�28F(7%'�.-�4!?T����4$���Z(2%_1`%C(%'<K(9/�I.��������EL ����.(9?@4$��<>"�-!?T(2�W6.(2(N��-]acb7%'�2��/C�d%'�.-Jb7%��2�2/0�+V!e�fCg0gLhFi#/C505C?>/j%'�`-]kl?@�2/m(9?�V!e�f0gCf!Vne�fCf0oLVe�f0fCo�I+h3kl?@�2/m(9?�VFe�fCf0pLh!b�2/$/0B�13��%0-O%'�.-:qr/'*R�$V3e�fCgCg!h!s�/$/!-L"J%��.-�tu%��28$���vVLe�fCgCg!V.e�fCg0fLh$wx13?@ 2�$Ve�f0gCf!V#e�fCfCo!h.yz?@G3<>��"$V.e�fCf�{3h+|�B�/C1!63�.-L��/3V.e�f0gQ}mhr~u/C1F/C�3���vV+e�fCf0oLh.q+%�Gn�&-L��(�%'�.-��.%'��In����Vre�fCg0gLhy763B���<@1.%'�� �V+�l?@�L �/C��%'�.-�wx?><><@?T%�B�(�V�e�f0gC�LhR�l���� 2�$V�~u�2/05C1�%��.-�i�%�<>B�����V�e�fCfLe0h~u63�F53Ve�fCf0�Lh� �2�N�F/'*�(N8L?�%��.-�y7/$(N���!In���253V+e�fCg$}$h=�l63�2<@I.���2 �%��.-�i#/05C50?>/3V+e�fCg0gLh+i#/05C50?>/3V+e�fQ}&�Q�)[

����%�(9���2?>�&(]/';:G.%�Gn���)(�*R��1.%�4$����E!G3<>/0�2��-x%�P$63?> ���5C���3���)%�<:%'G3G3��/$%0��1� 2/� 21F� G3��/CI3<@��B/';^;A63�`�� 2?@/C��%'GFG3�2/�E!?>B�%� 2?>/0�+[u\1F�S%'G3G3��/$%0��1�����5C63<K%'��?>����(7 21F�J?><><@��G./m(9��-�G3��/CI3<@��B�/';^;A63�.�W 2?>/0�%'GFG3�2/�E!?>B�%� 2?>/0�u;A�2/CB�(NG.%'�Z(9��-3%� )%lI!":%C(2(N63B�?@�35u%��S%'G3GF�2/CGF�2?T%� 2�7G3��?>/0�#/0�J 213�,��<T%0(2(+/';=%�G3G3�2/�E!�?>BM%' 2?@�35J;A63�.�� �?>/C�`(�[Oy7��5C63<K%'��?>��%� 2?>/0�� 2���)13�3?KPQ6F��(ua�\?@8L13/0�3/�4rV�e�fC�0�Lh�\?>8!13/C�3/�4�%'�.-��l�Z(9���F?>�+Ve�f$}C}mh.s�/C�2/0��/�4rVFe�fCg�{3h.b���� 2����/3V!e�f0gC�Lh3w�%'1!I.%!Vne�fQ}&�LVre�fQ}&fLV+e�f0fCo$�� N"LGF?T��%�<><>"j?>B�G./$(N��(9B�/$/0 213��3��(�(���/0�.(9 ��)%'?@�L Z(�/0�x 213��%'G3GF�2/�EL?@B�%' �?>�35�(N�� S/';O;A63�.�� �?>/0�.(�[��� ���%'��I.��%'�25063��-� �1.%' �(N/CB��;A/C��B�/';_(9B�/$/0 213�3�&(2(J?T(��3���W��(2(�%'�2"� 2/�%'<><@/�*�B��&%'�3?@�35';A63<^50���3���Z%'<>?@��%' �?>/0��?@��%'G3G3��/�EL?@B�%' �?>/C� N"LG.�SG3�2/0I3<>��B�(�a�i�/C5C50?>/�%��.-�k�?>��/$(9?cVe�fCgCf!V7e�f0fCoQ�Z[���(9?>BH?><T%��O%'��5C63BH���L ���%'��%�<T(N/�I.��6.(N��-a�(N���U(9���W 2?>/0�xf![>e'�:?>�� �13����%0(9��/';d��<K%C(�(9?��n��%' �?>/C��*713���2��(NB�/$/C �13�3��(�(�?K(J% �W/C�.-L?@ 2?@/C��/0�� �13���<K%C(2(N?��=��%' 2?@/C��I./C63�`-3%'��?>��(J�)%� 213���J �1.%'��/C�� 213��?@�3G363 ���/063 2GF63 ]BM%'G3G3?@�35�?> Z(9��< ;�[�|l6F�]6.(N��/';�2��5C63<K%'�2?@��%' �?>/0�+Vn*71F?T�)1�;A/C<><@/�*�(z �13�S��<T%0(2(N?T��%�<# �����1F�3?TP$63�O?>�! 2��/!-L6.����-�IL"�\?>8!13/C�F/'4=V.?T-L���! 2? �.��( 21F��%�G3G3��/'E!?>BM%' 2?@�35u;A63�.�� �?>/0��%0(z �13�uB�?@�3?>BH?�������/';¡%J��/m(9 ;A63�.�W 2?>/0�.%'<+ �1.%' 7?@�.��<@6.-L��(R%'� Y�]z]_(]\3Y[]zm %'�.-U%](NB�/$/C �13�3��(�(,;A63�`�� 2?@/C�.%�<�V36.(N6.%'<@<>"���%�<><@��-�% ~[\rj({Db�dfb�¢;Y[] [7���� 213�db7%�"$��(9?K%'��?@�L ����2G3����� )%� 2?@/C��/�;�����5C63<K%'��?>��%� 2?>/0��a�(N���j~�?@B���<K-L/C�N;+%��.-�w�%�1LI`%LVre�fQ}meCh.w�%�1LI.%!Vre�fCfCo!hrb���2 2���2/3V!i#/05C50?>/%'�`- \+/C���2�$V^e�f0gCg!h^s�%'�2��/!PQ6F?>�+V�s�?> � 2���j%'�`- i#/05C50?>/3VRe�f0gQ}$h�i#/C505C?@/3V�\+/C���2�H%'�.-�~u/!��1vV�e�f0gC�Q� 21F�S(9 )%�I3?><@?>��������/C���2��(NGn/0�.-3(u 2/M%�(9B�/$/0 213�F��(2(uG3��?>/C��Vr%��.-� 213�:���2��/C�u ����2B� 2/M%MBH/!-L��<+/';R �13��3/0?T(9�O?@�� �13�:-3%' Z%�aA6.(96`%'<><@"�kj%'6.(�(9?K%'��%'�`-�%0-3-L?@ 2?>4$�0�)[

����i�/C5C50?>/j%'�.-�k�?>��/$(N?.a2e�f0gCf!V3e�f0fCoLVFe�fCf0o'Ir�£%'�.-�k�?>��/$(9?.a�e�f0fCpQ�=*�R(N13/�*��-u 21`%' +�2��5C63<K%'�2?@��%'� 2?@/C�JG3��?>�.�W?>G3<@��(£<@��%C-� �/:%'G3G3��/�EL?@B�%' �?>/C�d(2�)13��B��&(r*713?T�)1S%'���7��PQ6F?>40%'<@���L � 2/O�3�� 9*R/C��83(#*7?@ 21J/0�3�¤ 1F?T-3-L���.¥u<T%�"$����V0*713?T�)1J*�j��%'<@<r¦ Y=g×o�dfj(][b�¢`je\rbc_(Z�§­Y \�¨�_(]2©D~ acylª_�Z[$���]G`%'�2 �?T��6F<T%'��V$*�j-L��(2�W�2?>I.��-13/�*�%������� )%'?@����<K%C(2(J/';��)%C-!?T%'<�(N )%�I3?><@?>�����Z(�«¬%'�.-� 213�U%0(2(9/!�W?T%' ���-�G3��?>/C�Z(�?>�� 21F����P$63?>40%�<>���! b7%�"$��(9?K%'�J;A/C��B]63<K%' �?>/C��«d<>��%0-� �/J%:(963I=��<K%C(2(/�;��2��5063<T%��2?@��%' �?>/C�S�3�� N*R/C�28F(�V$ �13�O%'<@�2��%0-L"!��8!�3/�*7�y�%C-L?K%'<+b7%0(9?K(�363�.�� �?>/0�.(ua�i#/�*R��<><cV3e�f0gQ}$V�e�f0fCo!h.�`�Z%'�38$�mVre�f0gCp!V+e�fCg$}$h=s�?T���)13��<@<>?cVLe�fCgC�!h.~O%'�.(�%LVe�f0fCo0%LV­IvhOs�%C-L"F��1�%��.-�ªl��<T(9/0�+V�e�fCf0oLhOtl"!�+Vue�fCg$}$VOe�f0fLeChj�u%'�Z-L"$Vue�fQ}meCVOe�f0fCoLhjb6313B�%��3�+Ve�f0fCo!h.q+%'�.��%0(9 �����%'�.- � %'<@8C%�6.(980%0(�Vre�fCg0�Lh=b�2/$/CBH13��%C-S%'�`-�qr/�*�$V.e�f0gCg!h.s�/$/!-L"�%'�`-�tu%'��8$���+Ve�f0gCg!V�e�f0gCfLhvi#/C505C?>/H%'�`-®k�?>��/$(9?cV+e�f0fCoLV�e�fCf0o'I+h�kl?@�2/m(9?�V+e�fCf0pQ�)[�\13�O����5C63<K%'��?>��%� 2?>/0���3�� N*/0�28F(*7?> �1��)%0-L?T%�<R(9 )%�I3?><@?>�����)(u*�H(9 �6.-L?>�&-®?@�.��<>6`-L�]BM%'�!"���<K%C(2(N?T��%�<^/C�3���c-L?@B����.(N?>/C�`%'<7a � ��1!63B�%�8$����Ve�f0gLe0hr-L�jb/$/C��V+e�f$}�gQ�,%C(^*��<@<=%C(BS63<> �?T-L?@B]�W�.(9?@/C�.%�<.(9GF<>?>�F��(^%'�.-�%'GFG3�2/�E!?>B�%� 2?>/0�] ����)13�3?TP$63��(WV(96`��1¯%C(]�Z%C-L?K%'<j%'�.-��3/0�3�A�)%C-!?T%'<:ku%�6.(2(N?T%��+Vl �13?>�3�AG3<K%' 2��(9G3<@?>�3�&(�a�tl6.�)13/0�+VOe�fQ}0}$hOs���?@�35C6F�� �V

e

Page 3: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

e�f$}�f!h�kl��?>B�(N/C�+V�e�f0gCp!h � /'E=VOe�f0g'{3h���63I`%'�38=Vue�f0gCg$��%��.-�BS63<> �?TP$6.%C-L��?T��;A63�.�� �?>/0�.(�ac�u%'�Z-L"$Ve�f$}$e0V�e�fCf0oQ�)[d� ��i#/C505C?@/�%��.- k�?>��/$(9?,a2e�f0fCo!Ve�f0fCo0%Q��*�J��E! 2���.-L��-� 213?K(l��<K%C(�(l/';R�3�� N*R/C�28F(l �/�l"!G.���ub7%0(9?K(u�363�.�� �?>/C�`(_ac�ub7���)[=���� �13?T(lG`%'G.���u*R�J(91F/'*� 21.%� O%'����EL ����.(9?@/C�U/';,yz��5C63<K%'�2?@��%'� 2?@/C��ª��� N*/C��83(WV+*713?T�)1 *R�]GF�2/CG./m(9�� 2/���%'<@<�� Y[Z#Y[]¾jedfb�¢;Yk ¦ Y=g×o�dfj(][b�¢`je\rbc_(Z®§­Y \�¨�_(]2©D~ a9kjy�ª_�)V���.�W/CB�G.%0(2(N��(7%'�U��4$����I3��/$%0-L�����)%'�F5C��/�;R%'GFG3�2/�E!?>B�%� 2?>/0��(2�)13��BH��(�?@�.��<>6`-L?>�35FVL?@��%0-3-L?@ 2?>/0�� �/�ub7�V� ����.(N/C�SG3�2/!-L6`�� �(9GF<>?>�F��(�VBM%'�!"�/';O �13��50���3���Z%'<j%C-3-!?> 2?@4$��B�/!-L��<K(�V7%��.-�(N/CB��U/';O �13��3��6F�)%'<=�3�� N*/0�28F(�[^�u(^��E!Gn�&�� 2��-=V`kjy�ª 1.%�4$�j%'G3G3��/�EL?@B�%' �?>/C�SG3��/CG.���2 �?>��(/�;� 213��(2%'BH�u N"LG.�j%C(%'<@�2��%0-L"J(N13/�*7��;A/0�R(9/CBH�/';v 213�7�F��63�)%�<3�3�� N*R/C�28F(aNkl?@�2/m(9?.%��.-]i�/C5C50?>/FVne�fCf0oLh � "!I.���38$/FVne�fCg0fLh�l/0�2�3?@8rV � 2?@�.��1`��/CBSI.�u%��.-�wx13?@ 2�$V+e�fCg0fLh.wx13?> ��$Vre�fCfCo!h+���2?@�O%'�.-Us�?>"!%�8$�$V.e�fCg0gLh+�363�`%'1.%0(913?cVe�f0gCf!V7b7%'���2/C�vVle�fCfLe0Vue�f0f'{Fh��C/0�3��(WVle�fCfCp!h�s�1.%C(N8C%��S%'�.-�s�?T���)13��<@<>?AV^e�f0fCpLVje�fCf0�Lh�s�1.%0(980%'��Ve�f0fC�!V#e�fCfC�0%Q�Z[

\13�JG3<K%'��/';R 213�JG`%'G.���u?K(u%C(l;A/C<@<>/�*�(�[Ow����.�)(N O-L?T(���6.(�(l 213�S(N/C<@63 2?@/C��/';, 213�J40%��2?T%� 2?@/C�.%�<G3��/CI3<@��B /';��2��5C63<K%'�2?@��%' �?>/0�+[�w �O �13����?>�! 2��/!-L6.���O 21F�2���O-!?��=���2���L ���<K%C(�(9��(/�;R(9 Z%'I3?@<>?>�����)(�«H%'�.- 21F�7��/0�2�2�&(9G./C�.-!?>�35uGF�2?>/0�)(#?@�� �13���P$63?@4C%�<>���! +b7%�"$��(N?T%���?>�! 2���2G3���� )%� 2?>/0�u«O 21.%� #<@��%C-O 2/O-!?��=���2���L ��<K%C(2(N��(u/';,I.%C(N?T(�;A6F�.�� 2?@/C�.(u 213�S*��<><>�A8!�3/�*7���)%C-!?T%'<R(N )%'IF?><>?@�����Z(�Vr ����.(9/0�2�AG3�2/!-!6.�� S(9 Z%'I3?@<>?@�����)(WV%'�`- 213�S�3��* %C-3-!?> 2?@4$��(N )%�I3?><@?>�����Z(l 21`%' �6F�.-L����<>?>�S%0-3-L?@ 2?>4$�S(NG3<>?@�3��(u/';z-L?��=�������! _ N"!G.��(�[H� O?K( 21F����G./$(2(N?>I3<@�J 2/�(N13/�* �1.%' u �13�S(2%�B��J%��25063B����! l �1.%' j��EL ����.-3(jyl%0-L?T%�<^b7%C(N?T(u�363�.�W 2?>/0�.(l �/�l"!G.���Sb7%C(N?T(S�`6F�.�� 2?@/C�.(S%'<K(9/�<@��%C-F(d;A��/CB %C-3-!?> 2?@4$��B�/!-L��<T(� 2/¬(9/CBH���2?K-L5C��%'G3G3��/�EL?@B�%' �?>/C�(2�)13��BH��(�V!-L���`�3��-�%C(

� a ����� �������� �

a � ��� ���*713�����

� �%��2�:%'GFG3�2/0G3�2?K%' 2�:/C�3����-L?@B����.(N?>/0�.%'<.;A63�.�� �?>/C�`(�[

� G.����?K%'<^��%0(9��(u/�;7�2?K-L5C�S%�G3G3��/'E!?>BM%' 2?@/C��%��2�Hb�2��?@B�%'��� (13?>�F5C��;A63�.�W 2?>/0�.(Ja2e�fCfC�$�)V�i¡��/C�N����� 2?@/C�Hi�63�)(N63?> ,yz��50�2��(�(9?@/C�Ua�i^i^y��,a��3�2?@��-LB�%��J%'�`- � 26F����<>�mV3e�f0gLeCh.��63I.����V.e�f0gC�!h.tl?T%0��/C�3?K(^%'�.-�3�2���&-LB�%'�vV�e�fCg�{3h�tl/C�F/C13/�%'�.-��C/C13�.(N 2/0�3�$V�e�fCg0fLh�s�/$/!-L"�%��.-��R%'�24!?>�vVe�f0fLe��J%��.-�s�63<> �?>�<T%�"$���ji#���Z����G3 ��2/0�.(Ja�q+%'G.��-!��(�%��.- �.%��2I.����V^e�fCgCg!h^yz6FB���<>1`%'�2 �V+�l?@�L �/C��%'�`-®wx?@<><>?K%'B�(WV#e�fCg0�Lh�l���� 2�$V=~u�2/05C1�%'�`-�i�%'<@B�����V+e�fCf!eCh�~u63�F53V�e�fCfC�!h � �2�N�3/�*�(98!?^%��.-�yz/m(9���!I.���25FV�e�f0gQ}0�)[ � ?>B�GF<>��!63B�����?T��%�<n��ELG.����?>B����! )(�%'�2�O �13����-!��(2����?>I.��-] �/]?@<><@6.(9 ��)%' ��u 21F�_ �13��/0�2�� �?T��%�<+%'��5C63BH���L Z(�[

��� (N63B�B�%��2"$Vu �13����1`%'?>�D/�;�/063��%��25063B����! )(U(913/�*�(� 21.%� �(N/CB�����?T-L50��%'G3G3��/�EL?@B�%' �?>/C�(2�)13��BH��(+%'����%'G3G3��/�EL?@B�%' �?>/C�`(#/';vy7��5C63<K%'��?>��%� 2?>/0�Sªl�� N*/0�28F(£*7?@ 21S%�G3G3�2/0G3�2?K%' ��u%0-3-L?> �?>4$�,(9 )%�I3?>�<>?@�����Z(�[�\13�l;A/0�2B�/';

� �-L��Gn���.-3(�/0�� 21F�O(9 Z%'I3?@<>?>������V$%��.-�?>�.�W<>6.-L�&(#?>��G`%'�2 �?T��6F<T%'�,��63I3?K�l(NG3<>?@�3��(

a�6`(9��-�?>�� N"LG3?K��%'<=?>B�GF<>��BS���! )%' �? /C�.(^/';Ri^i^y��R%��.-�/C�F����-!?>B����`(9?>/0�.%'<�kj%'6.(�(9?T%��.(�[,i#���)�W��G3 2��/C�3�<>?@8$�l�F��63�)%�<+�3�� N*/0�28F(*7?> �1�/0�3���A13?T-F-L����<K%�"$���7%��.-�*7?> 21�%]kj%'6.(�(9?T%���%C�� �?>40%' �?>/0�M;A6F�.�� 2?@/C�U%'���?>�`��<>6.-!��-r[��� ,(9����BM(¡?@B�G./$(�(9?>IF<>�$V$13/�*��4$����V$ 2/S-!?>�2�&�� 2<@"S-L���2?@4$�z;A��/CB��2��5063<T%��2?@��%' �?>/C�HG3�2?@�.��?>GF<>��( 21F��(9?@5CB�/0?T-3%�<%0�� 2?@40%' 2?@/C��;A63�.�W 2?>/0�.(_ N"!G3?T��%'<><@"�6.(9�&- ?>� ;A����-Q;A/C��*7%��)-��3��63�Z%'<R�3�� N*/0�28F(�[�w��-L?K(2��6.(�(�V313/�*R��4$����V!?>�U%S(9?>BHG3<>�u��E3%�B�G3<>�mVQ �13�:��<>/m(9�O�2��<T%' �?>/0�.(913?@G�In�� 9*R������I.%0(9?T(;A63�.�W 2?>/0�.(7/'; 21F�_1F?>�350�$V3 213�:(N?>5CBH/C?T-H%'�.-� 213�Jkj%'6.(�(9?K%'�� N"!G.�$[

\13�J%�G3G.���.-L?K����(�-L��%�<+*7?> 21U/CI.(N���240%� 2?>/0�.(l����<T%� 2��-� 2/S 21F��B�%�?>���2��(N63<> Z(/';^ �13��G`%'G.���j%'�.-

p

Page 4: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

B�/0�2�u �����1F�3?T��%�<+-L�� )%'?@<T(W[

� ����� ���������J�7�� ��J�����M� ����� �R���]��� ��� ����� ���������®��� ����^����� � �R��������

� 63GFGn/m(9�S 21.%� u 21F�S(9�� �� �! $a �#"%$'&�"T�)(+*),�-�*�.�/" ��� /';,-3%' Z%�1.%C(lI.������/CI3 Z%'?>�F��-�IL"��Z%'�.-L/0B(2%�B�G3<@?>�35U%M;A6F�.�� 2?@/C� � V#I.��<@/C�350?>�35� �/�(9/0B��H(9G.%0����/';7;A6F�.�� 2?@/C�.(�0 -L�W�.�3��-�/C�1* , V�?@� �13�G3����(9���`����/';:�3/C?K(9�$V,%'�.-�(963G3G./m(9��*��%'����?>�! 2���2��(N 2��-�?>���2���W/'4$���2?>�F5� 21F��;A63�.�W 2?>/0� � V/C��%����(N 2?>BM%' 2�O/�;^?> �V`;A��/CB �13�J(N�� �/';,-3%' Z%2�=[O\13?K(zG3��/CI3<@��B�?T(���<>�&%'�2<@"�?><@<>�AG./$(9�&-rV+(9?@�.���O?> �1.%0(_%��?>�!�.�3?> ��u�!63B]I.���^/�;^(N/C<>6F 2?>/0�.(�[R����/C�)-!���7 2/S�)13/$/$(N��/0�3�OG.%'�� 2?T�W63<T%��7(9/0<>63 �?>/0��*R�O�3����-] �/]1`%&4$�(9/0B�� j¶np]zbc_(][b 8L�3/�*7<@��-L5C�R/';= 21F��;A63�.�W 2?>/0�J 21.%� �1.%0(# 2/uI.�7������/C�`(9 2��6.�� ���-r[�\1F�B�/m(9 ���/CB�BH/C�;A/C��B /'; jãnp][bc_(]zb 8!�3/�*7<>��-!5C����/0�.(9?K(9 )(^?>�S%0(2(96FB�?>�35O �1.%' R 213�;A63�`�� 2?@/C�S?T( ~`mO_;_e\�� VC?@�] �13�j(9���.(N� 21`%' � N*R/�(N?>B�?@<T%��l?@�3G363 Z(���/0�2�2�&(9G./C�.-� 2/� N*R/�(N?>B�?@<T%��l/063 2G36F )(�[�\1F��B�%'?@��?T-L�&%M6F�.-L����<>"!?>�35�2��5C63<K%'�2?@��%' �?>/0�� 21F��/C��"�?K(z �1.%' j 213�d(9/C<@63 2?@/C�U/';,%'�U?><><@��G./m(9��-�G3�2/0I3<>��BY��%���I.�J/CIF )%'?@�3��-�;A�2/CB%_40%��2?T%� 2?@/C�.%�<+G3�2?@�.��?>GF<>�$VC*71F?T�)1���/0�L Z%'?@�.(�I./C �1� 213�O-F%' )%J%��.-]G3��?>/0�7(9BH/$/C 21F�3��(2(?@�L;A/C��B�%' �?>/0�+[� B�/$/0 213�F��(2(�?T(� )%'8$���J?>�! 2/:%C���W/C63�! �I!"S-L���.�3?@�35O% ~`mO_;_e\��JZ#Y¾~h~2^`o8ZJiz\qbc_(ZJjed4365 �87 ?>�S(N6.��1S%u*,%&" 21`%' ^<>/�*���#40%'<@63��(#/�;+ �13�;A63�.�� �?>/0�.%'<.�W/C�2����(9G./0�.-� �/O(9BH/$/C 21F���#;A63�.�W 2?>/0�.(�[ � ?>�`���7*�7<@/$/C8_;A/0�R%;A63�.�W 2?>/0�] �1.%' ^?K(�(N?>BS63<> Z%'�3��/C6.(N<>":��<>/m(9�7 �/� 21F��-3%' Z%�%'�`-�%'<K(9/:(9B�/$/0 21+V$?@ �?K(��.%' �63�)%�<n �/J�)13/$/$(N�%C(:%�(N/C<>6F 2?>/0��/';, 213�M%'G3G3��/�EL?@B�%' �?>/C��GF�2/CIF<>��B �13��;A6F�.�� 2?@/C�� 21.%� �B�?@�3?>BH?�����(7 213�J;A/C<@<>/�*7?>�F5;A63�.�W 2?>/0�.%'<

9 5 �87 � /�" ���a � a � " �;:+& " �=<?>A@ 3;5 �B7DC a2e��

*713�����E@�?K(_%�G./$(9?@ 2?@4$�J�L63BSI.���u �1.%' :?T(u6.(96`%'<><@"���%'<@<>��-� 21F� ]hY=g(o�d±j(]zb�¢`je\rbc_(ZÓnJj(]¾j(m³Yh\3Y[] [S\13��.�Z(9 � 2����B ?T(����L;A/0�)��?@�35���<>/m(9���F��(2(� 2/� �13��-F%' )%!V�%��.- �13��(N����/0�.- (NB�/$/C �13�3��(�(�Vu*713?@<>�� �13��2��5C63<K%'�2?@��%' �?>/0�_G`%'�)%�B��� �������/C�! 2��/C<K(r 213�^ 2�Z%C-L��/ �HIn�� 9*R�����O 21F��(9�^ N*/7 ����2B�V�%��.-���%'�OI.�7�)13/$(N���%C����/C�Z-L?>�35U 2/U����/$(2(N��40%�<>?T-F%' 2?@/C�� 2�&��13�F?TP$63��(�ac�l<><@���+V�e�fQ}�{Fh�w�%'1!I.%U%'�.- w�/C<K-rVe�fQ}&�Lh7kl/0<>63IvV�l��%� 21�%'�.-�w�%'1!I.%LV�e�fQ}&fLh � �)%�4$����%��.-�w�%'1!I.%LV�e�fQ}&fLh;Fl 2�����)%0(�V�e�f$}�fLh�w�%�1LI`%LV�e�fCgC�$��/C�u �/(9/0B��u/0 213����G3��?>�.��?@G3<>�mVL(N6.�)1�%0( � 2�26`�� 263�Z%'<�y7?T(N8�s�?@�3?>B�?@��%' �?>/0��aHG%�G3�3?@8rV=e�fCg0gQ�Z[

�� J��%���I.��(N13/�*7�� 21.%� �V#;A/C�S%�*7?K-L�H��<T%0(2(�/';7;A6F�.�� 2?@/C�.%�<T( 3 V# 21F��(9/0<>63 �?>/C�`(�/';j 213��BH?>�3?@�B�?@��%' �?>/C�J/�;� �13�l;A63�`�� 2?@/C�.%�<�a2e��^%�<><r1`%&4$�� 21F�O(2%�B��z;A/0�2B�[��l<> �13/C6F5C1�%J-L�� )%'?@<>��-S%'�`-M��?>50/C�2/06.(-L����?>40%' �?>/0��/�;O 21F��(N/C<@63 2?@/C��/';O �13?T(�GF�2/CIF<>��B�?K(�/C63 S/';j 21F��(���/CG.�U/';O �13?T(�G.%�G.����V7%�(N?>B�GF<>�-L����?>40%' �?>/0��/';� �13?T(O5C���3���)%'<R�2��(N63<> O?K(_G3����(9���! 2�&-®?@��%'G3G.���`-L?>E�a��_�Z[����� �13?T(:(9���W 2?>/0� *R���N6.(N G3����(9���! R%�;c%�B�?><@"�/';�(NB�/$/C �13�3��(�(¡;A63�`�� 2?@/C�.%�<T(^%'�.-� �13�u�W/C�2����(9G./0�.-L?>�F5S(9/C<@63 2?@/C�.(^/';� �13�l40%��2?T%�� 2?@/C�.%�<LGF�2/CIF<>��B�[+w������;A���� 213�R�2��%0-L���� 2/u �13�7��6F�2�2���L �<>?@ 2���Z%' 26F�2��;A/C�� �13�BM%' 21F��B�%' �?T��%�<$-L�� )%'?@<T(a�w�%'1!I.%!V+e�fCf0oLh+s�%0-L"F��1�%��.-�ª���<T(N/C�+V+e�fCfCo!hrt�"L�+V+e�fCg$}C�)[

w �u�.�Z(9 ��3����-� �/]50?>4$�:%�BH/C�2�jG3�2���W?T(9��-L���.�3?@ 2?@/C��/';^*71`%' �*�OB���%���I!"�(NB�/$/C �13�3��(�(7%'�.--L���`�3�J%S��<T%0(2(7/';R(N63?> Z%'I3<@�J(NB�/$/C �13�3��(�(,;A63�`�� 2?@/C�.%�<T(�[Rw �:�2��;A���7 �/�(NB�/$/C �13�3��(�(l%0(u%JB���%C(N63�2�

Page 5: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

/';j 21F� ¤ /m(2��?@<><T%� 2/0�2"F¥�I.��1.%�4!?>/C�J/�;j%�;A63�.�� �?>/0�+[�\13������;A/C���$V�*7?> �13?>�¬%���<K%C(2(�/�;O-!?��=���2���L �?T%'IF<>�;A63�.�W 2?>/0�.(�V!/C�3�u;A63�`�� 2?@/C��*7?@<><.I.��(�%'?K-M �/JI.�O(9B�/$/0 213��� 21`%'�U%'�3/0 213���7/C�3�O?�;�?@ /m(2��?@<><T%� 2��(^<>��(�(�[��;O*�U<>/$/08x%' S 21F��;A63�.�W 2?>/0�.(]?@�� 21F��;A�2�&PQ63���.��"�-L/0B�%'?@�+V^*��BM%&"¬(2%�"� �1.%' H%®;A63�.�W 2?>/0��?K((9BH/$/C 21F���7 21.%���%��3/C �13����/C�3�:?�;�?> 71.%0(z<@��(2(���F���250"�%' �13?>501�;A�2��P$63���.�W"�ac(9B�%�<><>���I.%��.-L*7?T-! 21r�Z[\13��13?>501�;A����P$63���.��":��/0�L ����! �/';£%j;A6F�.�� 2?@/C�H��%'�JI.��B���%0(963����-�IL"O�.�)(N ^13?>5013��G`%C(2(��.<> ����2?@�35u �13�;A63�.�W 2?>/0�+V!%'�.-S 213���HB���%C(N63�2?@�35u �13�uG./�*����VQ �1.%' R?T(^ 213��� < �3/0�2B�V$/';� �13���2��(N63<> �[����];A/C��B]6F<T%C(WV 21F?T(7(96F5C5C�&(9 )(j-L���.�3?@�35S(9BH/$/C 21F�3��(2(�;A6F�.�� 2?@/C�.%�<T(7/';� 213�u;A/0�2B

365 �B7 ��������(C� �� arC'� <�� arC'� a�p$�

*713����� � ?>�.-L?K��%' ���(l �13�S�3/C63��?>���u ��)%��.( ;A/0�2B�V �� ?T(O(N/CB��:Gn/m(9?@ 2?>4$�O;A63�.�� �?>/0�� 21.%� _ ����.-3(u �/�������/%C(��[C���� � ac(9/S 21.%� � �� ?K(l%���13?@5C13�AG.%0(2(z�.<@ 2���W�7%��.-M;A/0�l*71F?T�)1� �13�J�W<T%C(�(z/�;�;A63�.�W 2?>/0�.(�(96.�)1 21`%' � �13?T(u��E!G3����(2(N?>/C��?T(�*��<@<^-L���.�F��-®?K(u�3/C :��B�G3 N"$[J�3/0��%�*R��<><^-!���.�3��-���<K%C(2(O/';R;A63�.�� �?>/C�`(� a�s�%0-L"3�)1�%'�.-�ª���<T(N/C�+VRe�fCf0oLhRtl"!�+Ve�fCfLe0h7tl"!� �� J%'<c[>V^e�f0gCf$�O 213?K(�;A63�.�W 2?>/0�.%'<^?K(�%�(N��B�?@��3/0�2B�VC*7?@ 21S%l�.�3?@ 2��-L?@B����.(N?>/0�.%'<!�L6F<><.(NG.%C�����D[�\13���3��E! ^(N���� 2?@/C�J*7?@<><3I.��-L��4$/0 2��-� �/O5C?>4!?>�F5��EF%'B�GF<>��(7/';� �13�]G./m(2(9?@I3<>�M��13/0?T���&(z;A/C�: 213�H(9 Z%'I3?@<>?>����� 3 [��3/0�_ �13��B�/0B����! 7*�O�N6.(9 d%C(�(963B�� 21`%' O?> O��%'��I.�]*7��?> � 2����%0(�?@����P$6.%' �?>/C��acpQ�ZV#%��.-�B�%'8$�O 21F�S%C-3-L?@ 2?@/C�.%�<%0(2(N63B�G3 �?>/C�� �1.%' ��?T(j(9"!B�B��� ��2?T�0V3(9/U 21.%� O?> )(j�`/063�2?@���u ��)%'�`( ;A/C��B � ?T(u����%'<^%��.-�(9"!B�B��� ��2?T��[O���� 213?K(u��%0(9�S?> u?K(G./$(�(9?>IF<>�� 2/�(913/�* ac(9���M%'G3G.���.-!?>E�a��_��;A/C�H%�(98$�� Z��1�/';O �13��G3��/$/';W�J 21`%' S 213��;A63�.�W 2?>/0�� 21.%� B�?@�3?>BS?>����(� 213�u;A63�`�� 2?@/C�.%�<^a2e'�^1`%C(7 213�u;A/C��B

� a ��� � /�" ����� " � a � : � " �#> ��� ��� � ����� a ��� a��$�

*713����� � � . �� ��� ?T(7%JI.%C(N?T(7?>�� 21F�! H-L?@B����.(N?>/0�.%'<.�!63<><�(NG.%C���"� /';^ �13�u;A63�.�� �?>/C�`%'< 3 V3 �1.%' 7?@�B�/m(9 ���%0(9��(7?T(�%](N�� �/';^G./C<@"L�F/CB�?K%'<T(WV.%'�.-� 213���2��;A/0�2��*7?@<><=In�J����;A�����2��-] �/�%C(7 21F� ¤ G./0<>"!�3/CB�?K%'< 2���2B�¥]?@����P$6.%' �?>/C��a��$�)[S\13�H��/$�$#M��?>���L Z(%� � %��.- � "R-L��G.���.-�/C�� 21F��-3%� )%!V�%'�`- (�%' 2?K( ;A"� �13�;A/C<@<>/�*7?>�F5J<>?>�F��%'�,(9"F(9 2��B

a � >A@'&3�3< >)(�*p7 �,+ a�{!�

(�<���o a��$�*713�����-&]?T( �13�O?T-L���! 2?@ N"JB�%' ��2?>E=V!%'�.-�*�O1.%�4$�O-L�W�.�3��-

a.+�� " � & " $ aq<L� " � � " $ aq7�� " �/� " $a � � "10 � � a � " :�� 0 � $ a2(O� � " � ��� a � " �

ªl/0 2?T�W�_ �1.%' �?�;� 21F��-F%' )%S 2����B ?>����P$6.%' �?>/0��a2e��?K(�2��GF<T%C�W��-�IL"43 /" ���65 a � a �#"T� : & "��^*71F���2� 5?T(7%��L"U-L? �=���2���! 2?K%'I3<@�l;A63�.�W 2?>/0�+V3 21F�J(9/0<>63 �?>/0��/';� 21F��40%'��?T%' �?>/0�.%'<�G3�2?@�.��?@G3<>�u1`%C(�(9 2?@<><+ �13�u;A/C�2B{

Page 6: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

�LV3IF63 7 213�:��/$� #���?@���! )(��%'�3�3/0 7I.�_;A/C6F�.-�%'�!"LB�/0�2�uI!"H(9/C<@4L?@�35S%J<>?>�F��%'�,(9"F(9 2��B /';���P$6.%' �?>/C�`(a9k�?@�2/$(N?�V+e�fCfLe0h£k�?@�2/$(N?�V.i#/05C50?>/H%'�.- � %'G3��?><>�mVre�f0fLe��)[

\13�S��EL?K(9 ����.���:/';�%�(N/C<>6F 2?>/0�� 2/� �13�J<>?@�3��%'��(9"F(9 2��B (913/�*7��%'I./�4$�]?K(�506.%'�Z%'�! 2���&-®I!"� �13���E!?T(N 2���.�W�_/�;7 �13�S(9/0<>63 �?>/C��/�;R 213�J40%'��?T%� 2?>/0�.%'<�G3�2/0I3<>��B�[u\13�S��%0(9�J/�;)@ ��o���/0�2����(9G./C�`-3(_ �/G363���J?>�! 2����G./C<T%� 2?@/C�+[:���� 213?K(u��%C(N�J 213�J��EL?K(9 2���.����/�;,%'����E3%0�� O(N/C<>6F 2?>/0��/';, 213�J<@?>�3��%��u(N"3(N 2��B/';¡��PQ6`%' 2?@/C�.(7-!��G.���.-3(7/C�� 21F�_GF�2/CG.���� 2?@��(z/�;� �13�OI.%C(N?T(;A63�.�� �?>/0� � acs�?T���)13��<@<>?AV3e�fCgC�$�)[

\13�:%'G3GF�2/�EL?@B�%' �?>/0��(2�)13��B���/';¡��PQ6`%' 2?@/C��a��$�^1.%C(�%S(9?>BHG3<>��?>�! 2����G3�2�� )%' �?>/0��?>�� 2���2B�(�/';�%�3�� N*R/C�28U*7?> �1�/C�3�S<T%�"$����/';R13?K-3-L����63�F?> )(WV+*713?T�)1�*R�S��%'<@<^%�¦ Y=g(o(dfj(][b�¢`je\qbc_(Z�§­Y \�¨�_(]2© a�y�ª_�)[�lG3G.���`-L?>E�bx-!��(2����?>I.��( �13�O��EL ����.(N?>/C�� �/J 213�O4$���� �/C�7/063 2G36F u(���13��B��$[

����(N63B�B�%��2"$V0 213�:%'��5C63BH���L ^/�;� �13?T(7(N���� 2?@/C�U(91F/'*�( �1.%' �6.(N?>�35S%�����5C63<K%'��?>��%� 2?>/0���3�� N*/0�28/';¡ 213�u;A/C��B a��Q�ZV`;A/0�u%S������ )%�?>�U��<T%0(2(/�;^I.%C(N?T(z;A6F�.�� 2?@/C�.( � V.?T(7��P$63?>40%'<@���! 2/SB�?@�3?>BS?>��? �35O �13�;A63�.�W 2?>/0�.%'<,a2e'�Z[�����G.%��2 �?T��63<K%'��Vr 213�d��1F/C?T�W��/'; � ?K(l��P$63?>40%�<>���! l �/� 21F�S��/C���2��(NGn/0�.-L?@�35U��13/0?T���/';¡ 213�:(9BH/$/C 21F�3��(2(�;A6F�.�� 2?@/C�.%�<^a�p$�)[

����� � ����»�#�����1��+��Ù�Q�#��� ��� ��������¶���Ù�� ����� ��� !�&�(')���#*V+� /C�`(9?T-!���u%���%'G3GF�2/�EL?@B�%' �?>�35�;A6F�.�� 2?@/C�U/';R 213�O;A/C��B ac�Q�ZVn�3��5C<>�&�� 2?@�35J 213� ¤ G./C<@"L�F/CB�?K%'<+ 2���2B�¥;A/C�j(9?@B�G3<@?T��?  N"$[+�D��/0B�G.%C�W �3/0 )%' �?>/0��;A/C�7 �13?T(7��E!G3�2�&(2(9?@/C��?K(

� a ������< � W�a ��� a��$�*713�����¶W�a ���=?T(# �13�4$���W 2/C��/';.;A63�`�� 2?@/C�.(�(96.�)1J 21`%' 7arW#a �����%" � � a �): �#">�Z[ � ?@�.��� �13�7�W/$�$#��W?>���! )(<S(2%' �?T(�;A"� 213�O<@?>�3��%���(9"F(9 ���B a�{!�)V.(N/C<>6F 2?>/0��a��Q�RI.����/0B���(

� a ��� � a � >A@'&3�� � + � W#a ��� Cw�����%'���2��*7��?> ��_ �13?T(��ELG3����(2(N?>/0��%0(

� a ����� /�" ���& " � " a ��� �/+ ��� a ��� a9}0�

?>��*713?K��1H 213�O4$���� �/C� � a ���^/�;�I.%0(9?K(,;A63�`�� 2?@/C�.(?K(7-L���.�3�&-� a ��� �Da � >1@'&`�� � W#a ��� a�g$�

%'�`-¬�F/'*�-!��G.���.-3(�/0��%'<@< 21F��-3%' Z%�G./C?>�! )(:%'�.-�/0�� 213�H�2��5063<T%��2?>�&%' 2?@/C��G`%'�)%�B��� �����@r[�\13��2��G3�2��(N���! )%' �?>/0��aN}C�O/';� �13��(N/C<>6F 2?>/0��/';� �13��%�G3G3�2/�E!?>B�%� 2?@/C��G3�2/0I3<>��B ?K(_8!�3/�*7��%C(� �13� k(oNjed/';R��P$6.%� 2?>/0��ac�Q�)V=%'�`-� 213�:I.%C(N?T(z;A63�`�� 2?@/C�.( � " a ���,%'���J��%�<><>�&-M �13� Y��DoNb��Djed�Y[ZN\z©(Y�]zZ1Y d ~ V+In�&��%'6.(N�/';¡ 213�:(9?@B�?><K%'��?> N"JI.�� N*�����H��PQ6`%' 2?@/C��a9}C�,%'�`-� 21F�_8$���2�3��<v(9B�/$/0 213?@�35S 2���)13�3?KPQ63�j 21.%� l*R�_*7?@<><-L���`�3�?@�J(9�&�� 2?@/C�Jp![ p�a � ?><@4$���2BM%'�+V0e�fCg�{3hF���%'�Z-L<>�$V!e�f0fCo!hL�j%C(9 �?>�,%'�.-J\?@I.(913?@�)%��3?�V3e�fCf0oQ�)[�wx1F?><>�?>�S��P$6.%' �?>/0��ac�Q�� 213� ¤ -!? #M��63<> Z¥uG.%'�� ?T(� �13�u�W/CB�G36F )%' �?>/0�J/';� 21F�74$���� 2/0�^/';��W/$�$#��W?>���! )( � " V$ �13�(9�� u/';^I`%C(9?K(l;A63�.�� �?>/C�`(,W�a ���RIn��?>�35��&%C(9?@<>"�I363?@<> �Vn?@����P$6.%' �?>/0��a9}0�7 21F� ¤ -L? #���6F<> )¥JG.%��2 u?K(z �13�

Page 7: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

��/0B�G363 Z%' 2?@/C�:/';. �13�I.%0(9?K(£;A63�.�� �?>/0�.( � a ���)V� 21F�7��/$�$#M��?@���L Z(r/';= 21F���E!G.%'�`(9?>/0��I.��?@�35u��E!G3<>?K��?> �<>"5C?@4$����I!"� 213� & " [uªl/0 2?T�W�_ �1.%' � a ���7-L��Gn���.-3(l/0�� 213�d-L?T(N 2�2?@I363 �?>/C�U/';R 21F�J-3%� )%�?>�U 213�:?>�3G36F (9G`%C���j%'�.-J 21`%' �13�78$�����3��<T( � " a ���)V063�3<>?@8$� �13�l8$���2�3��<K( � a ��: � " �)V!%'���l�3/0 ��)%'�`(9<T%� 2��-J�2��G3<>?K��%C(/';` 213�,(2%'BH��8$���2�3��<c[+ªl/0 2?T�W�^%'<K(9/u �1.%' �VC%0(�(913/�*7�:?>�J%�G3G.���.-L?@E:buVC%�-L6.%�<L����G3�2�&(9���! )%� 2?>/0�O/';. �13�;A/C��B a9}C�,��EL?K(9 Z(,;A/0�u%�<><� 213�d%'G3G3��/�EL?@B�%' �?>/C��(2�)13��B��&(� 21`%' O��/0�.(9?K(9 Z(z/�;<@?>�3�&%'�j(963G.����Gn/m(9?@ 2?>/0�.(/';�%'��I3?> ��)%��2"��!63BSIn���)(u/';jI.%C(N?T(_;A63�`�� 2?@/C�.(WV%0(�<>/C�F5�%C(� 21F�����2�2/0�S���2?@ 2����?>/0� �1.%' J?K(�6.(9��-� �/-L�� ����2BH?>�3�� 213�OG.%��)%�B��� 2���)(�/�;� �13�:%'G3GF�2/�EL?@B�%' �?>/0��?K(7PQ6`%C-L�Z%' 2?K�C[

\13�H-L6.%'<^����G3�2�&(9���! )%� 2?>/0��G3�2/�4!?T-L�&(u%'��?>�! 263?@ 2?@4$��*7%�"U/';7<@/$/C8!?>�35U%� � 21F�S%'G3G3��/�EL?@B�%' �?>/C�(2�)13��BH�7a��$� # �13�40%�<>63�7/�;r �13�7%�G3G3��/'E!?>BM%' 2?@�35;A63�.�W 2?>/0�S%' ^%��J��40%'<@6.%' �?>/C�JG./0?>�! ��?T(+��E!G3<>?K��?> �<>"��E!G3�2�&(2(9�&-�%C(O%]*��?>5C1! 2�&-�(963BY/';7 �13�J40%'<@63��()&�"�/';, 213��;A63�`�� 2?@/C��%' j 213�S��EF%'B�G3<@��( �#"�[:\13?K(��/0�.����G3 J?K(��3/C S�3��*�?>��%�G3G3�2/�E!?>B�%� 2?@/C�� �13��/C��"$VR%'�.-�1.%C(JI.������6`(9��-rV�;A/C�J��E3%�B�G3<>�mV#?>�� �13� 21F��/C��"�/';¡PQ6`%C(9?@��?@�L ����2G./0<T%' �?>/0�+[\1F����%C(9�O?@��*71F?T�)1� 213�:-3%� )%JG./C?>�! )(� �#"H.��W/C?>�`��?T-L�j*7?> 21� �13�BS63<> �?>�A?>�! 2��50���)(���,�VC*71F���2��� ?T(� 213��(N�� ^/';v?>�! 2��50���)(+�L6FB]I.����V'1.%0(�I.�����J��EL ����.(9?@4$��<>"�(9 26`-L?>��-�?@� 21F��<>?@ 2���Z%' �63�2�$V=%'�`-�?> �?T(u%�<T(9/H8L�3/�*7��%0( �pi��J_eY[Z�{zY�]Bg�� ~Ôjzn(np]_���bcmOje\qbc_(Z a � �)13/$���!I.���25FV�e�f�{$�0%LVe�f�{$��I+Vle�fC�0fLhRyl%�I363 �VRe�f0fLeCV�e�f0fCp!hs�%0-L"3�)1�%'�.-�ª���<T(N/C�+V^e�f0fCo0%Lh �$%0��8F(9/0�+Ve�fCgCg!h-!��b/$/C��Ve�f0fCo!h�b6313BM%'�3�+V+e�fCf0oLVe�fCf!eCh�tl"!���� u%�<�[@V�e�f0gCfQ�Z[����U 213?K(u��%C(N�$V+%���%'G3G3��/�EL?@B�%' �?>/C� ��� �/U%;A63�.�W 2?>/0� � ?K(7(9/C6F5C1! l/�;� �13�u;A/C�2B

� � a ��� � �� � � � a��'� � a � :��'� C a�f$�

*713����� � ?T(�(N/CB���;c%0(9 2�c-L����%&"!?>�F5 ;A63�.�� �?>/0�� 21`%' �?K(�% <>?@�3��%�����/0B]IF?>�.%� 2?>/0��/';dyl%0-L?T%�<ub7%0(9?K(�363�.�� �?>/0�.(�[O\13�S%�G3G3��/'E!?>BM%' 2?@/C��(2�)13��B��JacfQ��?T(7 21F���2��;A/0�2�S%]<@?>�3�&%'�j(963G.����Gn/m(9?@ 2?>/0� /�;,yl%0-L?T%�<b7%C(N?T(��363�`�� 2?@/C�.(]?@�x*713?T�)1� �13��;A63�.�W 2?>/0�.( � a � :��'�JGF<T%�"� 213����/C<>��/�;:��PQ6F?>40%'<@���L S8$�����3��<T(W[� 6.%C(N?>�A?>�! 2����G./C<T%� 2?@/C��?T(?@�L ����2��(N 2?@�35JI.����%'6`(9�O?> ���/063<T-�G3��/�4L?K-L�u5C/$/!-�%'GFG3�2/�E!?>B�%� 2?>/0��*7?> �13/C6F 21F�7�3����-O/';v(9/0<>4!?>�35O�W/CB�G3<@��E�B�?>�3?@B�? ��%' �?>/0�uG3�2/0I3<>��B�(r/C�^(N/C<@4L?@�35u<T%��250�7<>?>�F��%'��(9"F(9 ���B�(�[��3/C�¡%-L?K(2��6.(�(9?@/C��/';R(N6.�)1��3/C�U?> ����)%� 2?>4$�� 2�Z%'?@�3?>�35S%�<>50/C�2?@ 213BM((9����s�1`%C(980%���a�e�fCf0�C%$��%'�.-�����;A���2���.����( 21F���2��?@�+[

�l<> �13/C6F5C1�-L? #M��63<@ u 2/�GF�2/�4$�]��?>50/C�2/06.(9<@"$V�*�M��%'����ELG.���� : 213�H8$���2�3��<T( � " a ���u 2/�-!�����2�&%C(9�*7?> �1x 213��-!?T(9 Z%'�.�W��/';d 213��-3%' Z%�Gn/0?>�! )( � " ;A�2/CB 213����4C%�<>6.%� 2?@/C�xG./C?@�L �Vl(N/� 21.%� �/C�3<@"� �13��3��?@5C1!I./C�2?@�35�G./0?>�! )(% �=���� ^ 213�j��(9 �?>B�%� 2�/�;� 213�7;A63�.�W 2?>/0��%' �^V$G3�2/�4!?T-L?@�35O 213������;A/C����% ¤ <>/!��%�<T¥%'GFG3�2/�E!?>B�%� 2?>/0�S(2�)13��B��m[���4$���]? ;+ �13�7/C��?>5C?@�.%'<=I.%C(N?T(#;A63�.�W 2?>/0� � ?K(¡�F/C ¤ <>/!��%�<T¥!VQ<@?>8$�7 �13�lBS63<@� 2?KPQ6`%C-L��?T� � a ��� ��� e > � � � < V. 213�JI.%0(9?K(z;A63�.�� �?>/0�.( � "�a ���7%��2�JI.��<@<�(N1.%'G.��-rV=<>/!��%�<£;A63�`�� 2?@/C�.(WV*713/m(9��<@/!��%'<@?> N"S*7?><><=-L��Gn���.-�/0�� �13�:��1F/C?T�W�u/';� 213�OI.%0(9?K(�;A63�.�� �?>/C� � V3/C�U 213�:-L���.(9?@ 9"S/';¡-3%� )%G./C?@�L Z(�V3%��.-�/C�� �13�u����5C63<K%'��?>��%� 2?>/0��G.%��)%'BH�� 2����@=[^\13?K((91F/'*�( �1.%' ,%'G3G`%'�2���L �<>" ¤ 5C<@/CI.%�<T¥J%�G3�G3��/'E!?>BM%' 2?@/C��(2�)13��B���(7��%'��I.�]����5$%��)-L�&- %0(l<>/!��%�<�V m³Y[mO_(][|��3{hj�~;Yk 2���)13�3?KPQ63�&(_ac(9���J��P$6.%� 2?>/0�}C�Sacs�1.%C(N80%'��V7e�fCf0�C%Q�Z[��� J(91F/C63<K-¬I.���F/C 2�&-¬1F/'*R��4$����V£ �1.%' J �13��(N�� 2���)13�3?KPQ6F��(O-L/��3/C J1`%&4$� 21F�J13?>5013��(9 �G./$(�(9?>IF<>�H-L��5C������/�;R<>/!��%�<>?> N"$V=(9?@�.���: 213�:G.%'�Z%'B��� ����� 21.%� O��/C�! 2��/C<K(l 213�J<@/!��%'<@?> N"�?K( 21F������5C6F<T%'��?>��%� 2?@/C��G.%��)%�B��� 2����@=V� 21.%� ]?K(_ �13�U(2%'BH��;A/0��%�<>< �13��8$�����3��<K(�[��� �?T(�G./m(2(9?@I3<>�� �/-L��4!?T(N�J��4$���UB�/C����<>/!��%'<^ 2���)13�3?KPQ6F��(�V.?>��*713?K��1��&%C�)1�8$���2�3��<#1.%0(�%�G.%��)%'BH�� 2���� 21`%' :��/C�! 2��/C<K(?> Z(<>/!��%�<>?@ 9"Ua�b/0 2 �/C6�%��.- GR%'G3�3?@8rV+e�fCf0pLh8G%�G3�3?@8rV!Gn���)(9/0�.%'<���/0B�B]6F�3?T��%� 2?@/C�r�Z[

Page 8: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

wx13���U 213�:-3%� )%S%'�2�:��P$6.%'<@<>"H(9G.%0����-�/0��%���?>�!�.�3?> ��O5C�2?K-rV3*�O��E!G.���� 7 �13�OI.%C(N?T(;A63�.�� �?>/C�`(� " a ���v 2/�I.���W/CB��R 2�)%��.(9<K%' �?>/C�H?>�!4C%��2?K%'�! �V$%��.-] 21F���2��;A/0�2�7 �13��-L6.%�<r�2��G3�2��(N���! )%' �?>/0��a9}C��I.����/0B���(%���/C�!4$/C<@63 2?@/C���.<> �����[¯�`/0��%�(9 �6.-L"�/';: �13��G3�2/0Gn���2 2?@��(J/';O �13��(9���.<> ����)(�?@�� �13����%0(9�U/';O/0�3�-L?@B����.(N?>/C�`%'<^��6FI3?T�S(9G3<@?>�3�&(_(N���S 213��*R/C��8 /�; � ?><@4$���2BH%'��a�e�fCg�{L�ZV�*713/�5C?@4$��(u��ELGF<>?T�W?> ��2��(N63<> Z(;A/C�� 21F��(N1.%'G.�:/';� 213�O��P$63?>40%�<>���! 8$�����3��<c[

qr�� �6.(+��/C�`(9?T-!����(9/0B��^(9?@B�G3<@�#��E!G.���2?@B����! )(3 21`%' �(91F/'*� 213�R(91`%'G.�/�;. 213�^��P$63?@4C%�<>���! .8$���2�F��<T(?>�:(NGn�&��?��=�R(9?@ 26.%� 2?>/0�.(�[�w ���.�Z(9 ���/C�`(9?T-!���2��-:%l-F%' )%�(9�� ���/0B�G./$(N��-_/�;=�C�7��P$6.%'<@<>"O(NG.%C���&-_G./C?@�L Z(/C�H 213�j-L/CBM%'?>� 5 o $�e 7 - 5 o $�e 7 V$%' R 213���3/!-L��(/�;�%_����5C63<K%'�^5C��?T-]*7?@ 21H(9G.%0��?>�F5���P$6.%'<. �/JoL[ pL[�w��6.(N�J 213�:B]63<@ 2?KPQ6.%0-L�2?K�lI.%0(9?T(7;A63�.�� �?>/C�`( � a ��� ��� � < > � � � < V=*713���2� � 1.%0(�I.������(9�� u 2/�o![ p![�#?@5C63���]e�%�(91F/'*�(� 213�:/C�2?@5C?@�.%'<+BS63<> �?TP$6.%C-!�2?T�;A63�.�W 2?>/0�+V=%'�.-��.5C63����eWI� 213�O��P$63?>40%�<>���! 78$���2�F��<� ��� V3?>�� 21F����%C(9�O/�;�@ ��o!V3*713���2�mV3%C����/C�Z-L?>�35S 2/S-!���.�3?@ 2?>/0��a�gQ�

� " a ��� � � ��0 ��� a � � � "10 � a � :�� 0 � C�l<@<+ 213�J/0 213����8$�����3��<T(WV3��EF����G3 � 213/m(9�S��<@/$(N�� 2/H 213�:In/0�)-L����V+%��2�J4$����"�(N?>B�?@<T%���V3(N?>�.�W�� 21F�J-3%� )%%'���O��PQ6`%'<><@"�(NG.%C�W��-rV.%'�`-� 2�Z%'�.(N<T%� 2?>/0��?@�L40%'��?T%��.���u13/0<T-3(�%'GFG3�2/�E!?>B�%� 2��<@"$[� /C�.(N?T-L���l�3/�* %�/0�3�:-L?>BH���.(9?@/C�.%�<r��EF%'BHG3<>��*7?> �1�%JBS63<> �?TP$6.%C-L��?T�I.%0(9?K(,;A63�`�� 2?@/C��

� a��r� ��� � < >�� < C\13�d-3%' Z%](N�� l*,%C(���1F/$(9���� �/]I.�d%��3/0��63�F?�;A/C��B�(2%�B�G3<@?>�35J/�;^ 213�O?@�L ����240%'< 5 o $�e 7 V3 �1.%' �?T( �13�(9��

�o C o $Zo C e $)o C p $)o C � $)o C { $)o C } $�e C o . C��� �.5063�2��e��CVe�-�%'�`- eW��*�S1.%�4$�H-L�)%�*7�+V�����(9G.���� �?>4$��<@"$Vr �13����P$63?>40%�<>���! u8$�����3��<T( � � V � %'�.-� � V�63�.-!���� �13��(2%�B��H-L���.�3?@ 2?@/C�.(W[�ªl/C �?T���S 21`%' J%�<><R/';� 21F��B�%��2��I.��<@<>�c(91.%�G.��-rV^%'<@ 213/0635C1� �13�/C��?>50?>�.%�<rI.%0(9?T(�;A63�.�� �?>/0�]?K(%'�H?>�.������%C(N?>�35FV!��63G3�c(91.%�G.��-];A63�.�� �?>/C�v[�ªl/0 2?T�W�$V$B�/C����/�4$����V� 21.%� �13�(91`%'G.�O/';� 21F�u��P$63?>40%'<@���! �8$���2�F��<T(^�)1.%'�350��(¡;A��/CB � � �/ � � V$In�&��/CB�?@�35OI3�2/m%C-L���7?>��B�/�4!?>�35�;A�2/CB%�13?>501� 2/�<@/'* (2%�B�G3<>�d-L���.(N?> N"��2��5C?>/0�+[S\13?T(uG31F���3/CBH���3/C��1.%0(�I.������(N13/�*7��IL" � ?><>4$���2B�%��a2e�fCg0�Q�;A/0����63I3?K�_(NG3<>?@�3��(WVLI363 7*R�O��ELG.���W 7?> �/�%�G3G.��%'��?>��BS6.�)1]B�/0�2�u50���3���Z%'<���%0(9��(W[

\13�U��/C�F�3���� �?>/C��In�� 9*R�������2��5063<T%��2?@��%' �?>/C�� 213��/0�2"�%'�.-� �13�U-L6.%'<R�2��GF�2��(N���L Z%' �?>/C�¯a9}C�OI.�����/0B���(7��<@��%'�7?@�� �13�J(NG.����?T%�<���%C(9�:/'; ¤ ��/C�! 2?@�L6F/C6.(�¥�-3%' Z%LV3;A/C��*713?T�)1� �13�O�2��5063<T%��2?@��%' �?>/C��;A63�.��� 2?@/C�.%�<+1.%C(7 21F��;A/0�2B

9 5 �B7 � � � ��a � a ���;:�&.a ����� < >A@ 365 �B7DC a2e�oQ�*713������&.a ���^?K(z �13�_;A63�`�� 2?@/C�� �/]I.�d%'G3G3��/�EL?@B�%' ���-r[7\13?K(,;A6F�.�� 2?@/C�.%�<���%'��I.�:?>�! 263?@ 2?>4$��<>"S(9�����%C(u �13�J<>?@B�?> 7/�;7 21F��;A63�.�� �?>/C�`%'<�a2e��l*71F���� 213�S�!63B]I.���7/�;�-3%� )%�Gn/0?>�! )(u5C/$�&(� �/�?>�L�.�F?> N"U%'�.- 21F��?>�O(NG.%C�W?>�35�?T(u63�F?�;A/C��B�[J�� u?K(��&%C(9?@<>"�(9������ 21`%' �V+*713��� �13��(N )%�I3?><@?>����� 3;5 �B7 ?T(�/';7 �13�J;A/C�2Ba�p$�)V3 �13�:(9/C<@63 2?@/C�U/';� 213�O�2��5C63<K%'�2?@��%' �?>/0�M;A6F�.�� 2?@/C�.%�<^a2e�oQ�R?T(

}

Page 9: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

� a ����� &na ��� ��� a ��� a2e0e'�*713����� � a ����?K( 213�:�3/C6F�2?>���7 2�)%��.( ;A/0�2B�/';

�� arC'� � �� arC'�@�> �� aqC'� $a�(N���:i#/C505C?@/3V G^/$/C��13��(u%��.- �^63?@<><@�$Vra�e�fCg0gQ�;A/0�u(N/CB��O��EF%'BHG3<>��(^/'; � a ���2�Z[\13�d(9/0<>63 �?>/C��a2e0e'�?T(� �13������;A/C����%��`<> 2���2��- 4$���)(9?@/C��/';j 21F��/0�2?@5C?>�`%'<;A63�.�W 2?>/0�1&na ���:%'�.-rVR��/0�.(9?K(9 2���L �<>"�*7?> 21� �13��2�&(963<@ )(�/'; � ?><@4$���2B�%��Sa2e�f0g'{!�)V31.%0(¡ �13�7;A/C�2B�aN}C�ZVQ*71F���2�� 213����P$63?>40%�<>���! #8$���2�3��<K(�%'���l ��)%��.(9<K%' 2�&(/';, 213�J;A63�.�W 2?>/0� � a ����-!���.�3��-�%'I./�4$�$[Sªl/0 2?T�W�J 213�J� �=���W u/';� �13�J�2��5063<T%��2?@��%' �?>/C��G.%��)%'BH�� 2��� ;A/C� @ ��o� �13����P$63?>40%�<>���! u8$�����3��< � a ���j?T(�%�t�?>�)%0��-L��<@ )%�;A63�.�� �?>/C�vV^%'�.- � a ����� &na ���Ja��F/�3/0?T(9�0��V3*713?><@�l;A/C��@ � � *�O1.%�4$� � a ��� � � a ���R%��.- � � � � &Ua�%J<>/�* G`%C(2(�.<@ 2���W�)[

\13��-L6`%'<����G3����(9���! )%� 2?@/C��?T(u?><@<>63B�?@�.%' �?>�35H%'�`- ��(9G.���W?T%'<@<>"U?>�! 2������(9 �?>�35�;A/C�: 213�H��%0(9��/�;j%BS63<> �?>�A/C63 �G363 ^�3�� N*/0�28J«H%'G3GF�2/�EL?@B�%' �?>�35:%�4$���W 2/C�^�.��<K-�«S 21.%� 7?T(R-L?T(���6.(2(N��-�?>����G3G.���.-L?@E�bu[

��� � %�������h ����� *���������+

�l� %'G3GF�2/�EL?@B�%' �?>/0�x 2���)13�3?KPQ63��4$���2"x(N?>B�?@<T%��] �/xy�%C-L?K%'<:b7%C(N?T(��363�.�� �?>/C�`(M?K(� 213��(9/0����%�<><@��-§ã_(]zmOjedfb�¢;Yk ¦ j(k(bcjed�a�j�~`bÉ~���o8Z�i[\qbc_(Z�~ acs�/$/!-L"�%'�.-�tu%'��8$���+V7e�f0gCg!V_e�fCg0fQ�)[�� ªl/0�2B�%�<>?@����-y�%C-L?K%'<�b7%C(N?T(7�363�.�W 2?>/0�.(��E!G.%'�`(9?>/0��?K(7%d;A63�`�� 2?@/C��/';� 213�u;A/0�2B

� a ��� � 3�� � ��� � � � a ��: � �3 � � ��� � a � :� � � C a2e�pQ�

\13�u/0�3<>"H-L? �r���2���.�W�lI.�� N*�����]�&PQ6.%� 2?@/C��a�e�pQ�R%��.-�y�%C-L?K%'<vb7%C(9?K(�363�.�W 2?>/0�.(�?K(� �13�u�3/0�2B�%�<>?>�&%'� 2?@/C��;c%C�� �/C�O?>�� 21F�S-L���3/0B�?>�.%� 2/0��V+*713?T�)1�?T(O%�� ��(N 2?@B�%' ���/';� �13�JG3��/CI.%�I3?><@?> N"�-L?K(9 ��2?>IF63 2?@/C��/'; 21F�S-3%' Z%L[O� -L?K(2��6.(�(9?@/C��%'I./063 O 213�J����<T%� 2?>/0��I.�� N*�������3/0�2B�%�<>?@����-�kj%'6.(�(9?T%�� I`%C(9?K(z;A63�.�W 2?>/0��3�� N*R/C�28F(�V.kj%'6.(�(9?T%���B�?@EL �63�2�&(�%'�.-�kj%'6`(2(9?K%'�UB�?>E! 263������<T%0(2(N?��.���Z(��%���In�u;A/063�.-�?>�� �13�u*R/C�28/';¡\+�2��(NG+V3�l/0<><K%' 2��%'�.-��l13BM%C-�a2e�f0fC�$�)[7���� �13�u�2�&(9 7/';� �13?T(7(N���� �?>/C�H*�O(N13/�* �1.%' �%�G.%��2 �?T��63�<T%��l4$���)(9?@/C��/';¡ 213?K(l%�G3G3�2/�E!?>B�%� 2?@/C��(���13��B��u1.%0(l%�5$%'?@��%� �?>501L j��/C�F�3���� �?>/C�� �/]����5C63<K%'��?>��%� 2?>/0� 21F��/C��"$[

qr�� �Ja �D$'&3��I.�_ �13��N/0?>�! G3��/CI.%�I3?><@?> N"J/';�?>�3GF63 )(R%'�.-�/C6F 2G363 Z(z/�;� 213�O�3�� 9*R/C��8rV!%'�`-M<@�� 6`(%C(�(963BH�u 21.%� l*R�O1.%�4$�O%](�%'B�GF<>�u/�;�� G.%'?@�)() $a �#"%$'&�" � .�/" ��� �Z%'�.-!/CB�<@"�-L�Z%�*7��%0����/0�)-L?@�35] �/��J[|�63�75C/m%'<�?T( �/]I36F?><T-�%����&(9 2?@B�%' �/C�ja�%J�3�� N*/0�28.� � 21.%� lB�?@�3?>BS?>����(� 21F� Y �hn#Yiz\wYk�][bÉ~)©

& 5 �B7 � � � � � &��Ja �D$'&3�)a &): � a ����� <�C a2e��Q�\13?K(���%'�3�3/0 ^In�j-L/0�3�$V!(9?@�.���7 21F�7G3�2/0I.%'I3?@<>?@ 9"�� ?K(�63�38!�3/�*7�+V!%'�.-J6.(96`%'<><@"� �13� Y�m,npbc]zbcihjed#][bÉ~)©

&������ 5 �87 � e�/�" ���a%& " : � a � " ���=< a2eW{L�

g

Page 10: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

?T(SB�?>�3?@B�? ����- ?@�.(9 ���%C-=[ �l� %'<> ����2�`%' 2?@4$����/0�.(9?K(9 Z(M?@�x/CI3 Z%'?@�3?>�35�%�� %�G3G3�2/�E!?>B�%� 2?@/C��/�;J �13�G3��/CI.%�I3?><@?> N" �Ja �D$'&3�u�.�Z(9 �V,%'�.-� 213����?>��B�?@�3?>B�? ��? �35U 213����E!G.���� ���-��2?T(N8r[���;u �13?T(J/CGF 2?>/0��?K(�)13/$(N���+V7/C�3���W/C63<K-�6.(N�� 213������5C63<K%'��?>��%� 2?>/0�x%�G3G3�2/m%C�)1x 2/�G3��/CI.%�I3?><@?> N"���(N 2?>BM%' 2?@/C� a GR%'G3�F?>8%'�`- � 2��;c%��L"!638=Vue�f$}�g!h��l?K-L6�%'�.-AGR%�G3�3?>8=Vue�fCgCf!h GR%�G3�3?>8=Vue�fCgCp$�)V� 21.%� �<>��%0-3(J 2/� �13��*R��<><8!�3/�*7�] �����1F�3?TP$63�7/';�� j(]2¢;Y[Z�¨�bcZJk(_$¨ë~ [��i�%��2�����S*7?>�`-L/�*���(N 2?>BM%' 2/0��� � ;A/0� 21F�lG3��/CI.%�I3?><@?> N"-L?K(9 2��?>I36F 2?>/0��/';¡%](N�� 7/';R-F%' )% �� " . /" ��� 1`%C(7 213�u;A/C��B

� � a��L��� e��/�" � �

��� � :�� "�

a2e��Q�

*713������ ?K(]%���%�G3G3��/CG3��?T%' ���8$�����3��<cV#;A/C�J��EF%'B�GF<>�H%¬kj%'6`(2(9?K%'�+VR*713/$(N�� � �F/C�2B ?K(�eCVR%'�.-*713�����

�?K(_%�G./$(9?@ 2?@4$�]G.%��)%�B��� 2����Vr �1.%' �V#;A/C�:(9?@B�G3<>?K��?> N"0Vn*R��(N�� � �/�eJ;A�2/CB �F/'* /0�+[���;7 �13�

�N/C?@�L �G3��/CI.%�I3?><@?> N" ��a �D$'&3�r?@�� 21F�7��ELG.���W 2��-u�2?K(98Ha2e��$�+?T(�%'GFG3�2/�E!?>B�%� 2��-O*7?> 21d%ui�%��2�����J*7?@�.-L/�*��(N 2?>BM%' 2/0� � � V+*�J/0I3 )%�?>��%'��%�G3G3��/'E!?>BM%' 2�&-���E!G3�2�&(2(9?@/C��;A/0�_ �13�J��E!G.���� 2�&-��2?T(N8rV & ��5 �B7 V+ 21.%� ��%���I.����E!G3<>?K��?> �<>"UB�?>�3?@B�? ����-r[U����/C�)-!���J 2/�(913/�*�13/�*� �13?T(J��%'��I.�U-L/0�3�$V^*���3/0 2?K���� 21.%� *�O�3����-� 2/�%�G3G3�2/�E!?>B�%� 2�u �13�OG3�2/0I.%'IF?><>?@ N"�-L?T(N 2��?>I363 �?>/0� �Ja �D$'&`�ZV.%'�.-� 213���2��;A/0�2�O 213�O�Z%'�.-L/0B40%'��?T%'IF<>����/';j��P$6.%' �?>/C��a�e��Q�:?T(�� � a �D$'&3�)[��l���.�W�$V�*���)13/$/m(9�U%�8$���2�F��</�;u �13�];A/C<@<>/�*7?>�F5;A/C��B <

��a��L���� �a$� � ���� �a &`�*713������ �?T(�%l(N )%��.-3%'�Z-�/C�3����-L?@B����.(N?>/0�.%'<cV�(9"!B�B��� ��2?@�£8$���2�3��<cV�<@?>8$�� �13�lkj%'6`(2(9?K%'�+[^\1F�i�%'�2�����*7?>�`-L/�* ��(N 2?@B�%' �/C�7 2/��Ja �D$'&`�^?K( 213���2��;A/0�2�

� � a �D$'&3� � e�/�" � �

�a$� � :�� " ���� �a%&�: & " � a2e��Q�

�l�U%'GFG3�2/�E!?>B�%� 2?>/0�� 2/S 21F�_��ELG.���� ���-]��?T(98H?T( 21F���2��;A/0�2�u/0I3 )%�?>�3�&-�%C(& � 5 �B7 � e

�/�" ���

� � � � &� a � � :�� " ���� �a%&�: & " �)a%&�: � a ���2� < C��� /0�)-L���_ �/��.�.-�%'��%'�.%�<>"! 2?T��%'<^��E!G3�2��(�(9?@/C��;A/C�O �13�]BH?>�3?@BJ63B /'; & � 5 �87 *�S?>B�G./m(9�J 21F�S(9 )%�� 2?@/C�.%��2?@ 9"M��/C�.(N 2�Z%'?>�! �

�& 5 �B7�� arC'� ��o $

21`%' �<>��%0-3( 2/S 213�u;A/0<><>/�*7?@�35���P$6.%� 2?>/0��� 23�����[þ3ÿ4�;þ?�)� 6 7 ù;þ 6!�[ÿ4>������ �"!$#%��&('*)+��ú��;�2ù;ú-,Bù 7 ù�þ 6/.$�0, 7 ú�����#%úõû&þ?%[þ ��ú���þý1,Bù5� 6 7 ù;þ %[ýhÿBú±ý32$�yþ3û4&ý��&85) � �1. � 8 �yþý�8 7 � 7 ù;þ�ûrý >Vþ6, ���0, �7.;ûBú����;û 7 ù�ý 7 �pþ �12 7 ýhú�� 6!�[ÿ 7 ù;úyû8,Bù$�zú9,°þ�'

f

Page 11: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

/�" ���

� � � � &� �a � � :�� " ���� �a%&�: & " �Za%&�: � a ���2� � a � :©C'����o C

i#���N;A/C��B�?>�35: 213�O?@�L ���5C�Z%'<r/�4$��� �^V.%'�.-�6.(9?@�35J 21F��;c%0�� � 21.%� �1 � ��� �DeO*�O/CI3 Z%'?@��� a ��� � 3 /" ��� �a � � :�� " �����"� &� �a%&�: & " � &3 /" � � �a$� � :�� " ��� C

i#���N;A/C��B�?>�35:%J�)1.%'�F5C�u/�;�40%'��?T%�I3<>�u?@�� 213�u?@�L ���5C�Z%'<=/';� 21F�_GF�2��4!?>/06.(���E!G3����(2(N?>/C�M%'�.-�6.(N?>�35J �13�;c%C�W � 21.%� � 21F�8$�����3��<� ?T(�(N"LBHB��� 2��?@�CV�*R���.�.%�<><@"��W/C�.��<@6.-L�R 21.%� � 213�;A6F�.�� 2?@/C�: 21.%� �B�?>�F?>B�? ����( 21F��%�G3G3��/'E!?>BM%' 2�&-]��E!Gn�&�� 2��-S�2?T(N8�?T(

� a ����� 3 /" � � & " �a � � :�� " ���3 /" ��� �a � � :�� " � � C a2e�}C�

\13�7��?>5C1! �1.%��.-�(N?T-L�R/';+ �13�7��P$6.%' �?>/0����/0�L4$���25C�&(£ �/ � *713���J 213�7�!63BSIn���#/�;+��EF%'B�GF<>��(r50/$��(� �/?>�!�.�3?> N"$V0G3�2/�4!?T-L��-J 21`%' 7 21F�u(���%'<@�z;c%0�� 2/0�

� 2���`-3(� �/�������/J%� 7%'�M%'G3G3��/CG3��?T%� 2�u�Z%' 2�m[^\13?T(�;A/C�2B

/';,%�G3G3�2/�E!?>B�%� 2?@/C��?K(z8!�3/�*7��%C( ©(Y�]zZ1Y d�]�Y=g(]hY¾~h~`bc_(Z V./C� §ãj(k(j(]¾j(|�j ���áje\c~`_(ZUY¾~[\rbcmOje\q_(] V=%'�.-�?@ 1.%0(_I.������ �13��(N63I3�N���� O/';���EL ����.(9?@4$�J(N 26.-L"�?>�� 213�H(9 Z%' 2?K(9 �?T��(:��/CB�BS63�3?  N"�a�ªu%0-3%'�Z%�"!%LVe�fC��{3hw�%' )(N/C�+V�e�f0�'{Fhly7/$(N���!I3<T%� 2 �V7e�fQ}meCh7i��2?@��(9 �<>��"�%��.- � 1.%'/FVle�fQ}&pLhukj%C(2(N���S%'�`-�s �63<><@����V7e�fCg0�Lhtl��4!�2/�"$�S%��.-�w�%�5C�3����Ve�fCgCo$�)[���(9?@B�?><K%'�O-!���2?@4C%� 2?@/C��/';���P$6.%' �?>/0�xa2e�}C�u1`%C(_I.������5C?@4$��� I!"� G.���)1L ja2e�fCfLe��)V.I363 7*R�O(913/063<T-�����B�%'��8] �1.%' 7 �13?T(^��P$6.%' �?>/C��?K(6.(96.%�<><@"�-L���2?>4$�&-�?@��%J-!?��=���2���L *7%�"$V+*7?@ 213?@� �13��;A�Z%'B���*/C��8�/�;�<>/!��%�<><>"�*R��?>501L ���-��2��5C�2�&(2(9?@/C�+V�%C(�(963B�?@�35U%�<@/!��%'<@<>"���/0�.(9 Z%'�! B�/!-L��<�a��j%'�)-!<>�$V=e�fCf0oQ�7*7?@ 21U%J<>/!��%�<+*��?@5C1! �;A63�.�W 2?>/0� �[

ªl/C �?T���R 21.%� ^ 213?K(¡�&PQ6.%� 2?@/C�J1.%0(¡ �13�;A/C��B /';=��P$6.%' �?>/0��a�e�pQ�ZV$?>�J*713?K��1J �13�������! 2���Z(#�W/C?>�`��?T-L�*7?> �1� 21F�u��EF%'B�G3<@��(�Vm%'�.-� 21F�O��/$�$#M��?>���L Z( � " %'���O(9?@B�G3<@"� 21F�u40%'<>6F��(�& " /';� 21F�l;A63�.�� �?>/0��%� �13�-3%� )%�G./C?>�! )( � " [�|��� 213�J/0 213���u1.%'�`-rV+ 213�J��P$6.%� 2?>/0��?T(u%�����(9 �?>B�%� 2�O/'; � *713?K��1U?T(l<@?>�3��%��l?@� 21F�_/0I.(9���240%' �?>/C�`( & " %'�.-�1.%C(7 213���2��;A/0�2�:%'<K(9/S 213�O5C���3���)%�<r;A/C��B /';���P$6.%' �?>/C��a9}0�)[

\13�Si�%��2�����U*7?>�.-!/'* ��(9 �?>B�%� 2/C��V.%'�.-� �13������;A/C������E!G3�2�&(2(9?@/C��a2e'}0�)V+��%'��I.�J-L���2?>4$�&-M?@�� �13�;A�)%�B���*R/C�28�/�;�����5C6F<T%'��?>��%� 2?@/C�x 21F��/C��" a GR%�G3�3?>8¯%'�.- � 2��;c%��L"!638=V_e�fQ}&gLhJ�l?K-L6x%��.- G%�G3�3?@8rVe�f0gCf!h GR%'G3�F?>8=V3e�f0gCpQ��63�.-L���^%u(9BH/$/C 21F�3��(2(^%0(2(96FB�G3 2?@/C�:/C�S 213�7G3��/CI.%�I3?><@?> N":-L?T(N 2��?>I363 �?>/0�J 21.%� 1.%0(� �/�In�S��(N 2?>BM%' 2�&-r[O\13?T(uB��&%'�.(l �1.%' �V+?>��/C�Z-L���O 2/U-L���2?>4$�:��P$6.%' �?>/C��a�e'}0�)V�%�(NB�/$/C �13�3��(�(%C(�(963BHG3 2?@/C��1.%0(� �/JIn�jB�%C-L��/C�H 213��N/0?>�! ^G3�2/0I.%'I3?@<>?@ 9"S-!?T(9 ��2?@I363 2?@/C� �Ja �D$'&`�ZV$�)%' �13���R 21.%���/0� 21F�_����5C����(2(N?>/0�M;A6F�.�� 2?@/C�U%C(7?>��acpQ�)[

� � ��� �� �� ���?���¬����� )�O��

���� 213�OG3����4L?@/C6.(7(N���� �?>/C��*R���W/C�.(N?T-L������-] �13�:��<T%0(2(7/';¡(9 )%�I3?><@?>�����)(�/�;^ 21F��;A/0�2B 365 �B7 ��� � ��(C� �� arC'� <�� arC'� a2e�gQ�

e�o

Page 12: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

%'�`- *�S1.%�4$�S(9����� �1.%' : 213�H(9/0<>63 �?>/C��/';7 �13��B�?@�3?>BS?>��%' �?>/0��G3��/CI3<@��B %'<@*7%�"3(u1.%0(_ �13��(�%'B��;A/C��B�[����� 21F?T(S(9���� �?>/0�x*��-!?T(2�W6.(2(J 213������-!?��=���2���L S N"LG.��(J/';d(9 Z%'I3?@<>?@�����)(�I.��<@/C�350?>�35� 2/� �13���<K%C(2(Oa2e�gQ�ZVr��/0�2����(9G./C�`-L?>�35S 2/H-L? �r���2���! 7G3�2/0G.���2 �?>��(7/';^ �13�OI.%C(N?T(;A63�.�� �?>/0�.( � [ �^%0��1U/';^ �13��B��/0�2�2�&(9G./C�.-F(� �/�-L?��=�������L jAnp][bc_(][b %C(2(N63B�G3 �?>/0�.(_/0�� �13�U(9B�/$/0 213�F��(2(�/�;u �13�];A63�.�W 2?>/0�� 21.%� BS6.(9 RIn�:%�G3G3�2/�E!?>B�%� 2��-=[

����� ����­ ��O+N�#�� h�h �����#+s�/$(N O/';� 21F�S��/CB�BH/C�3<@"�6.(9�&-�(9 Z%'I3?@<>?>�����)(71.%�4$�]�Z%C-L?K%'<R(9"!B�B��W 2��"$V3 21`%' �?K(�V+ 21F��"�(�%' 2?K( ;A"� �13�;A/C<@<>/�*7?>�F5J��PQ6`%' 2?@/C��

3;5 � a ��� 7 � 365 � a%*���� 7;A/C�H%'�!"��2/0 )%' �?>/0�xB�%' ��2?>E+*�[�\13?K(]�)13/C?K���������.���� Z(� �13� jánp]zbc_(][b %0(2(N63B�G3 �?>/C�� �1.%' �%�<><7 �13�40%'��?T%'IF<>��(^1.%�4$�u 213��(2%'BH�l����<>��40%��.���$V!%'�`-] 21.%� 7 213���2�O%��2�u�3/JGF�2?>4!?><@��5C�&-J-L?>������ 2?@/C�.(W[�y7/C Z%' 2?@/C�?>�!40%'��?T%'�! S(9 Z%'I3?@<>?@�����)(:��/C���2��(NG./C�.-� �/ �Z%C-L?K%'<7I.%0(9?T(�;A63�.�W 2?>/0� � a � � ���)[�s�6.�)1�%� 2 ����L �?>/0��1`%C(I.�����H-L��-L?K��%' ���-� 2/O �13?T(���%C(9�mVL%��.-J 213�j��/C���2��(NG./C�.-L?@�35:%'G3GF�2/�EL?@B�%' �?>/0�J 2���)13�3?KPQ63�R?T(#8!�3/�*7�H%C(y�%C-L?K%'<+b7%0(9?K(�363�.�� �?>/0�.(ua�i#/�*R��<><cV3e�f0gQ}$V�e�f0fCo!h.�`�Z%'�38$�mVre�f0gCp!V+e�fCg$}$h=s�?T���)13��<@<>?cVLe�fCgC�!h.~O%'�.(�%LVe�f0fCo0%LV­IvhOs�%C-L"F��1�%��.-�ªl��<T(9/0�+V�e�fCf0oLhOtl"!�+Vue�fCg$}$VOe�f0fLeChj�u%'�Z-L"$Vue�fQ}meCVOe�f0fCoLhjb6313B�%��3�+Ve�f0fCo!h.q+%'�.��%0(9 �����%'�.- � %'<@8C%�6.(980%0(�Vre�fCg0�Lh=b�2/$/CBH13��%C-S%'�`-�qr/�*�$V.e�f0gCg!h.s�/$/!-L"�%'�`-�tu%'��8$���+Ve�f0gCg!Vne�fCg0fLh3i�/C5C50?>/O%��.-]k�?>��/$(9?cV3e�f0fCo!Vne�fCf0o'I+h.kl?@�2/m(9?�V!e�f0fCp$�)[R\13�7��<K%C(�(£/�;+%0-LB�?K(2(9?@I3<>�¡yl%0-L?T%�<b7%C(N?T(7�363�.�W 2?>/0�.(?T(^ 213�:��<K%C(�(/';¡��/C�.-!?> 2?@/C�.%�<><@"]G./$(N?> �?>4$�O-L�W�.�3?> ��l;A63�.�W 2?>/0�.(ua�s�?K���)13��<><@?�V!e�f0gC�Q�/';j%��L"�/0�)-L����V^(9?@�.���J?@ �1.%0(_I.������(N13/�*7�xa�s�%0-L"F��1�%'�.-�ªl��<T(N/C�+VRe�f0fCoLhRtl"!�+Ve�fCf!e'�O 21`%' �?@� 21F?T(���%C(N�� 21F�_;A63�.�W 2?>/0�.%'<�/';¡��PQ6`%' 2?@/C��a2e�g$�7?T(�%�(N��B�?>�A�3/0�2B�V!%'�`-� 213�d%C(2(N/!��?T%� 2��-�40%��2?T%� 2?@/C�.%�<G3��/CI3<@��B ?T(*R��<><=-L�W�.�3��-r[^��<><r �13�:yl%0-L?T%�<�b7%C(N?T(7�363�.�� �?>/0�.(7��%'�U 213���2��;A/0�2�uI.�J-!���2?@4$��-�?@�� 213?K(;A�)%�B���*R/C�28=[#w��O��E!G3<>?K��?> �<>"�50?>4$�u N*R/]?@B�G./C�2 Z%'�! ��EF%'BHG3<>��(W[

� oNi��J_(ZlmOo(dy\qbck(bcm³Y�Z�~`bc_(Z�jed2~3n#dfbcZ1Y¾~tl6.�)13/0��a2e�fQ}0}C�,��/C�.(N?T-L���2��-�B���%0(963����(�/�;R(9BH/$/C 21F�3��(2(/�;^ 21F��;A/0�2B

3;5 �87 ��� � � �(C �[C�� <�� �� aqC'� <�C���� 213?K(7��%C(N� �� aqC'��� ����� %��.-� �13�:��/C���2��(NGn/0�.-L?@�35]I`%C(9?K(,;A6F�.�� 2?@/C��?T( �13������;A/C���

� a ������� � � � <�� , <>� � � � ?�;¡p����/�]%��.- �]?K(��4$���� � � <�� , /C �13���2*7?K(9�$[ a2e�fQ�

���� 213?K(l��%C(9�J �13�J�!63<><�(NG.%C���J/�; 3;5 �87 ?K(l 21F�J4$���� 2/0��(9G.%0���J/';RG./C<@"L�F/CB�?K%'<T(7/';,-L��5C�2���S%' uB�/m(9 � ?@� ��40%'��?T%�I3<>��(WV3*713/$(N�J-L?@B����.(N?>/0��?T(

eCe

Page 13: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

� � � > � :xe� � C

\13��(N�I.%0(9?K(v;A63�`�� 2?@/C�.(�%'�����Z%C-L?K%'<F%'�.-:��/C�`-L?> �?>/C�`%'<><@"uG./$(N?> 2?@4$�R-L���.�3?@ 2�$V�(N/u 21`%' � 213��"j�2��G3����(9���L �N6.(N 7G.%'�� 2?T�W63<T%���?@�.(9 Z%'�.�W��(/';� �13�u*��<><.8L�F/'*7�Uy�%C-L?K%'<vb7%C(9?K(�363�.�W 2?>/0�.(� ����)13�3?TP$63�:a�s�?K����1F��<><@?�Ve�f0gC�!h�w�%�1LI.%!V^e�fCf0oQ�Z[����� N*/�-L?@B����.(N?>/0�.(�Vn;A/0� � ��pLV#�&PQ6.%� 2?@/C��a2e�fQ��"!?>��<K-3(l 21F�S(9/U��%'<@<>��-¤ �13?>�UG3<T%� 2��¥�I`%C(9?K(,;A6F�.�� 2?@/C� � a ����� � � � < <>� � � �Oac�u%'�Z-L����%��.-�tl�&(9B�%��)%'?K(�V+e�fQ}�p!h£k���?>B�(N/C�+Ve�f0gCp$�)[

���#Y � j(o×~h~`bcj(Z�D(9 Z%'I3?@<>?>�����/�;� �13�u;A/C�2B

3;5 �87 � � � � �(C���� � �� �� aqC�� <�$*713�������D?T(S%®�.E!��-�G./$(9?@ 2?@4$��G.%��)%'BH�� 2����V�1`%C( �� aqC'� � � � � �� %'�.-x%0(]I.%C(N?T(];A63�.�W 2?>/0�� �13�kj%'6.(�(9?K%'��;A63�.�� �?>/0��a�i#/05C50?>/S%'�`-�k�?>�2/m(9?cVre�f0gCf!h���6F?><><@��%'�.-�k��2��"L*,%C���$V.e�fCgCg$�)[R\13��kj%'6`(2(9?K%'�;A63�.�W 2?>/0� ?K(_G./$(N?> �?>4$�H-L���.�3?@ 2�$V�%��.- ?> O?K(�*R��<><^8!�3/�*7� ;A�2/0B 213�S 21F��/C��" /�;��2��G3��/!-L6.��?@�35�8$���2��3��<K(Ja��l��/C�.(N��%'�N�+V^e�f0�Co$�O 21.%� �G./$(N?> 2?@4$�S-L���.�F?> 2�J;A63�.�W 2?>/0�.(Ja � ���*7%��2 �Ve�f$}��$�O��%���I.�]6.(N��- �/-L���`�3� ZJ_(]zmº~ /�;� 213�� N"LG.�Ja�e�gQ�Z[ � ?>�`��� 365 �87 ?K(%O�3/C��B�VC?> Z(��!63<><=(NG.%C���j��/0�L Z%'?>�`(�/C�F<>"S 213��������/��<@��B����! �V.%��.-® �13�S%C-F-L?> �?>/C�`%'<^�L6F<><�(9G.%0���] ����2BM(z/�;7��P$6.%' �?>/0��a��Q�j%��2�J�3/0 _�F����-L��-=Vr63�3<@?>8$��?@�tl6.�)13/0�J(9GF<>?>�F��(�[���-!?T(2%0-L40%'�! )%�5C��/';. �13�lkj%'6`(2(9?K%'�J?K(£ �13�7%�G3G.��%'�Z%'�.���7/�;= 213�,(2��%�<>?>�F5lG.%��)%�B���� 2�����V0*713?><@�7tl6.�)13/0��(NG3<>?@�3��(�V0In��?>�35O13/0B�/C50���3��/06.(£;A63�.�W 2?>/0�.(�V!-L/O�3/0 ^-L��G.���`-�/0��%��L"d(2��%�<>?>�F5G.%��)%'BH�� 2����[S�l/�*��4$����Vr?> j?T(_G./m(2(9?@I3<>�S 2/�-L��4!?T(N�J5C/$/!-�13��63��?T(N 2?T��(l 21.%� _;A63���3?T(N1�(N63I3�A/CG3 �?>B�%�<�VI363 �(N 2?@<><+5C/$/!-=Vn40%'<@63��(7/';��V!/C��5C/$/!-�(N )%'�� 2?@�35]G./0?>�! )(�;A/C�j����/$(2(N��40%�<>?T-F%' 2?@/C�UG3�2/!���&-L63�2�&(�[��\c�#Y[]ãa�j�~`bÉ~ ��o8ZJiz\qbc_(Z(~�l�����O*��50?>4$�:%J<>?T(N l/�;^/C �13���7;A63�.�� �?>/0�.(l 21`%' j��%'�UIn�J6`(9��-U%C(lI.%0(9?K(,;A63�`�� 2?@/C�.(7?>�U 213�dyl%0-L?T%�<b7%C(N?T(O�363�.�� �?>/0�.(l 2�&��13�F?TP$63�$V+%��.-® �1.%' :%��2�S 213������;A/C���S%C(�(9/!��?K%' 2�&- *7?> �1� 213�SB�?>�F?>BS?>��%� 2? /C�U/';(9/0B��l;A63�`�� 2?@/C�.%�<�[R� �� �13�_;A/0<><>/�*7?@�35J )%�I3<>�O*�O?@�.-L?T��%' 2�:%0( ¤ G+[ -r[ ¥® �13��G./m(9?> �?>4$�O-!���.�3?@ 2�u;A63�.��� 2?@/C�.(WV�*713?T�)1�-L/��3/C :�3����-�%'�!" G./C<@"L�F/CB�?K%'<^ 2����B ?>�� �13��(N/C<>6F 2?>/0�+V�%��.-�%C( ¤ �C[­G+[ -r[ !¥� �13���/0�.-L?> �?>/0�.%'<@<>"�G./m(9?> �?>4$�d-L���.�3?@ 2��;A63�`�� 2?@/C�.(u/';R/0�)-L��� .V+*713?K��1U�3����-�%]G./C<@"L�F/CB�?K%'<�/�;�-L��50�2��� S?>�� �13�:(9/0<>63 �?>/C�v[^� 7?K(%J*��<@<.8L�3/�*7��;c%C�W 7 21.%� 7Gn/m(9?@ 2?>4$��-L���.�3?@ 2�l;A6F�.�� 2?@/C�.( ����.-� 2/J�����2/S%� ?>�!�.�3?> N"S*713������%C(���/C�`-L?> �?>/C�`%'<><@"]G./m(9?> �?>4$�l;A6F�.�� 2?@/C�.(7 2���.-� 2/J?>�!�.�3?> N"$[

e�p

Page 14: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

� a � � � � ���� � kj%�6.(2(N?T%'�vVnG+[ -r[

� a � � � � � < > � < BS63<@ 2?TP$6.%0-L�2?K�CV$�C[ G+[ -r[Re

� a � � � �� � ��� � � ?@�L4$���)(9�jB]63<@ 2?KPQ6.%0-L�2?K�CVCG+[ -r[

� a � � � � < � � � �13?>��G3<K%' ���(NG3<>?@�3��(WV.�C[­G+[ -r[

� a � � � � < � <>� � �13?>��G3<K%' ���(NG3<>?@�3��(WV.�C[­G+[ -r[

��� � �$���"+J��� �º�#�V�­�"02��+8�#��­ h�h �����#+�l�d%'<> ����2�`%' 2?@4$� �/O��1F/$/$(9?@�35O%u�)%0-L?T%�<Q;A6F�.�� 2?@/C� �� aqC��+?>�: 213��(N )%'IF?><>?@�����^a�e�gQ��?K(#% \3Y[Z�~`_(]�np]¾_;k(oNiz\ N"LG.�O/';�I.%0(9?T(;A63�.�W 2?>/0�+V3 21`%' 7?T(7%�;A63�.�W 2?>/0��/';^ �13�u;A/C�2B

�� arC'����� ,0 ��� ��=a� $0W� a�p0oQ�*713������ 0 ?K( 213���$�A 21U��/$/0�)-L?@�.%' ���/';� 21F�u4$���� �/C�¶C0V3%'�`- ��H?T(7%��U%'G3G3��/CG3��?T%� 2�O/C�3����-L?@B����.(N?>/0�.%'<;A63�.�W 2?>/0�+[Owx13��� �U?T(lG./m(9?> �?>4$�S-L�W�.�3?> ��� �13��;A63�.�� �?>/0�.%'< 365 �87 ?T(u�W<>��%��2<>"M%M�F/C�2B %'�.-�?> Z(l�!63<><(9G`%C���:?T(��B�GF 9"m[����� 213�:��%0(9�O/';R%S��/0�.-L?> �?>/0�.%'<@<>"�G./$(N?> �?>4$�O-L�W�.�3?> ��u;A63�.�� �?>/C�� �13�J(N 2�26`�� 263���O/'; 21F�u�L6F<><=(9G.%0���O��%���In�jB�/C���u��/0B�G3<@?T��%� 2��-J%��.-�*�O-L/:�3/C ��W/C�.(N?T-L���R?> R13���2�m[ � Z%'I3?@<>?>�����)(�*7?> �1�� aqC'�,%C(7?>����P$6.%� 2?>/0��a�pCo$�1`%&4$�j 213�u;A/C��B

3;5 �B7 � � � � �(C �� arC'� <� ,0 ��� ��va� 0 �*713?K��1�<>�&%C-3( �/S% \3Y[Z�~`_(]¶np]¾_;k(o8i[\ I.%0(9?K(,;A63�`�� 2?@/C�

� a ������� ,0 � � �=a ��0W�*713����� ��0^?K(� �13���$�A 21H��/$/C�Z-L?>�`%' 2�j/';� 21F�l4$���W 2/C����%'�.-��=a �r��?K(� 213�j�3/C63��?>���^ 2�Z%'�.(�;A/C��B�/�; ��va� C�)[�l��?>�! 2���2��(N 2?>�F5���EF%'B�GF<>��?T( 21F�_/0�3�J�W/C�2����(9G./0�.-L?>�F5] �/J 213�:�)13/C?K���

��=a� C��� ee�>� < $

*713?K��1�<>�&%C-3( �/J 213�OI.%0(9?T(;A63�.�W 2?>/0��� a ������� ,0 ��� ���� ����� � � 3 ���� � � ����� � �� ��� ��� � C

\13?K(lI.%C(N?T(l;A63�.�W 2?>/0��?K(l?>�! 2������(9 �?>�35J;A�2/0B �13�JG./C?>�! u/�;4!?>��* /'; GOq � �?>BHG3<>��BH���! )%� 2?>/0�.(�V3I.�����%�6.(9�u?@ ^�2��P$63?>����(� 213����/CB�GF63 )%� 2?>/0�]/�;� 213� � � �F/C�2B�/';� �13��?>�3G36F 4$���� �/C���^V$*713?T�)1�?K(¡6`(96.%�<><>"��%0(9?>��� 2/d��/CBHG363 2�� 21`%'�� 213� ��6.��<@?T-L��%����3/0�2B � < [^��/'*R��4$����VC 213?K(�I.%0(9?K(�;A63�.�� �?>/C�H?T(��F/C 4$���2"

e��

Page 15: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

(9BH/$/C 21vV7%'�.-�?> Z(�G.���N;A/C�2BM%'�.����?@��GF�)%C�W 2?T��%'<���%0(9��(S(913/063<T-��`�)(9 SI.�� ���(9 ���-���ELG.����?>B����L Z%'<><@"C[ªl/0 2?T�W�_ �1.%' j?�;� 213�d%'G3G3��/�EL?@B�%' �?>/C��?K(z�3����-L��-];A/C����/CB�GF63 2?@�35S-L����?>40%' �?>4$��(7(NB�/$/C �13�3��(�(z/�;7%��%'GFG3�2/0G3�2?K%' 2�M-L��5C�����J?T(O��<@��%'��<>"U%��F������(�(2%'��"�����PQ6F?>�2��B����! Oa�(9���Si#/C505C?>/FV G^/C��13����(O%��.- �^63?><@<>�$Ve�f0gCg$�)[w��_�F/C 2?K���O 21.%� 7 213�:�)13/C?K���

��=a� C��� �� � �<>�&%C-3(7%�5$%'?@�� �/] �13�Jku%�6.(2(N?T%���I.%0(9?T(;A63�.�W 2?>/0� � a ����� � ��� � � [����� - ���­ 3�� ��Õ�G+N�#�� h�h �����1+w���1.%�4$�:(9������?>�U 213�:G3�2��4L?@/C6.(�(9���W 2?>/0��13/�*D(N/CB��: 2���`(9/C��G3��/!-L6.�� O%�G3G3��/'E!?>BM%' 2?@/C�U(2�)13��BH��(��%���I.�O-L����?>4$��-�?@�� 213�7;A�)%�B���*R/C�28J/�;��2��5063<T%��2?@��%' �?>/C�H 213��/0�2"$[�w �j�3/�*x*7?><><=(N���l �1.%' R?> R?T(^%'<K(9/G./$(�(9?>IF<>�S 2/U-L����?>4$�� �13�H��<T%0(2(u/'; j(k(k(b�\qb���Yàjzn(np]¾_���bcmOje\rbc_(Z (2�)13��B��&(z?@� �13�S(2%�B���;A�)%�B���*/0�28=V*713�����OIL"�%0-3-L?@ 2?>4$��%'G3G3��/�EL?@B�%' �?>/C�H*�OB���%���%'�U%'GFG3�2/�E!?>B�%� 2?>/0��/';� 213�u;A/C��B

� a ��� � ,�� ���

� � a � � � a�p!e'�

*713����� � � ?T(l �13���n�A 21¬��/CB�G./0�3���! l/�;7 21F�J?>�3G36F _4$�&�� 2/0����%'�`- 213� � � %'���J/C�3����-L?@B����.(N?>/0�.%'<;A63�.�W 2?>/0�.(� 21.%� *7?@<><3I.�j-L���.�3�&-]%0(¡ �13� j(k(k(b�\qb���Y�ih_(m,nJ_(Z1Y[ZN\�~ /�; � aT;A�2/0B �3/�*�/C�Ukl������8:<>�� � 2���?>�`-L?T���&(£*7?@<><!In��6.(N��-�?>�S%0(2(9/!�W?T%' �?>/0�]*7?@ 21S��/0B�G./C�3���! )(�/';+ �13�7?>�FG363 �4$���W 2/C�Z(��Z[#�j-3-L?> �?>4$�^B�/!-L���<K(u%'���]*R��<><�8!�3/�*7��?>��(9 Z%' �?T(9 �?T��(Jac�u%C(N 2?>�S%��.-�\?>I.(N13?>�Z%'�3?cV�e�fCg0�LV7e�f0gQ}mVe�f0fCo!h � �/C�3�mV�e�fCg0�Lhw�%'1!I.%LV7e�fCfCo!h7b6C��%!V��u%0(9 2?@��%'�`-�\?>I.(N13?>�Z%'�3?je�f0gCfQ�d%'�`-���%'��In�U��/0�.(9?K-L������- %0(J%�50���3���Z%'<>�?>�&%' 2?@/C�U/';^<@?>�3��%��lBH/!-L��<T(W[7\13��"U%��2�J%�G3G.��%'<@?>�35HIn�&��%'6.(N�$V.In��?>�35��&(2(9���L �?T%'<@<>"H%�(96FGn���2G./$(N?> 2?@/C�/';j/C�F����-!?>B����`(9?>/0�.%'<�;A63�`�� 2?@/C�.(WV� 213��"�1.%�4$�H%�<>/�*���/CBHG3<>��E!?> N"$Vv%'�.-� 21F��"�(N1.%'����*7?> 21�<>?>�F��%'�B�/!-L��<T(# �13�l;A��%� 263���l �1.%' R 213��� �=���� Z(¡/�;� 213�j-L? �r���2���! ^4C%��2?K%'I3<@��(^��%'��I.����EF%'B�?@�3��-J(9��G.%'�Z%' 2��<>"$[

\13�J(N?>B�GF<>��(N 7*7%�"� 2/S/CI3 Z%'?>��(N6.�)1�%'��%�G3G3��/'E!?>BM%' 2?@/C�U(2�)13��BH�u?T(7 2/��)13/$/m(9�$Vr? ;�G./m(2(9?@I3<>�mV%S(9 )%�I3?><@?>����� 21`%' ���/0�2�2�&(9G./C�.-F(l 2/S%���%C-F-L?> �?>4$�uI.%0(9?K(,;A63�`�� 2?@/C��

� a ����� ��� � �

� � �=a�� � � a�p0pQ�

*713����� � � %'���������2 )%�?>���.E!��-�G.%'�Z%'B��� 2���Z(�[ � 6`��1�%U��13/0?T���:*/063<T-�<>��%0-® �/U%'��%'G3G3��/�EL?@B�%' �?>/C�(2�)13��BH�l/�;� �13�u;A/C�2B acpLe'�R?>��*713?K��1H 213�:%C-F-L?> �?>4$�O��/0B�G./C�3���L Z( � � 1`%&4$�O �13�u;A/C�2B � � a �r� � � �

/�" � ��� " � a � �):�� �" � a�p0�Q�

ªl/0 2?T�W�] �1.%' : 213�H%C-3-!?> 2?@4$���W/CB�G./C�F���L Z(O%'�2�H�3/C :?>�.-L��Gn���.-L���! :%' � �13?T(:(9 Z%'5C�mV^(9?>�`���] �13�����]?K(/C�F<>"�/0�3�:(9�� 7/�;^��/$� #���?@���! )( � " [�w �OG./$(N 2G./C�F�J 213�O-!?T(2�W6.(2(N?>/C��/�;^ 213?K(�G./C?@�L 7 �/�(N���� �?>/C��a�{3[ pQ�Z[

e�{

Page 16: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

w ��*/063<T-x<>?@8$�� �13���� 2/�*7�2?@ 2��(9 )%�I3?><@?>�����)(���/0�2����(9G./C�`-L?>�35� 2/� 21F� I.%0(9?K(H;A6F�.�� 2?@/C��a�p0pQ�?>�� 213��;A/C��B a2e�gQ�ZVz*71F���2� �� aqC��J?T(J 213���3/C63��?>���S 2�Z%'�.(�;A/C�2B /'; � a ���Z[ w����3/0 2?T�W�� 21`%' � �13��3/C63��?>���^ ��)%'�`( ;A/C��B /';�%���%C-F-L?> �?>4$�;A63�.�W 2?>/0��<>?@8$�7 213��/C�F�u?>���&PQ6.%� 2?@/C��acpCpQ����E!?T(9 Z(�/C�3<@"]?@�] �13�5C���3���)%�<>?@����-S(9���.(N�Ja9k���< ;c%'�.-S%'�`- � 13?><@/'4=V.e�f0�'{L�ZV3?>�!4$/C<@4L?@�35u 21F�

�-L?T(N 2�2?@I363 �?>/C�v[^�`/0���EF%'BHG3<>�$V

?>�� N*/S-!?>B����`(9?>/0�.(�*R�O/CI3 Z%'?>�

�� arC'��� � � ��=a� � ��a� � �#> � � ��=a� � �

�a� � � a�p�{L�

%'�`-® �13�J?>�! 2����G3�2�� )%' �?>/0��/';R �13�J�2���W?>G3��/!��%'<�/�;R 213?K(l��E!G3�2��(�(9?@/C��?T(j-L��<>?K��%' ��$[u��/'*R��4$����V jedfmO_�~[\%C-F-L?> �?>4$��I.%0(9?K(n;A63�.�� �?>/C�`(+��%'�:In�^/0I3 )%�?>�3��-u? ;3*R�^%'G3GF�2/�EL?@B�%' ��� 21F�-!��<> Z%¡;A63�.�W 2?>/0�.(r?>�O��P$6.%� 2?>/0�a�p�{L�j*7?> 21�kj%�6.(2(N?T%'�`(�/';74$���2"�(NB�%'<@<#40%��2?T%��.���$[ � /0�.(9?K-L����V+;A/C�O��EF%'B�GF<>�O?>�� N*/U-L?>BH���.(9?@/C�.(WV 21F��(N )%�I3?><@?>�����

365 �87 � ����� �(C�� �� arC'� <� � ��=a� � � � ������� � > � � ��=a� � � � �� �� � � a�p0�Q�

\13?K(7��/C���2��(NGn/0�.-3(l �/S%�I`%C(9?K(,;A6F�.�� 2?@/C��/';� 21F��;A/0�2B � a �#$'&3��� � � �=a��r� ���� � � � > � � �=a%&3� ���� � � � C a�p0�Q�

���� �13��<@?>B�?@ /';��750/C?@�35� 2/H�����2/S 21F�S-L���3/0B�?>�.%� 2/0�7?>����E!G3�2�&(2(9?@/C��a�pC�$��%'GFG3�2/m%C�)13��(l��P$6.%� 2?>/0�a�p�{L�ZV%��.- 21F��I.%C(N?T(_;A63�`�� 2?@/C�xacpC�Q�:%�G3G3��/$%C�)13��(J%�I`%C(9?K(_;A63�.�� �?>/0�� 21.%� J?T(O 213��(N63B /';j/C�3���-L?@B����.(N?>/C�`%'<7I.%0(9?T(�;A63�.�W 2?>/0�.(�[ ���� 21F?T(JG.%'G.����*R��-L/��3/C H-L?T(���6.(�(] 213?K(�<@?>B�?@ �G3��/!����(�(]?>�¯%�2?@5C/0�2/C6`(l*7%�"$[R���.(9 ���%C-�*�O/C63 �<>?@�3�:%'�3/0 213���j*7%�"� 2/S/CIF )%'?@��%0-3-L?> �?>4$�:%'GFG3�2/�E!?>B�%� 2?>/0�.(?>�� �13�;A�)%�B���*R/C�28S/';��2��5C63<K%'�2?@��%' �?>/0�� �13��/0�2"$[

qr�� �6.(�%C(�(963BH� 21`%' �*�8!�3/�* j¶np]zbc_(][b �1.%' � 213�^;A63�.�� �?>/C� � �1.%' �*�*,%'�! # �/u%�G3G3��/'E!?>BM%' 2�?T(7%0-3-L?@ 2?>4$�mVL 21`%' 7?T(

� a ��� � ,�� ���

� � a � �C�w��u 213����%'G3GF<>"S 213�u����5C6F<T%'��?>��%� 2?@/C��%�G3G3�2/m%C�)1U%'�.-�?>BHGn/m(9�j%�(NB�/$/C �13�3��(�(7��/C�.(N 2�Z%'?>�! �V!�3/C 7/0� 21F�l;A63�.�� �?>/0� � %0(7%�*713/C<@�$V$I363 7/C�H��%C�)1�(9?@�35C<@�O%C-F-L?> �?>4$����/0B�G./C�3���! �V$ �13�2/0635C1�%_�2��5C63<K%'�2?@��%'� 2?@/C��;A63�.�W 2?>/0�.%'<+/�;^ 21F��;A/0�2B aAw�%�1LI`%LV+e�f0fCo!h+�u%C(N 2?@�O%'�.-U\?>I.(N13?>�Z%'�3?cV+e�f0fCoQ�

9 5 �B7 � /�" ���a%& " : ,�

� ���� � a � �" �2� < >1@

,�����

e� �� � �� �� � a� C� <��=a� m�

*713����� � � %'����50?>4$����Gn/m(9?@ 2?>4$�HG.%'�Z%'B��� ����)(O*713?T�)1�%�<><>/�*�6.(� 2/�?@B�G./$(N��-L?��=�������! J-L��50�2���&(�/';(9BH/$/C 21F�3��(2(O/C�� �13�H-L?��=�������L �%C-3-L?@ 2?@4$����/0B�G./C�3���L Z(�[�\1F�]B�?@�3?>BH?������7/';� �13?T(l;A63�.�W 2?>/0�.%'<^?K(;A/C6F�.- *7?@ 21x �13��(�%'B��U 2���)13�3?KPQ63��-L��(����2?@In�&-�?>��%�G3G.���.-L?@E ac�_�)V�%'�`-rVu(N8L?@G3G3?>�F5��L6F<><j(9G.%0��� 2���2B�(WVQ?@ 71.%C(7 21F�_6`(96.%�<£;A/0�2B

e��

Page 17: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

� a ����� /�" ����� " � a � :�� " � a�p$}C�

*713�����

� a � :�� " ��� ,�����

� � �=a � �):�� �" � $%C(7?>����P$6.%� 2?>/0��a�pCp$�)[

w �O�3/0 2?K���O 21.%� 7 213�:%C-F-L?> �?>4$�O��/0B�G./C�3���L 7/�;���P$6.%� 2?>/0��a�pQ}0�7��%'��I.�O*7�2?@ 2 ����U%C(

� � a�� �C���/�" ����� �" �=a�� � :�� �" �

*713�����O*�O1.%�4$�O-L���`�3��-

� �" � � "� � C\13�d%C-3-L?@ 2?@4$���W/CB�G./C�F���L Z(l%��2�: 213������;A/C�����3/0 l?@�.-L��G.���`-L���! lI.����%�6.(9�: 213�:G.%'�Z%'B��� 2���Z( � � %'����.E!��-r[j�c;¡ 213� � � *������;A������G`%'�)%�B��� ����)(WVn �13�J��/$� #���?@���! )( � �" */063<T-�In�J?@�.-L��G.���`-L���! �V=%C(l*R��<><%C(7 21F��%0-3-L?@ 2?>4$����/CB�G./0�3���! )(�[

ªl/C �?T���� 21`%' 7 21F�l N*/:*7%�"F(�*�j1.%�4$�l/063 2<@?>�3��-J;A/C�7-!���2?@4L?@�35:%C-3-L?@ 2?@4$�u%�G3G3�2/�E!?>B�%� 2?@/C�J;A�2/CB�2��5C63<K%'�2?@��%' �?>/0�x 213��/0�2"�%��2����PQ6F?>40%'<@���L �[ \1F��"xI./C 21 (9 Z%'�� �;A�2/0B jlnp]zbc_(][b %C(2(N63B�G3 �?>/0�.(�/';%C-F-L?> �?>4!?> N"�%��.-�(NB�/$/C �13�3��(�(�/�;O 21F���W<T%C(�(�/�;l;A6F�.�� 2?@/C�.(J 2/�I.��%�G3G3�2/�E!?>B�%� 2��-=[����� 213���.�)(N 2�&��13�F?TP$63�# �13�^ N*/�%C(�(963BHG3 2?@/C�.(+%��2�^*/�4$���u �/C50�� 213���+?>�u �13�R��13/0?T����/';F 213�R(9 Z%'I3?@<>?@������a���P$6.%� 2?>/0�pC�$�)h.?>�� �13�:(9���W/C�.-� 213��"M%'�2�OB�%0-L�u��E!G3<@?T��?@ %��.-���ELG3<@/C?@ 2��-�(N��P$63���! 2?T%�<><@"$[

� � ���?��� ^����� �� $�R� � � �������J�z�� )�J�^����� � �O�����S�� ¬���� ��� ��O� ��'�� )�� � � ������J�7�� )�J�����M� � �O�����]���

���� 21F?T(7(9�&�� 2?@/C��*R�_*7?@<><3�.�Z(9 7�2��4L?@��*�(9/0B��u��E! 2���`(9?>/0�.(�/�;�����5C6F<T%'��?>��%� 2?@/C���3�� N*/0�28F(�VF%'�.-� 21F���*7?><@<+%�G3G3<>"H 213��BX 2/Hyl%0-L?T%�<�b7%C(9?K(7�363�.�� �?>/C�`(7%'�.-� 2/S%C-F-L?> �?>4$�O(NG3<>?@�3��(�[

� ;A63�`-3%'B����L Z%'<+G3��/CI3<@��B�?>��%�<>B�/m(9 j%'<@<#G3�Z%C�� �?T��%�<�%'G3GF<>?T��%' 2?@/C�.(�?>��<@��%'���3?>�F5�%��.-�G.%' � 2������2�&��/C50�3?> �?>/C�S?T(� �13�u�)13/0?T����/';v 213���2��<@��40%'�! ^?>�3G36F �40%��2?T%�I3<>�&(�[��� ^B�%�"�1`%'G3G.���� �1.%' ,(9/0B��l/�;+ �13�40%'��?T%'IF<>��(�%��2�7B�/0�2�R�2��<@��40%'�! # �1.%'�J/0 213���Z(�V$ 21`%' ^(N/CB��R4C%��2?K%'I3<@��(�%'�����N6.(9 � 2/C Z%'<@<>"�?@�2����<>��40%��L �V'/0� 21`%' 7 21F�_����<>��4C%��L R40%'�2?K%'I3<@��(7%'���O<>?>�F��%'�,��/CBSI3?>�`%' 2?@/C�.(^/';� 213�O/0�2?>50?>�.%�<+/C�3�&(�[^�� ���%'�� �13���2�W;A/C�2�I.��6.(N��;A63< �/�*/0�28��3/C :*7?> 21� 213��/0�2?@5C?>�`%'<7(N�� J/';�40%��2?T%�I3<>�&( �^V#IF63 J*7?> �1�%�<@?>�3��%��� ��)%'�`( ;A/C���B�%� 2?>/0��/';R 213��B�V� ��V.*713���2�� ?K(l%SGn/m(2(N?>I3?@<>"��2���W )%'�F5C63<K%'�uB�%� 2��?>E=[7���� 21F�_;A�)%�B���*R/C�28H/';�2��5C63<K%'�2?@��%' �?>/0�� 213��/C�2"mV� �13?T(:��%'��I.�� )%'8$����?>�! 2/�%C����/063�! JIL"�B�%'8!?>�F5� 21F��%C(�(963B�GF 2?>/0�� 21.%�

e��

Page 18: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

21F��%�G3G3�2/�E!?>B�%� 2?@�35];A63�.�W 2?>/0� � 1.%0(_ �13��;A/0�2B � a �������]a ����;A/0�J(9/0B��S(9BH/$/C 21�;A63�.�W 2?>/0��][�\13�O(NB�/$/C �13�3��(�(%C(�(963BHG3 2?@/C��?K(¡�F/'*�B�%0-L��-L?>������ �<>"�/0���]V$ 213��/C63501U%�(9BH/$/C 21F�3��(2(�;A63�.��� 2?@/C�.%�< 3;5 � 7 /�;7 �13��;A/0�2B a�e�gQ�Z[S\13�]����5C6F<T%'��?>��%� 2?@/C��;A63�.�� �?>/C�`%'<^?T(l��ELG3����(2(N��-�?>�� 2���2B�(7/';��%C(

9 5 � 7 � /�" � �a%& " :��]a*� " ��� < >A@ 3;5 � 7

*713����� � " � � " [�\13�_;A6F�.�� 2?@/C�U 21.%� lB�?@�3?>BS?>����(^ 213?K(�;A63�.�� �?>/C�`%'<�?T(���<>��%��2<@"$V3%0����/C�Z-L?>�F5C<>"� �/ 21F�_����(96F<> )(/�;R(9�&�� 2?@/C��acpQ�)V./';� 21F��;A/0�2B

�Sa��L� � /�" ����� " � a���:�� " � C

a�GF<>6.(��4$���L �6.%'<@<>"S%JGn/0<>"!�3/CBH?T%'<=?>� �L�)[^\1F���2��;A/0�2�O 21F��(N/C<@63 2?@/C��;A/C� � ?T(� a �������Sa ��� � /�

" ����� " � a � : � " � a�p0gQ�

\13?K(J%'�25063B����! �?K(_��?>5C/0�2/06.(d;A/0�J5C?@4$����%'�`-¬8!�3/�*7� �V^%0(�?>�� 213�M��%C(N��/�;O�W<T%C(�(9?K��%'<,yl%0-L?T%�<b7%C(N?T(J�363�.�W 2?>/0�.(�[ Fj(96.%�<><>"� 21F��BM%' 2��?>E ?K(_63�38!�3/�*7�+V7%��.-�?> JBS6.(9 :I.���&(9 2?@B�%' ���-�;A�2/CB 21F�_��E3%�B�G3<>�&(�[ �^(9 2?@B�%' �?>�35:I./C 21� �13�:��/$�$#M��?>���L Z( � " %'�.-� 21F�_BM%' 2��?>E IL"H<>��%0(9 �(2P$6.%��2��(?K(6.(N6.%'<@<>"u�3/0 �%75C/$/!-�?K-L��%!VC(N?>�.���^*R��*R/C63<K-u���.-u63G� ��2"!?>�357 �/l�&(9 2?@B�%' ��^%7�L63BSI.���./';.G`%'�)%�B��� ����)( 21`%' S?T(_<K%'��5C���J �1.%'�� 213���!63B]I.���O/�;:-3%' Z%®G./0?>�! )(�a� �13/C6F5C1�/0�3��B�%�" 6`(9���2��5063<T%��2?@����- <@��%C(N (2P$6.%��2��()�)[^\13������;A/C���$VL?@ 1.%0(zI.������GF�2/CG./m(9��-�a�s�/$/!-L"�%��.-�tu%'��8$���+V+e�fCgCg!V+e�f0gCfLh=b�2/$/0B�13��%0-%'�`-�qr/�*R�$Vre�fCgCg!h.i#/C505C?@/S%'�.-�k�?>��/$(9?cVre�fCgCf!V#e�fCf0oQ�^ 2/J����G3<K%C���� 213��%'G3G3��/�EL?@B�%' �?>/C�H(2�)13��BH�7/';��P$6.%' �?>/0��a�p0gQ�^*7?> �1U%�(9?@B�?><K%'�^/C�F�$VL?@��*713?T�)1� �13�uI.%0(9?T�j(91.%�Gn�O/�;� �13�O%'GFG3�2/�E!?>B�%� 2?>/0��(���1F��B��?T(����� )%�?>�3��-=VCI363 ^ 21F�l�!63BSIn���#/�;+I.%0(9?T(#;A63�`�� 2?@/C�.(�?T(^-L�&���2��%0(9��-=[�\13���2��(N63<> �?>�35�%'G3G3��/�EL?@B�%' �?>�35;A63�.�W 2?>/0�� 21.%� l*R����%'<><= 213� � Y[Z1Y�]¾jedfb�¢;Yk ¦ Y=g(o(dfj(]zb�¢`je\rbc_(Z�§�Yh\�¨�_(]Z© a9kjylªO�^?T(

� a ��� � ��� � � � � � a � : � � C a�p0fQ�

*713�������� ��%'�.-� �13� izY�Z8\wY�] ~ � %'���7�)13/$(N���J%0����/C�Z-L?>�F5u 2/j(9/0B��^13��63��?T(9 �?T�CV�/C��%'������/C�`(9?T-!���2��-%C(�;A�2����G.%'�Z%'B��� 2���Z(�a�s�/$/!-L"�%'�`-�tu%��28$���+V�e�f0gCg!Vue�f0gCfLhji#/C505C?@/�%��.- k�?>��/$(N?�V�e�fCg0fLVOe�f0fCo$�)[\13���W/$�$#��W?>���! )( � � V# �13�S��<>��BH���L Z(z/�;� 213�SB�%� 2�2?@E V�%'�`- ��4$���! 26.%�<><@"� �13�������L ����)( � V�%'�����(N 2?>BM%' 2�&-�%C����/C�Z-L?>�35H 2/U%]<>�&%C(9 �(2P$6.%'����(O���2?@ 2����?>/C�v[O\13�]��<>��B����L Z(�/';, 213�JBM%' 2��?>E ��/C63<K-%'<K(9/:In�j��(9 �?>B�%� 2��-� �13�2/0635C1��W�2/$(�(9�A40%'<>?K-3%' �?>/0� ac�l<><@���+V3e�fQ}�{3h3w�%'1!I.%�%��.-]w�/C<T-=Vre�f$}��!hrkl/0<>63IvV�l��%� 21�%��.-]w�%'1!I.%LV=e�f$}�fLh � �)%�4$���H%'�`-]w�%�1LI`%LV+e�f$}�f!h8Fl 2�����)%0(�Vre�fQ}&fLh3w�%'1!I.%LV=e�fCg0�Q�ZVn*713?K��1B�%�"SIn�:%�;A/C��B�%'<@<>"JB�/0�2�O%�G3G3�2/0G3�2?K%' ��� 2�&��13�F?TP$63�$[

���� 21F�7(9G.���W?T%'<!��%C(9�R?>�:*713?T�)1O 213�RB�%' ��2?>E %'�.-� �13�R�����! 2���Z(+%'�2�R8$��G3 +�.E!��-rV� 213�^�2�&(963<@ 2?>�F5 2�&��13�F?TP$63�^?T(+/C�3�7/0�2?>50?>�.%�<><@"uG3�2/0G./$(9�&-�I!":b�2/$/CBH13��%C-:%'�.-Jqr/�*R�Oa2e�f0gCg$�)V!%'�.-� �13�7�W/$�$#��W?>���! )((2%� 2?K( ;A"� �13�u;A/C<><@/�*7?>�35J<@?>�3��%��7��P$6.%' �?>/C�

e'}

Page 19: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

� * � < � � * + $*713�����O*�O1.%�4$�O-L���`�3��-� 213�u;A/0<><>/�*7?@�35J4$���� �/C�)(7%��.-�BM%' 2��?T���&(

a +^� " � & " $ aq<L� � � � � $ a � � " � � � a � " : � � C\13?K(] 2���)13�3?KPQ6F�$V�*71F?T�)1�1.%0(MI.���W/CB��UP$63?> �����/0B�B�/C��?@�� 21F���3��63�Z%'<��3�� N*/0�28���/CBHB]63�F?> N"CV1.%0(l 213�S%0-L40%'�! )%�5C�S/';R�2�� Z%'?@�3?>�35S 21F�_;A/C��B /�; �13������5C6F<T%'��?>��%� 2?@/C��(9/0<>63 �?>/0�+Vr*713?@<>�OI.��?>�35H<>��(�(��/0B�G3<>��EJ 2/H��/CB�GF63 2�$[��D��/CB�GF<>�� ��l �13��/C���� 2?K��%'<�%��.%'<@"3(N?T(1.%0(l�3/0 7"$�� 7I.������5C?@4$���+VLIF63 u(N/CB���2�&(963<@ )(�V�?>�� 213����%0(9��?>��*713?T�)1x 213��B�%� 2�2?@E ?K(�(9�� � 2/�?K-L���! 2?> N"$V�%��2��%'<>����%C-!"�%&40%�?><T%�I3<>�a � ?>40%'8!63B�%��7%'�`-�w�%'�)-=V+e�fCf!eCh+i�/C5C50?>/H%'�.-�k�?>�2/m(9?cVre�f0gCf$�)[

\13���3��E! J(N���� 2?@/C�.(J-!?T(2�W6.(2(J%�G3G3�2/�E!?>B�%� 2?@/C��(���13��B���(u/';j 213�S;A/C�2B a�pCf$��?@�� 21F����%C(9�&(�/';�)%0-L?T%�<�%'�.-U%C-3-!?> 2?@4$�uI.%0(9?T(;A63�.�W 2?>/0�.(�[

� ��� ��� �#�Ù��+1 �¶�"+)� �U����­ ����@�+1 +��"����0ë�� �¶��+

���� 213�d��%C(N�_?@��*713?K��1H 213�:I.%C(N?T(;A63�.�� �?>/C��?K(z�Z%C-L?K%'<�V3 �13�:%'G3GF�2/�EL?@B�%' �?>/0��(���1F��B���/';^��P$6.%� 2?>/0�a�p0fQ�RI.����/CBH��(

� a ����� ��� � � � � � a$� � :� � ��l�*713�����O*�O1.%�4$�O-L���`�3��-� 213�O*R��?>501L ���-]�3/0�2B

� � ��� �� * � C a��0oQ�\13��I.%C(N?T(�;A63�.�� �?>/C�`(�/';��&PQ6.%� 2?@/C�Ua�pCf$�^%��2�u�3/0 ^�)%C-!?T%'<v%'�!"LBH/C�2�mVC/C��VQBH/C�2��G3������?T(N��<>"mV' �13��"S%'����)%0-L?T%�<�?>�� 21F�JB��� 2��?T�O-L���`�3��-�I!"���P$6.%' �?>/0��ac�CoQ�Z[J\13?K(�BH��%'�.(7 21`%' O 213�S<>��4$��<���63��4$��(z/�;7 �13�I.%0(9?T(+;A63�.�� �?>/C�`(�%'���7�3/C R��?@�)��<@��(�V�I36F ���<><>?@G.(9�&(�V�*713/m(9�j%'E!?T(�-L/j�3/C ^�3���&-_ 2/OI.��%'<@?>50�3��-_*7?@ 21J �13���/$/0�)-L?@�.%' ��S%'E!?T(�[�ªl/0 2?K���O 21.%� u?>�U 213?K(l��%0(9�J*71.%� u?T(7?>BHGn/0�2 Z%'�! 7?T(7�3/C u �13��BM%' 2��?>E ?> Z(9��< ;�VI363 J�Z%' �13���� �13��(N"LB�BH�� 2��?T�_BM%' 2��?>E * [ \1F���2��;A/0�2�$V�IL"� 21F� � 13/C<@��(98!"�-L����/0B�G./$(9?@ 2?@/C�+V?> O?K(u(96�#M��?@���L j 2/��W/C�.(N?T-L��� �/�I.�S63G3G.���O 2��?T%'�F5C63<K%'��[H\13�S/CG3 �?>B�%�<^�����! 2���j<>/!��%� 2?>/0�.( �(2%� 2?K( ;A"� �13�u;A/C<><@/�*7?>�35S(N�� 7/';^�F/C�3<@?>�3��%��7��P$6.%' �?>/C�`(ua�i#/05C5C?@/�%'�`-�k�?@�2/$(N?�V+e�fCfCo!V�e�f0fCo0%Q�

� � 3 " � �" � "3 " � �" ��De $ C�C�C $ a��!e'�

*713����� � �" %��2�:��/$�$#M��?@���L Z(� 21.%� u-L��Gn���.-�/C�U%'<@<r 21F�_G`%'�)%�B��� ����)(^/';� 213�u�F�� N*/C��8�%��.-�%��2�O�3/0 �3���W��(2(�%'�2?@<>"OG./$(N?> 2?@4$�$[�\13�7/CGF 2?>BM%'<F�����! 2���Z(#%��2�7 21F���S%l*��?>5C1! 2�&-�(96FB /';v 213�R��EF%'B�G3<@�^Gn/0?>�! )(W[\1!6.(l?>��(N/CB��:��%0(9��(�?> uB�%�"�I.�JB�/0�2�O�$#M��?>���L 7 �/ ¤ B�/�4$��¥J 21F�J��/$�$#M��?@���L Z( � �" �)%� 213���l �1.%'� 21F�u��/0B�G./C�3���L Z(#/'; � a ;A/C�^?@�.(9 Z%'�.���7*71F���] �13�j-L?>B����.(9?@/C�.%�<>?> N"u/�;+ �13�l?@�3G363 Z(#?T(�13?@5C1S�2��<K%' �?>4$� 2/S 21F�_�!63BSI.���^/';R-3%� )%JG./C?>�! )()�)[

e�g

Page 20: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

\13�J%�G3G3��/'E!?>BM%' 2?@/C�U(2�)13��BH�O-L���.�F��-�I!"���P$6.%' �?>/0��a�p0fQ�71`%C(lI.�����U-L?K(2��6`(2(9�&-�?>��-L�� Z%'?><+?@�i#/05C5C?@/S%'�.-�kl?@�2/m(9?�a�e�f0fCoQ�R%��.-�k�?>��/$(N?�a2e�fCf0pQ�)V.(N/�*R�u*7?><@<3�3/C ,-L?T(���6.(�(�?> �;A63�� 213����[^���] �13�u�3��EL (9�&�� 2?@/C��*�O*7?><@<+��/0�.(9?K-L���7?@ )(7%'�`%'<>/05C63�:?>�� 21F����%C(9�O/�;R%C-3-!?> 2?@4$�uI.%0(9?T(�;A6F�.�� 2?@/C�.(W[

� � � ��� �#�Ù��+1 �¶�"+)� �l����­ 3�� ��¶�!+ �­�h h����+���� 213�JGF�2��4!?>/06.(u(9�&�� 2?@/C�.(l*R��1.%�4$�S(N������%'����EL ����.(9?@/C��/�; �13�S��<K%C(2(N?T��%�<��2��5C63<K%'�2?@��%' �?>/0�� 2���)13��3?KPQ63�m[x���� 21F?T(S(9���� �?>/0��*R��-L���2?>4$�H 213��;A/C�2B �1.%' � �13?T(J��E! 2���`(9?>/0�� )%'8$�&(�*713���x%'GFG3<>?@��-� �/%C-F-L?> �?>4$�:(9G3<@?>�3�&(�[�\13������(96F<> 2?@�35H(2�)13��B��u?K(z4$���2"U(9?@B�?><K%'� �/�i��2/C�N�&�� 2?@/C�Ui�63�)(N63?> Oy7��50�2��(�(9?>/0�a��3��?>��-LBM%'��%��.- � 26F����<>�mV+e�fCg!eCh+��63I.����V�e�f0gC�Lh�tl?K%C��/0�3?T(�%'�`-��`������-LBM%'�+V=e�fCg�{3h�tl/0�3/C13/M%'�.-�C/C1F�.(9 �/C�3�$V�e�f0gCf!hrs�/$/!-L"U%��.- �R%'��4L?@�+Vre�fCf!e'�)[w��7(9 Z%'�� #;A�2/0B 21F� ¤ �W<T%C(�(9?K��%'<K¥u%C-3-!?> 2?@4$�R(9G3<@?>�3�$V0-L����?>4$��-l;A��/CB ����5C6F<T%'��?>��%� 2?@/C��?@�J(N���� 2?@/C�Ha��L[ �Q�

� a ��� � /�" � � � "

,�����

� � � a � � :�� �" � a��0pQ�

���� 213?K(l(���1F��B��O 213�d(9B�/$/0 213?@�35�G.%��)%�B��� 2���)( � � (91F/C63<K-�In�J8!�3/�*7�+Vr/0�O��%���In�J�&(9 2?@B�%' ���-�I!"����/$(2(N��40%�<>?T-F%' 2?@/C�+[d�l��%'<@ 2�����.%' �?>4$�O 2/U����/$(2(N��40%�<>?T-F%' 2?@/C��?T(l �/���/0�.(9?K-L���u �13�JG.%'�Z%'B��� 2���Z( � � %C(^`]�YhYOnJj(]j(m³Yh\wY�] ~ V7%��.-���(N 2?>BM%' 2�� �13��B *7?> �1�%¬<@��%C(N �(�PQ6`%'�2�� ����)13�3?TP$63�� 2/05C�� �13����*7?> �1� �13���/$�$#M��?@���L Z( � "c[^�c;� �13�uG.%��)%�B��� 2���)( � � %'���l;A�2���$VL �13�O%'GFG3�2/�E!?>B�%� 2?>/0��(���1F��B��7/';���P$6.%' �?>/0��a��0pQ�I.����/0B���(� �13�u;A/C<@<>/�*7?>�35

� a ��� � /�" ���

,�� ��� � �" � a � � :�� �" �

*713�����O 213�:��/$�$#M��?@���L Z( � �" %��2�O�3/�* ?@�.-L��G.���`-L���! �[|7;���/C6F�)(9�mV3�3/�* *�uBS6.(N ��(N 2?>BM%' 2� � - ���/$�$#M��?@���L Z(_?@�.(9 ���%C-�/';R�N6.(9 � V7%��.-�*R�U%'�2�U<>?@8$��<>"� �/ ���`��/C63�! 2���J%'��/�4$���9�. � 2?@�35�G3�2/0I3<>��B�[w��J 213����%0-L/CGF _ �13�S(2%�B���?K-L��%]GF�2��(N���L ���-�?@��(9���W 2?>/0��a�{!�)V�%'�.-���/0�.(9?K-L���j%'��%'G3G3��/�EL?@B�%' �?>/C�(2�)13��BH�l/�;� �13�u;A/C�2B

� a ����� ��� ���,����� � �� � a � � : � �� � $ a��0�Q�

?>��*713?K��1� 213�S�!63B]I.���j/';��W���L ����)(u?K(_(NB�%'<@<>���� 21`%'�� �13�]�!63BSI.���u/';���E3%�B�G3<>�&(�V.�2��-L6`��?>�35� �13��!63B]I.���O/�;O��/$� #���?@���! )(_ �1.%' JBS6.(N �I.����(9 �?>B�%� 2��-r[�w����3/0 2?T�W�� �1.%' J�&PQ6.%� 2?@/C��a��0�Q�d��%'��I.�*7�2?@ 2 ����U%C(

� a ��� � ,�� ���

� � a � �C�*713�����O��%C�)1U%C-3-L?@ 2?@4$�O��/CBHGn/0�3���! 1.%0(z �13�u;A/C��B

e�f

Page 21: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

� � a � � ��� ��� ��� � �� � a � � : � �� � C\13������;A/C����%��3/C �13���S%C-!4C%��L Z%'50��/';� �13?T(O 2���)13�3?KPQ63�J?K(u 21.%� � 21F� j(k(k(b�\qb��;Y$ih_(m,nJ_(Z1Y�Z8\�~Aj(]�Y

Z�_$¨.bcZ�k8Yrn1Y�Z�k8Y[Z8\ Vr��%0��1�/�;^ 21F��B I.��?>�F5S%�/0�3���c-L?>B����.(9?@/C�.%�<+y�%C-L?K%'<�b7%C(N?T(7�363�.�W 2?>/0�.(�[w �d��%'�U�3/�*D6.(9�: 213�:(2%�B��:%'��5C63B����L ;A��/CBY(9���W 2?>/0��aA{L�R 2/�?@�L ��2/!-L6.�W��%S<>?>�F��%'�7 ��)%'�`( ;A/C���

B�%� 2?>/0��/';� �13�O?>�3GF63 )(�� � �^VL*713����� ?K(7% � � - ��BM%' 2��?>E=[ � %'<><@?>�35 � � �13� �n�A 21��2/�*�/';��V.%'�.-�G.���N;A/C�2BH?>�35J �13�:(963I.(N 2?@ 263 �?>/C� � � ��?>����P$6.%' �?>/0� ac�C�$�)V.*�u/0I3 )%�?>�

� a ����� ��� ���,������� � �� � a � � � � : � �� � C a���{L�

w��_�F/'* -L���.�3�O �13�u;A/C<><@/�*7?>�35:/C�3���c-L?@B����.(N?>/C�`%'<n;A6F�.�� 2?@/C��

� �a%&3� � ��� ��� � �� � a &�: � �� �

%'�`-��2��*7�2?> ��u 21F��%�G3G3��/'E!?>BM%' 2?@/C��(���1F��B���/';^��P$6.%� 2?>/0��a��'{!�7%0(

� a ����� ,��������� �

a � � � ��� C a��0�Q�

ªl/C �?T���J �13�S(9?@B�?><K%'��?> N"�I.�� N*��������PQ6`%' 2?@/C��ac�C�Q��%'�.-� 21F��i��2/0�N���� 2?@/C��i�63�Z(963?@ �y7��50�2��(�(9?>/0� 2�&��13�F?TP$63� O?>��In/0 21�(2�)13��BH��(z �13��63�F8L�3/�*7� ;A6F�.�� 2?@/C��?K(O%'G3G3��/�EL?@B�%' ���-®I!"�%�<@?>�3�&%'�:(963G.�����G./$(N?> 2?@/C�U/';^/0�3���c-L?>B����.(9?@/C�.%�<r40%'��?T%'IF<>��(WVn*713?K��1M%'�2�:G3�2/0�N���� 2?@/C�.(/�;^ 21F��/C��?>50?>�.%�<+4C%��2?K%'I3<@��(z/0������� )%�?>��4$���� �/C�Z(l 21.%� O1.%�4$��I.��������(9 �?>B�%� 2��-=[O� ��i���/C�N���� �?>/C��i�63�Z(963?@ Oy7��5C����(2(N?>/C�� 21F�S��13/0?T���/';� 21F��;A6F�.�� 2?@/C�.(

� �a%&3��?T(<@��;A 7 2/J �13�O6.(9����[^����/C63�j��%C(N�O 213�

� �%��2�O/C�3����-L?@B����.(N?>/0�.%'<vyl%0-L?T%�<

b7%C(N?T(u�363�`�� 2?@/C�.(WVn;A/C�O��EF%'B�GF<>�:��63I3?K��(NG3<>?@�3��(�V=/C��kj%'6`(2(9?K%'�.(W[S\13�S��1F/C?T�W�J-L��G.���`-3(�V+(N 2��?T�� �<>"(9G.��%�8L?@�353V�/0�� 213��(NG.����?��n�]G3�2?@/C��V� 21.%� �?T(WV�/C�� 21F��(9G.����? �=�S(9B�/$/0 213�3�&(2(J%C(�(963BHG3 2?@/C�.(OB�%C-L�I!" �13��6.(N����[����! 2������(9 �?>�350<>"$V�?>��BM%'�!"�%'GFG3<>?K��%' �?>/C�`(�/';ji��2/C�N�&�� 2?@/C��i�63�Z(963?@ Syz��50�2��(�(9?@/C�� �13�;A63�.�W 2?>/0�.(

� �1.%�4$�SIn����� ?@�.-L���&- �)13/$(N���� �/�I.���W63I3?T�S(9GF<>?>�F��(uI363 �/0 213���J�)13/C?K����(O%'�����#<@��E!?>�

I3<@�u�3/C6F�2?>��� � ���2?@��(�VC�Z%' �?>/C�`%'<+%�G3G3��/'E!?>BM%' 2?@/C�.(^%��.-]/C�� 213/05C/0�.%'<+G./C<@"L�F/CB�?K%'<T(7ac(9���js�/$/!-L"H%'�.-�R%'��4L?@�+Vre�fCfLe��)[qr�� �6.(+I3��?>���."O����4L?@��*� 213�,(9 2��G.(£ �1.%' �I3�2?@�35u6.(r;A�2/0B �13�7�W<T%C(�(9?K��%'<F%C-3-!?> 2?@4$�R%'G3G3��/�EL?@B�%' �?>/C�

(2�)13��BH�l/�;���P$6.%� 2?>/0��acpC�Q�R 2/S%Si��2/C�N�&�� 2?@/C�Ui�63�)(N63?> �y7��5C����(2(N?>/0�3��<@?>8$�u N"!G.�_/�;^%�G3G3��/'E!?>BM%' 2?@/C��eC[7 �13���2��5C63<K%'�2?@��%' �?>/0��G`%'�)%�B��� ����)( � � /�;u �13����<K%C(2(N?T��%�<7%�G3G3�2/�E!?>B�%� 2?@/C��(2�)13��B��Ua�p0�Q�:%'�����/0�.(9?K-L������-�%C(;A�2���uG`%'�)%�B��� ����)(WhpL[7 �13�O�L63BSI.���^/';R�W���L ����)(^?T(7�)13/$(N���� 2/SI.��(NB�%'<@<>���R 21.%��� 213�O�!63B]I.���R/';¡-3%' Z%]G./C?@�L Z(�h�L[7 �13�l ��263���2��<>��40%'�! ^40%'�2?K%'I3<@��(^%'���O%C(�(963B��&-� 2/�I.�O(N/CB��76F�38L�F/'*7�H<>?>�F��%'�R��/0B]I3?@�.%' �?>/0�J/'; �13�O/C�2?@5C?@�.%'<+40%'��?T%�I3<>��(Wh

pCo

Page 22: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

w �J�F/C 2?K���� �1.%' O?@�� 21F�J��EL ��2��BH����%C(9�J?@��*713?K��1��&%C�)1�%C-F-L?> �?>4$�J�W/CB�G./C�F���L �1.%0(,�N6`(9 u/0�3������! 2���ua� �De��)V3 �13�:%'G3G3��/�EL?@B�%' �?>/C�M(2�)13��B���/';���P$6.%' �?>/C��a���{L�RIn�&��/CB��&(

� a ��� � , ��� � � � � � a � � � � : � �C� C a��0�Q�

wx13���� 21F�JI.%C(N?T(�;A6F�.�� 2?@/C� � ?T(O%�kj%'6.(�(9?K%'��*R�S��%'<@<#«�(N/CB���*71`%' u?@B�G3�2/0G.���2<@"M«�%��3�� N*/0�28/';: �13?T(J N"LG.��% � j(oe~h~`bcj(Z } o(dy\rb�dfj(|�Y�] � Y[]¾izYrn#\q]_(Z � } s ��� §­Yh\c¨�_(]2© VlI.����%'6.(N��?�; � *R���2��% 21F�2��(N13/C<K-�;A63�`�� 2?@/C��(9?>50B�/C?K-3%'<�;A63�`�� 2?@/C�� 213?K(�*R/C63<K-®I.��%�s�63<@ 2?@<T%�"$���ji#���)�W��G3 2��/C��*7?> �1 /0�3�<T%�"$���7/�;^13?K-3-L���U63�3?> Z(�[j\13�J(N?>5CBH/C?T-F%'<r;A63�.�W 2?>/0�.(�V. N"LGF?T��%�<><>"S6.(N��-�?>�.(N 2��%0-�/�;^ 213�: 213����(91F/C<T-=V��%��3�3/C jIn�S-!���2?@4$��-�-L?@�2���W 2<>"S;A�2/CB�����5C63<K%'��?>��%� 2?>/0�� 213��/C�2"UI.����%'6`(9�J?> �?T(��3/C O(N"LBHB��� 2��?@�CVLI36F *��*7?><@<=(9����?>�H(9���W 2?>/0��ac�Q�� 213�u����<T%� 2?@/C�.(N13?>GSI.�� N*�����S%:(9?@5CB�/0?T-3%�<`;A6F�.�� 2?@/C�H%'�.-S 213�O%�I.(9/0<>63 ��40%'<@63�u;A63�.�� �?>/C�vV3*713?T�)1�?T(7%JI.%0(9?T(;A63�.�W 2?>/0�� 21.%� ���%'�UIn�:-L���2?>4$�&-�;A�2/0B �2��5063<T%��2?@��%' �?>/C�v[

\13�����S%'�2�H%��L6FB]I.����/';z��/CB�GF63 )%� 2?>/0�.%'<�?T(2(N63��(u�2��<T%' ���-� 2/�13/�*� 2/��.�.-� 213�JG`%'�)%�B��� ����)(/';,%���%'G3G3��/�EL?@B�%' �?>/C��(2�)13��B��j<>?>8$�O �13�J/C�3�J/�;R��PQ6`%' 2?@/C��ac�'{L�ZVrI363 j*�J-!/��3/C :-L?K(2��6`(2(l �13��B13�����$[]w��SG3�2��(N���! _?@�.(9 ���%C-=V#?>��(9�&�� 2?@/C��a9}C�ZV�(N/CB��J��E!G.���2?@B����! )%�<#����(963<@ )(WV#%��.- *7?@<><R-L��(����2?@In� 21F��%�<>50/C�2?@ 213BX6.(9��-� 2/J/0I3 )%�?>�� �13��B�[

� ������� ��� ��^���]� �����?�O�������O�?�J�^����� � �����_� ����� ��d � ���������J�z�� )�J������� � �_�����S��

�� J?T(O*��<@<8!�3/�*7�� �1.%' H%�40%'��?T%' �?>/0�.%'<7G3��?>�.�W?>G3<@��(N6.��1�%0(���P$6.%� 2?>/0��a2e'�:��%'��I.��-!���2?@4$��- �3/0 /C�F<>"�?@�� 213�S�W/C�! 2��E! u/';^;A63�`�� 2?@/C�.%�<^%'�.%�<>"F(9?K(�ac\?>8!13/C�F/'4�%'�.-��l�Z(9���3?@�+V�e�fQ}0}C�ZV#I363 :%�<T(9/�?@��%G3��/CI.%�I3?><@?T(9 �?T��;A�)%'BH��*/0�28Sa�~u?>BH��<T-L/0�9;`%'�.-�w�%'1!I.%!Vne�fQ}meCh3w�%'1!I.%LV.e�f0gCo!Vne�fCf0oLh.i#/05C5C?@/3V!\+/C�2���%'�`-]~u/!�)1+V.e�fCg0�Lh.s�%��2�2/!P$63?@�+V!s�?> 2 ����^%��.-]i�/C5C50?>/FVre�f0gQ}mh.b���2 ����2/FV$i#/C505C?@/J%'�`-]\+/C���2�$V.e�f0gCg$�)[��� �13?T(O(N���� 2?@/C��*R�]?@<><>6`(9 2�Z%' ��J 213?K(u��/C�F�3���� �?>/C��?>�!;A/C�2BM%'<><@"$V.*7?> 21F/C63 :%C-F-L�2��(�(9?@�35� �13�]����<T%� 2��-B�%� 213��BM%' 2?K��%'<F?T(2(N63��(W[

� 63G3G./m(9�� 21.%� � �13��(9�� � � $a � " $'& " �D(�* � -�*�. /" � � /�;�-3%� )%u1.%0(#I.�����J/CIF )%'?@�3��-JIL"O�Z%'�.-L/0B(2%�B�G3<@?>�35d%d;A63�`�� 2?@/C� � V.-L�W�.�3��-�/C��* � V3?@�� 213�OG3����(9���`���u/';��3/0?T(9�mV3 21.%� l?K(� a � " � � & " > � " $� �De $ C�C�C $ � a��$}C�

*713����� �="�%'���O�)%'�`-L/CB ?@�.-L��G.���`-L���! 40%'��?T%'IF<>��(^*7?> 21U%�50?>4$����-!?T(9 ��2?@I363 2?@/C�+[�w �:%��2�u?@�L ����2��(N 2��-?>���2����/�4$����?>�35H 213�];A6F�.�� 2?@/C� � V�/C�S%����&(9 2?@B�%' ��J/';�?@ �V£;A��/CB� �13�H(9�� J/�;j-3%' Z%E�=[�w �H )%'8$�M%G3��/CI.%�I3?><@?T(9 �?T�S%'G3GF�2/$%0��1vV�%'�`- �2��5m%'�Z- 213�S;A63�.�� �?>/C� � %0(_ �13�]����%'<@?>��%� 2?@/C��/';j%��)%��.-L/CB �.��<T-*7?> �1U%�8!�3/�*7��G3�2?@/C�7G3��/CI.%�I3?><@?> N"�-L?K(9 2��?>I36F 2?>/0�+[^qr�� 76.(7-!���.�3� «� 5 � � 7 %0(z �13�:��/C�.-!?> 2?@/C�.%�<+G3�2/0I.%'IF?><>?@ N"�/';� 213�u;A63�`�� 2?@/C� � 50?>4$���H 213�O��EF%'B�GF<>��( �=[

pLe

Page 23: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

« 5 � �87 %0(� �13�U��/C�.-!?> 2?@/C�.%�<7G3�2/0I.%'IF?><>?@ N" /�;)��50?>4$��� � [��c;j 21F�M;A6F�.�� 2?@/C��63�.-!���2<@"L?@�35� �13�-3%� )%�?K( � V# �13?T(u?K(� �13�SG3�2/0I.%'I3?@<>?@ 9"U 21.%� �I!"��Z%'�.-L/0B�(�%'B�GF<>?>�F5� 213�J;A63�.�W 2?>/0� � %' O 21F��(N?> 2�&( � " . /" ��� 21F�(N�� �/';.B��&%C(96F�2��B����L ; �& " . /" � � ?T(+/CI3 Z%'?@�3��-r[�\13?T(+?T(+ 213���2��;A/0�2�R%zBH/!-L��<$/';` 213�R�3/C?K(9�$[« 5 �87 O?T(_ �13� jAnp][bc_(]zb G3��/CI.%�I3?><@?> N"�/';� �13�S�)%'�`-L/CB �.��<K- � [�\13?K(_��BSI./!-L?>�&(�/063� j³np][bc_(][b8!�3/�*7<>��-L50�u/';� 21F�l;A63�.�� �?>/0�+V3%��.-���%���I.�O6.(9��-� �/J?>B�G./$(N�O��/0�.(9 ��)%'?@�L Z(�/0�� �13�OB�/!-L��<cV!%C(2(N?>50�3�?>�F5S(9?>50�3?��n��%'�! 7G3�2/0I.%'IF?><>?@ N"�/C�3<@"� 2/J �13/$(N�_;A63�`�� 2?@/C�.( �1.%' j(2%� 2?T(�;A"� 21F/$(9�d��/C�`(9 2�Z%'?@�L Z(�[

�u(2(N63B�?@�35l �1.%' � 213�RG3�2/0I.%'I3?@<>?@ 9"�-L?T(N 2�2?@I363 �?>/C�`( 5 � �B7 %'�`- 5 �87 %'���78L�3/�*7�+V0 213�RGn/m(9 ����2?@/C�-L?K(9 2��?>I36F 2?>/0� 5 � � 7 ��%'�U�3/�* I.�J�W/CB�G36F 2��-]I!"H%'G3G3<@"L?@�35J 21F�Jb7%�"$��(���63<>� 5 � � 7 � 5 � �B7 5 �87%C a��0gQ�

w �j�3/�* B�%�8$�l �13�O%0(2(96FB�G3 2?@/C�� �1.%' 7 �13�u�3/0?T(N�u40%'�2?K%'I3<@��(?>�H��PQ6`%' 2?@/C��ac�Q}0�R%'�2�O�3/0�2B�%�<><@"-L?K(9 2��?>I36F 2��-rV!*7?> �1�40%��2?T%��.��� � [^\13������;A/C���O 213�OG3��/CI.%�I3?><@?> N" 5 � �B7 ��%���I.�O*7�2?@ 2 ����U%C(

5 � �B7 � � ���� � 3��� � ��� � � �� � � � �

*713����� � ?K( 213�O40%'��?T%'�`���O/';� 213�O�3/0?T(9�m[\13�JB�/!-L��<r;A/C�u �13��G3��?>/0�lG3��/CI.%�I3?><@?> N"U-L?T(N 2��?>I363 �?>/0� 5 �B7 ?T(���1F/$(9����?>��%'�.%�<>/05C"�*7?> �1� �13�

-L?K(2������ 2�,��%C(N�Oa�*713���J �13��;A6F�.�� 2?@/C� � ?K(�-L���`�3��-_/0��%7�.�3?> ��7(N63I.(9�� �/';v%�n�c-L?>BH���.(9?@/C�.%�<$<T%� 2 2?K���C�;A/C��*713?T�)1� �13�7G3�2/0I3<>��B ��%'�JI.�;A/C��B�%'<@?>����-Jac(9���^;A/C��?@�.(9 Z%'�.����s�%��2��/!PQ63?@�+V$s�?@ 2 2����%��.-]i�/C5C50?>/FVe�f0gQ}0�)[7\13�OG3��?>/0�7G3�2/0I.%'I3?@<>?@ 9" 5 �87 ?K(*7�2?> � 2���U%0(

5 �87 � � ��� � � a��0fQ�*713����� 3;5 �87 ?K(+%l(NB�/$/C �13�3��(�(v;A6F�.�� 2?@/C�.%�<L/�;. 21F� N"LG.�R-L��(����2?@I.��-u?>�J(N���� �?>/C�Sac�Q�v%'�.-

�%7Gn/m(9?@ 2?>4$�

�2�&%'<��L63BSI.����[,\13?T(;A/C��B /';RG3��/CI.%�I3?><@?> N"�-L?K(9 ��2?>IF63 2?@/C��50?>4$��(713?@5C1�GF�2/CI`%'I3?@<>?> N"�/C�F<>"� 2/� �13/$(N�;A63�.�W 2?>/0�.(�;A/0�O*713?T�)1 �13�� ����2B 3;5 �87 ?T(�(NB�%'<@<�V+%��.- ��BSI./!-L?>�&(l 213� j³np]zbc_(][b 8!�3/�*7<>��-!5C�S 21.%� /C�F�_1`%C(�%'I./C63 j 213�:(9"F(9 ���B�[

�3/C<><@/�*7?>�35J �13�:b7%&"$�&(��26F<>�Sa��0gQ�R 213� jºnJ_�~[\3Y[]zbc_(][b G3��/CI.%�I3?><@?> N"]/�; � ?T(*7��?> � 2���U%C( 5 � � 7 � � ���� � 3��

� � � � � ���� � � � � � < ��� � �� ����� C a�{moQ�|��3�u(N?>B�GF<>�^��(9 �?>B�%� 2�R/';+ �13�7;A63�.�� �?>/C� � ;A�2/0B 213�7G3��/CI.%�I3?><@?> N"J-!?T(9 ��2?@I363 2?@/C�Ua�{moQ��?T(� 21F��(9/

��%�<><>�&-�s��ui a3} j���bcmOoNm t � _�~[\3Y[][bc_(]zb �,��(9 �?>B�%� 2�$V! 21.%� ��W/C�.(N?T-L���Z(z �13��;A63�.�W 2?>/0�� �1.%' uBM%'E!?>�B�?@����(+ 213� j,nJ_�~[\wY[][bc_(][b GF�2/CI`%'I3?@<>?> N" 5 � � 7 V$%��.-] �13���2�W;A/C�2�7BH?>�3?@B�? ����(r 21F�l��E!G./C�3���L ^?>�S��P$6.%'� 2?@/C�Ua�{moQ�)[R\13�js��ui���(9 �?>B�%� 2�7/'; � ?K(¡ �13������;A/C���l �13�lBH?>�3?@B]?@�����+/�;� 213�7;A/C<@<>/�*7?>�F5�;A6F�.�� 2?@/C�.%�<

9 5 �87 � /�" ���a%& " : � a � " ��� < >A@ 3;5 �B7DC

pCp

Page 24: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

*713����� @ �Xp � < � [�\1F?T(_;A63�.�W 2?>/0�.%'<R?T(O 213�H(2%�B���%C(O 21.%� J/';j��P$6.%' �?>/C�¯a2e'�ZV^%'�.-�;A�2/CB 13���2�?> O?K(���<@��%'�O 21`%' � �13��G.%��)%�B��� 2����@=V� 21.%� �?T(u6.(N6.%'<@<>"���%'<@<>��-� 21F� ¤ �2��5063<T%��2?>�&%' 2?@/C��G`%'�)%�B��� ����)¥-L�� ����2BH?>�3��(^ 213�: 2�Z%C-L���A/ ��I.�� N*������ �13��<@��4$��<=/';R 213�O�3/0?T(N�S%'�.-� 213�d(9 2�����350 21�/';¡ 213� j np][bc_(][b%C(�(963BHG3 2?@/C�.(+%�In/063 � �13�7(N/C<>6F 2?>/0�+V� 213������;A/C���R��/C�! 2��/C<><@?>�357 �13�R��/CBHG3�2/0B�?T(N�#I.�� N*�����u 21F�7-L��50�2���/';z(9B�/$/0 213�F��(2(l/�;7 �13�S(9/0<>63 �?>/C��%'�`-®?@ )(u��<@/$(N���3��(�(l 2/� 21F�S-3%' Z%L[Jªl/0 2?K���J 21.%� l;A63�.�W 2?>/0�.%'<K(u/'; 21F�u N"LG.�Sa��0fQ�R%'���:��/CB�BH/C�J?>�U(N )%' �?T(N 2?T��%'<rGF1L"F(9?K��(laci�%'��?T(9?cV.e�fCg0gQ�ZVn*713���2� 3;5 �B7 GF<T%�"3(^ 213�j�2/C<@�/';�%'�����3����5C"�;A63�.�� �?>/0�.%'<c[��� J?T(�?@�L ����2��(N 2?@�35� 2/��3/C �?T���� �1.%' �V�?@�� 21.%� S��%C(N�$V� �13����/0�2����<T%� 2?>/0�;A63�.�W 2?>/0��/';^ �13�OG31L"F(9?K��%'<v(9"F(9 ���B�-L��(����2?@I.��-]I!" 3;5 �B7 ?T( �13�OI.%C(N?T(�;A63�`�� 2?@/C� � a ���)[

�u(*�O1.%�4$�uG./0?>�! 2��-�/C63 Oaci#/C505C?>/H%'�`-®k�?>��/$(9?cV+e�f0gCfLh=y7?>4$��(N �VLG.���Z(�[^��/0B�B�[ �)VCG3��?>/0�7G3�2/0I3�%'IF?><>?@ 2?@��(7��%'��%�<T(N/�I.�S(N������%0(O%]B���%0(963���_/�;,��/CB�GF<>��E!?> N"$VF%C(2(N?>50�3?>�35�13?@5C1���/0B�G3<@��EL?@ N"J 2/� �13�;A63�.�W 2?>/0�.(l*7?@ 21�(9BM%'<><�G3��/CI.%�I3?><@?> N"$[O�� u1.%0(lI.������G3�2/0Gn/m(9��-�I!"�y7?T(2(�%'�3����a2e�f$}�g$�u 2/HB���%C(N63�2� 21F�J��/0B�G3<>��EL?@ 9"J/�;,%�1!"LG./0 213��(N?T(l?@�� ����2B�(/�;^ 21F��I3?@ l<@���35C �1��3����-L��-� 2/����`��/!-L��?@ �[��� l �63�2�`(/C6F 21`%' ^ 213�js��ui �&(9 2?@B�%' ��B����L �?>/C�F��-�%�In/�4$��?T(^��<@/$(9��<>"�����<T%� 2��-J 2/O �13�us�?@�3?>BS63BDt���(2����?>G3� 2?@/C�Uqr���350 21�i¡��?>�.�W?>G3<@� # �13�O1L"!G./C 21F��(9?K( � *713?K��1S;A/C��5C?>4$��������%'��I.�:-L��(����2?@I.��-�?>�� 213�OB�/m(9 ��/0B�G.%C�W u*7%�"�?K(O��13/m(9����%0(_ �13� ¤ I.��(N )¥�1!"!Gn/0 213�&(9?T(W[ � ?>B�?@<T%��l?K-L��%C(u1.%�4$�JI.��������ELG3<@/C����-®I!"/C �13���Z(ua ;A/C�7?@�.(9 Z%'�.�W� � /C<@/CB�/0�3/ ��V@e�fQ}&gQ�Z[7\13��"H��/C�F�3���� ,-3%' Z%]��/0B�G3����(2(N?>/C�M%'�.-���/!-L?@�35J*7?> �1b7%�"$��(9?K%'��?@�L;A�������.���$V$����5C63<K%'��?>��%� 2?>/0�+VL;A63�.�W 2?>/0�U%'G3G3��/�EL?@B�%' �?>/C�M%'�.-�<>��%��2�3?@�353[

� � �������� � ����'������E������� � L��� ���^����� �� ^��� � �M����������� �� ��x���O�

���� 213��G3����4L?@/C6.(S(9�&�� 2?@/C�.(�*R��1`%&4$�U(N13/�*7��13/�* �/ ��E! 2���.-�ylª 2/�(���1F��B���(O 21.%� ]*R��1`%&4$���%�<><>�&-�kjylª�V3*71F?T�)1�?>�.�W<>6.-L�j�2?T-!5C�:%'G3GF�2/�EL?@B�%' �?>/0��(2�)13��B��&(�/';� 21F��i^i^y N"LG.�$V! 21.%� l?K(

� a ����� ,��������� �

a � � � ��� $*713�����

� �a%&3� � ��� ��� � �� � a%&�: � �� � C

\13�7;A/C�2B�/';v 213��I.%C(N?T(#;A63�.�W 2?>/0� � -L��G.���.-3(�/0�] �13��(9 Z%'I3?@<>?>������V$%��.-S%�<@?T(N �/'; ¤ %C-!B�?T(�(9?>IF<>��¥� 1.%0(uIn������5C?@4$����?>��(N���� 2?@/C��ac�Q�)[d\13��(9�S?>�`��<>6.-!�� 21F�S%'I.(N/C<>6F 2�S4C%�<>63� � a��v� � � «���/C���2���(9G./0�.-L?>�F5� 2/�G3?>�&����*7?T(N�J<>?@�3��%'�:(NG3<>?@�3��(�V�%��.- 21F��;A63�`�� 2?@/C� � a��r��� � � «���/0�2�2�&(9G./C�.-!?>�35� �/��63IF?T��(NG3<>?@�3��(Oa�6.(N��-�?>�U N"LG3?K��%'<�?>BHG3<>��BS���$ Z%' 2?@/C�.(/�;,i�i^yu�)V=%C(u*��<><�%C(Oku%�6.(2(N?T%��®;A63�`�� 2?@/C�.(W[\13/0635C1U?> 7B�%�"H(9����B��.%� 263�Z%'<� 2/J 21F?>�38� �1.%' j(9?@5CB�/0?T-3%�<rBS63<> �?><K%&"0����G.���Z����G3 ��2/C�`(B�%�"]I.�O?>�3���<@6.-L��-]?@�� 213?K(�;A�)%'BH��*/0�28=VL?> R?T(7%0�� 26.%�<><@"�?>B�G./m(2(9?@I3<>�� 2/H-L����?>4$� k(bc]hYiz\=df| ;A��/CB ����5C63<K%'��?>��%� 2?>/0�G3��?>�.��?@G3<>�&(� �13�H(9?>50B�/C?K-3%'<R%0�� 2?@4C%� 2?@/C� ;A63�`�� 2?@/C�.(O 9"!G3?K��%'<@<>"�6`(9��-�?>��s�63<@ 2?><K%�"$���Oi#���Z����G3 ��2/0�.(�[

pC�

Page 25: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

���� 213��;A/C<@<>/�*7?>�F5�(9�&�� 2?@/C��*�U(91F/'*OV^13/�*��4$����V� 21.%� ] �13���2�H?T(J%���<>/m(9������<T%� 2?>/0�.(91F?>G�I.�� N*�����I.%0(9?T(;A63�.�W 2?>/0�.(/';¡ 213�O13?@�35C�$V! 213�:(N?>5CBH/C?T-H%'�.-� 213�Jkj%'6.(�(9?K%'�� N"LG.�$[

����� �V�#� � ����­ 3�� ��¶�!+ �­�h h����+S�ó� �#�� ����"� �º h���Q� �D�º��02�� ����+w��l*7?@<><.��/0�.(9?K-L���^13�����7 213��/C�F����-!?>B����`(9?>/0�.%'<`��%C(N�$V!(9?>�`���lBS63<@ 2?T-!?>BJ���.(N?>/0�.%'<F%C-3-!?> 2?@4$�7%�G3G3�2/�E!�?>BM%' 2?@/C�.(J�W/C�.(N?T(9 S/';:/0�3���c-L?>B����.(9?@/C�.%�<7 2����B�(�[�w ����/C�`(9?T-!���] �13��%�G3G3��/'E!?>BM%' 2?@/C��*7?> �1� �13�<>/�*R��(9 :Gn/m(2(N?>I3<@��-L��50�2����/�;j(9B�/$/0 213�F��(2(�GF?>������*7?T(9�S<>?@�3��%���[U\13��%C(�(9/!��?K%' ���-�I.%0(9?K(�;A63�.�W 2?>/0�� a �r��� � ?T(7(91F/'*7�U?>���.5063�2�dpC%LV.%��.-� �13�:%C(�(9/!��?K%' 2�&-�(9 Z%'I3?@<>?@�����?K(5C?@4$����IL"

3;5 �87 � ��� �

�� �< �� a� C� <\13?K(_%0(2(N63B�G3 �?>/C�� �1L6`(l<>��%0-3(l �/�%�G3G3��/'E!?>BM%' 2?@�35�%]/0�3���c-L?>BH���.(9?@/C�.%�<£;A6F�.�� 2?@/C��%C(u 21F�J<>?>�F��%'���/0B]I3?@�.%' �?>/0��*7?@ 21�%�G3G3�2/0G3�2?K%' �����/$� #���?@���! )(�/';: ��)%'�`(9<T%� 2��(�/�; � [D�� ]?K(]��%0(9"� �/�(9���� 21.%� %J<>?>�F��%'�j��/CBSI3?@�.%' �?>/C�H/';R N*/S 2�)%��.(9<K%' ���(z/�; � *7?> �1�%'GFG3�2/0G3�2?K%' 2�S�W/$�$#��W?>���! )(�a�G./$(N?> 2?@4$�:%'�.-�3��5m%' �?>4$�7%��.-���P$6.%'<!?>�d%'I.(N/C<@63 2�740%'<@63�C�+"!?>��<T-3(r �13�7G3?>�&����*7?T(N�^<>?>�F��%'�+ �13�2��(N13/C<K-_;A63�.�� �?>/0� � � a��r�%'<K(9/d(913/�*7��?>�J�.5C6F�2�Op�I+[qr?@�3��%��7��/0B]I3?@�.%' �?>/0�.(#/';� ��)%��.(9<K%' 2�&(�/';¡(96`��1J;A63�.�� �?>/0�.(��%���I.�u6.(N��- 2/S%�G3G3��/'E!?>BM%' 2��/C�F����-!?>B����`(9?>/0�.%'<3;A63�`�� 2?@/C�.(W[^� (9?@B�?><K%'�R-L����?>40%' �?>4$���A<>?@8$�$V'<@?>�3�&%'�7�W/CBSI3?>�.%� 2?@/C�/';= N*/j 2�)%��.(9<K%' ���(#/'; � � a �r�r;A63�.�W 2?>/0�.(#*7?@ 21S%'GFG3�2/0G3�2?K%' 2���W/$�$#��W?>���! )(+"L?@��<T-F(£ �13�lkj%'6`(2(9?K%'�3�A<>?@8$�;A63�.�W 2?>/0��� � a �r��%�<T(9/:(N13/�*7�]?@���.5C63���up0�C[�qr?@�3��%��^��/CBSI3?@�.%' �?>/C�`(#/';= 2�Z%'�.(N<T%� 2��(�/';v 213?K(£;A63�.�W 2?>/0���%��J%'<K(9/uI.�R6.(9��-u;A/C�^%�G3G3��/'E!?>BM%' 2?@/C�O/';n%z;A63�.�� �?>/0�+[�\1L6.(�%'�!"_50?>4$���:%�G3G3�2/�E!?>B�%� 2?@/C�O?>�: 2����B�(/';D� � a��v�,��%�� I.�J�2��*7�2?> � 2���U?>�� ����2B�(/�; � � a �r��%��.-� 21F�J<T%' � 2������%'��I.�J?>�� �63�2����ELG3����(2(N��-�?@� 2���2B�(^/';� 213�OI.%0(9?T(;A63�.�W 2?>/0� � [ªl/C �?T���� 21.%� + 213�^I.%0(9?T(n;A6F�.�� 2?@/C�.( � 63�.-!���2<@?>�� �13� ¤ 1F?>�350��¥z ����)13�3?TP$63��G3�2/0G./$(9�&-_I!"ub����?>B�%��a2e�fCf0�Q�)V!*713������%C(^ 213�7I.%0(9?K(�;A6F�.�� 2?@/C�.( � � a �r��%'�2�j(9?@5CB�/0?T-3%�<>�A<>?@8$�%��.-J 213��� � a��v��%��2�ukj%'6.(�(9?K%'�3�<>?@8$�$[�\13�j%'�25063B����! )(^%�In/�4$�j(913/�*x �13�O��<@/$(9���2��<T%' �?>/0�.(�In�� 9*R�����H%'<@<3/';� �13��B�V$-!��(9G3?@ 2�� 213�7;c%C�W 21`%' �/C�3<@" � ?T(7(N 2��?T�� �<>"H% ¤ <>��5m%'<T¥JI.%0(9?T(;A63�.�W 2?>/0��;A�2/CBX 213�:Gn/0?>�! 7/';^4!?>��* /�;�����5C63<K%'��?>��%� 2?>/0�a � � a �r�7?K(l�3/C �V+ 213/0635C1� �13�J4$����"�(N?>B�?@<T%��7I363 O(NB�/$/C �13����kj%'6`(2(9?K%'��?K(��Z[�ªl/0 2?K���J%�<T(9/� �1.%' � ��%���I.�U��ELGF�2��(�(9��- ?@�� 2����B�(_/�; ¤ �)%'BHG.¥�;A63�.�� �?>/0�.(�V^ 21.%� ]?K( � � � � > � [�\1!6.(J%�/C�3���13?K-3-L����<K%&"$���uG.���)����G3 2��/C��6.(N?>�35� 21F��%0�� 2?@4C%� 2?@/C��;A63�.�W 2?>/0� � � a �r����%�� I.�J����*7�2?@ 2 2����?>�� 2����B�(/';j%�5C���F���)%�<>?>����-®����5C6F<T%'��?>��%� 2?@/C���3�� N*/0�28�*7?> �1�I.%0(9?T(u;A63�.�� �?>/0� � [�\1F�]��P$63?@4C%�<>���! O8$���2�F��<?T(u� �=���W 2?>4$��<>"�<@/!��%'<�/0�3<>"�? ;R 213�����J��E!?T(9 �%�(N6�#M��?>���! u�!63BSIn���l/�;������! 2���)(;A/C�O��%C�)1�-L?>B����.(9?@/C�a � � � ���)[�\1F?T(�?K(� 213�j��%C(N�l;A/C�Ri��2/0�N���� 2?@/C�Hi�63�)(N63?> ,yz��50�2��(�(9?@/C�SI363 �F/C �;A/0�^6.(96.%�<r/0�3���A13?T-3-!���<T%�"$���RG.���)����G3 2��/C�.(W[

\13��(N���2��<K%' �?>/C�`(913?@G.(�?>B�GF<>"� 21.%� J?> :B�%�"�In�H?>�! 2������(9 �?>�35� 2/��W/CB�G.%��2�S13/�*�*R��<><^��%0��1�/'; 21F��(9�JI.%0(9?K(z;A63�.�� �?>/0�.(l?T(�%'IF<>�J 2/M%'G3G3��/�EL?@B�%' ��J(9/0B��J(N?>B�GF<>�l;A63�`�� 2?@/C�+[O\+/�-L/� 21F?T(7*�J6.(N��- 21F��B�/!-L��< � a��v� � 3 � � � � � a�� � �: � � �d 2/�%'G3GF�2/�EL?@B�%' ��� �13��;A63�.�� �?>/0� �

a �r� � (9?>�va�p�� �r�/C� 5 o $�e 7 V3*713���2� � a��v�R?T(7/C�F��/';R �13��I.%0(9?K(,;A63�`�� 2?@/C�.(7/';^�.5063�2�dpL[��#?�;A N"� ��)%�?>�3?@�35]G./0?>�! )(�%'�.-e�o!V o0oCol ���(9 �G./C?>�! )(+*���2�R��1F/$(9���_6F�3?�;A/0�2B�<@"l/0� 5 o $�e 7 [�\13�^G.%��)%�B��� 2���)(r*���2�^<>��%��2�3�&-�6`(9?>�F5l �13�?> ����)%� 2?@4$��I.%C�)8$�. 2 �?>�35�%�<>5C/0�2?@ 213B ac�3�2?>�&-LB�%'��%'�.- � 263����<>�$V0e�f0gLeCh!�u%0(9 �?>�R%'�.-:\?>I.(N13?>�Z%'�3?cVLe�fCf0oLh

p'{

Page 26: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

b�2��?>B�%��+V+e�f0fC�Q�j 21.%� u*7?><@<#I.�H-L��(����2?@In�&-�?>��(N���� �?>/C��}m[_w��J<>/$/08$��-�%' O �13��;A63�.�� �?>/0��<>��%��2�3��-%&;A ����7�. 2 �?>�35�e0Vrp!Vn{FV.g]%��.- e��]I.%C(N?T(;A63�.�� �?>/0�.(�[ � /CBH�_/�;^ 21F�_����(96F<> 2?@�35S%'GFG3�2/�E!?>B�%� 2?>/0�.(7%'���G3<@/C 2 ���-�?>���.5063�2�:�L[

\13�J�2�&(963<@ )(u(N13/�* 21`%' O 213�JG.���N;A/C��B�%'�.�W��/';,%�<><� �13�2���:I.%C(N?T(l;A63�.�W 2?>/0�.(l?K(z;c%'?@�2<>"���<>/m(9�d%C( 21F���L6FB]I.���u/�;�I.%C(N?T(u;A63�.�� �?>/C�`(_?>�`���2��%0(9��(W[���<><^B�/!-L��<K(O-L?T-�%�5C/$/!-��N/CI�/�;j%'G3G3��/�EL?@B�%' �?>�35(9?@�+a�p � �r�)[J\13�H%'I`(9/C<@63 2�H4C%�<>63��;A6F�.�� 2?@/C��-L?T-�(9<@?>501L �<>"�*/0�)(9�H%'�`- 213� ¤ kj%'6.(�(9?T%��.¥�;A63�.�W 2?>/0�-L?K-�(9<@?>5C1! 2<@" I.�� � 2����[�� :?T(�?@�L ����2��(N 2?@�35� 21.%� J 213�U%'GFG3�2/�E!?>B�%� 2?>/0��6.(N?>�35� N*/�%'I.(N/C<@63 2��40%'<@63�;A63�.�W 2?>/0�.(�?K(^%'<>BH/$(9 ^?K-L���! 2?T��%'<! 2/� �13�j%'G3G3��/�EL?@B�%' �?>/C�S6.(N?>�35:/C�3� ¤ (N?>5CBH/C?T-F%'<T¥l;A63�`�� 2?@/C��*713?K��1%'5m%'?@��(N13/�*�(� �1.%' j 9*R/�%'I`(9/C<@63 2�S40%'<@63��I.%0(9?K(j;A6F�.�� 2?@/C�.(j��%'��(N63B �/��&PQ6.%�<#/0�3� ¤ (N?>50B�/C?K-3%'<K¥G3?@������*7?K(9�u<@?>�3��%���;A63�`�� 2?@/C�+[

� � ��� �O�7�'� ������'� ������J�^�����

� ��� � � � ����� h��� ����­ 3�� ��¶� Õ��� ���¶��������­ 3�� ��¶� � �V���Ù�+

���J/C�Z-L���^ 2/O?><@<>6.(N 2�Z%' 2�,(9/0B��7/';= 21F�l?K-L��%C(�G3�2��(N���! 2��-�?@�J 213?K(#G.%'G.���R%��.-] 2/jG3�2/�4!?T-L��(N/CB��7G3�Z%C��� 2?K��%'<�?>�! 263?@ 2?>/0��%�In/063 � �13�S4C%��2?@/C6.(uB�/!-L��<T(�V=*�JG3����(9���! u�!63B�����?T��%�<+��E!Gn���2?>BH���L Z(7��/CBHG.%'��?>�35 21F��G.���9;A/0�2B�%��.����/�;j%C-3-L?@ 2?@4$��%'�.-��3/0�3�c%C-3-L?@ 2?@4$���3�� N*/0�28F(_/0�� N*R/C�c-L?>B����.(9?@/C�.%�<�GF�2/CIF<>��B�(W[����%OB�/!-L��<`��/C�.(N?T(N 2?>�F5_/�;�%�(N63B /';v 9*R/C�c-L?>BH���.(9?@/C�.%�<rkj%'6.(�(9?K%'�.(WV3 213��B�/!-L��<`��%'�SI.�O��1`%'�350��-;A�2/0B %��F/C�3�c%C-3-!?> 2?@4$�Oy�%C-L?K%'<+b7%0(9?K(�363�.�� �?>/0���3�� N*/0�28J �/S%'�U%C-3-!?> 2?@4$�l�F�� N*/C��8JIL" ¤ ��<>/C�F5$%' ��?>�F5$¥� 213��kj%'6.(�(9?K%'�.(:%'<>/0�35� �13�S 9*R/���/$/0�)-L?@�.%' ���%'E!?T( ��%'�.-�&n[S\13?K(O%'<><@/�*�(�6`(� �/�B���%C(N63�2� 21F�JGn���9;A/C��B�%'�`���O/';�%S�3�� N*/0�28U%C(u?> j�)1.%'�350��(z;A��/CB %��3/0�3�c%C-3-L?@ 2?@4$�J(2�)13��BH�_ �/�%'��%0-3-L?@ 2?>4$�/C�F�$[

�#?>4$�:-L? �=���2���! 7B�/!-L��<T(*���2�O 2��(N 2��-=[l\1F�_�.�Z(9 u �13�2���:-L? �=���l/0�3<>"�?@�� 21F��40%'��?T%'�`����(7/';^ �13�kj%'6.(�(9?K%'��%�<>/C�F5� �13�J N*/��W/$/C�)-!?>�.%� 2�H%'E!?T(�[:\13�J�Z%' 2?@/�/';R 213� ��4C%��2?K%'�.���J �/� 21F� &�40%'��?T%'�`���-L�� ����2BH?>�3��(7 21F�J��<>/0�35$%� 2?>/0��/';, 213��kj%�6.(2(N?T%'�v[�\13��(9�SB�/!-L��<T(u%�<><�1.%�4$�J �13��(�%'B���;A/0�2B %'�.-��%���I.�:*7�2?> � 2���U%0(

� a ��� � /�" � � � " 5 � � a � :��#"��#> � < a � :��#" � 7

*713�����

� � � � �� �� � � � �� � h � < � � �� �� � � � �� � C\13��B�/!-L��<T(�-!?��=���J/C�F<>"�?@�� 213��40%'<@63��(�/�; � � %'�.- � < [��3/C�S 21F�]�.�)(N ]BH/!-L��<�V � � � C ��%'�.-� < � C ��acylb7�^�)VL;A/C�� 21F��(N����/0�.-�B�/!-!��< � � ��e�o]%��.- � < � C ��aA��<><@?>G3 �?T��%�<£kj%�6.(2(N?T%'�=�)V=%'�.-�;A/0� 21F�J 213?@�)-�B�/!-L��<�V � � � � %'�.- � < � C ��a�%0-3-L?@ 2?>4$�0�)[:\13��(9�JBH/!-L��<T(j��/C���2��(NGn/0�.-� 2/�G3<T%0��?>�F5 N*/�ku%�6.(2(N?T%��.(]%� ���%0��1¬-3%' Z%�Gn/0?>�! ��#"cV�*7?> 21�/C�3��kj%�6.(2(N?T%'����<>/0�35$%� 2��-�?>�� �13� ��-L?>������ �?>/C�%'�`-�/C�3�:��<>/0�35$%� 2��-�?>�� �13��&H-L?>������ 2?@/C�+[,� �U 213�O�.�)(N u��%C(9�Ha�y�b7���^ 21F���2�:?T(�3/���<>/C�F5$%' �?>/0�+Vn?@�

pC�

Page 27: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

s�/!-L��<^e � a �#$'&3��� 3 < �" ��� � " 5 � ��� �� ��� �� � � � ��� � �� �� �� > � ��� �� ��� �� � � � ��� � �� �� � 7 � � � � < ��o C �

s�/!-L��<�p � a �#$'&3��� 3 < �" ��� � " 5 � ��� �� ��� �� � � � ��� � �� �� �� > � ��� �� ��� �� � � � ��� � �� �� � 7 � � �De�o $ � < ��o C �

s�/!-L��<�� � a �#$'&3��� 3 < �" ��� � " 5 � � �� � � �� > � � ��� � � � �� 7 � ��o C �s�/!-L��<+{ � a �#$'&3���,3 � � ��� � � � �� �� �� � �� � «s�/!-L��<�� � a �#$'&3��� 3 � � ��� � � � a � � � � : � � � «

\�%'IF<>�Se ���#Y&u�;YOmO_;k8Yhd ~_¨ÙY�\wY~[\wYk�bcZl_(oN]ºZJo8m³Y[][bcihjed�Y �hn#Y[][bcm³Y[Z8\c~�� 21F�J(9�&��/C�.-���%C(9�Ha���<@<>?@G3 2?K��%'<�ku%�6.(2(N?T%��r�� 213������?K(zB�/!-!���)%� 2����<>/C�F5$%' �?>/0�+V+%'�`-�?>�� �13��<K%C(N O��%C(N�a�%0-3-L?@ 2?>4$�0�� 21F���2�O?T(?@�L�.�3?@ 2�u��<>/C�F5$%' �?>/0�+[

\13�_;A/063�2 �1�B�/!-!��<r?K(7%Mk����3���)%'<@?>���&-�y7��5063<T%��2?>�&%' 2?@/C�Uªl�� N*R/C�28SB�/!-L��<�VL/�;^ 21F��;A/0�2B a��0�Q�ZV 21`%' �6.(9��(7%�kj%'6.(�(9?K%'��I`%C(9?K(,;A6F�.�� 2?@/C��

� a ��� � ��� ��� � � � �� �� �� � �� � C���� 213?K(lB�/!-L��<�V3 2/�*713?K��1U*�J����;A���2����-��&%'�2<@?>���j%C(j%�kj%�6.(2(N?T%'��s�q+ix�3�� N*/0�28�aA��P$6.%' �?>/C���0�Q�ZV 21F�_*R��?>501L R4$���� �/C�)(WV.�����! 2���Z(�V!%'�`-���/$�$#M��?@���L Z(%��2�:%'<@<+<>��%��2�3��-=[

����/C�Z-L���� �/O(9���13/�*�(9���`(9?> �?>4$��*R���2�R 213�RG.���9;A/0�2B�%��.����(+ 2/u �13�7�)13/0?T���^/';=I.%0(9?K(£;A63�.�� �?>/0�+V'*R�%'<K(9/J����G.��%' ���-] 21F�u��E!Gn���2?>BH���L Z(v;A/0�7B�/!-L��<�aA{L��*7?@ 21�%J(N?>50B�/C?K-�aA 21.%� ?T( Z�_e\ %�I.%0(9?K(¡;A63�.�W 2?>/0� 21`%' :��%'��I.�S-L���2?>4$�&-M;A�2/0B ����5C63<K%'��?>��%� 2?>/0�� 213��/C�2".�7����G3<T%0��?>�F5� 213�Skj%'6.(�(9?T%���I.%0(9?T(l;A63�`�� 2?@/C�+[����/C63����E!Gn���2?>BH���L Z(#*�O6.(N��-� 213�:(N )%'�`-3%'�Z-�(9?>50B�/C?K-�;A63�.�W 2?>/0��

� a��v� � ee�> � �� C

s�/!-L��<K(ua2e��^ 2/�a��$�7%��2�:(96FB�B�%'��?>���&-�?>�� Z%'I3<@�]e ��3/C �?T���O �1.%' 7/0�3<>"�BH/!-L��<�a��$�^?T(7%Ss�63<> �?><T%�"$���i#���Z����G3 ��2/0��?@�� 213�:(9 Z%'�.-F%'�)-U(9���`(9�$[

���� �13�_�`�)(9 7 �13�2���_BH/!-L��<T(WVL �13�:�����! 2���Z(*�����l�.E!��-�?@�� �13�O<>��%��2�3?@�35S%'<@5C/0�2?> �13B�%��.-���P$6.%'< 2/� �13�J 2�Z%'?>�F?>�35���E3%�B�G3<>�&(�[u\1F�J/C�3<@"�G.%��)%'BH�� 2���Z(z �1.%' O*R���2�:<>��%��2�3��-�*R���2�: 213�S�W/$�$#��W?>���! )(� " V+ 21.%� O*�����S��/CB�GF63 2��-�I!"�(N/C<@4L?@�35� 213�J<@?>�3��%��O(9"F(9 ���B /�;7��P$6.%� 2?>/0�.(Ja�{!�)[S\13�J;A/C63�� 21�%'�.- 21F�M�F;A 21�B�/!-L��<R*������ 2�Z%'?@�3��-�IL"��. 2 �?>�35�/0�3��I.%0(9?K(_;A63�.�� �?>/C��%� �%� �?>B��H%C���W/C�)-!?>�35� 2/� �13�;A/C<@<>/�*7?>�F5J�2����6F�)(9?@4$�O%'<@5C/0�2?> �13B�*7?> �1�I`%C�)8Q�. � 2?@�35�a��3�2?@��-LB�%���%'�`- � �63����<@�$Vre�fCgLe0h+�u%0(9 2?@�:%'�.-\?>I`(913?@�)%'�F?�V+e�f0fCo!hrb����?>B�%��+V.e�f0fC�Q�

pC�

Page 28: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

� �u-F-�%J�3��*�I.%0(9?T(;A63�.�W 2?>/0�+h

� |�G3 �?>B�?@���+ 213�^G.%��)%�B��� 2���)( � � V � � %'�`- � � 6.(N?>�357 �13� ¤ �Z%'�.-L/0B (N 2��G.¥7%�<>50/C�2?@ 213B�a � %'G3��?><>�%��.-®k�?>��/$(N?�V+e�f0fCo$�7-L�&(2����?>I.��-�I.��<>/�*Oh

� b7%0��8$�. 2 �?>�35 £;A/0�l��%0��1HI.%C(N?T(;A63�.�� �?>/C��%C-F-L��-�(N/�;c%'�

� 1F/C<T-� 213�OG.%��)%�B��� 2���)(�/�;^%�<><+/0 213���7;A63�.�W 2?>/0�.(��.E!��-rh� �����A/CG3 �?>B�?@���l �13�OG.%'�Z%'B��� 2���Z(�/';�;A63�.�� �?>/C�

�h

� y7��G.��%' 7 �13�OI.%C�)8$�. 2 �?>�35S(N )%'50��63�! 2?@<r �13���2�O?K(�3/�(N?>50�3?��=��%'�! �-L��������%C(N�u?>� � < ���2�2/0��[\13� ¤ �Z%'�.-!/CB (N 2��G`¥_a � %'G3��?><>�¡%'�.-Jkl?@�2/m(9?�V!e�f0fCo$�+?T(+%�(9 �/!��1.%0(9 �?T��/0G3 2?@B�?>�&%' 2?@/C�j%'<@5C/C��?> �13BD 21.%� ?T(�4$���2"U(9?@B�G3<@�� 2/H?>B�G3<@��B��W�L ,%'�.-� 21`%' O6.(96`%'<><@"��.�`-3(u5C/$/!-�<>/!��%�<�B�?@�3?>B�%![u\13�S%�<>50/C�2?@ 213B*/0�28F(^%C(#;A/C<@<>/�*�( �G3?T�)8��Z%'�.-L/0B���1`%'�350��(� 2/O��%C�)1JG.%��)%'BH�� 2���¡(96.�)1J 21.%� ^��%C�)1]�Z%'�.-!/CB��)1.%'�350�<>?@��(u*7?> �13?>��(9/0B��]?@�L ����240%�< 5�� $ � 7 [��j-3- 21F���)%��.-L/CB �)1.%'�350��(_ �/���%0��1�G.%��)%'BH�� 2���:%��.- 21F�����%�<T��63<K%' ��u 213�j�3��*����2��/C�7I.�� N*������ 213�j/C63 �G363 7/';� 21F�_�F�� N*/C��8�%��.-� 213�O Z%'�250�� 740%'<@63��(�[^��;� �13������2/C��-!�����2�&%C(9�&(�V3 21F����8$����G� �13�:��1.%��35C�&(l%��.-�-L/063I3<@�_ �13�O<>���F5C 21U/';� 213�O?@�L ����240%'<r;A/0�7G3?T�)8!?>�35�)%��.-L/0B �)1.%'�F5C��(W[^�c;v 213�������2/C�^?@�.���2�&%C(9�&(�V$ 213���] �13�2/�*�/063 �13�j��1.%��35C�&(%'�`-]1.%'<@4$�7 213�j(9?@����/'; 21F��?>�! 2���240%'<c[u��;^ 21F�J<>���350 21U/';R 213�J?@�L ����240%�<+In�&��/CB��&(z<@��(2(7 21.%���(9/0B��� �13�2��(N13/C<K-rVr �13��������(9�� 21F�_<@���350 21�/';^ �13�O?>�! 2����40%'<r �/S(9/0B��O<T%'��5C���740%�<>63�$[

\13���.4$�OB�/!-L��<T(7*��������%0��1U 2��(N 2��-�/C�� N*/H-L?��=�������! z;A63�`�� 2?@/C�.(7%] N*/0��-L?@B����.(N?>/0�.%'<�%0-L�-L?@ 2?>4$�7;A63�.�W 2?>/0��

� �����a��#$'&`� ��(9?@�+a�p � �v� >�{Fa%&�:�o C �Q� <

%'�`-� 21F�_ N*R/C�c-L?>B����.(9?@/C�.%�<#kj%'I./C�7;A63�.�W 2?>/0����

�� ���a��#$'&`� � � ��� � � �W/$(�a C }&����a ��> &3�2� C

\13�O 2�Z%'?@�3?>�35d-3%' Z%d;A/0�7 213�u;A63�`�� 2?@/C�.(� �����

%��.-�� ��� ���

��/0�.(9?K(9 ���-]/';�pCo�G./C?@�L Z(G3?T�)8$��-�;A�2/CB %63�3? ;A/C��B -!?T(9 ��2?@I363 2?@/C��/0� 5 o $�e 7 - 5 o $�e 7 %��.- 5 ::e $�e 7 - 5 ::e $�e 7 ����(9G.���� �?>4$��<@"$[7�l�F/C 21F���Je�o!V o0oCoG./C?@�L Z(*�����l�Z%'�.-L/0B�<>"H�)13/$(N���� 2/S(N���24$�j%C( ���(9 �-F%' )%![\1F�u�2��(N63<> Z(%��2�:(963BHB�%'��?>����-O?>�� Z%'I3<@�p�a�(9����k�?>�2/m(9?cV �C/C�3��(�%'�`-�i#/05C5C?@/3V�e�f0fC��;A/C�j%�B�/C���u��E! 2���.(N?>4$�O-!��(2����?>G3 �?>/0��/';^ �13�O�2��(N63<> Z(��Z[�u(]��ELG.���� ���-rV �13���2�&(963<@ )(S(913/�* �1.%' H 213��%0-3-L?> �?>4$�UB�/!-L��<:a��$�J*7%0(�%'I3<@�� 2/�%�G3G3��/'E!?>BM%' 2� 21F�J%C-F-L?> �?>4$�l;A63�`�� 2?@/C�+V

� �����a��#$'&`�^I.�� � 2���� 21`%'��I./0 21� 21F�Jy�b7�¬BH/!-L��<�a�e'�,%'�.-� �13�O��<><@?>G3 �?T��%�<

kj%'6.(�(9?K%'��B�/!-L��<Ra�p$�)V+%��.-® �1.%' O �13���2�d(9����B�(z �/�I.�S%�(9B�/$/0 21�-L��50�)%0-3%' �?>/C��/';RG.���N;A/C�2BM%'�.���%C( �13�uB�/!-!��<=��1.%��35C�&(�;A�2/CB� 21F�O%C-3-!?> 2?@4$�l �/� �13�:yl%0-L?T%�<+b7%C(N?T(R�`6F�.�� 2?@/C�+[��C6`(9 �13�u/0G3G./$(9?@ 2��2�&(963<@ )(u%��2�S(9������?@��%'G3G3��/�EL?@B�%' �?>�35S 213�:�3/C�F��%0-3-L?> �?>4$��kj%'I./0��;A6F�.�� 2?@/C�+V8� �

�� ���a �#$'&3�)V=(913/�*7�

?>���.5C6F�2��{m%L[ \13��y�b7� B�/!-L��<Oa�e'�S-L?K-�4$����"�*��<><�V�*71F?><>�U 213��%C-3-!?> 2?@4$��B�/!-L��<Oa��Q��-L?T-�%4$����"�G./$/0�u�N/CI+V�%C(O(N13/�*7� ?@���.5C63���]{0I+[S�l/�*��4$����V3�.5C63���]{m�J(913/�*�(O 21.%� _ �13��kjylª (���1F��B��

pQ}

Page 29: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

s�/!-L��<^e s�/!-L��<�p s�/!-L��<�� s�/!-!��<+{ s�/!-L��<��

� � ���a �#$'&3� 2�Z%'?>� o![ oCo0oCo0�C� oL[ o0oCo0oC�Q} oL[ oCo0oCoCo!e o![ o0oCoLe�}�o oL[ oCoCo$}�{m�

2��(N RoL[ oLeCe�}$e�} oL[ o0oLe��CfCg oL[ oCo0oCoCo$} o![ o0oLe�{mpCp oL[ oCpC�0�Cf0f� �

�� ���a �#$'&3� 2�Z%'?>� o![ oCo0oCo0oCo oL[ o0oCo0oCoCo oL[ oCo0oCoCo0o o![ o0oCoCo0oLe oL[ oCoCo0o'{0{

2��(N RoL[ oCoC�0gLe�g oL[ ��{C{mgCgLe �Q}m[ f0�CpC�$} o![ o0�C�Cf0�'{ oL[@e�fLe�oC�0�

\�%'I3<@��p t ~`oNmOmOj(][|U_w^·\��#Y·]�Y¾~`o(dy\c~·_w^ß_(oN]áZ�oNm³Y[][bcihjedºY � n1Y�]zbcm³Y[ZN\�~�� � j(i�� \qj({[d�Y Y[Z8\r][|ih_(Z8\rj(bcZ�~�\��#Y � < Y�]z]_(] ~�^`_(]�{h_e\���\c�#Y�\r]¾j(bcZ�bcZeg³~;Y \¶j(Z�k$\c�#Y�\wY¾~[\�~;Yh\ �a�BH/!-L��<3{!�#50?>4$��(�%j;c%�?>��<>"�50/$/!-�%'G3G3��/�EL?@B�%' �?>/C�vVCI.����%'6`(9�� 213�7<@��%'���3?>�35:%�<>5C/0�2?@ 213B �.�`-3(�In�� 2 2���-L?@�2���� �?>/0�.(¡;A/0�lG3��/C�N���� �?>�35J �13�:-3%' Z%� �1.%'�U 213� �U%'�.- &�%�EL?K(7%C(7?>�� 213�OG36F�2�:%C-3-!?> 2?@4$�uB�/!-L��<�[

ªl/C �?T���O �1.%' u �13�u�.�)(N u 21F�2���OB�/!-L��<T(*�d��/C�`(9?T-!���2��-�1.%C-U%]�!63B]I.���R/';^G`%'�)%�B��� ����)(7��P$6.%'< 2/� �13���L6FB]I.���O/';�-3%� )%�Gn/0?>�! )(WV%��.-�*R���2��(N63G3G./$(N��-� �/���EF%C�� �<>"�?>�! 2����Gn/0<T%� 2�� �13�U-3%' Z%LVR(9/ 21`%' �/0�3�SB�%�"�*/0�.-L���:*71L"� �13�S 2�)%�?>�3?@�35����2��/C�Z(�%'���]�F/C ���E3%0�� 2<@"�������/3[�\13�S�2�&%C(9/0��?T(u �13�?><@<>�c��/C�`-L?> �?>/C�F?>�35�/�;O 213�U%0(2(9/!�W?T%' ���-�<>?@�3��%��S(9"F(9 2��B�V�*713?T�)1�?K(J%® N"!G3?T��%'<7G3��/CI3<@��B�/';_yl%0-L?T%�<b7%C(N?T(7�363�.�W 2?>/0�.(ua�t�"L�+V.qr��4L?@��%��.-�y7?>GFG.%LV+e�fCgC�$�)[

� � �J�7 � �J� � �]�� ����� �������� �� ��� ������ �����?�J�^����� �� ���O� ����S�� �J�7��� ���?������������

w���1`%&4$�M(9������ 21.%� �-L? �=���2���! ��F�� N*/C��8�%��)�)13?> ����� �63�2��(O��%���In�U-L���2?>4$�&-®;A�2/0B ����5C63<K%'��?>��%� 2?>/0�I!"�B�%'8!?>�F5J(9/0B���*71.%� �-L?��=�������! �%C(2(N63B�G3 �?>/0�.(/C�U 213�:��<K%C(2(N��(/';�;A63�.�� �?>/C�`(6.(9��-�;A/C��%�G3G3�2/�E!�?>BM%' 2?@/C�+[�kl?@4$���x 21F��I.%C(N?T����/CB�BH/C����/$/C Z(�Vu/C�F��?T(] ���B�G3 ���-� �/x%��25C6F�®«¯%'�`- �L6FB����2?K��%'<��E!G.���2?@B����! )((N63G3G./C�� � �13�J��<K%'?@B «U �1.%' u �13�����J*7?><><+I.�H(9B�%�<><�-L? �=���2���`����(7?>��%�4$���)%�5C�:Gn���9;A/C���B�%��.���/�;+ �13�740%'�2?@/C6.(^%��)�)13?> ����� 26F�2��(^a�(N����%'<K(9/:qr?>G3GFB�%'�3��e�fCg0fLV+e�f0fLe��)[^�� �I.����/0B���(# �13���2�W;A/C�2�?>�! 2���2��(N 2?>�F5� 2/H%C(N8�*713?K��1U%'�Z��1F?> 2�&�� 263����(%��2�O��%0(9?>���7 2/J?>BHG3<>��BH���! �?>��1.%��)-L*,%'���$[

�l<><^ �13��(2�)13��BH��(l 21`%' J6.(N�� 213�M(2%'BH���L6FB]I.���u/�;O�W���L ����)(O%0(���E3%�B�G3<@��(z«�(96`��1�%0(Jylb7�%'�`-]%0-3-L?> �?>4$��(NG3<>?@�3��(£«d%'���l��ELG.���.(N?>4$�7?@�J 2����B�(£/�;�B���BS/C��"u�2��P$63?@�2��B����L Z(�a�?�;= �13���2�j%'���7B�%'�!"��EF%'B�GF<>��()�OI363 �1.%�4$��%�(9?@B�G3<@��<@��%'���3?>�F5�(9 Z%'5C�m[ s�/C����?>�! 2������(9 �?>�35�%'���� 213��(���13��B���(J 21.%� 6.(N��;A��*���H�����! 2���)(� 21`%'����E3%�B�G3<@��(�a�%��.-�6.(9�� �13��<@?>�3�&%'�S 2�)%��.( ;A/0�2B�%� 2?@/C� �Z[D\13������%'���%' O<@��%C(N _ N*R/�G.���Z(9G.���� �?>4$��(7;A/C�O/C63�:-L?K(2��6`(2(9?@/C��O*�S��%'����/C�.(N?T-L���_?@B�G3<@��B]���L Z%' 2? /0��/';,�)%0-L?T%�<4F(�[�%C-F-L?> �?>4$��(���13��B���(O%'�.-�*����%'�x�W/C�.(N?T-L���S-!?��=���2���L d%C�� �?>40%' �?>/C��;A63�`�� 2?@/C�.(W[�qr�� J6.(��.�)(N -L?K(2��6.(�(_�Z%C-L?K%'<^43(W[��F/C�3�A�)%0-L?T%�<�;A63�.�W 2?>/0�.(�(N6.�)1�%0(�% kj%'6.(�(9?K%'��y�b7� 4F(�[U%®kj%�6.(2(N?T%'��s�q+i�3�� N*R/C�28=[x�3/C�M% GOq � ��?>B�G3<@��BS���L Z%' �?>/C�`(�V� 21F��BM%'?>��-L? �=���2���`����?T(J?>�x�W/CB�G36F 2?>�F5�%�(2��%�<T%��G3��/!-L6.�� 7�Z%' 21F��� �1.%'�U% � < -L?T(N )%��.���$V!*713?T�)1]?K(�6.(N6.%'<@<>"SB�/C���l��ELG.���.(N?>4$��I./C 21�;A/0��-L?>50?> )%�<=%'�.-%'�`%'<>/05 GOq � ��[v\13� � < -L?T(N )%'�`���$Vr13/�*R��4$����V=B�?>501L �I.�]����G3<T%0����-�*7?@ 21� 213��� � -!?T(9 Z%'�.�W�$V+ 21.%� ?T(:%�(963B /';�%'I`(9/C<@63 2��40%'<@63��(WV�*713?T�)1���%'��I.���W/CB�G36F 2��-��$#M��?>���! 2<@"$[�ª�/C 2?K���� �1.%' d%�yl%0-L?T%�<

pCg

Page 30: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

b7%C(N?T(��363�.�� �?>/C�`(7(2�)13��B��� 21.%� l6`(9��(7 213�-� � �3/0�2B 1`%C(lI.�����U-L���2?>4$�&-]?>�U(9�&�� 2?@/C��a��![ pQ�^;A�2/0BY% 2���.(9/0�2�AG3�2/!-L6`�� O(9 Z%'I3?@<>?@������[

qr�� �6.(��W/C�.(N?T-L�����3/�* -L?��=�������L U%0�� 2?@4C%� 2?@/C�x;A63�.�� �?>/C�`(�[ �j�� 2?@4C%� 2?@/C��;A63�.�W 2?>/0�.(�(96.�)1 %C(kj%'6.(�(9?K%'�+V+(N?>50B�/C?K-M/0�u%�I.(9/0<>63 ���40%'<@63��(�%'������P$6.%'<@<>"��&%C(9"� �/���/0B�G363 ��$VL�&(9G.����?K%'<><@"�?�;�<>/$/08L�A63G )%�I3<>�U%�G3G3�2/m%C�)13��(J%��2��6.(9�&-r[�����%��.%'<@/C5�1.%'�Z-L*7%��2�U?> �?K(J(9/0B���*71.%� S(9?>BHG3<>���j 2/�5C���3���)%' ��U%(9?@5CB�/0?T-� 21.%���% ku%�6.(2(N?T%��+V%�<> �13/C63501xku%�6.(2(N?T%��3��<@?>8$�U(91`%'G.��(J��%���I.��(N"L�! 21F��(9?@����-�*7?> 21�<>��(�( 21`%'��e�o� ��)%��.(9?K(9 2/0�)(Oa �3[.�u%��2��?T(�V!G.���)(N/C�.%�<���/0B�BS63�3?T��%' 2?@/C�r�Z[

����G3�)%0�� 2?K��%'<^?@B�G3<>��B����! )%� 2?@/C�.(l/0 213����?T(�(963�&(�V^(96`��1�%0(_ ��)%C-!����/ �v(�I.�� N*����� BH��B�/C��"U%'�.-��/0B�G363 Z%' 2?@/C�H%'�.-�/0�3���)13?@G�<>��%��2�3?@�353V!%��2�u<@?>8$��<@"� 2/:I.�_BS6.�)1�B�/0�2���2��<@��40%'�! ^ 21.%��� �13�O(NGn�&��?��=��)13/$(N���U%'�)�)13?@ 2���� �63�2�m[#����/C �13����*/0�)-3(WV.%�5C���3���)%'<��W/C�.��<@6.(9?@/C�U%'I./063 u��%0(9�O/';�?>B�GF<>��BS���! )%' �?>/0�?T(�F/C �Gn/m(2(N?>I3<@� ��3/C�F��/';� 21F��%��)�)13?> ����� �63�2��(^*�O1.%�4$�O��/0�.(9?K-L������-�13/C<K-3(l%J�W<>��%��7��-L5C�m[

�3�2/CB� �13��G./C?@�L j/';R4L?@��*�/'; {Dbc_edf_hg(bcihjed�bcm,n#d�Y[m³Y[ZN\qje\rbc_(Z�~ �13�J(N?> �6.%' �?>/C��?K(l(N/CB���*71.%' j-L?�;A�;A�������L �[O\13�J13?K-3-L����63�F?> �?>��s�q+i �3�� 9*R/C��83(7*7?> �1�(9?>50B�/C?K-3%'<@��<@?>8$�O%0�� 2?@40%' 2?@/C��;A63�.�� �?>/0�.(l?T(j%G3<K%'6.(N?>I3<@�$V$%'<@I.��?> �BS6.�)1�/�4$������(N?>B�G3<@?��.��-rV�B�/!-!��<3/';v�2��%�<3�3��6F�2/C�`(�[^\13��(N?>5CBH/C?T-F%'<3 ��)%'�`( ;A/C��B�%'� 2?@/C��/';�%J(2��%�<T%'��G3��/!-L6.�� j(9����B�(�B]6.�)1S��%C(N?>���7 �/]?@B�G3<>��B]���$ �?>�� 2����B�(�/�;^8!�3/�*7��IF?>/CGF1L"F(9?K��%'<B����)1.%��3?T(NB�(� 21.%��� 21F��kj%�6.(2(N?T%'��/�;R%JB]63<@ 2?K-L?>BS���.(N?>/C�`%'<.��6.��<@?T-L�&%'��-L?K(9 Z%'�.���m[l|��� �13��/0 213���1.%��.-rV�?> O?K(_?>�! 2��?>5063?>�35� �/�/CI`(9����4$�] �1.%' d�ub7� �W���L ����)(j%'�.-� 26F�3��-���/C�� 2?T��%'<^�3��63��/C�.(�I.��1`%&4$�%'<@?>8$�Ua�i#/05C50?>/�%'�.-��l63��<>I.���� �V7e�f0fC�$�)[�����G.%��2 2?K��63<K%'��V^% kj%�6.(2(N?T%'�¯�ub7� 63�F?> �?K(�B�%'E!?>BM%'<>< "��EF��?> ���-J*713������%C�)1U��/CBHGn/0�3���! /�;� �13�u?>�FG363 7��EF%C�� �<>"SB�%' Z��1F��(���%C�)1���/0B�G./C�3���! /�;^ 21F�O�����3� 2����[�\1!6.(^ 213��63�3?@ �?K(�/CG3 �?>B�%�<><>"O �63�3��-J 2/: 213�j(9 �?>BS63<>6.(�4C%�<>63�j(9G.���W?��.��-�I!"J?> Z(^�����! 2����[?Fl�3?@ )(*7?> �1JB]6F<> 2?K-L?>BS�W�.(9?@/C�.%�<!�����! 2���Z(#%��2�7 26F�3��-� 2/:��/0B�G3<@��El;A��%� 263����(�VCBM%C-L�R/';+ �13����/0�C�N63�.�� �?>/0�J/';(9?@B�G3<@���#;A��%� 263����(�[^\13?K(7-L��(����2?@G3 2?@/C�S?T(4$����"J<>?>8$�7 �13�:��6.(N 2/CBM%'�2"S-!��(2����?>G3 �?>/0��/';¡��/C�� 2?K��%'<=����<@<T(/CGF 2?>BM%'<><@"� 263�3�&-® �/�(9/0B��JB�/0�2��/0��<@��(2(O��/0B�G3<>��E�(N 2?@B]63<@6.(�[ � /0����%�<><@��-®GF<T%C�W����/!-!?>�35�?T(u �13�(9?@B�G3<@��(9 ^%��.-�B�/$(N ^63�3?>4$���)(2%�<.��E3%�B�G3<@�7/';� 263�3?@�35�^�W��<><K(#*7?> �1��2/0635C13<@"�I.��<><=(N1.%'G.��-��2�&����G3 �?>4$��.��<K-3(1.%�4$�OG.��%'8�(N���.(N?> 2?@4L?@ 2?@��(#;A/C��5C?>4$����<>/!��%� 2?@/C�.(7?>�� 21F�_?@�3G363 j(9G`%C���$V.%��.-�IL"H/'4$���2<T%�G3G3?@�353V��/�4$���R%'<@<+/';� 21.%� �(9G.%0���$[^\1!6.( 26F�3��-���/0�2 �?T��%�<r�3��6F�2/C�`(l(N����B 2/SI.��1.%�4$�uB�/0�2��<>?@8$�_kj%'6`(2(9?K%'��ub7� 6F�3?> Z(� 21`%'��<@?>8$�� 213��(9?>50B�/C?K-3%'<=63�3?@ )(/';¡s�q+i��F�� N*/C��83(# �13�O 263�3�&-M����(9G./0�.(9�u;A63�.�W 2?>/0�/';¡��/0�2 2?K��%'<=�3��63��/C�.(7B�/m(9 2<@"J�2��(N��BSI3<>��(���ELGva : � � : �� < ��B�/C���u 21`%'��?> �-L/$�&( � a � � ���)[�wx1F��� 21F��(N 2?@B]63<@6.(u 2/�% �W/C�2 �?T��%�<�3��63�2/0��?T(J�)1.%��35C��- ;A��/CB�?@ )(�/CGF 2?>BM%'<40%�<>63��?>��%��L"�-!?>�2�&�� 2?@/C�+V 21F�J�3��63��/C��� (l�2��(NG./C�.(N�J 9"!G3?K��%'<@<>"�-L�&���2��%0(9��(W[u\13�S%0�� 2?@4L?@ N"�/';,%�kj%'6.(�(9?T%����jb7�¬6F�3?> u*R/C63<K-%'<K(9/�-L�&��<>?@�3��*7?> �1�%'�!"��)1.%'�F5C��?>�� �13�U(9 �?>BS63<>6.(O%�*7%�"�;A�2/0B�?> Z(�/CG3 �?>B�%�<�40%�<>63� $[��3/C�J �13�(9?@5CB�/0?T-]6F�3?> �VL 21F/C63501+V.������ )%'?@���)1.%'�350��(7%�*7%�"J;A�2/CBX 213�u/0G3 2?@B�%'<=(N 2?>BS63<@6.(�*7?><><.�3/0 u-!�����2�&%C(9�?> Z(7%C�� �?>4!?> N"$VC;A/C����EF%'B�GF<>��*713���� 213�O?@�3G363 ��?T(BS63<> �?>G3<@? ��-�I!"H%]��/0�.(9 Z%'�!

�� eC[

�l/�* B�?@5C1! �V� 21F���+VBS63<> �?T-L?@BJ���.(N?>/C�`%'<7kj%'6.(�(9?T%��x�2���W��G3 2?@4$�]�.��<K-3(JIn��(9"!�L �13��(N?>����-�;A�2/CB8!�3/�*7����������GF 2?>4$�7�.��<K-3(7%'�`-�I3?@/CG31!"3(N?T��%�<rB��&��1.%��3?T(NB�( �

\13�j(9?>BHG3<>��(N �%��.(9*R���^?T(# �1.%' ,����<@<T(+ 263�3�&-� �/��W/CB�G3<@��Eu;A��%' �63�2�&(#B�%�"�I.����/0�.(9 ��26.�� ���-�;A�2/CB%�13?>���Z%'�Z��1!"�/';_(9?>BHG3<>���d����<@<T(_ �63�3��-� 2/�?@�.������B����! )%�<�<@"�<T%��25C������/0�C�N63�.�W 2?>/0�.(J/';O��<@��B����! )%��2";A��%� 263����(�[:\13?T(u?K-L��%�«�G./0G363<T%��:%'B�/0�35�G31L"F(9?@/C<@/C5C?K(9 Z(z«���%'��?@B�B���-L?@%� 2��<@"]I.��;A/C��B�%'<@?>���&-M?@� 2���2B�(O/';:ku%�6.(2(N?T%��x�)%C-!?T%'<7I`%C(9?K(d;A6F�.�� 2?@/C�.(WV(N?>�.�W��%�BS63<> �?T-L?@BJ���.(9?@/C�.%�<7ku%�6.(2(N?T%���;A63�.�W 2?>/0���%��xIn��-L����/0B�G./$(N��-�?@�L �/ �13��G3��/!-L6.�� H/';:<>/�*���S-L?>B����.(9?@/C�.%�<uku%�6.(2(N?T%��.(�a�b7%'<@<T%��)-rVue�fCg0�Lh

pCf

Page 31: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

s���<cVLe�fCgCg!V>e�fCfCo!V>e�fCf$pLh=i#/05C5C?@/J%��.-Mk�?@�2/$(N?�V3e�fCf0oQ�)[R\13������%'���u(N��4$���)%�<LIF?>/CGF1L"F(9?K��%'<@<>"OG3<T%�6.(9?@I3<>�*7%�"F(l 2/�?@B�G3<>��B]���! lkj%�6.(2(N?T%'�¬ylb7�#�A<>?@8$�O63�3?> Z(Ja�(9���Si#/C505C?>/�%'�.-�k�?>��/$(9?cV�e�f0gCfU%'�.-�i�/C5C50?>/FVe�f0fCo$�)V#IF63 u�3/0�3�J?T(lG`%'�2 �?T��6F<T%'��<>"U(9?@B�G3<@�$[�� ��/C�3?K��%'<@<>"�/0�3�S/';R 213�JGF<T%'6`(9?>IF<>��?@B�G3<@��B]���$ )%' �?>/0�.(/';j%Uylb7��63�3?> OB�%�"���E!G3<@/C?> ���?>�Z��63?> Z(uI.%C(N��- /C��(N?>5CBH/C?T-F%'<��3/0�3<>?@�3��%��2?> �?>��(Jac(9����i�/C5C50?>/�%'�.-�l63��<>I.���� �VOe�f0fC�Q�Z[�� �x50���3���Z%'<cVz �13����?@�)��63?@ )(J�2��P$63?@�2��-�;A/C�� �13��40%'�2?@/C6.(�(���13��B���(S-L��(2�W�2?>I.��-?>�� 21F?T(uG.%'G.���d%'���]����%C(N/C�.%�I3<>�J;A�2/0B %�I3?@/C<>/05C?K��%'<^G./C?@�L O/';,4L?@��* aci#/C505C?@/�%'�`-�k�?>�2/m(9?cV�e�fCg0fLhi#/05C5C?@/3V+e�fCfCo$�)[R�3/C���E3%�B�G3<>�mV' �13�u�3/0�2B�%�<>?>����-_I.%0(9?K(�;A63�.�� �?>/C�H(2�)13��BH�7/';�(9�&�� 2?@/C�Ua�pL[ pQ�¡��/C63<K-I.�l?@B�G3<@��B��W�L ���-O%C(�/063 2<@?>�3�&-�?@���.5063�2�j�_*71F���2�j% ¤ G./$/C<K¥J����<><`(963B�BM%' 2�&(£ �13�u%0�� 2?@4L?@ 2?@��(#/';�%�<><13?K-3-L���U63�3?> Z(u%'�`- (N1L63�! )(� 213�:/C63 �G363 O63�3?@ l*7?@ 21�%�(N1L63�! 2?@�35�?@�313?>IF?> 2?@/C��%'G3G3��/�EL?@B�%' �?>�35J �13��2�&PQ63?@�2��-H-L?>4!?T(N?>/C��/0Gn���)%' �?>/0�+[

� ����� � �J� � �]� � � � �J��

�x<T%'��5C���L6FB]I.����/';�%�G3G3�2/�E!?>B�%� 2?@/C�J 2�&��13�F?TP$63��(���%'��I.��*7�2?@ 2 2���S%C(�BS63<@ 2?><K%�"$���+�3�� 9*R/C��83(�*7?> �1/C�F��1F?T-3-L����<T%�"$����[�����G.%C(N ]G`%'G.���)(�aci#/C505C?@/�%��.-�kl?@�2/m(9?�V7e�fCg0fLh�i#/C505C?@/�%'�.-xkl?@�2/m(9?�V7e�fCf0oLVe�f0fCo�I+h]k�?>��/$(9?cV�e�fCfCp$��*R��(913/�*�&-�13/�* 2/¬-L���2?@4$��y�%C-L?K%'<Ob7%0(9?K(��363�`�� 2?@/C�.(WVl��"LG.����b7%0(9?K(�363�.�� �?>/0�.(u%'�`- (N��4$���)%�<# N"!G.��(l/';RBS63<> �?T-L?@B]���.(9?@/C�.%�<+(9GF<>?>�F��(z;A�2/0B ����5C63<K%'��?>��%� 2?>/0��G3�2?@�.��?@G3<>��(W[w���1`%C-��3/0 ]6.(N��-�����5C6F<T%'��?>��%� 2?@/C�� 2/�"L?@��<T-�%'G3G3��/�EL?@B�%' �?>/C��(���13��B���(_/�;O 21F��%0-3-L?@ 2?>4$�� N"!Gn�a�w�%'1!I.%!V#e�fCfCo!h+�u%0(9 2?@�:%'�.-U\?>I.(N13?>�Z%'�3?cV+e�fCf0oQ�ZVr(N6.��1�%C(�%C-3-!?> 2?@4$�O(9GF<>?>�F��(�V3��?T-L50��%�G3G3��/'E!?>BM%'� 2?@/C��/';, 213�Hi��2/C�N���W 2?>/0��i�63�)(N63?> :y7��5C����(2(N?>/C�� N"LG.�S%��.- 13?@�35C��;A63�`�� 2?@/C�.(W[����� 213?K(uG.%'G.����V£*R�(91F/'* �1.%' :%�G3G3�2/0G3�2?K%' ���(N )%'IF?><>?@�����Z(u��%'��I.��-L���`�3��-� 2/S�N6.(9 �?�;A"�(96.�)1�%0-3-L?@ 2?>4$�d(2�)13��B��&(�V=%'�.- 21`%' � �13�H(2%'BH�]��E! 2���.(9?@/C�.(u 21`%' �<@��%C-F(�;A�2/0B�y�b7�� 2/��ub7�x<>��%0-3(�;A��/CB %C-F-L?> �?>4$�H(9G3<@?>�3��(u �/�2?K-L5C��;A6F�.�� 2?@/C��%'G3GF�2/�EL?@B�%' �?>/0��(2�)13��BH��(z/�;7 �13�Si��2/C�N���W 2?>/0��i�63�)(N63?> :y7��5C����(2(N?>/C�� N"LG.�$[S|l6F�k����3���Z%'<@?>����-:yz��5C63<K%'�2?@��%' �?>/0�Sªl�� N*/0�28F(£?@�.��<>6`-L�$V0-L��G.���.-L?@�35O/C�S 213��(N )%�I3?><@?>�����Ra� �1.%' �?T(#/0�] �13�G3��?>/C�:8L�F/'*7<@��-L50��/C�� 21F�];A63�.�� �?>/0�.(_*R��*7%��L : 2/�%'GFG3�2/�E!?>B�%� 2�C�ZV��ub7�x�3�� N*/0�28F(�V��2?T-!5C��%�G3�G3��/'E!?>BM%' 2?@/C�+V� 2���.(9/0��G3�2/!-!6.�� )(�(9G3<@?>�3��(�%'�.-Ji#���)����GF 2�2/0�3�A<>?>8$�^�3�� 9*R/C��83(+*7?> �1J/C�3�713?K-3-L���:<T%�"$���%'�`-�%'GFG3�2/0G3�2?K%' 2�:%0�� 2?@4C%� 2?@/C��;A63�.�� �?>/0�.(ua�(N6.��1U%0( 213�Jkj%'6.(�(9?K%'�r�Z[7�#?>5063�2���J(913/�*�(�%]-L?K%'50�)%'B/';R �13�J�2��<K%' �?>/C�`(913?@G.(�[Oªl/0 2?K���� �1.%' O�jb7���3�� N*R/C�28F(�%'�.-��2?K-L5C�S%�G3G3�2/�E!?>B�%� 2?@/C���3�� N*/0�28F(u%'���-L?@�2���� �<>"J����<T%� 2��-J?>�� �13�O(NGn�&��?T%�<+��%0(9�O/';��3/0�2B�%�<>?@����-J?>�3G36F )(lacs�%'��63"!%'B�%!V3kl?@�2/m(9?�%'�`-�i�/C5C50?>/FVe�f0fCp$�)[

w �:�3/�* ;A����<� 21.%� O%���/0B�B�/C�H 213��/0�2�� �?T��%�<r;A�)%�B���*/0�28��N6`(9 2? �.��(u%S<T%'��5C�d(9G.���� ��263B�/';,%�G3�G3��/'E!?>BM%' 2?@/C��(2�)13��B��&(l?>�� ����2BM(�/�;j-L?��=�������! J(9BH/$/C 21F�3��(2(J�W/C�.(N 2�)%�?>�! )(O?>B�G./$(N��-�*7?> 21F?>�� �13�(2%�B�������5C6F<T%'��?>��%� 2?@/C��;A6F�.�� 2?@/C�.%�<u 2/¬(9/C<@4$�� �13��?@<><>�AG./$(N��-�G3�2/0I3<>��B /�;O;A63�.�� �?>/C��%�G3G3��/'E!?>BM%'� 2?@/C��;A�2/0B�(NG.%'�Z(9�U-3%� )%L[�\13�U��<T%�?>B ?K(� 21.%� JB�%'�!"�-L?��=�������! ��3�� N*R/C�28F(�%��.-���/C���2��(NG./C�.-L?@�35%'GFG3�2/�E!?>B�%� 2?>/0��(2�)13��BH��(^��%'�UIn�:-L���2?>4$�&-�;A�2/0B 213�O40%'��?T%� 2?>/0�.%'<�G3��?>�.��?@G3<>�

9 5 �87 � /�" ���a � a �#"��;:+& "A� < >A@ 3;5 �B7DC a�{Fe'�

\13��"S-L? �=���^In�&��%'6.(N�u/';£-L?��=�������! �)13/0?T����(�/';�(N )%�I3?><@?>�����Z( 3 V!*713?T�)1S��/0�2�2�&(9G./C�.-S 2/J-!?��=���2���L �Co

Page 32: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

%C(�(963BHG3 2?@/C�.(^/';�(9BH/$/C 21F�3��(2(W[^���] �13?T(R��/C�! 2��E! �V$*R�lI.��<@?>��4$�7 �1.%' R 213�jb7%�"$��(9?K%'�S?>�! 2����G3�2�� Z%' �?>/C�?T(u/0�3��/';� �13��B�%�?>��%0-L40%'�! )%'50��(�/';�����5C6F<T%'��?>��%� 2?@/C���?@ OB�%'8$��(j��<>��%��O 21.%� J-L? �r���2���! O�3�� N*/0�28%'�Z��1F?> 2�&�� 263����(���/C���2��(NGn/0�.- �/�-!?��=���2���L uGF�2?>/0�:%C(2(N63B�G3 �?>/0�.(u/';�(NB�/$/C �13�3��(�(u/';7 �13�J;A63�.�� �?>/C�`( 2/SI.�:%'G3G3��/�EL?@B�%' ���-r[

\13�J�W/CB�B�/0�];A�)%�B���*R/C�28H*�O1.%�4$�:-L���2?@4$��-�(963505C��(N )(l �1.%' j-L? �r���2���.�W��(zI.�� N*R������ 213�O40%'���?>/06.(_�F�� N*/C��8�%��)�)13?> ����� 26F�2��(u%��2�S�2��<K%' �?>4$��<@"�BH?>�3/0��V+��/0�2����(9G./C�`-L?>�35� �/U-L?��=�������L :(NB�/$/C �13�3��(�(%C(�(963BHG3 2?@/C�.(W[�|l�F��*/063<T-���E!Gn�&�� O 21.%� ���%0��1�%'�Z��13?@ 2���W 263���J*7?><><^*R/C�28�I.��(9 O;A/C�: 213�H��<T%0(2(O/';;A63�.�W 2?>/0��-L���.�F��-�I!"� 213��%0(2(9/!�W?T%' ���-xG3�2?@/C�Ua� 21`%' �?K(�(9 Z%'I3?@<>?>�������ZV7%'�x��E!G.���� Z%' 2?@/C��*713?T�)1�?K(��/0�.(9?K(9 2���L 7*7?@ 21��L6FB����2?K��%'<F�2��(N63<> Z(?>�� 213?K(G.%'G.���:a�(N���:%'<K(9/Htl/C�3/013/�%��.- �C/013�.(9 �/C�3�mV+e�fCg0fQ�Z[����� � ��+�+1 ���0���� ���æÕ����+ ���,����������+�+

�3�2/0B 213��G./C?>�! ^/';�4!?>��*�/�;��2��5063<T%��2?>�&%' 2?@/C�+V0 213�� )%0(98S/';��W<T%C(�(9? �=��%' �?>/0��«d?>�.(N 2��%0-�/�;��2��50�2��(�(9?>/0�«:B�%�":(9����BD �/_����G3����(9���! �%�GF�2/CIF<>��B (9?>�`���7 213�7��/C<@�7/';v(9B�/$/0 213�F��(2(�?T(�<>��(�(#/CI!4L?@/C6.(W[ � /C�.(N?T-L���;A/C��(9?@B�G3<@?T��?@ 9"RI3?>�`%'�2":��<K%C(�(9?��n��%' �?>/C�vV'?@��*713?K��1O 21F��/063 2GF63 D&l?K(£��?@ 213����oz/0�e7%��.-_<@�� �Ja �D$'&3� ��Ja ��� ��a & ���I.�: 213�u�N/0?>�! lG3��/CI.%�I3?><@?> N"�/';R 21F�J?>�3G36F 2�A/C63 �G363 uG.%�?>�Z(�a �D$'&3�)[j\13�J%�4$���Z%'50�S��/$(N %C(�(9/!��?K%' ���-� �/�%�����(N 2?>BM%' 2/0� � a ���^?T( �13� Y �hn#Yiz\3Yk�]zbÉ~)© a�(N���:(9���W 2?>/0�UpL[ p$�

& 5 �B7 � � � � � &��Ja �D$'&3�)a &): � a ����� < C\13�:G3�2/0I3<>��BX/';^<@��%'���3?>�35J?K(�3/�* ��P$63?>40%�<>���! �/]B�?@�3?>BH?���?��F5� 21F�_��ELG.���� ���-]��?T(98�I.%0(9��-�/C� �(2%�B�G3<@��(l/';� �13�O�N/C?>�! OG3�2/0I.%'IF?><>?@ N"�-L?K(9 2��?>I36F 2?>/0���Ja �D$'&`�ZV�%'�.- ?@ O?T(u6.(96`%'<><@"�(9/0<>4$��-�IL"�BH?>�3?@�B�?@��?>�35O �13�O��B�G3?@�2?T��%'<3��?T(98�a2e�{!�)[^�l���2�u*R��-!?T(2�W6.(2( N*/JG./m(2(9?@I3<>�d%'G3GF�2/$%0��1F��( 2/S 213�OG3��/CI3<@��B/';��.�.-L?@�35J 213�OI.��(N l��(N 2?@B�%' �/C�

� ��;R*�J<@/$/C8�;A/C��%'����(9 �?>B�%� 2/C��?>�� �13�H��<T%0(2(l/�;7�2�&%'<�40%'<@63��-�;A63�`�� 2?@/C�.(WV£?@ u?T(�*��<@<#8!�3/�*7� �1.%' � 213�OB�?@�3?>BS?>�W��� � � /�;�� 5 �B7 ?T( 21F��(N/���%'<><@��- ]hY=g(]�Y¾~h~`bc_(Z"^`o8ZJiz\qbc_(Z Vn �1.%' �?T(

� � a��r� � � � & &��Ja%& ��� � �Ja2e ��� C a�{mpQ�

\13���2��;A/0�2�$VF%_�2�&%'<r40%�<>63��-S�3�� N*/0�28 � 2�)%�?>�3�&-]/C�� �13�u��BHG3?>��?T��%�<3�2?K(98Ua2e�{!�^*7?><@<r%�G3G3��/'E!?>�B�%� 2�$V$63�`-L���j�����2 Z%'?@����/C�`-L?> �?>/C�`(z/�;^��/0�.(9?K(9 ����.��"�aHGR%'G3�3?@8rV=e�f0gCpLh8GR%'G3�F?>8�%��.- � 13���24$/C��3���38L?K(�V�e�fCf!e'�)V� �13�S��/0�.-L?> �?>/0�.%'<�GF�2/CI`%'I3?@<>?> N"�-L?T(N 2�2?@I363 �?>/C��/�;���<K%C(�(�e0V ��a�e ���)[S���� 213?K(��%0(9�u/063���`�.%'<+��(N 2?@B�%' �/C� � ?K(��2�&%'<.40%'<>6F��-rV3%��.-]?@��/C�Z-L��� �/�/0I3 )%�?>�U%_I3?@�.%'��"]�&(9 2?@B�%' �/C�*R�u1.%�4$�u 2/S%�G3G3<@"�%� �13�2��(N13/C<K-];A63�.�� �?>/C�H 2/J?> �V3(N/J 21.%� 7/C63��.�`%'<�(9/0<>63 �?>/0�� �63�2�`(/C63 7 �/I.�

� � a ����� � a � a �����*713���2� � ?T( �13�:�l��%�4L?K(9?K-L�l;A63�.�W 2?>/0�+[

�Le

Page 33: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

� w��:��/C63<K-]<>/$/08�;A/C��%'����(N 2?@B�%' �/C�*7?@ 21��)%��35C� �o $�e .$VL;A/C�7��EF%'BHG3<>��/';� 213��;A/C�2B � a ������ 5 �=a ��� 7 [:���� 213?K(u��%C(N�] �13�J��E!G.���� 2�&-��2?T(N8�I.����/0B���(7 213�S%�4$���Z%'50�J�L63BSI.����/';7BH?T(2�W<T%C(�(9?@��.�&-�4$���� 2/0�)(W[O\13��;A63�.�� �?>/0�� 21.%� _BH?>�3?@B]?@����( �13�J��E!G.���� 2�&-��2?K(98�?T(��3/C O 21F�J�2��50�2��(�(9?>/0�;A63�`�� 2?@/C�U%'�!"LBH/C�2�mVQIF63 u%�IF?>�.%��2"�%�G3G3�2/�E!?>B�%� 2?@/C�� 2/J?@ �[

w �H%'��5C63�H 21.%� _?@� I./0 21���%0(9��(O?> uBM%'8$��(u(N���.(N�] �/�%C(�(963BH�J 21.%� � a�%��.- �.��?T(O%�(NB�/$/C �1�2�&%'<>�A40%'<@63��-_;A63�.�W 2?>/0�S%'�.-J 21F���2��;A/0�2�7 �/_6`(9�7�2��5C63<K%'�2?@��%' �?>/0�J�3�� N*/0�28F(# 2/:%'GFG3�2/�E!?>B�%� 2�?@ �[�\13�%'��5C63BH���L O?K(_ 21`%' S%��.%� 263�Z%'<GF�2?>/0�S��/C�`(9 2�Z%'?@�L O;A/C�S��<K%C(2(N?��=��%' 2?@/C��?K(�(NB�/$/C �13�3��(�(_/';���<K%C(2(N?��.���%� 2?>/0��I./C63�`-3%'��?>��(WV^(9?>�`���]/0 213���2*7?T(N��?> O*R/C63<K- I.��?>B�G./m(2(9?@I3<>�J �/�� �=���� �?>4$��<@"�50���3���Z%'<@?>���J �13���/0�2�2�&�� ��W<T%C(�(9? �=��%' �?>/0��;A�2/CB %�(9�� �/';:��EF%'B�GF<>��(W[ �363�2 �13����B�/C���$V%���/C�.-!?> 2?@/C�x �1.%' �6`(96.%�<><>"G3��/'4!?T-!��(u(9BH/$/C 21��W<T%C(�(9? �=��%' �?>/0� I./C6F�.-3%'��?>��(u?K(u(9B�/$/0 213�F��(2(u/';, 213�J6F�.-L����<>"!?>�35�����5C����(2(N/C� O%(9BH/$/C 21�;A63�`�� 2?@/C��6.(96`%'<><@"�1.%0( ¤ (9B�/$/0 21.¥J<>��4$��<.���2/m(2(N?>�35m(�[R\1L6.(7I./C �1�%'GFG3�2/m%C�)13��(�-L��(2�W�2?>I.��-%'I./�4$��(N635C50��(9 S 2/�?@B�G./$(9�H(9BH/$/C 21F�3��(2(�/�; � /0���=V� 21.%� J?T(O 2/�%'GFG3�2/�E!?>B�%� 2� � /C����*7?> �1�%�2��5C63<K%'�2?@��%' �?>/0���F�� N*/C��8r[

��� � � � � �­�� � 3�(��� �Ó�p�"� � ���#� � ����� �¶� ���#� �­�� �� /];c%��l*R��1.%�4$�:-L?K(2��6.(�(9��-U(9��4$���)%'<�%�G3G3��/'E!?>BM%' 2?@/C�� 2�&��13�F?TP$63��(/C�F<>"�;A�2/0B �13��G./0?>�! l/�;4!?>��*/';� 21F�u�2��GF�2��(N���L Z%' �?>/C�M%'�.-�%'�Z��1F?> 2�&�� 263���$V$%��.-�*�O-L?K-]�3/0 �-L?T(���6.(2(^13/�* *R��<><. �13��"SGn���9;A/C��B�?@�%'GFG3�2/�E!?>B�%� 2?>�F5z;A63�`�� 2?@/C�.(#/�;�-L? �=���2���! +;A63�.�� �?>/C�`(�(9G.%0����(W[ � ?>�.�W� 21F��(9�7 �����1F�3?TP$63��(+%��2�j-L���2?@4$��-63�.-!���7-L? �=���2���! j"np]zbc_(][b (NB�/$/C �13�3��(�(%0(2(96FB�G3 2?@/C�.(WV$*�j��<>��%��2<@"J��ELG.���W � �13��B �/�G.���9;A/0�2B /0G3� 2?@B�%'<@<>"u*71F���] �13/$(N� j,np][bc_(][b %0(2(N63B�G3 �?>/C�`(�%��2�j(2%� 2?T(��.��-r[�\13?T(�B�%�8$��(+?> R-L? #M��63<@ # �/:��/CB�G`%'�2� 21F��?>��G.���9;A/0�2B�%��.����(WV.(9?>�`����*R����E!G.���� ���%C�)1� �����1F�3?TP$63�O 2/�*R/C��8�I.��(N u/C��%H-L?��=�������L j��<K%C(2(�/';;A63�.�W 2?>/0�.(�[��l/�*��4$����V�?�;=*R�B���%0(963���G.���N;A/C�2BM%'�.���&(£I!"O13/�*xP$63?T�)8L<@"l �13��%'GFG3�2/�E!?>B�%� 2?>/0�������2/0�5C/$�&( 2/J������/O*713���� 213���!63B]I.���^/�;�G.%'�Z%'B��� ����)(�/�;� �13�O%'GFG3�2/�E!?>B�%� 2?>/0��(���1F��B��50/$��( 2/J?@�L�.�3�?> N"$V=4$���2"U5C���3���)%'<^����(963<@ )(z;A��/CB �13�] �13��/0�2"�/';,<>?@�3��%'��%'�.- �F/C�3<@?>�3��%��O*7?T-L �1.(Ja�\?>BM%'�+V�e�fC�0�Lhi�?>�38!6.(WV+e�fCg0�Lh+qr/0�2���! 2�mV+e�fC�0pLh�e�fCg0�Lh+tl��G�/0�2�$V.��/'*,%'�Z-�%��.-�s�?K���)13��<><@?�V3e�fCg0fLh+tl��G�/0�2�$V+e�fCf!eChtl��G^/0�2�j%'�.- �^6+V.e�fCf!e'�R(N635C50��(9 R 21.%� %�<><. 2�&��13�F?TP$63��(�(91.%��2�u �13�u(�%'B��7<@?>B�?@ )%� 2?>/0�.(�[v�`/0�^��E3%�B��G3<@�$Vr*713����%'GFG3�2/�E!?>B�%� 2?>�F5�%�� ] �?>B��&(l��/0�L �?>�!63/C6`(9<>"U-L? �=���2���! 2?K%'I3<@�_;A63�`�� 2?@/C��?>� ��40%��2?T%�I3<>�&(*7?> �1�(N/CB��u;A63�.�W 2?>/0��G.%��)%�B��� 2��?>���&-MI!" G`%'�)%�B��� ����)(WV3/C�3�d��%'��G3��/�4$�_ �1.%' j��4$���� 213� ¤ I.��(N )¥�3/0�3<>?@�3��%'�OG.%��)%�B��� 2��?>��%� 2?@/C����%'�3�3/0 :%C�)13?>��4$�d%'��%C���W63�)%0��"� 21.%� O?T(lI.�� � 2���O 21`%'�� 213��� j(i�©D~`_(Z\r|�n#Y I./C63�.-=VQ �1.%' �?T(��:a� �� �Z[��l���2� �13��%C-��N���� 2?@4$� ¤ I.��(9 Z¥u?T(#6.(N��-�?>�: 213��(N���.(N��-L���.�3�&-_I!"Jtl���G^/C���$V3�l/�*,%'�)-�%��.-�s�?K����1F��<><@?+a2e�fCgCf$�?@�� 213��?@�*R/C�28�/0���F/C�3<@?>�3��%�� n�A*7?T-L �1.(�V3*71F?T�)1�����(9 ��2?K�� )( 21F�O(9�� Z(�/�;��3/0�3<>?@�3��%��G.%��)%'BH�� 2��?>��%� 2?>/0�J 2/J �13/$(N�l;A/C�7*713?K��1S 21F�u/CG3 �?>B�%�<.G.%'�Z%'B��� ����)(^-L��Gn���.-��/0�L �?>�!63/C6.(N<>"U/C�� 213��;A63�`�� 2?@/C�� 21`%' O1.%C(O 2/�I.�S%'G3GF�2/�EL?@B�%' ���-r[:ªl/C �?T���J �1.%' �V�%'<> �13/C6F5C1� 213?K(?T(R%J-L��(N?>�)%�I3<>�jG3�2/0Gn���2 N"$VL�F/C j%'<><= 213��%'G3G3��/�EL?@B�%' �?>/C�H 2���)13�3?KPQ63�&(¡BM%&"J1`%&4$�j?> �V!%��.-� �13���2�W;A/C�2� 21F��(9�O�2�&(963<@ )(7B�%�"]�3/0 u%�<>*,%&"F(7In�:%�G3G3<>?K��%'IF<>�$[R�l/�*��4$����VL �13�OI.%C(N?T�O?>�! 263?@ 2?>/0��?T(7 21`%' j%]��<K%C(�(/';�;A63�.�� �?>/C�`(z1.%0(u%'��?@�L ��2?@�.(9?K�u��/CBHG3<>��E!?> N"J �1.%' �?>�.�W�2��%0(9��(��E!G./C�3���L �?T%'<@<>"�?@�� �13�O 213�:�)%' �?>/ ,

�V

*713������ ?K(#%u(NB�/$/C �13�3��(�(£?@�.-L��E=V� 21.%� �?T(�%zBH��%C(N63�2�^/';= �13�7%�B�/C63�! +/';v��/0�.(9 ��)%�?>�! )(+?>B�G./$(N��-_/0� 21F�;A63�.�� �?>/C�`(#/';v 213����<K%C(�(�[�\1F���2��;A/0�2�$V0?�;= 213��(NB�/$/C �13�3��(�(#?>�`-L��E�?K(#8$��G3 ���/0�.(9 Z%'�! �V$*�7��E!G.����

�Cp

Page 34: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

21`%' u �13���!63BSIn���7/';RG.%'�Z%'B��� 2���Z(�3����-L�&-�?>�U/C�Z-L���u �/�%C�)13?>��4$��%S������ )%�?>��%0����63�Z%C��"�?@�.���2�&%C(9�&(��E!G./C�3���! 2?K%'<@<>"S*7?> 21� �13�O�L63BSI.���^/';R-!?>B����`(9?>/0�.(�V$?@�2�2�&(9G.���� �?>4$��<@"J/';� 213�:%'GFG3�2/�E!?>B�%� 2?>/0�� 2���)13��3?KPQ63�mV�(913/�*7?>�F5u 213�RG313���F/CB����F/C�O8L�F/'*7�d%C( ¤ �13�7��6F�)(9�R/';=-!?>B����`(9?>/0�.%'<@?> N"F¥zacb��<><@B�%'�vVCe�f0�Le��)[� <>�&%'�2<@"$V$?�;�*R�O��/C�`(9?T-!���7��<K%C(�(9��(/�;#;A63�`�� 2?@/C�.(^*7?> 21U%:(9B�/$/0 213�3�&(2(?>�`-L��ES 21.%� 7?>�.������%C(N��(�*71F��� 21F�_�!63BSI.���/�;^40%'�2?K%'I3<@��(?>�`���2��%0(9�$V3 �13���U%J�)%' ��O/';R��/0�L4$���25C���.���u?@�.-L��G.���.-!���L 7/�;� �13�J-!?>B����F�(9?@/C�.%�<>?@ 9"M��%'�UIn�O/0I3 )%�?>�3��-=VnI.����%�6.(9�: 213�O?@�.���2�&%C(9�O?@����/0B�G3<>��EL?@ 9"d-L63�: 2/S 213�O<T%��250���l�!63BSI.���/';¡4C%��2?K%'I3<@��(z?K(7��/CBHGn���.(2%� 2��-�I!"� 213�d-L��������%C(N�:-L63�O 2/� �13�:(9 ��2/C�F5C���j(9B�/$/0 213�F��(2(���/C�`(9 2�Z%'?@�L �[����/C�Z-L���u �/�BM%'8$�O 213?K(u��/0�.����G3 ���<>��%���Vr*R�S(963BHB�%'��?>����-�?>�� )%�I3<>��ac�Q��%��!63BSIn���7/';�-!?��=���2���L %'GFG3�2/�E!?>B�%� 2?>/0� ����)13�3?TP$63��(WV+%'�`- 213�M��/C�.(N 2�Z%'?>�! )(O 21.%� J��%���I.��?>BHGn/m(9��-�/0�� 21F��B ?@� /0�)-L��� 2/�B�%�8$�� �13�S%'G3GF�2/�EL?@B�%' �?>/0�����2��/C�u �/�I.���:a��� � �)V+ 21.%� O?T( ¤ ?>�.-L��Gn�&-L���! u/';, 213�H-L?>BH���.(9?@/C�.¥!V%'�`-� �13���2�W;A/C�2�7?@B�BS63�3�� �/_ �13�j��63�)(N�7/';£-L?>B����.(9?@/C�.%�<>?> N"$[vªl/C �?T���R 21.%� �V!(9?@�.���7 21F��(9�� 2���)13�3?KPQ6F��(%'���O-L����?>4$��-�6F�.-L���,-L?��=�������L j"np]zbc_(][b %0(2(N63B�G3 �?>/C�`(�VL �13����ELGF<>?T�W?> #;A/0�2B�/';� 21F�O��/C�`(9 2�Z%'?@�L Z(%'���-L? �r���2���! �[��`/0���EF%'BHG3<>�7?@�����! 2�2?@��(^��%��.-��_/';� �13�u Z%'I3<@�Ja9k�?>��/$(N?+%'�`-����3����<@<>/C � 2?cVLe�fCfCp!V#e�fCf0�Lhk�?>��/$(9?cV.e�fCf0�Q�^ �13�l����(96F<> ^13/C<K-3(�?>� 9 <�� � � a%* , �)V$ 21`%' ?K(� 213� � /CI./0<>��4S(NG.%C���j/';r;A6F�.�� 2?@/C�.(�*713/m(9�-L����?>40%' �?>4$��(u63G� 2/�/C�Z-L���Sp � %��2��?@�L ���5C�Z%'I3<@��a��.?@��B�����V�e�f0gCf$�)[�ª�/C 2?K���S 21.%� J 213���!63BSI.���O/';-L����?>40%' �?>4$��(O 21.%� S%'����?@�L ���5C�Z%'I3<@��1.%0(� �/�?>�.������%C(N��*7?> 21� 213�U-L?@B����.(N?>/C� �®?@��/0�)-L���J 2/�8$����G 21F���)%� 2��/';d��/0�L4$���25C���.������/0�.(9 Z%'�! �[x�Y(9?@B�?><K%'��GF13���3/0B����3/0��%�G3G.��%'�Z(]?>�����! 2��?>��(Jp�%'�`-x�a�b7%��2��/C�+V=e�fCf!eCV+e�fCfC�!h.b�2��?@B�%'�vVLe�fCfC�$�)V3I36F ?>�M%_<>�&(2(�/CI!4L?@/C6.(^*7%�"$[�� �J;c%C�W �VL?@ R��%'��I.�j(913/�*7�a9k�?@�2/$(N?�%'�.-U�l�3����<><>/0 2 �?�V.e�f0fCpLV�e�fCf0�Q�R 21.%� �V3;A/C�7��EF%'BHG3<>�$V$ �13�:(9G.%0����/�;#;A63�`�� 2?@/C�.(���/C�`(9?T-!���2��-I!"�b7%'���2/C��aA���L ��2"�p$�R%'�.-Ub�2��?@B�%'�Ua����L ��2"��$�R%'�2�: 213�:(N�� 7/';�;A6F�.�� 2?@/C�.( �1.%' j��%���I.�:*7�2?> � 2����2�&(9G.���� �?>4$��<@"J%C( � a ��� � � � � � , � @M%'�.- � a ��� � � � � < , � @=VL*71F���2��@H?T(R%'�!"�;A63�`�� 2?@/C��*713/m(9��3/C63��?>���R\+�)%��.( ;A/0�2B ?K(�?>�! 2��5C�)%�I3<>�mVL%��.- � (9 Z%'�.-3(�;A/0� �13�O��/0�L4$/0<>63 �?>/C�S/CG.���Z%' �/C��[Rªl/0 2?T�W�l �1.%' �V?>�� �13?T(�*7%�"$Vr?@ uI.����/CBH��(zBH/C�2�d%'G3G`%'�2���L u �1.%' O �13��(9�S(NG.%C�W�J/';^;A63�.�� �?>/0�.(uIn�&��/CB��OB�/0�2�d%'�.-B�/0�2�J�W/C�.(N 2�)%�?>�3�&- %0(� �13�S-L?@B����.(N?>/C�`(z?@�.���2�&%C(9�&(�V+-L6F�] �/� 213�SB�/0�2�J%��.-�B�/C�����)%�G3?T-�;c%'<@<>�A/ �/';� 21F�u 2����B�( � � � � , %��.-�� � � < , [^\13�:(2%�B��lGF13���3/0B����3/0��?T(7%�<T(9/J4$���2"H��<>��%��^?>�� 213�j�2��(N63<> Z(/';z��[ ª:[.s�1.%C(N8C%��Sa2e�f0fC�$�)V#*71F/�GF�2/�4$��-� 21`%' O 213�J�Z%' ��J/';��W/C�!4$���250���.���:/';,%'G3GF�2/�EL?@B�%' �?>/0��/';;A63�.�W 2?>/0�.(l*7?@ 21 S��/0�L �?>�!63/C6.(j-L���2?@40%' 2?@4$��(I!"�BS63<@ 2?><K%�"$������-�;A����-$;A/C�2*,%'�Z-��3��6F�)%'<��3�� N*/0�28F(z?K(�:a� �� � �?�;+ �13�u�!63BSIn����/�;���/C�! 2?@�L6F/C6.(R-L���2?@40%' 2?@4$��( u?>�.������%C(N��(�<@?>�3�&%'�2<@"J*7?> �1� 213��-L?>B����.(9?@/C��3V. 213�:��63�Z(9�:/';R-L?@B����.(N?>/0�.%'<@?> N"S-L?T(�%'G3G.��%��)(WVr<>��%0-L?>�F5J 2/H%]�)%� 2��/�;R��/0�L4$����5C���`���u?>�`-L��G.���.-L���L /';¡ 213�:-L?@B����.(N?>/C�v[

�� u?T(u?>BHGn/0�2 Z%'�! u 2/���B�GF1.%C(N?>���: 21.%� _?@��G3�)%0�� 2?K���J 21F�]G.%��)%�B��� 2���)(l/�;7 21F�S%'G3G3��/�EL?@B�%' �?>/C�(2�)13��BH�u1.%�4$�� �/]I.�J��(N 2?>BM%' 2�&-M6`(9?>�F5�%��`�3?> ��J%'BH/C63�! l/�;R-3%� )%�a GR%'GF�3?>8�%��.- � 13����4$/C�3���38L?K(�Ve�f$}$e0V#e�fCgLe0V�e�f0fLe0hBGR%'GF�3?>8=Vre�fCgCp!hri�/C<><K%'�Z-rV+e�f0g'{3h+k���B�%��+V3b?@���3���.(N 2/!�)8�%��.-�t�/C63�Z(2%' �V#e�fCf0pLh�u%�6.(2(N<>����V+e�fCg0fLh=b7%'63B %'�.-U�u%'6.(�(9<@����V+e�fCgCf!V+b7%'6FB�V.e�fCg0gLh+s�/$/!-!"$V#e�fCf!e�%LV�e�fCf!e�Ir�Z[7����;c%0�� �V*71.%� �/C�3��-L/$��(]?@��G3�Z%C�� �?T����?K(� �/�B�?>�F?>BS?>�W�] �13� Y[m,npbc][bcihjedV][bÉ~)© a�(N�����&PQ6.%� 2?@/C� eW{L�ZVz*71F?><>�*71.%� �/C�3��*R/C63<K-�����%'<@<>"�<>?@8$�� �/�-!/�?K(� �/�B�?@�3?>BS?>�W�� 21F� Y �hn#Yiz\3Yk�][bÉ~)© ac(9���U��P$6.%' �?>/C�De��Q�Z[\13?K(?>�! 2�2/!-!6.����(R%'�U%C-3-!?> 2?@/C�.%�<�(9/063�)���j/';����2��/C��VF(9/0B��� 2?@B���(���%'<><@��- ¤ ��(9 �?>B�%� 2?>/0�]���2�2/0�)¥!V3 21.%� 6.(N6.%'<@<>"J-!��G.���.-3(�/C�S 21F�u-L?@B����.(N?>/0� �_?@�S%uB]6.�)1OB�?><K-L���+*,%&": 21.%��� 21F��%'G3G3��/�EL?@B�%' �?>/C�:���2��/C��V%'�`-���%���I.����(N 2?@B�%' ���-]6.(N?>�35S 213�O �13��/C��"�/';^63�F?�;A/C��B���/0�L4$����5C���`���u/';¡�2��<K%' 2?@4$�l;A�2�&PQ63���.����( �/G3��/CI.%�I3?><@?> 2?@��(aHG%�G3�3?@8J%'�`- � 13����4$/C�3���F8L?K(�V3e�fQ}$e0V+e�f0gLeCV=e�f0fLeCh GR%�G3�3?>8=V3e�fCgCp!h.i#/C<@<T%��)-rV.e�f0g'{!�)[

�C�

Page 35: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

� G.����? �=�]�2�&(963<@ )(_/0�� 213��50���3���Z%'<@?>��%� 2?>/0�������2/C��V� 21.%� S��/CBSI3?@�3�JI./C 21�%�G3G3�2/�E!?>B�%� 2?@/C��%'�.-��(N 2?>BM%' 2?@/C�����2��/C��V�1.%�4$��I.������/0I3 )%�?>�3�&-¬I!"���[^b7%'���2/C��a�e�fCf!eCVue�fCf�{L�O;A/C�H(9?>50B�/C?K-3%'<^�3��63�)%�<�3�� N*R/C�28F(�V^%��.-�IL"�ªl?@"$/C5C?R%��.-�kl?@�2/m(9?Oa2e�fCf�{L�O;A/C�]kj%�6.(2(N?T%'�¯yl%0-L?T%�<7b7%0(9?T(J�363�`�� 2?@/C�.(W[ ��<>� 21F/C63501 �13��(9�JI./063�.-3(:%'�2�H-L? �r���2���! �V. 213��"�%'<@<�1.%�4$�� �13�H(2%'BH�JP$6.%'<@?> )%� 2?@4$��I.��1.%�4!?>/C6F� z;A/0�:%�.E!��-��L6FB]I.���^/';¡-3%� )%JGn/0?>�! )( �13�O5C���3���)%'<@?>��%� 2?@/C�������2/0��.�)(N �-L��������%C(N��(*713���� 21F�_�!63BSI.���^/';G.%��)%'BH�� 2���Z(�?@�.���2�&%C(9�&(�VL �13��������%C�)13��(R%�B�?>�F?>BJ63B %'�.-�(9 Z%'�� 7?>�.������%C(N?>�35S%�5$%�?>�+V3����4$��%'<@?>�35O �13�*��<><.8L�F/'*7�HG313���3/0B����3/0��/'; _ �;Y[]âuÞ\B\rbcZeg [7�3/0�7%�5C���3���)%�<+-L�&(2����?>G3 �?>/C�H/';�13/�*� 213�O%�G3G3��/'E!?>BM%'� 2?@/C��%��.-]��(N 2?@B�%' �?>/C�S�����2/C�R��/0B]IF?>�3�7 �/C5C�� 213���R 2/:In/063�.-� 21F�u5C���F���)%�<>?>�&%' 2?@/C�S���2��/C�,(9���jªl?>"$/05C?%'�`-®k�?>��/$(9?^a�e�f0f'{L�Z[

����� - ���­ 3�� ��Õ�G+N�#���"02�����#� ����ñ����� +J�Ù��+������ ')������

���� 213?K(<T%C(N u(N���� �?>/C��*R��%0-3-L����(2(7 213�:(N63�2G3��?T(N?>�35S�2��<K%' �?>4$�j(96.���W��(2(/�;R%C-3-!?> 2?@4$�O(2�)13��BH��(�/�;� �13��2?K-L5C��%'G3G3��/�EL?@B�%' �?>/C�S N"LG.�u?@�]����%'<=*/0�2<T-H%'G3G3<@?T��%� 2?@/C�.(W[^�u(�*R�u1.%�4$�u(N�����+V!�2?K-L5C�O%�G3G3��/'E!?>BM%'� 2?@/C�S(���13��B���(r-!��G.���.-�/C�JGF�2?>/0�)(+ 21.%� ^��/0B]I3?@�3�R%C-3-!?> 2?@4L?@ N"u/';./0�3���c-L?>BH���.(9?@/C�.%�<Q;A6F�.�� 2?@/C�.(+*7?> �1 21F�76.(96.%�<.%C(�(963BHG3 2?@/C�J/';v(NB�/$/C �13�3��(�(�[^tl/O(N6.�)1JG3�2?@/C�)(^��%�G3 26F�2�7(N/CB��^;A63�.-3%�B����! )%�<LG3��/CG.���� 9"/';, 213�JGF1L"F(9?K��%'<�*/0�2<T- � � /0�.(9?K-L���l;A/0�_��E3%�B�G3<>�O �13�JG3�2/0I3<>��B /';,/CI3�N���W l������/C50�3?> �?>/0�+V+/C�u �13�G3��/CI3<@��B /';�B�/0 2/C���W/C�! 2�2/0<�[�w��O��%����2�&��/C50�3?>����%'<>BH/$(9 �%��L"H/CI3�N���� ^;A�2/0B�%'�!"�/';¡B�%'�!"�(NB�%'<@<(96FI.(9�� Z(_/�;7?> Z(l;A��%' �63�2��(WV+4L?K(96.%�<%��.-��3/C�3�A4!?T(96`%'<�[Sw �H��%�� G.���N;A/C�2B BM%'�!"�B�/0 2/C��%C�� �?>/C�`(�?@�(9��4$���)%�<+-L? �r���2���! *,%&"F(�[^����B�/m(9 7(N?> �6.%' �?>/C�`(�V3/C6F�u(N���.(9/0�2"�%��.-�BH/C 2/0�*R/C�2<K-3(�%'�2� ]hYk(o8Z�k(j(ZN\ [���� 2����B�(u/';:kuy�ª 213?K(_B��&%'�.(O 21.%� J?>�.(N 2��%0-¬/�;u1F?>5C1F��-L?@B����.(N?>/0�.%'<,�����! 2���Z(�V�%��L"�/';�(9��4$���Z%'<<>/�*R���2�c-L?>BH���.(9?@/C�.%�<^�����! 2���)(�V+ �1.%' J?K(���/0B�G./C�3���! )(WV�%��2��/�;A 2����(N6�#M��?>���! O 2/UGn���9;A/C��B�%�50?>4$��� )%0(98=[7\13?K(B���%'�`( 21.%� l �13� ¤ %'�`-3¥]/';�%�13?@5C13�c-L?@B����.(N?>/C�`%'<���/0�C�N63�.�� �?>/0����%'��I.�:�2��G3<K%C���&-MI!" 21F� ¤ /C�Z¥�/';7?@ )(u�W/CB�G./C�F���L Z(_aA<>/�*7�c-L?>B����.(9?@/C�.%�<���/0�C�N63�.�W 2?>/0�.(��R«U%];c%C���JB�%�"�I.�S�2���W/C5C�F?>����-I!"�?> Z(u��"$��I3��/'*�(j%'<>/0�3�$V+/C�:%�B]635SI!"�?> Z(O��/C<@/C��[S\+/��2����/05C�3?@���S%'��/CI3�N���� �Vr*�JBM%&"U6.(9�S�3/0 /C�F<>"� ���B�G3<K%' 2�&(��W/CB�G3��?T(N?>�35d%'<><+?@ )(�;A��%� 263����(�V3IF63 �%'<K(9/H(963I3 ���B�G3<K%' ���(�V!��/0B�G3�2?K(9?@�35J(N63I.(9�� )(7/';;A��%� 263����(7%'�.-�?@��(N/CB���(9?> �6.%' �?>/0�.( 213�O<K%' 2 �����V!IL"H 213��BM(9��<@4$��(�V�B�%�"]I.�u;A63<@<>"H(96�#M��?>���L �[#�j-3-L?>� 2?@4$�$V!(9B�%�<><v�����! 2���Z(¡«S?>�� �13�O<>?>BH?> �*7?@ 21U-L?>BH���.(9?@/C�.%�<>?@ 9":/C�3�u«H*7?> �1� �13�:%'G3GF�2/CGF�2?T%� 2� %'���/';���/C63�Z(9�:%C(�(9/!��?K%' ���-�*7?@ 21U(9 Z%'I3?@<>?>�����)(^/';^ �13�:%C-3-L?@ 2?@4$�u N"LG.�$[

� G3<@?> 2 �?>�35� 21F���2�&��/C50�3?>��%�I3<>��*R/C�2<K-�?@�L �/ ?@ )(S%C-3-L?@ 2?@4$��G`%'�2 Z(]B�%�"�*R��<><7I.��GF�2��;A���Z%'I3<@�� �/�2�&��/C�.(N 2��6.�� 2?@�35�?@ _?@��?> Z(z;A63<><�B]63<@ 2?K-L?>BS���.(N?>/C�`%'<>?@ �"$V3I.����%�6.(9�H%�(9"F(9 ���B ��/0B�G./$(N��-�/';z(9��4$���Z%'<?>�`-L��G.���.-L���L �Vr%0-3-L?> �?>4$�OG.%��2 )(�?T(l?@�313�������L �<>"�BH/C�2�O��/CI36.(N u 21`%'��%]*713/C<@�J(N?>BS63<> Z%'�3��/06.(9<@"�-L���G.���.-L���L 7/0����%0��1�/';�?> Z(G.%'�� )(W[\13�d(9B�%�<><.<>/m(2(7?>��63�3?KPQ6F���3��(�(/';^������/C50�3?> �?>/0��?K(��%C(N?><@"]/ �+(N�� I!"� 213�S5$%�?>��%�5$%'?@�.(9 :�3/C?K(9�H%'�.-�/!����<>6`(9?>/0�+[�\13�����]?K(O%'<T(N/�%�Gn/m(2(N?>I3<@�]B��� )%'�c%'��5C63BH���L j 21.%� *�SB����! 2?@/C��13���2�S/C�3<@"�;A/C�� �13��(�%'8$�S/';j��63��?>/m(9?> N"$[H�� _BM%&"UI.��%'��5C63��-� 21.%� �1!63B�%'�`(�*R/C63<K-�3/0 ]I.��%�I3<>�U 2/�63�.-L���)(9 Z%'�.-� 213�U*/0�2<T-�?�;j?> J*R���2���3/0 �%0-3-L?> �?>4$��I.����%�6.(9�U/';O �13�� �/$/C�A<T%'��5C��!63B]I.����/';v�3�����&(2(2%��2":��E3%�B�G3<@��(�aAI.����%'6`(9�7/';v13?>501�-!?>B����`(9?>/0�.%'<@?> N"u/�;+%��L"S(N���.(N/C�2"J?@�3G363 ¡(96.�)1%C(�%'�U?>B�%�5C�C�Z[�\1!6.(/C�F��B�%�"SIn�O ���B�G3 ���-� �/��W/C�C�N���W 263���_ �1.%' 7/063�j(9���.(N/C��"�*R/C��<T-�?T(I3?K%C(N��- 2/�*,%'�)-F(l%�� ¤ %0-3-L?@ 2?>4$��(9 2��6.�� �63�2��¥![

�'{

Page 36: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

�363�.�W 2?>/0�U(9G.%0��� ªl/C��B �lG3G3��/'E!?>BM%' 2?@/C��(���1F��B��

� � � �(C �� aqC�� � > � � < a � � � a ����� 3 �" ��� � " (N?>�+a � � � " > � " �

a �C/C�3��(WV+e�f0fCpQ�� � � �(C �[C�� �� arC'� � > � � < a � � � a ����� 3 �" ��� � " � a � � � " > � " �

acb7%'�2��/C�+V+e�fCf!e'�

� � � �(C �[C�� < �� aqC'� � > � � < a � � � a ����� 3 �" ��� � " � � � " > � " � >�� � I�> �

acb�2��?@B�%'�+VFe�fCf0�Q�

� ��� � � � @ $ @ (� � a *),&� ��a%* < � � a ����� 3 � � ��� � � � ��� �� � �

aNkl?@�2/m(9?�%'�`-��l�3����<><@/C 2 �?�V.e�f0fCp$�

9 < � � � a * , �'$�p����/� ��a%* < � � a ����� 3 � � ��� � � � � a$� � :� � � < �

aNkl?@�2/m(9?�%'�`-��l�3����<><@/C 2 �?�V.e�f0fCp$�

9 < � � � a * , �'$�p����/� � < a * < � � a ����� 3 � � ��� � � � �� � � � �� �

aNkl?@�2/m(9?�V+e�fCf0�Q�

\�%'I3<@�O� tQn(np]¾_���bcmOje\rbc_(ZA~`ih�#Y[m³Y¾~�j(Z�kÔih_(]z]hY¾~3nJ_(Z�k(bcZeg�^`o8ZJiz\qbc_(Z(~"~3nJj(izY¾~:¨�b�\c��\c�#Y,~`j(m³Y�]¾je\3Y_w^ ih_(Z ��Y[]=g8Y[Z�izY ��a� �� � �Ô���#Y�^`o8ZJiz\qbc_(Z � bcZá\��#Y�~[\rj(Z�k(j(]¾kà~`byg×mO_(bck(jed�^`oNZ�iz\rbc_(Z��¶\c�#Y�^`o8Z�i[\qbc_(Z � � bcZá\��#Y�\c�Jbc]¾k�Y[Z8\r]z|»bÉ~�\��#Y�]j(m,n­^`o8ZJiz\qbc_(Z(�Vj(Z�k$\c�#Y�^`o8Z�i[\qbc_(Z � � bcZá\c�#Y�u�^[\c� Y[Z8\r][|$bÉ~�ja"Y~h~;Yhd(n�_e\3Y[Z8\rbcjed ��\��Jje\�bÉ~¶\c�#Y ��_(oN]zbBY[]­�J]¾j(Z(~c^`_(]zm!_w^ a2e8> �[C�� < � � � �#\3Y[bcZ��Õ�����e� � � 9 < � � � a * , �bÉ~¶\c�#Y��p_({h_ed�Y ��~3nJj(izYQ_w^p^`o8Z�i[\qbc_(Z�~j¨2�J_�~;Y¶k8Y[][b��Dje\rb���Y¾~�o¸nÔ\q_�_(]¾k8Y[] p�� j(]�YQbcZ8\3Y=g(]¾j({[d�Y ��� bBY[m³Y[]¾������(� � �

�C�

Page 37: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

�$<��2M�> �»K=687�W#68R©6NM ;C ���V�D¡3�¶®�¡�D¬3�¾½c¥e§p¬3¤�î�ÑNöÞ£f¨;¤;®D£=¿Nê,Ñ��»�N��¦q¼`�D¡z¿���ÑJÛ�¡q£f�[�eµ��D«#¿��(Ñ��³¤�¤(�e¨;¿�"ÑÝ1¡3�[¦q�Ô�¸«N�­¤;«(�V¤D½2¬3�(�ºèr�D«(¤;«e¨�µº¤;¥N¦¾é2¡3�¾½c�h¡3�h�[¦�½c¤;¡�¥N¦°�¾½â¥e§���£x¦3²¾¥N¦3¦B£f¤;«N¦¶�D«N�O¦°¥(®;®;�[¦q¬q£f¤;«N¦�Ñ�Ý��e£x¦Ù�N�D�N�h¡�e�[¦3²¾¡q£fÖ8�[¦V¡w�[¦q�[�D¡²w���e¤;«(��ª�£f¬3�e£f«á¬3�(����h«e¬3�h¡�½c¤;¡VÚ룱¤¸§±¤�®D£x²h�z§Þ�D«N���¤;µ��(¥(¬�¸¬q£f¤;«N�z§� ��[�D¡3«e£f«(®³£f«�¬3�(����h�N�D¡3¬wµ��h«�¬¶¤¸½ÞÚ&¡�z£f«��D«N���¤�®;«e£f¬q£f¢;����²w£f�h«N²¾�[¦��D«N�$�D¬¶¬3�(�ºåQ¡3¬°£��J²w£x�z§�Ò=«e¬3�¾§y§y£±®��h«N²¾�� #�DÖN¤�¡�D¬3¤;¡w¨Ô�D¬�³ÒrݶÑ8Ý��e£x¦�¡3�[¦q�[�D¡²w�­£x¦Q¦°�N¤;«N¦q¤�¡3�[�OÖe¨O®;¡�D«e¬¦&½c¡3¤;µG¬3�(����� ²¾�,¤D½�öQ�z¢`�`§�Ø��[¦q�[�D¡¾²3�$¥(«N�e�h¡¶²¾¤;«�¬w¡�;²¾¬¦ö����������Ü���hÜ��DÜ��� "!�#O�D«N�lö����������Ü���$DÜ��DÜ%�&!�'(�)�Ö�¨l�³®;¡�D«e¬,½â¡w¤;µ ¬3�(� ö��D¬q£f¤;«N�`§*��²w£f�h«N²¾��Û(¤�¥(«N�(�D¬q£f¤;«¥(«N�e�h¡V²¾¤;«e¬3¡�;²¾¬�å+��Ü���$�,',�,���"è=ªÙ�e£É²w�³£f«N²w§±¥N�e�[¦�½c¥(«N�(¦�½c¡3¤;µ-��å¶Ø�î8å��(¡w¤`¢�£x�e�[�³¥(«N�e�h¡V¬3�(�"êQî./�(¡3¤;®�¡�DµOéÑ0�;¥(�(�N¤;¡w¬�½â¤;¡2¬w�(��å�Ñ ÒÑ� #�DÖ8¤;¡�D¬w¤;¡3¨�ìí¦p�¸¡3¬q£1�J²w£x�z§N£f«e¬3�¾§y§õ£f®;�h«N²¾�¶¡w�[¦q�[�D¡²w�,£É¦ë�(¡3¤D¢;£x�e�[�ºÖ�¨2�QöQز¾¤;«e¬3¡�;²¾¬Vö������3���;Ü���hÜ��¸Ü4�5�� �!(Ñ­Ý#¤�µ��;¦q¤»î�¤;®�®D£f¤O£x¦"¦q¥(�(�N¤;¡w¬3�[��Öe¨$¬3�(�76Ù«N²h�;¦"�D«N�áê��¾§f�h«á�ç�e£f¬�¸¼;�h¡��N�z£f¡Q�¸¬�¬3�(�¶� �e£f¬�D¼;�h¡8&¤D§y§±�h®��;¿9�$�;¦3¦w�;²3�e¥N¦q�h¬3¬¾¦�ÒB«N¦q¬q£f¬3¥(¬3�¶¤¸½ëÝ1�[²3�(«(¤¸§±¤�®;¨;Ñ

�C�

Page 38: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

-���� � ��� � ���

� � �O�z�����J������� � ������ �������O���� $�S� � �� �� ��������M� �� ��D������������J�7�� ��J�����M� ���� � ����

w��_1`%&4$��(9������?@��(N���� �?>/C��a�pQ�R 21`%' 7 21F�_����5C6F<T%'��?>���&-�(9/0<>63 �?>/C��/�;^ 213�:%�G3G3�2/�E!?>B�%� 2?@/C��G3��/CI3<@��B?T( �13�u;A63�.�� �?>/0�� �1.%' �B�?@�3?>BS?>�W��(^%J��/$(N z;A6F�.�� 2?@/C�.%�<+/';� 213�u;A/0<><>/�*7?@�35�;A/C��B

9 5 �B7 � /�" ���a & "8: � a �#"����=<?>A@ 3;5 �B7 a�{m�Q�

*713�����O 213�:(9BH/$/C 21F�3��(2(�;A6F�.�� 2?@/C�.%�< 3;5 �B7 ?T(50?>4$���HIL"365 �B7 � � � � �(C �� arC'� <�� arC'� C

\13�J�.�)(N _ ����2BYB���%0(963����(z �13�H-L?T(N )%'�`���JI.�� N*������ �13�S-3%� )%�%��.-� 213�S-L�&(9?>����-�(9/0<>63 �?>/0� � V%'�`-� 21F��(N����/0�.-� ����2B�B���%0(963����( 213�:��/m(9 �%0(2(9/!�W?T%' ���-�*7?> �1� 213�:-L��4!?T%� 2?@/C��;A�2/0B�(9B�/$/0 213�F��(2(W[�3/C��%�*7?T-L����<T%0(2(J/';O;A63�.�� �?>/0�.%'<K( 3 �13��(N/C<@63 2?@/C�.(]/�;: 213��B�?@�3?>BS?>��%' �?>/0��G3�2/0I3<>��B aA{$�$��%�<><1.%�4$�7 21F�u(�%'B��;A/0�2B�[���-L�� )%�?><@��-J%'�.-J�2?@5C/0�2/C6`(-L����?>40%' �?>/0�]/�;+ 21F�u(N/C<>6F 2?>/0�]/�;+ �13�l40%��2?T%� 2?@/C�.%�<G3��?>�.��?@G3<>��%C(�(9/!��?K%' ���-_*7?@ 21O��P$6.%' �?>/C�SaA{$�Q�=?T(r/063 )(N?T-L�^ �13�R(2��/0Gn�R/';F 213?K(rG.%'G.����[#w��^G3�2��(N���! +13���2�%�(N?>B�G3<@�:-L���2?@40%' 2?@/C��%��.-��2��;A���u 213�:�2��%0-L���u �/� 21F�S��63�2�����! l<@?> 2���)%' �63�2�O;A/C�u �13�JB�%� 213��BM%' 2?K��%'<-L�� Z%'?@<T(ua�w�%'1!I.%!V+e�fCf0oLh+s�%0-L"F��1�%��.-�ª���<T(N/C�+V=e�fCf0oLh+t�"L�+V+e�fCg$}C�)[

w �^�.�)(N #�F/C 2?K���^ 21.%� �V$-!��G.���.-L?@�35l/0�J 213�R�)13/C?K���^/'; � VC �13��;A6F�.�� 2?@/C�.%�< 3;5 �B7 ��%'�:1.%�4$�%7�3/0�3���B�GF 9"J�!63<@<�(9G.%0���$V.%'�`-� 21F���2��;A/0�2�O 21F���2�O?T(�%S�����2 Z%'?@���W<T%C(�(/';�;A6F�.�� 2?@/C�.(7 21`%' j%'�2� ¤ ?@�L4!?T(N?>I3<@��¥ 2/�?@ �[J\+/���/0G.�]*7?@ 21� 21F?T(uG3�2/0I3<>��B *���`�)(9 :-L�W�.�3�H%'����PQ6F?>40%'<@���.���:�2��<K%' 2?@/C��%�B�/C�35U%�<><� �13�;A63�.�W 2?>/0�.(7 21.%� O-L?��=���7;A/C�j%'����<>��B����L ^/';¡ 213�:�L63<@<�(9G.%0����/�; 3;5 �87 [7\1F����*R����E!G3�2�&(2(7 213�O�.�)(N 2���2B /�;D9 5 �B7 ?@�� 2����B�(�/�;� �13�:�`/063�2?@���7 2�Z%'�.(�;A/C��B /�; � �

� a ����� � � � �(C �� aqC'� � " � � /CIF )%'?@�3?>�F5] �13�u;A63�.�� �?>/C�`%'<

9 5 ��B7 � /�" ���

� & " : � � � �(C �� aqC�� � " � � � < >A@ � � � �(C �� arC'� <�� aqC'� C

\13����*R�_�F/C 2?K���O 21.%� �(9?@�.��� � ?K(�2��%�<�V!?> )(7�3/063�2?@���7 2�Z%'�.(�;A/C�2BY(�%' 2?K( �.�&( 213�:��/0�.(9 ��)%'?@�L

�� � aqC'��� �� a :�C'�� �[ÿ�ûBú�>,ü$�yú-,qú 7 �5��63�$� 7 ý 7 ú���� ��þ 7 ý �[þ"ý���� 7 ù;þ , ���;û 7 ý � 7 û 7 ù�ý 7 ý�ü;üeþýhÿ�ú�� 7 ù;þ58Dþ��&�;ú 7 ú���� � 6 7 ù�þ �1.;ÿBúõþwÿ

7 ÿqý��;û 6!�[ÿ4> 7 ��2eþ�þ��+.�ý � 7 � 4 '

�Q}

Page 39: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

(9/S 21`%' � 213�u;A63�.�W 2?>/0�.%'<���%'��I.�_����*7�2?@ 2 ����U%C( 9 5 ��B7 � /�

" ���� & " : ����� �(C �� arC'� � " � � � < >A@ � ��� �(C �� a :"C'� �� aqC'��� aqC'� C

����/0�)-L���j 2/]�.�`-� 213�JB�?@�3?>BJ6FB /';R 213?K(z;A63�.�W 2?>/0�.%'<�*�� Z%'8$�:?> )(;A63�.�W 2?>/0�.%'<¡-L���2?@40%' 2?@4$��(*7?> �1�2�&(9G.���� 7 �/ �� %��.-�(N�� 7?> 7 �/]�����2/� �

9 5 �� 7��� a C� �xo � �(�* , C a�{0{L�

w��J�3/�* G3��/!������-� 2/U��/0B�G363 ��� 21F��;A63�.�� �?>/C�`%'<R-L����?>40%' �?>4$��(7/';, 213���.�Z(9 :%'�`- (N����/C�`-® ����2BY/';9 5 ��B7 [^�`/0�7 213�u�.�Z(9 � 2����B�*R�O1.%�4$� ��

�� a C�/�" � �

� & " : � � � �(C �� aqC'� � " � � � <��p /�

" ���a%& " : � a � " ��� ����� �(C

��� aqC����� a 0� � " � � �

�¯p /�" ���

a & "8: � a �#"���� � � � �(C�aqC�:�0� � " � � �

��p /�" � �

a & " : � a � " ��� � " � � � ��3/C�� 213�:(9BH/$/C 21F�3��(2(�;A6F�.�� 2?@/C�.%�<+*�O1.%�4$� ��

�� a C� � � � �(C �� a :"C'� �� arC'��� aqC'� � p � � � �(C �� a :�C'��� arC'���� aqC����� a 0�

��p � � � �(C �� a :"C'��� aqC'��aqC�:C� � p �� a : C��� a C� C

Fu(N?>�35J �13��(9�O����(963<@ )(*R����%'���3/�* *7�2?@ 2�u�&PQ6.%� 2?@/C��aA{C{!�7%0( /�" ���a%& " : � a � " �2� � " � � � �?>1@�� a : C��� a C� ��o C

� 1.%��35C?@�35 :?>��: :%'�.-�B]63<@ 2?@G3<>"!? �35OIL" �� a C�^/C�UIn/0 21�(9?T-!��(/';^ �13?T(�&PQ6.%� 2?@/C��*�O5C�� �� a C��� �� a : C� /�" ���

a%& " : � a � " �2�@ � " � � � � C

�Cg

Page 40: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

w �O�3/�*D-!���.�3�O 21F���W/$�$#��W?>���! )(

� " �a%&�"8: � a �#"��2�

@ � �De $ C�C�C $ � $

%C(�(963BH�u 21.%� �� ?T((N"LBHB��� 2��?T��a�(9/J �1.%' R?> Z(�3/C63��?>���R 2�Z%'�.(�;A/C�2BX?T(�����%'<A�)VF%'�.-� )%�8$�u 21F�O�3/C63��?>��� 2�Z%'�.(�;A/C��B /�;� �13�O<T%0(9 ���PQ6`%' 2?@/C�+V!/CI3 Z%'?@�3?>�35

� a ��� � /�" � � � "

�a �#" :���� � � a ��� � /�

" ���'� " � a ��: �#"A� Cw��7�3/�*�������%�<><$ 21`%' ^*�R1.%C-J-L�W�.�3��-J%0(#��P$63?>40%'<@���! �%�<><! 213�;A63�`�� 2?@/C�.(�-L?��=����?>�35jIL":%l ����2B� 21.%� <>?@��(#?@�J 213���L6F<><.(NG.%C���7/�; 365 �B7 V!%'�.-J 213���2��;A/0�2�7 21F�lB�/m(9 �50���3���Z%'<.(N/C<@63 2?@/C�S/';+ �13��B�?>�3?@B]?@��%' �?>/0�G3��/CI3<@��B ?T(

� a ��� � /�" ����� " � a � :��#"T�#> � a ���

*713����� � a ���R?T(�%] 2����B� 21.%� l<@?>��(7?>�U 213�:�L63<@<�(9G.%0����/�; 3;5 �87 V3 �1.%' u?K(l%H(9�� �/';^G./0<>"!�3/CB�?K%'<K(,;A/0�B�/m(9 7�W/CB�B�/0���)13/C?K����(�/�;^(N )%�I3?><@?>����� 3;5 �B7 [

� � �������®��� �J�^����� �� � �������S� �+��� � ����� � � ������J�7�� )��������M� ���O�����]���

� /C�`(9?T-!���u 21F��G3��/CI3<@��B�/';,%'G3GF�2/�EL?@B�%' �?>�35S%��'�c-L?>B����.(9?@/C�.%�<r4$���� �/C�7�.��<K- +Ra ����;A�2/0BY%�(9�� j/';(9G`%'�)(N��-3%� )%!V 213����EF%'BHG3<>��(WV#*713?K��1�%��2��G`%'?>�Z(�a �#" $ +#"T�_;A/0� � � e $ C�C�C $ � [ � 13/$/m(9��% � Y[Z �Y[]jedfb�¢;Yk ¦ Y=g(o(dfj(][b�¢`je\qbc_(Z�§­Yh\c¨�_(]2© %C(O 213�H%'GFG3�2/�E!?>B�%� 2?>/0��(2�)13��B��mVr 21.%� O?T(�V�%��3�� N*/0�28�*7?> �1/C�F� ¤ 13?T-3-!���.¥�<T%�"$���j%'�.-�<>?@�3��%��u/C63 �G363 O63�3?@ )(W[ � /C�.(N?T-L���u 213�H��%0(9�J/'; ����E3%�B�G3<@��(�V��� ������! 2���)(�V�?>�3GF63 J-L?@B����.(N?>/0�.%'<@?> N"��%��.-�/C63 �G363 S-L?@B����.(N?>/C�`%'<>?@ N"���a�(N���]�.5063�2��}C�Z[�\13���� �13�%'GFG3�2/�E!?>B�%� 2?>/0��?T(

+Ra ��� � ��� ��� < � � a � :� � � a�{m�Q�

*713����� � ?T(] �13���)13/m(9���xI.%0(9?K(M;A63�.�W 2?>/0��%'�.-� 213����/$� #���?@���! )($< � %'��� �F/'*��'�c-L?>BH���.(9?@/C�.%�<4$���� �/C�Z(� �< � �Da � �� $ C�C�C $ � �� $ C�C�C $ � � �Z[�l�����O*�:%C(�(963B��mVL;A/C�O(N?>B�G3<@?T��?  N"$VC �1.%' � ?T(7Gn/m(9?@ 2?>4$�:-L�W�.�3?> ��O?>��/0�)-L���l �/�%�4$/C?K-� �13�O�3����-�/';%C-F-L?> �?>/C�`%'<�G./C<@"L�F/CB�?K%'<� 2����B�(z?@�� �13�JG3�2��4L?@/C6.(l�&PQ6.%� 2?@/C�+[ �^PQ6.%� 2?@/C��a�{$�$����%�� I.�J�2��*7�2?> � 2���?>��B�%� 2��?>EJ�3/0 )%' �?>/0��%C(�¾ø2ù;þ�, ��>Vü&���;þ?� 7 û=��6óý �;�1. 7 ü�. 7 %[þ , 7 �zÿ=�2ú���� 2eþ�ý�����ý �Dû=8Dþ?�$� 7 þ.8 2 �¶û .;üeþ3ÿ=û�,qÿ=úyü 7 # *[ÿBþ3þ��"ú���8Dú-,qþ3û�'

�Cf

Page 41: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

+a ��� � � W#a ��� a�{m�Q�*713����� �13�^B�%' ��2?>E � ?T(�-L���.�3�&-_I!"Ja � � � � � � � �� %��.-OW�?T(+ 21F�4$���� �/C�+*7?@ 21���<>��B����L Z(£arW#a ���2� � �� a ��:� � �Z[��u(�(963BH?>�35FV';A/C�R(9?@B�G3<@?T��?@ �"$V� 21`%' ^ 213���2�7?T(��3/O�3/0?T(N�l?@�J 213��-3%� )%Sa� 21`%' ^?T(���P$63?>40%�<>���! 2/d��1F/$/$(9?@�35 @ �xo�?@�� 21F�l����5C63<K%'��?>��%� 2?>/0�];A63�.�W 2?>/0�.%'<�a2e��2�)V! 213�j��PQ6`%' 2?@/C�.(�;A/C�7 �13�u�W/$�$#��W?>���! )(< � ��%'��I.�_;A/063�.-�?@B�G./$(N?>�35: 213�O?>�! 2���2G./C<K%' 2?@/C�U��/0�.-L?> �?>/0�.(

+ " � � W�a � " ����L ��2/!-L6`��?>�35J �13�u;A/C<@<>/�*7?>�35J�F/C )%� 2?@/C��

a��J� "� � � & � a � " � $ a � � � � � � � �� $ a � � � � " � � a � " :� � �

21F�_BM%' 2��?>ES/';¡��/$�$#M��?>���L Z( � ?T(50?>4$���HIL" � ��� � � C

*713����� � � ?K(_ �13��G.(N��6.-L/0?>�!4$���)(N��/'; � aci#���3��/$(9�mV7e�fC�0�Lh7��<>I.���2 �V7e�f$}�pQ�Z[ � 6FI.(9 �?> 26F 2?>�F5� 213?K(��E!G3�2�&(2(9?@/C��?>����P$6.%� 2?>/0��a�{$�$�)V. 213�u;A/0<><>/�*7?@�35���E!G3����(2(N?>/C��?K(/CI3 Z%'?>�F��-

+Ra ��� ��� � � W�a ��� C�z;A ����7(N/CB��:%'<@5C��IF�)%'?K�lB�%��3?>G36F<T%' �?>/0�.(�V! 213?K(��ELGF�2��(�(9?>/0�U��%'�UIn�O����*7�2?@ 2 2����%0(

+a ��� � /�" ���

� " a ��� + "*713�����7 213�7;A63�.�W 2?>/0�.( � " a ���)V­ �1.%' ¡%'�2�� 21F�7��<>��BH���L Z(r/';v 213�74$���W 2/C� � a ���)V$-L��Gn���.-�/0�] �13���)13/$(N���� V.%C���W/C�)-!?>�35S 2/

� a ��� � � � W#a ��� C\13������;A/C���$V+?> l;A/0<><@/'*�(JaA 213/0635C1�?@ u?T(u�3/0 :(9/�*R��<><�8!�3/�*7�r�� 21.%� � 21F�J4$���� 2/0�l�.��<K- +Ra ���,?T(u%�G3�G3��/'E!?>BM%' 2�&-�I!"� 21F�_�F�� N*/C��8�%C(7 21F�_<@?>�3�&%'�7�W/CBSI3?>�.%� 2?@/C��/�;� �13�O��E3%�B�G3<@�z�.��<T-3( + " [

\1L6`( ^`_(]�j(Z�| ih�J_(bcizY�_w^�\��#Y�]hY=g(o(dfj(]zb�¢`je\rbc_(Z�Z#Yh\�¨�_(]Z©@j(Z�k©j(Z�|ßi��J_(bcizY�_w^�\��#Y � nJ_�~`b�\rb���Yk8Y�uQZJb�\wY � {hj�~`bÉ~2^`oNZ�iz\rbc_(ZÓ\c�#Y­Y¾~[\rbcmOje\3Yk³_(o(\Énpo(\��Yiz\r_(]"bÉ~ãjed ¨�j(|¸~ãjOdfbcZ1Yj(]"ih_(mO{DbcZJje\qbc_(Z�_w^V\��#Y_(o(\Énpo(\,Y ��j(m,n#d�Y��;Yiz\q_(]¾~d¨�b�\c�lih_eY�� iDbBY�Z8\�~ � \��Jje\Õk8Yqn#Y[Z�k�_(Zá\��#Y�bcZ;npo�\��Djed±oóY [,\13�O�2��(N63<> 7?K(40%'<@?T-�;A/0��%'<><=�3�� N*/0�28F(�*7?@ 21�/0�3�O13?T-3-!����<T%�"$���R%��.-�<>?>�F��%'�R/C63 �G363 )(WV3G3�2/�4!?T-L�&-] 21.%� 7 213�jB���%'�(2P$6.%��2�O���2��/C�j���2?@ 2����?>/0��?T(6.(N��-];A/C�� 2�Z%'?>�F?>�35F[

{$o

Page 42: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

a�%$�

00.5

1

0

0.5

1

0.2

0.4

0.6

0.8

1

00.5

1

0

0.5

1

0.2

0.4

0.6

0.8

1

a�Ir�

00.2

0.40.6

0.81

0

0.2

0.4

0.60.8

1

0

0.25

0.5

0.75

1

00.2

0.40.6

0.81

0

0.2

0.4

0.60.8

1

0

0.25

0.5

0.75

1

a���� 0.2 0.4 0.6 0.8 1

-0.2

0.2

0.4

0.6

0.8

1

a�-n� 0.2 0.4 0.6 0.8 1

0.2

0.4

0.6

0.8

1

1.2

aA�C� 0.2 0.4 0.6 0.8 1

0.2

0.4

0.6

0.8

1

�#?@5C63����e �ac%Q��\1F�JB]63<@ 2?KPQ6.%0-L�2?K�z;A63�.�W 2?>/0��a�Ir�z�l����P$63?>40%'<@���! 78$���2�3��<£;A/0�u 213�JBS63<@ 2?TP$6.%0-L�2?K�I.%0(9?T(;A63�.�W 2?>/0��?>�� 213�:��%0(9��(/�;^ N*/0��-L?@B����.(N?>/0�.%'<.��P$6.%'<@<>"H(9G.%0����-�-3%� )%L[ja��CVF-rV3�C�R\13�O��P$63?>4!�%'<@���! _8$���2�3��<K( � � V � %'�.- � � V£;A/C�O�3/0�L6F�3?�;A/0�2B /C�F����-!?>B����`(9?>/0�.%'<�B]63<@ 2?KPQ6.%0-L�2?K�u?>�! 2����Gn/0<T%� 2?>/0�a�(N���O 2��E! �;A/0�l��ELG3<K%'�.%� 2?@/C�r�Z[

{3e

Page 43: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

-0.4-0.2 0.2 0.4

0.1

0.2

0.3

0.4

0.5

-0.4 -0.2 0.2 0.4

-0.4

-0.2

0.2

0.4

-0.4-0.2 0.2 0.4

0.2

0.4

0.6

0.8

1

a b c

�#?@5C63���up ^%Q�^��I.(9/0<>63 ��u40%'<>6F�lI.%0(9?K(�;A63�.�� �?>/C�vV � V$Ir� � ?>5CBH/C?T-F%'<>�A<>?@8$�I.%0(9?K(¡;A63�.�W 2?>/0� � � a��r�����kj%'6.(�(9?K%'�3�A<>?@8$�_I`%C(9?K(,;A6F�.�� 2?@/C� � � a��r�

0.2 0.4 0.6 0.8 1

-1

-0.5

0.5

1

0.2 0.4 0.6 0.8 1

-1

-0.5

0.5

1

0.2 0.4 0.6 0.8 1

-1

-0.5

0.5

1

a b c

�#?@5C63����� H�lG3G3��/'E!?>BM%' 2?@/C��/�;O(N?>�+acp�� �r�u6.(N?>�35�g�I.%C(N?T(_;A63�`�� 2?@/C�.(�/�;u �13��%Q��%'I.(N/C<@63 2��40%'<@63� N"LG.�$V!Ir� � ?>50B�/C?K-3%'<@��<@?>8$�7 N"LG.�$VF%'�.-U�'�7kj%'6.(�(9?K%'�3�A<>?@8$�_ N"!G.�$[

{$p

Page 44: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

-1-0.5

00.5

1-1

-0.5

0

0.5

1

-0.50

0.5

1

-1-0.5

00.5

1-1

-0.5

0

0.5

1

-0.50

0.5

1

-1-0.5

00.5

1-1

-0.5

0

0.5

1

-0.50

0.5

1

-1-0.5

00.5

1-1

-0.5

0

0.5

1

-0.50

0.5

1

00.2

0.40.6

0.810

0.2

0.4

0.6

0.8

1

-10-505

10

00.2

0.40.6

0.810

0.2

0.4

0.6

0.8

1

-10-505

10

b c

a

�#?@5C63����{��%Q�d\13��;A63�`�� 2?@/C�� �/�I.��%�G3G3�2/�E!?>B�%� 2��-�=a��6$ &`�Z[�Ir�d�u-3-L?@ 2?>4$�Uku%�6.(2(N?T%��xB�/!-L��<%'GFG3�2/�E!?>B�%� 2?>/0��/'; �=a �#$'&3�7a�BH/!-L��<+�$�)[R�'�7kjylªD�lGFG3�2/�E!?>B�%� 2?>/0�]/�; �=a��#$'&`��aAB�/!-L��<={L�Z[

{$�

Page 45: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

X 1 Xn

. . . .C1 C 2 Cn

I I I I

�#?@5C63����� ����?@B�G3<@��B]�W�! )%' �?>/0�]/�;� �13���3/0�2B�%�<>?@����-J�)%C-!?T%'<+I`%C(9?K(,;A6F�.�� 2?@/C�U(2�)13��BH�$[�� ¤ G./$/C<T¥����<@<+a�-!/C 2 ���-S��?>�Z��<>�C�v(96FB�B�%' ���(+ 213�j%C�� �?>4!?> �?>��(#/�;+ �13�l1F?T-3-L���]63�F?> )(^%��.-] 21F����-!?>4!?T-L��(� 213��/C63 ��G363 �/';` 213�^�3�� N*R/C�28=[�\13�7-!?>4!?T(9?@/C�OB�%�"�In�,%'G3GF�2/�EL?@B�%' ���-l?@��%7G31!"3(N?>/0<>/C50?T��%�<$?>B�GF<>��BS���! )%' �?>/0�I!"�(91!63�! 2?>�F5J?>�313?@I3?> �?>/0�+[

{C{

Page 46: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

Reg

ula

riza

tio

n n

etw

ork

s (R

N)

if ||x|| = 1

RBF Additive Splines

TensorProduct Splines

RidgeApproximationHyperBF

Regularization

RadialStabilizer

AdditiveStabilizer

ProductStabilizer

Movable metricMovable centers

Movable metricMovable centers

Movable metricMovable centers

Gen

eral

ized

Reg

ula

riza

tio

n

N

etw

ork

s (

GR

N)

�#?@5C63���u� � ��4$���)%'<`��<T%0(2(9�&(¡/�;�%'G3GF�2/�EL?@B�%' �?>/0�S(2�)13��B���(�%'�`-]��/0�2����(9G./C�`-L?>�35J�F�� N*/C��8J%��)�)13?> ������ 26F�2��(���%'�:I.�7-L����?>4$��-7;A�2/CBD����5C63<K%'��?>��%� 2?>/0�O*7?> 21: 213�,%'G3GF�2/CGF�2?T%� 2�,��13/0?T����/';v(9B�/$/0 213�F��(2(+G3�2?@/C�Z(%'�`-�%C(�(9/!��?K%' ���-�(N )%'IF?><>?@�����Z(%'�`-�I.%0(9?T(;A63�.�W 2?>/0�.(�V.(N13/�*7?>�35S 21F���W/CB�B�/0��b7%�"$��(N?T%����2/$/0 )(�[

{$�

Page 47: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

HH1

+ ++++

. . . . . .

. . .

. . . . . .

. . .

n

y y y1 2 q − 1 y q

X 1 X . . . d

�#?@5C63���z} +\13�^B�/m(9 +5C���3���)%�<C�3�� 9*R/C��8u*7?> �1_/0�3�^13?T-F-L���u<K%&"$���+%'�`-_4$���� �/C�=/C63 �G363 �[�ªl/C �?T���� 21.%� 21F?T(%�G3G3��/'E!?>BM%' 2?@/C��/�;^%JP$�c-L?>B����.(9?@/C�.%�<n4$�&�� 2/0�¡�`��<T-]1`%C(7?>��50���3���Z%'<n;A��*���RG.%'�Z%'B��� ����)(� �1.%'� 21F�O%'<@ 2�����.%' �?>4$�7�2��G3�2��(N���! )%' �?>/0����/C�`(9?T(N 2?@�35�/�; �_�3�� N*R/C�28F(�*7?> �1�/C�3����-L?@B����.(N?>/0�.%'<./C6F 2G363 Z(�[^��; 21F��/C�3<@" ;A�2����G.%'�Z%'B��� 2���Z(�%'���� 21F��*R��?>501L Z(�;A��/CB� �13��13?K-3-L����<K%�"$���� �/� 213��/063 2GF63 �a�%0(d;A/0�(9?@B�G3<@�Oylb7��*7?@ 21 � ��Vn*713���2� � ?T(7 213�O�!63B]I.���7/�;^��EF%'B�GF<>��()�� 21F�� N*/S�2��GF�2��(N���L Z%' �?>/C�`(%'���O��PQ6F?>40%'<@���L �[

{$�

Page 48: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

� � �O������� ��

5 e 7 �[ ��[!�l?T-L6H%'�`- Gd[ ª�[ GR%'G3�F?>8=[ �^(N 2?>BM%' 2?@/C�S/';�G3�2/0I.%'IF?><>?@ N"S-L���.(N?> N"]/0�� 213�uI`%C(9?K(/';� �13�B��� �13/!-_/�;�(N 2/!�)1.%C(N 2?T�7�2��5C63<K%'�2?@��%' �?>/0�+[ t �z\r_(mOje\qb�©�j»b��#Yhd�Y[m³Y2©`�Jj(Z�b�©�j V+a�{!� g'{'«QfQ}mV3�lG3��?><e�f0gCf![

5 p 7 ��[��l<>I.���� �[�¦ Y=g×]�Y¾~h~`bc_(Z©j(Z�kU\c�#Y } _;_(]hY�� � Y[Z�]_�~;Y � ~;Y[oNk(_(bcZ ��Y�] ~;Y [¯�u��%C-!��B�?T�Ji�����(2(WVªl��* �^/0�28=V+e�fQ}&pL[

5 � 7 t�[F�l<><@���+[�\13�u����<T%� 2?>/0�.(91F?>G�I.�� N*������40%'��?T%'IF<>�O(N��<>���W 2?>/0��%'�`-�-F%' )%S%'6F5CB����! )%� 2?@/C�H%'�.-%�B��� �13/!-];A/C�7G3����-L?K�� 2?@/C�+[ �#Yi��JZ�_(m³Yh\r][bci�~ V+e�� >e�p0�&«`e�pQ}mV^e�fQ}�{3[

5 { 7 ª�[!�l��/C�.(N��%'�N�+[^\13��/C�2"S/';��2��G3�2/!-L6`��?>�35J8$���2�3��<K(�[ �J]¾j(Z�~��#t�m³Y[]�� } je\c� �1�1_�i�� V.�CgC� �0�Q}�«{$o�{3V�e�f0�CoL[

5 � 7 t�[���[�b7%�<><T%��)-r[ � /C�� 2?K��%'<!��/0�3�3���W 2?>/0�.(+%'�`-�G`%'�)%�<><@��<CG3��/!����(�(9?>�F5��(N 2��6.�� 26F�2�^%��.-�;A63�`�� 2?@/C�+[a"Y�Jj �Dbc_(]¾jed�j(Z�k³aV]¾j(bcZ$�piDbBY[ZJizY¾~ V+f �Q}W«.e�p0oLV�e�fCg0�L[

5 � 7 ��[Fy_[.b7%��2�2/0�U%'�.-Ub7%'�2��/C��y_[.q�[ � Z%' �?T(9 �?T��%�<+<>��%��2�3?@�35J�3�� N*R/C�28F( ^%�6F�3?�;A"!?>�35J4!?>��*O[�����p|�m,n�_�~`bcoNm _(Zá\��#Y"v�Z8\wY�]â^`j(izY

��#\rje\rbÉ~[\qbci�~ j(Z�klX�_(m,npo(\qbcZ�g³�piDbBY[Z�izY Vry7��(9 �/C�+V Gj?>�250?>�3?K%LV

�lG3��?><�e�fCg0gL[5 } 7 ��[ y_[0b7%'���2/C�v[+�lG3G3��/�EL?@B�%' �?>/C�d%'�.-J��(N 2?>BM%' 2?@/C�JI./C6F�.-3(¡;A/0�R%'�2 �?��=�W?T%'<F�3��63�Z%'<.�3�� N*/0�28F(�[

\+����1F�3?T��%�<^y7��G./C�2 S�0fLV^tl��G.%'�� 2B����! u/�; � Z%' �?T(9 �?T��(WV?Fl�F?>4$���Z(9?> N"�/';j��<@<>?>�F/C?T(O%� �Fl��I.%'�.%��� 1.%�B�G.%'?@5C�+V � 1.%'BHG.%'?@5C�+V.�Nq�V.s�%'�Z��1�e�fCfLe0[5 g 7 ��[ y_[+b7%��2��/C�+[ Fl�3?>4$���)(2%�<^%'GFG3�2/�E!?>B�%� 2?>/0��I./C63�.-F(_;A/C�:(963G.����G./$(9?@ 2?@/C�.(�/�;j%�(N?>50B�/C?K-3%'<

;A63�.�W 2?>/0�+[ v � � � �J]¾j(Z�~`j(iz\rbc_(Zl_(ZAv�Z�^`_(][mOje\qbc_(Z����#Y_(][| V!�Cf!a��$� f0�Co�«!f'{m�LV�s�%�"�e�f0fC�![5 f 7 ��[ y_[0b7%'���2/C�v[+�lG3G3��/�EL?@B�%' �?>/C�d%'�.-J��(N 2?>BM%' 2?@/C�JI./C6F�.-3(¡;A/0�R%'�2 �?��=�W?T%'<F�3��63�Z%'<.�3�� N*/0�28F(�[

} j(ih�JbcZ1Y"s�Yj(][Z�bcZeg V=e�{ >eCe��&«`e��C�!V^e�fCf�{3[5 e�o 7 �7[3bu[Fb7%'63B�[^|��� �13�:��%'G`%'I3?@<>?> �?>��(�/�;^B]6F<> 2?@<T%�"C����G.���)����G3 2��/C�.(W[ � ��X�_(m,n#d�Y ��b�\r| V.{�@e�f0�&«

pLe��LV�e�f0gCgL[5 eCe 7 �7[ bu[�b7%'6FB�%��.-�t�[��u%'6.(�(9<@����[�wx1`%' S(9?@���S�3�� �50?>4$��(O40%'<>?K- 5C���3���)%�<>?@��%' �?>/C� � §�Y[o8]jed

X�_(m,npo(\qje\rbc_(Z V+e @e��!e�«.e��Co!V�e�f0gCfL[5 e�p 7 yO[ �7[$b��<@<>B�%��+[ t�k(jzn#\qb���Y�X�_(Z8\r]¾_ed � ]_;izY¾~h~;Y¾~ [=i¡��?>�.�W�� 2/0� Fl�F?>4$���Z(9?> N"Oi�����(2(WV3i��2?@�.���� �/C�+V

ª �3V=e�fC�!eC[5 e�� 7 s�[!b���2 ����2/F[�yz��5063<T%��2?@��%' �?>/C�HB��� 21F/!-3(¡;A/0�<>?@�3��%��?>�!4$���Z(9�7G3��/CI3<@��B�(�[v� � � [nk:[3\�%'<@���L �?�V

��-L?@ 2/0��V v�Z ��Y[]¾~;Y � ]¾_({zdxY[mº~ [ � G3��?>�350���2�HG^���2<K%'53V.b���2<>?@�+V.e�f0gC�L[{L}

Page 49: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

5 e�{ 7 s�[�b���2 2���2/3V�\u[�i�/C5C50?>/FV$%'�.-�GJ[�\+/C���2�$[!��<><@��G./m(9��-uG3��/CI3<@��B�(n?@�O��%'��<>"�4L?K(9?>/0�+[�� ]¾_;izYhYk(bcZeg;~_w^�\c�#Y"v � � �RVr}�� gC�0f&«!g0gCf!V�e�f0gCgL[

5 e�� 7 q�[:b/C 2 �/C6 %'�.- GJ[ GR%�G3�3?>8=[ qr/!��%'<�<@��%'���3?>�F5 %�<>5C/0�2?@ 213B�(W[ §�Y[oN]¾jedÔX�_(m,npo�\rje\qbc_(Z V{3ac�Q� gCg0g&«QfCoCo!V+ªl/�4$��BSI.����e�fCf0pL[

5 e�� 7 q�[�b�2��?@B�%'�v[��l?@�35C?@�35�1L"!G.���2G3<K%'�3�&(�;A/C�:�2��50�2��(�(9?@/C�+V���<T%0(2(9? �=��%� 2?>/0�+V�%��.- ;A63�.�� �?>/0��%�G3�G3��/'E!?>BM%' 2?@/C�+[ v � � � �J]¾j(Z(~`j(iz\qbc_(Z/_(Z v[Z�^`_(][mOje\rbc_(Z ���#Y_(]z| Vu�0fLa��$� fCfCf�«.e�oLe��3VSs�%�"e�f0fC�![

5 e'} 7 t�[ � [Cb��/$/CB�1F��%C-:%'�.-Jt�[0qr/�*�$[.s�6F<> 2?@40%'�2?K%'I3<@��;A63�.�� �?>/C�`%'<!?>�! 2����Gn/0<T%� 2?>/0�J%��.-J%C-3%�G3 2?@4$��3�� N*R/C�28F(�[ X�_(m,n#d�Y �»�p|¸~[\3Y[mº~ V.p �Cp!e�«Q�C�C�!V�e�f0gCg![

5 e�g 7 s�[ t:[+b6313B�%��3�+[�s�63<@ 2?@4C%��2?K%' 2�S��%'�)-!?>�.%�<?>�! 2���2G./C<K%' 2?@/C��*7?> �1��)%0-L?T%�<�I`%C(9?K(�;A63�`�� 2?@/C�.(W[X�_(Z�~[\r]zoNiz\rb���Y"tQn(np]¾_���bcmOje\rbc_(Z V.� pCp0�&«!p0�C�!V�e�f0fCoL[

5 e�f 7 s�[ t:[.b6313B�%��3�+[u|���PQ6.%0(9?@��?@�L ����2G./C<K%' �?>/C�U*7?> �1�yl%0-L?T%�<�b7%0(9?T(j�`6F�.�� 2?@/C�.(W[uªl6FB����2?K��%'<�l�.%�<>"F(9?K(uyz��Gn/0�2 Z(�t��us�i^\�e�f0fLe � ªu�u�!V^tl��G.%��2 �B����! l/�;j�lG3G3<@?>��-�s�%� 213��BM%' 2?K��(�%'�.-\13��/0�2�� �?T��%�<+i�1!"3(N?T��(WV � %'BSI3��?T-L50�$V����350<T%'�`-rV.s�%'�Z��1�e�f0fLe0[

5 pCo 7 ��[0b6C��%LVm\u[$�u%C(N 2?@�$V$%'�`-]yO[$\?>I`(913?@�)%'�F?�[.qr?>�F��%'�^(NB�/$/C �13���Z(�%��.-S%C-3-L?@ 2?@4$�B�/!-L��<T(�[ ���#Yt�Z�Z�jedí~O_w^��#\qje\rbÉ~[\rbci�~ V#e�} {$�C��«!�0�C�LV^e�fCgCf![

5 pLe 7 bu[ � %'G3��?><@�O%'�.-��[.k�?>�2/m(9?c[�� �3/0�.-L�� ����2BH?>�3?K(9 2?K�B�?>�F?>BS?>��%' 2?@/C�S%�<>5C/0�2?@ 213B�[���[ �)[Ls���B�/e�p0�'{FV��l�� 2? �=��?T%�<u���! 2��<@<>?@5C���.�W��q+%�I./C�)%� 2/0�2"$V:s�%C(�(2%C�)1!6.(9�� � )(����.(9 �?> �63 2��/�;H\£���)13�3/0<>/05C"$V� %'BSI3��?T-L50�$V!s���V � ��G3 2��BSI.����e�f0fCoL[

5 pCp 7 t�[ t�[ � /'E=[�s�63<@ 2?>40%��2?T%� 2��(9B�/$/0 213?@�35�(9G3<@?>�3��;A63�.�W 2?>/0�.(�[ ��vt } � ��§�oNm³Y[]��ºt�Z�jed�� VpLe �}&gCf&«QgLe��LV�e�fCg'{F[

5 pC� 7 i#[ � �Z%&4$����%��.-�k:[$w�%�1LI.%![ � B�/$/C �13?>�F5_�F/C?T(N"�-F%' )%O*7?> �1�(NG3<>?@�3�z;A6F�.�� 2?@/C�.(���(9 �?>B�%� 2?@�35 21F���W/C�2������ H-L��50�2����/';d(NB�/$/C �13?>�35�I!"� �13��B��� �13/!-�/�;O5C���F���)%�<>?>����-����2/m(2(J4C%�<>?K-3%' �?>/C�v[§ão8m³Y[]�� } je\�� V.�!e �$}C}W«${$o0�LV^e�f$}�f![

5 p'{ 7 k:[ � "!In���38$/3[��lG3G3��/�EL?@B�%' �?>/C��I!"x(N63G.���2G./$(N?> �?>/C��/';�%�(9?@5CB�/0?T-3%�<l;A63�.�W 2?>/0�+[ } je\c� �X�_(Z8\r]¾_ed#�p|¸~[\3Y[mº~��pbyg(Z�jedí~ Vrp!a�{L� �0oC�&«Q�LeW{3V^e�f0gCfL[

5 pC� 7 � [.-L�:b/$/C��[ t � ]¾j(i[\qbcihjed � oNbck8Y�\r_Ô�×n#dfbcZ1Y¾~ [ � G3��?>�350���2�HG^���2<K%'53V.ª���* �^/C�28=V+e�f$}�g![5 pC� 7 � [=-L�Jb/$/0��[ � 6.%0(9?@��?@�L ����2G./C<K%'�! )(�%'�.-�%�G3G3��/'E!?>BM%' 2?@/C��G./�*���u/�;^BS63<> �?>40%'��?T%' ��O(9GF<>?>�F��(�[

����s�[kj%C(���% %��.- � [ ��[�s�?K���)13��<><@?AV£�&-L?> �/C�)(WV X�_(m,npo(\rje\qbc_(Z)_w^ßX�o8] ��Y¾~Ój(Z�k��poN]â^`j(izY~ VG.%�5C��(��Le��&«!��{$�![+~u<>6!*���,�u��%C-!��B�?T��i�63I3<@?T(91F���)(WV3tl/0�)-L������1! �VFªl�� �13���2<K%'�.-F(�V+e�f0fCo![

5 pQ} 7 yO[utl��G^/0�2�$V:y_[O��/'*,%'�Z-rV�%��.- � [js�?T���)13��<@<>?c[ |�G3 �?>B�%�<_�F/C�3<@?>�3��%���%'G3GF�2/�EL?@B�%' �?>/0�+[} j(ZJo×~)©�][b n#\rj } je\c�#Y[mOje\rb�©�j V+e�f0gCfL[

{$g

Page 50: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

5 pCg 7 yO[ ��[!tl��G^/0�2�$[�tl��5C�����u/�;^�3/C�F<>?>�F��%'�,%'G3G3��/�EL?@B�%' �?>/C�v[���� � [ ~J[ � 1L63?cV3q�[ q�[ � ��1!63B�%�8$����V%'�`- t�[ �3[7w�%��)-rVu��-!?> 2/0�)(WV t�n(np]_���bcmOje\qbc_(Z ���#Y_(][|¸� � v VG.%'50��( e�}���«!pCo!eC[:�u��%0-L��B�?K�i��2��(�(�V.ªl��* ��/0�28=V+e�f0fLeC[

5 pCf 7 yO[ ��[�tl��G�/0�2�R%'�`-��J[ s�[ �^6+[Fªl/C�3<@?>�3�&%'�+�3�A*7?T-L �1.(#?@�Jb��(N/'4:(NG.%C���&(�[3��� � [ ~J[ � 1!63?cVCq�[ q�[� �)1L6FB�%'8$����V+%'�`-�t:[ �3[+w�%��)-rV^��-L?@ 2/0�)(�V t�n(np]_���bcmOje\rbc_(Z%���#Y_(][|¸� � v V#G`%'5C�&(JpCoC��«!p0oC�L[�u��%0-L��B�?K�7i��2��(�(�V.ªl��* �^/C��8rV=e�fCf!eC[

5 �Co 7 q�[ i�[rt���4L��/�"$�J%'�`- \u[ �3[nw�%'50�3����[:tl?K(9 2��?>I36F 2?>/0�3�T;A�2���d��/C�.(N?T(N 2���.�W"��2�&(963<@ )(l?@���3/0�3G.%'�Z%'�B��� ��2?K��-L?T(����2?@B�?>�`%' 2?@/C�O%��.-J�2��50�2��(�(9?>/0�_;A63�`�� 2?@/C�J��(N 2?>BM%' 2?@/C�+[ ���#Y�t�Z�Z�jed ~�_w^Q�#\rje\qbÉ~[\rbci�~ Vg pC�!e�«!p0�Cf!V�e�f0gCoL[

5 �Le 7 i#[=tl?K%C��/0�3?T(u%��.-�t�[r�3������-LB�%��+[u�j(9"!B�G3 2/0 2?K��(�/�;75C�Z%'G31F?T��%�<�G3�2/0�N���� 2?@/C�UG363�)(N63?> �[ ���#Yt�Z�Z�jedí~O_w^��#\qje\rbÉ~[\rbci�~ V#e�pLac�Q�  }�f0�&«!g!e��3V�e�fCg�{3[

5 �Cp 7 t�[ q�[rtl/0�3/C1F/�%'�.-��)[ s�[ �C/C13�.(N 2/0�3�$[�i��2/C�N���W 2?>/0�3�AI.%C(N��-�%'G3GF�2/�EL?@B�%' �?>/0��%��.-�%H-L6.%'<@?> N"*7?> �1�8$���2�3��<nBH�� 213/!-F(�[ ���#Y"t�Z�Z�jedí~O_w^��#\qje\rbÉ~[\rbci�~ V#e�}$a�e'� �Cg�«.e�o0�LV^e�f0gCf![

5 �C� 7 �3[�t�6.��1F/C�+[ � GF<>?>�F��BH?>�3?@B]?@��?@�35��2/C Z%' �?>/C�F��?@�L40%'��?T%��L S(N��B�?>�A�3/0�2B�(u?>� � /0I./C<>��4�(9G.%0����(W[����wD[ � �)13��B�GFGS%'�.-U~�[ �.��<><@����V$��-!?> 2/0�)(WV X�_(Z�~[\r]zoNiz\rb���Y�\c�#Y_(]z|O_w^�^`oNZ�iz\rbc_(Z�~à_�~,~;Y �;Y[]¾jed�Dj(][bcj({zd�Y¾~h��s�Yiz\qoN]�Y�§�_e\3Y¾~ bcZ } je\��#Y�mOje\qbci�~h�����e� [ � GF�2?>�F5C����� G^����<T%'5FV3b����<>?@�+V.e�fQ}0}$[

5 �'{ 7 ª�[+t�"L�+[S���! 2����Gn/0<T%� 2?>/0��/';z(2��%� 2 2���2��-�-3%' Z%�I!"��Z%C-L?K%'<�;A63�.�� �?>/0�.(�[S��� � [ ~J[ � 1!63?�V�q�[ q�[� �)1L6FB�%'8$����V$%'�`-��[ �)[ F� 2�2���)%C(WV3��-L?@ 2/C�Z(�V �J_znpbci�~»bcZlmOo(dy\rb��Dj(][bcje\wY jzn(np]¾_���bcmOje\rbc_(Z [F�u��%'�-L��BH?T��i¡����(2(WV.ªl��* �^/C��8rV+e�fCg$}$[

5 �C� 7 ª�[$t�"L�+[v� �! 2���2G./C<K%' 2?@/C�H%'�.-H%'G3G3��/�EL?@B�%' �?>/C�JI!"J�)%0-L?T%�<=%'�.-]����<T%� 2��-�;A63�.�W 2?>/0�.(�[v� � � [ ~J[� 1!63?�V.q�[ q�[ � ��1!63B�%�8$����V!%��.-�t�[ �3[3w�%��)-rV.��-L?@ 2/0�)(�V tQn(np]¾_���bcmOje\qbc_(Z©���#Y_(]z|D� � v V3G.%'50��(pLe0e�«QpC�'{F[+�u��%0-L��B�?K�li�����(2(WV.ªl��* ��/0�28=Vre�fCfLe0[

5 �C� 7 ª�[$t�"L�+V!�)[ yO[ �:[ �$%0��8F(9/0�+V3t�[!qr��4!?>�vV$%'�.-H��[$y7/C�+[�|��]BS63<@ 2?>40%��2?T%� 2�R%'GFG3�2/�E!?>B�%� 2?>/0�]I!"?>�! 2��5C���u ��)%��.(9<K%' 2�&(_/';z%�I.%0(9?K(�;A63�.�W 2?>/0�+[ � /0B�G363 ���� � ��?@���.����(j\£���)13�3?K��%'<¡yz��G./0�2 :gCg0�LVFl�3?@4$���)(N?> N"�/�;^wx?T(���/C�`(9?>�!«!s�%C-!?T(9/0�+V.ªl/�4$��BSI.����e�fCg0fL[

5 �Q} 7 ª�[7t�"L�+VOt:[lqr��4L?@�+Vu%��.- � [7y7?>GFG.%L[Xªl63B�����?T��%�<lGF�2/!����-!63�2��(];A/0��(N63�9;c%0�����. 2 �?>�35�/';(2��%' 2 ����2�&-�-F%' )%�IL"��)%0-L?T%�<z;A6F�.�� 2?@/C�.(W[ ��vt } � ���pi`b ���ó\qje\ �OX�_(m,npo(\�� V7}$acpQ� �C�0f&«Q�C�Cf!V�lG3��?><�e�fCg0�L[

5 �Cg 7 yO[ q�[ ��63I.%'�F8r[ �(n#d±bcZ1Yl�pmO_;_e\��JbcZeg j(Z�k�§�_(Z;n�j(]j(m³Yh\r]zbci ¦ Y=g(]hY¾~h~`bc_(Z V�4$/C<>6FB���fCo�/';�#\rje\qbÉ~[\rbci�~h�Q\3Y �;\r{h_�_'©`~Oj(ZJkÓmO_(ZJ_�g×]¾jzn��(~ [�s�%��)����<+tl��8!8$����V3b7%C(N��<�V=e�f0gCgL[

5 �Cf 7 yO[��3�)%��38$�$[ � ��%� 2 2���2��-�-3%� )%�?>�! 2����Gn/0<T%� 2?>/0��] ���(9 Z(�/';�(9/0B���B��� �13/!-r[©} je\c� �"X�_(m,n � V�Cg!a��$� >e�gLe)«!pCo0oLV^e�f0gCp![

{$f

Page 51: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

5 {$o 7 yO[L�3�Z%'�38$�$[�y7�������! ^%0-L40%'�.���&(?>�� �13�u%�G3G3��/'E!?>BM%' 2?@/C�S/';¡(963�N;c%C���&(¡;A�2/0B (���%' � 2������-�-3%� )%![��� � [ ~J[ � 1!63?cV�q�[ q�[ � �)1!63B�%'8$����V+%��.-��[ ��[ Fl 2�����)%0(�V#�&-L?> �/C�)(WV �J_znpbci�~AbcZSmOo(dy\rb��Dj(][bcje\wYjzn(np]¾_���bcmOje\qbc_(Z [F�u��%0-L��B�?K�7i¡����(2(WV.ªl��* �^/C�28=Vre�fCg$}$[

5 {3e 7 �3[ �:[^�`��?>��-!B�%'��%��.-�wD[ � 263�� 2��<@�$[�i���/C�N���� �?>/C��G363�Z(963?@ ]����5C����(2(N?>/C�v[ � _(oN]zZ�jedV_w^A\��#Yt�m³Y[][bcihj(ZA�#\rje\rbÉ~[\qbcihjed�tV~h~`_;iDbcje\qbc_(Z Vr}��Lac�Q}&�Q� gLe�}�«!g$p0�3V�e�f0gLe0[

5 {$p 7 ~J[.�363�.%'1`%C(91F?�[u|��� 21F�J%'GFG3�2/�E!?>B�%� 2�O�2��%�<>?@��%' �?>/C��/�;R��/C�! 2?@�L6F/C6.(7B�%'GFG3?>�35m(zI!"��3��63�)%�<�3�� N*R/C�28F(�[ §­Y�o8]jedr§­Yh\c¨�_(]2©D~ V=p >e�gC��«.e�f0pLV�e�fCg0fL[

5 {$� 7 \1+[Lkj%0(2(9���7%'�`-]��[ k:[$s �63<@<>����[ �^(N 2?>BM%' 2?@�35��2��50�2��(�(9?>/0��;A6F�.�� 2?@/C�.(^%��.-� �13��?@�^-L����?>40%' �?>4$��(I!"] �13�O8$���2�3��<rB��� �13/!-r[ �pihj(Z�k � � _(oN][Z ���#\rje\qbÉ~[\ � V�eCe @e'}me�«.e�gC�!V�e�fCg0�L[

5 {C{ 7 �)[ s�[.kl��<�;c%'�`-�%'�`- k�[ �7[ � 1F?><>/�4=[�� Y[Z#Y[]¾jedfb�¢;Yk"^`o8ZJiz\qbc_(Z(~�� � _ed �Q��� ]¾_zn#Y[]h\rbBY¾~�j(Z�k��&n �

Y[]je\qbc_(Z�~ [^�j��%C-L��B�?T�7i��2�&(2(�V.ª���* �^/0�28=Vre�f0�'{F[5 {$� 7]� [$k���B�%'�vV �z[mb?>���3���.(9 �/!��8=V�%'�.-JyO[0tl/C63�Z(2%� �[.ªl��6F�)%'<$�F�� N*/C��83(�%'�`-� 213�7I3?K%C( � 40%'��?T%'�`���

-L?@<>��B�BH%L[ §­Y[oN]¾jed�X�_(m,npo(\rje\qbc_(Z V3{ >e)«!�Cg!V#e�fCf0pL[5 {$� 7 �[lk�?@�2/$(N?�[�s�/!-L��<T(�/';S�3/0?T(N��%��.- �2/0I36.(N ���(N 2?>BM%' 2�&(�[���[ �)[Rs���B�/xe�pCg$}$VJ�l�� 2? �=��?T%�<

���L ���<><@?>50���.����q+%�In/0�)%� 2/C��"$V+s�%0(2(2%0��1!6.(N�� 2 Z(7� �`(9 2?@ 263 ��O/';¡\£���)13�3/0<>/05C"$V+e�fCfLe0[5 {L} 7 �[+k�?>�2/m(9?c[�|���(9/0B�����EL ����.(9?@/C�.(7/';,�)%0-L?T%�<�I.%C(N?T(z;A6F�.�� 2?@/C�.(j%'�.-� 213��?>�j%'G3G3<@?T��%� 2?@/C�.(l?@�

%'�� 2? �=��?T%�<r?@�L ���<><@?>5C���.���$[ X�_(m,npo(\3Y[] ~ } je\�� ��tQn(n#dfbci�� V.p�{3a�e�pQ� �!e�«!g0oLV^e�f0fCp![5 {$g 7 �[�kl?@�2/m(9?�[ y7��5C6F<T%'��?>��%� 2?@/C� �13��/C��"$V��)%0-L?T%�<�I.%0(9?T(�;A63�.�W 2?>/0�.(�%��.- �F�� N*/C��83(W[ ���

GJ[ � 13���280%C(�(98!"$V��3[ �:[.�`��?>��-!B�%'�+VF%'�.-���[3w����)1.(9<@����V3��-!?> 2/0�)(WV ��]¾_(m �#\rje\rbÉ~[\qbci�~ \q_�§­Y�o �]¾jed!§­Yh\c¨�_(]2©D~��Q���#Y_(]z|�j(Z�k � je\=\wY�]zZ ¦ Yih_hg(ZJb�\qbc_(ZàtQn(n#dfbcihje\rbc_(Z�~ [ � G3�2?@�35C����� G^����<T%�53V � 6FI3�(9���2?>�&(�V � /0B�G363 ����7%��.- � "F(9 ���B�( � ��?>���.����(WVne�fCf0�L[

5 {$f 7 �[7k�?>�2/m(9?O%��.- k:[7�l�3����<><@/C 2 �?�[�y�%' 2�&(]/';d��/0�L4$����5C���`����/�;J%�G3G3��/'E!?>BM%' 2?@/C��IL"� 2�Z%'�.(N�<T%� 2��(W[^��[ �)[!s���B�/He�p0gCgLV=�l�� 2?��n��?T%�<+���L ���<><@?>50���.����q+%�In/0�)%� 2/C��"$V+s�%0(2(2%0��1!6.(N�� 2 Z(l���.(N 2?> �63 2�/';¡\+����1F�3/C<@/C5C"mV+e�fCf0pL[

5 �Co 7 �[#k�?@�2/$(N?R%'�.-�k:[+���3����<@<>/C � 2?c[Jyl%� 2��(u/�;���/0�L4$����5C���`����;A/C�O�)%0-L?T%�<^I.%C(N?T(l;A63�.�� �?>/0�.(O%'�.-�3��6F�)%'<+�F�� N*/C��83(W[����Uy_[ �3[3s�%�B�B�/C�F�$VC��-L?@ 2/0��V t�]h\qb uQi`bcjedr§­Y[oN]¾jed.§­Y \�¨�_(]2©D~�^`_(],�(n#YhYi��j(Z�k � bÉ~`bc_(Z V3G.%�5C��(�fQ}W«.e0e��LV�qr/0�.-L/C�vV#e�fCfC�![ � 1`%'G3B�%�� � �u%'<@<�[

5 �Le 7 �[rk�?>��/$(N?�V=s�[ �C/0�3��(�V=%'�`-�\u[ri#/05C50?>/3[�i��2?@/C�Z(�V+(N )%'IF?><>?@�����Z(7%'�.-�I.%C(N?T(z;A63�`�� 2?@/C�.(7�3�2/CB�2��5C63<K%'�2?@��%' �?>/0�� 2/j�)%C-!?T%'<cVC 2���.(9/0��%��.-]%0-3-L?@ 2?>4$�R(NG3<>?@�3��(�[!��[ �)[�s���B�/�ªl/F[LeW{$�Co!V3�l�� 2? �=��?T%�<���L ���<><@?>50���.����q+%�In/0�)%� 2/C��"$V+s�%0(2(2%0��1!6.(N�� 2 Z(7� �`(9 2?@ 263 ��O/';¡\£���)13�3/0<>/05C"$V+e�fCfC�![

5 �Cp 7 �[Ck�?>��/$(N?3%��.-J\u[Ci�/C5C50?>/F[.ªl�� N*/0�28F(+%'�.-� �13�I.��(N ^%'G3GF�2/�EL?@B�%' �?>/0�_GF�2/CG.���� N"$[ aVbc_edf_hg(bcihjedX�|e{zY�]zZ1Y \qbci�~ V.�0� @e��Cf�«.e�}��LV^e�fCfCo![

�Co

Page 52: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

5 �C� 7 �[lk�?@�2/$(N?�Vj\u[7i#/C505C?@/3VO%'�`- bu[ � %�G3�2?@<>�$[ �¡E! 2���.(9?@/C�.(�/';�%� 213��/0�2"�/';J�F�� N*/C��83(];A/0�%'GFG3�2/�E!?>B�%� 2?>/0��%'�`-�<>�&%'�2�F?>�35 �/C63 �<>?>���)(J%'�`-��3��5m%' �?>4$����EF%'B�G3<@��(�[�����y_[^qr?@G3G3B�%��3�+V�3[3s�/$/!-!"$Vr%��.-�t�[.\+/C63���� 2��8!"$V!��-L?> �/C�Z(�V tVk �`j(Z�izY¾~ bcZM§�Y[oN]¾jed�bcZ�^`_(][mOje\qbc_(ZOnp]¾_;izY¾~h~`bcZeg;~~`|¸~[\3Y[mº~�� V � %'��s�%� 2��/FV � ��V+e�fCf!eC[=s�/C�25m%'��~O%'6!;AB�%'�3�Mi¡6FI3<>?K(913���Z(�[

5 �'{ 7 k:[3kl/0<>63IvV3s�[!�l��%� 21+VF%'�.-�k:[$w�%'1!I.%L[^kl���3���)%�<>?@����-J����/$(2(^40%'<>?K-3%' �?>/0��%C(7%OB��� 21F/!-d;A/0��)13/$/$(N?>�35H%�5C/$/!-��2?K-L5C�OG.%��)%'BH�� 2����[ �1Yi��JZJ_(m³Yh\q][bci�~ V=pLe pLe��&«QpCp'{FV^e�fQ}&fL[

5 �C� 7 wD[ �z[vq�[#k��2?>BM(9/C�v[u� �W/CB�G36F )%' �?>/0�.%'<� �13��/0�2"�/';R4!?T(96`%'<^(N63�9;c%0���J?>�! 2����G./C<T%� 2?@/C�+[%� ]¾_ �izYhYk(bcZeg�~º_w^­\c�#Y ¦ _(|�jed��p_;iDbBYh\r|$_w^"s�_(ZJk(_(ZAa V.p0fCg �Cf0�&«m{$pQ}!V^e�fCgCp![

5 �C� 7 yO[ q�[!�u%'�Z-L����%��.-�yO[ s�[!tl��(NB�%'�Z%'?T(W[����! 2����Gn/0<T%� 2?>/0��6.(N?>�35d(963�N;c%C���:(9GF<>?>�F��(�[ � �1t�bc]iD]¾jw^[\ Vf @e�g0f&«.e�fLe0V�e�f$}�pL[

5 �Q} 7 wD[=���%'�Z-L<>�$[ tQn(n#dfbBYk�Z�_(Z�nJj(]¾j(m³Yh\r][bciO]�Y=g(]hY¾~h~`bc_(Z V.4$/C<>6FB��Se�f�/'; � ih_(Z�_(m³Yh\r]zbciO�p_;iDbBYh\r|} _(ZJ_�g×]¾jzn��(~ [ � %'BSI3�2?K-L5C� Fl�3?>4$���)(9?@ N"Si¡����(2(WV+e�f0fCoL[

5 �Cg 7 yO[ q�[��u%'�Z-L"$[Hs�63<> �?TP$6.%C-L��?T����P$6.%� 2?>/0�.(_/�;7 �/CG./C50�)%'GF1L"�%'�`- /C �13���O?>���2��5063<T%���(N63�9;c%0����(W[� � � Y_zn��J|¸~�� ¦ Y¾~ V.}�� @e�f0oC�&«`e�f!e��LV^e�f$}$eC[

5 �Cf 7 yO[ q�[R�u%'�Z-L"$[�\13��/C��"�%'�.-x%�G3G3<@?T��%� 2?>/0�.(�/';: 21F��B]63<@ 2?KPQ6.%0-L�2?K���AI3?>1.%��2BS/C�3?K�]B��� �13/!-r[X�_(m,npo(\wY[]¾~ } je\�� ��tQn(n#dfbci�� V+e�fLacg � f$� @e��C��«!p$o0g3V�e�f0fCoL[

5 �Co 7 \u[^�u%0(9 2?@��%��.-�yO[^\?>I.(N13?>�Z%'�3?c[ k����3���Z%'<@?>����-�%0-3-L?> �?>4$��BH/!-L��<T(W[ �ó\qje\rbÉ~[\qbcihjed¶�piDbBY�Z�izY Ve pCf$}�«!�!e�g!V�e�f0gC�L[

5 �Le 7 \u[=�u%C(N 2?>�:%��.-�y_[=\?>I`(913?@�)%'�F?�[uk����3���Z%'<>?@����-�%C-F-L?> �?>4$�OB�/!-L��<K( R(9/0B��:%'G3G3<@?T��%� 2?@/C�.(W[ � �t�m³Y[]����#\rje\qbÉ~[\rbcihjed�tV~h~`_�i�� V.gCp �Q}me�«!�0gC�!V�e�fCg$}$[

5 �Cp 7 \u[��u%C(N 2?@��%'�.-�y_[�\?>I`(913?@�)%'�F?�[ � Y�Z1Y[]¾jed±b�¢;Yk·t�k(k(b�\qb���Y } _�k8Y d ~ V#4$/0<>63B��J{m��/';�} _(Z�_ �g(]jzn��(~�_(ZÓ�#\rje\rbÉ~[\qbci�~ j(Z�k³tQn(n#dfbBYk � ]¾_({hj({Db�dfb�\r| [ � 1.%'GFB�%'��%'�.-��u%�<><�VFqr/C�.-!/C�+V�e�fCf0oL[

5 �C� 7 t�[+�j%'6.(�(9<>����[Jtl�&��?T(N?>/C�� 21F��/C���� 2?K�_5C���3���)%�<>?@��%' �?>/C�`(�/�;7 �13�Sir� � B�/!-L��<#;A/0�O�3��63�Z%'<��3�� %'�`-®/0 213���O<@��%'���3?>�35U%�G3G3<>?K��%' �?>/0�.(�[S\+����1F�3?T��%�<�y7��G./C�� �F �7��� � � ylqr�cfLeW��o0pLV�Fl�F?>4$���Z(9?> N"/'; � %'<@?�;A/0�2�3?K%LV � %��L Z% � ��63�$V+e�f0gCf![

5 �'{ 7 �3[ �:[$�l���� 2�$V!��[!~u�2/05C1+V.%��.-�yO[3i�%�<>B�����[ v�Z8\r]¾_;k(o8i[\qbc_(Z$\r_à\c�#Y"\c�#Y_(]z|�_w^�Z#Y[o8]jed2ih_(m,npo �\rje\qbc_(Z [^�j-3-L?T(N/C�3�Aw���(9<@��"$V3y7��-L*R/$/!- � ?> N"$V � ��Vre�fCfLe0[

5 �C� 7 ~J[r��/C�2�F?>8=Vrs�[ � 2?@�.�)1.��/CBSI.�$V.%'�`-���[nwx1F?> 2�m[us�63<@ 2?><K%�"$���;A����-Q;A/0�2*,%'�)-��F�� N*/C��83(�%'���63�3?@4$���)(�%'<v%'G3G3��/�EL?@B�%' �/C�)(W[ §�Y[oN]¾jedr§�Yh\�¨�_(]Z©D~ V=p �C�0f&«!�0�C�!V�e�f0gCfL[

5 �C� 7 i#[ �3[3�l6FIn����[^i��2/C�N�&�� 2?@/C��G363�Z(963?@ �[ ���#Y"t�Z�Z�jedí~O_w^��#\qje\rbÉ~[\rbci�~ V#e��LacpQ� {$�0�&«${!}��3V�e�fCg0�L[

�Le

Page 53: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

5 �Q} 7 ��[��l6F�2<>I.���� �%��.-J\u[0i#/C505C?>/F[ � "!�! 213�� �?>��?@�35�%u��/0<>/0��%�<>5C/0�2?@ 213BD;A�2/CBD��EF%'BHG3<>��(W[ �piDbBY�Z�izY VpC�0f {$gCp�«${mgC�LV^e�fCgCg![

5 �Cg 7 bu[=� ��?>�d%'�.- � [�s�?>"!%�8$�$[ � %�G.%'I3?@<>?@ 2?>�&(l/';, 213�������A<T%�"$���2�&-�i����)����G3 2��/C�.(W[ v � � � v[ZN\wY[][Z�j �\rbc_(Z�jed�X�_(Z�^;Y[]hY[Z�izY�_(Z�§�Y[o8]jedn§�Yh\c¨�_(]Z©`~ V#e �'{Fe�«Q�'{$g!V^e�fCg0gL[

5 �Cf 7 �)[ yO[ ��[ �$%0��8F(9/0�+[]¦ j(k(bcjedëa�j�~`bÉ~ �2oNZ�iz\rbc_(Z�~Am³Yh\c�J_�k�~Q^`_(]OmOo�dõ\qb��Dj(][bcje\3Y»jzn(np]¾_���bcmOje\rbc_(Z [i�1+[ -=[L 21F��(9?K(�V8Fl�3?@4$���)(N?> N"J/'; � %'BSI3��?T-L50�$V F�[ ~J[>V.e�f0gCgL[

5 }�o 7 q�[ ~J[ �C/C�3�&(�[O� (N?>B�GF<>�O<>��BHB�%O/C��5C�2����-L"U%'G3GF�2/�EL?@B�%' �?>/0��?>���l?><@I.���2 �(NG.%C���S%��.-���/C�3�4$����5C���.�W��)%� 2��(#;A/0�i���/C�N���� �?>/C�Hi�63�)(N63?> ¡yz��50�2��(�(9?@/C�H%'�.-]�F��63�)%�<3�3�� N*R/C�28J ��)%�?>�3?@�353[ ���#Yt�Z�Z�jedí~O_w^��#\qje\rbÉ~[\rbci�~ Vrp0oLa�e'� �Co0g&«!�!e��3V+s�%��)�)1�e�fCf0pL[

5 }$e 7 �7[ �3[$~O%��.(2%![�s�63<@ 2?TP$6.%0-L�2?K��(£«S%:(2��%� 2 ����2��-S-3%� )%�%�G3G3��/'E!?>BM%' 2?@/C�H(2�)13��B��R*7?> �1�%�G3G3<>?K��%'� 2?@/C�.(� 2/:��/CBHG363 )%� 2?@/C�.%�< �.63?K-]-L"!�.%�B�?T��(r«d�)[ X�_(m,npo�\3Y[]¾~ } je\c� ��t�n(n#dfbci�� Vne�fLacg � f$� @e�pQ}W«e�{m�LV�e�f0fCoC%![

5 }�p 7 �7[ �3[$~O%��.(2%![�s�63<@ 2?TP$6.%0-L�2?K��(£«S%:(2��%� 2 ����2��-S-3%� )%�%�G3G3��/'E!?>BM%' 2?@/C�H(2�)13��B��R*7?> �1�%�G3G3<>?K��%'� 2?@/C�.(� 2/O��/0B�G363 Z%' �?>/C�`%'<��.63?K-J-L"!�.%'B�?K��(n«O?@?�[ X�_(m,npo(\3Y[] ~ } je\c� �(t�n(n#dfbci�� Vne�fLacg � f$� @e�{L}W«e��!eCV�e�f0fCo'Iv[

5 }�� 7 k:[ � [!~u?>BH��<T-L/0�9;v%'�`-�k:[!w�%�1LI.%![^� �W/C�2����(9G./0�.-L���.�W�_I.�� N*R�����Hb7%&"$�&(2%'�H��(9 �?>B�%� 2?>/0�]/0�(9 �/!��1`%C(9 �?T��G3��/!����(2(N��(S%'�.-�(9B�/$/0 213?@�35�IL"¬(9G3<@?>�3��(W[ t�Z�Z � } je\�� �Q�#\qje\rbÉ~[\ � V7p {$fC��«!�0oCpLVe�f$}$e0[

5 }�{ 7 \u[3~u/013/C�3���+[^\13�O(N��<�;A�A/C��5$%'�F?>��?@�35JB�%'Gv[ � ]_�izYhYk(bcZ�g�~�_w^�\c�#Y,v � � �RVn}&gLa�f$� @e�{$��{'«`e�{!gCo!Ve�f0fCo![

5 }�� 7]� [ �J[$~u63�35F[ � byg(b�\rjedn§�Y[oN]¾jedL§�Yh\c¨�_(]Z©`~ [#i������L �?T�����j%'<><cV ���35C<@��*/$/!- � <@?��v(�V!ªl��* �C���)(N��"$Ve�f0fC�![

5 }�� 7 i#[Rq+%'�`��%C(N 2���U%'�`-x~�[ � %�<>80%'6.(N80%C(�[ X�oN] ��Y·j(Z�k �po8]�^`j(izY �Qb�\B\rbcZeg [D�j��%C-L��B�?T��i�����(2(WVqr/C�`-L/C�+V�e�f0gC�![

5 }C} 7 ��[.q+%�Gn�&-L��(O%'�.-�yO[=�n%��2I.����[u�l/�*D�3��63�Z%'<��3�� Z(z*R/C�28=[u����tu%��.% ��[=�l�.-L���)(9/0�+Vr��-!?> 2/0��V§�Y[o8]jed�v[Z�^`_(][mOje\qbc_(Z � ]¾_;izY¾~h~`bcZ�g·�1|¸~[\3Y[mº~ V�G`%'5C�&(�{C{$p�«${m�C�L[,�lB�[����.(9 �[�i�1L"F(9?K��(�V�ª��JVe�f0gCg![i��2/!�W����-L?@�35$(7/';� 213�:tl���L4$����Vre�fCgQ} � /C�L;A�������.���m[

5 }�g 7 yO[.i#[.qr?>GFG3B�%'�F�+[^yz��4L?@��*x/';^�F��63�)%�<#�F�� N*/C��83(�;A/0��(9G.�����)1��2���W/C5C�F?> 2?@/C�+[ §�Y[o8]jed�X�_(m �npo(\qje\rbc_(Z V+e @e�«Q�CgLV�e�f0gCf![

5 }�f 7 yO[ri�[#qr?@G3G3B�%��3��%��.- �J[+qr���$[:� ����?> 2?K��%'<�/�4$���24!?>��* /';R�3��6F�)%'<^�3�� 9*R/C��8�G`%' 2 ����2����<K%C(9�(9? �.���Z(�[ � ]�Y~;Y[Z8\3Yklje\z§�Y[oN]¾jed#§�Yh\c¨�_(]Z©`~¶^`_(]$X�_(m,npo�\rbcZeg©X�_(Z�^;Y[]hY[Z�izY¾�V�pZ�_$¨�{`bc]¾k��»�V� Ve�f0fLe0[

�Cp

Page 54: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

5 gCo 7 k:[k:[^qr/C�2���L ��$[�s��� 2�2?K�]���! 2��/CG!"$V�*7?T-L �1.(�VR%'�`-�(96FGn���2G./$(N?> 2?@/C�x/�;u;A63�.�� �?>/0�.(�[ t�m³Y[]��} je\c� � } _(Z8\��Nd±| V.�Cf ­{m�Cf&«m{$g0�LV^e�f0�CpL[

5 gLe 7 k:[£k:[+qr/0�2���! 2�m[ tQn(np]¾_���bcmOje\rbc_(ZU_w^ ��oNZ�iz\rbc_(Z�~ [ � 13��<K(9��%Si�63I3<@?T(91F?>�35 � /F[>V+ª���* �^/C��8rVe�f0gC�![

5 gCp 7 wD[ yO[$s�%0-L"3�)1H%'�.- � [ ��[!ªl��<K(9/0�+[+s�63<@ 2?>40%��2?T%� 2�7?@�L ����2G./C<K%' �?>/C�H%'�`-��W/C�.-L?@ 2?@/C�.%�<><>":G./$(9?@� 2?@4$�7-L�W�.�3?> ���;A63�`�� 2?@/C�.(W[$�2�)[�} je\c�#Y[mOje\rbci�~�_w^�X�_(m,npo(\rje\qbc_(Z V!��{3a2e�gCf$� p!eCe)«!pC�$o!V �$%��L6`%'�2"e�f0fCo![

5 gC� 7 wD[ yO[�s�%C-L"F�)1�%'�.- � [ ��[�ªl��<T(9/0�+[�i#/0<>"!1.%'��B�/C�F?T�S��%'�Z-L?>�.%�<7(NG3<>?@�3��( d%�B�?>�3?@B]?@��%' �?>/0�G3��/CG.���2 N"$[ � _(oN]zZ�jed�_w^"tQn(np]¾_���bcmOje\rbc_(ZS���#Y_(][| VF�C� �Co0�&«!�0pCo!V�e�fCf0oC%L[

5 g'{ 7 �3[7q�[�s�%'���2/!P$63?>�vV � [7s�?@ 2 �����V�%'�`- \u[�i#/05C5C?@/3[�i��2/0I.%'I3?@<>?K(9 2?K��(N/C<>6F 2?>/0� /�;J?@<><>�AG./$(N��-G3��/CI3<@��B�(�?@����/0B�G363 Z%' 2?@/C�.%�<+4L?K(9?@/C�+[ � ��t�m³Y[]����#\rje\��2tV~h~`_;i�� V3g0p �}&�&«QgCfLV^e�fCgQ}m[

5 gC� 7 s�[=s�%'�26F"!%'B�%!Vr�[+k�?>��/$(9?cV+%'�`-�\u[+i#/C505C?@/3[:� ��/0�3�3���� �?>/0��In�� 9*R�������ub7��%��.-�s�q+i7[��[ ��[ms���B�/Oªl/F[.e�pCf!eCV.�l�� 2? �=��?T%�<.���L ���<><@?>50���.���,q+%'I./C�Z%' 2/0�2"$V=s�%C(�(2%0��1!6.(9�� 2 )(R���.(9 �?> 26F 2��/';\+����1F�3/C<@/C5C"mVre�f0fCp![

5 gC� 7 �3[3s���?>�35063�� �[�s�63<@ 2?@4C%��2?K%' 2��?>�! 2���2G./C<K%' 2?@/C��%� �%'��I3?> ��)%'��"�G./C?@�L Z(�B�%0-L�O(9?@B�G3<@�$[ � ��tQn(n#d �} je\c� � � �J|¸~�� VF�Co pCf0p&«Q�Co'{FV^e�fQ}&fL[

5 gQ} 7 bu[3wD[+s���<c[�s�Fuyli^��� .%]�2/0In/0 O 21.%� u<>��%��2�.(�IL"U-L/0?>�35F[O� ��t�[ ��[=�l�.-L���)(9/0�+Vr��-!?> 2/0��V§�Y[o8]jed�v[Z�^`_(][mOje\qbc_(Z � ]_;izY¾~h~`bcZegº�p|D~[\wY�mº~ [3�lB����2?T��%'�J���.(N 2?@ 263 ��7/';�i�1L"F(9?K��(�V Fl�F?>4$���Z(9?> N"/'; � /C<@/C�Z%C-L/FVrtl���L4$����Vre�fCgCg![

5 gCg 7 bu[­wD[^s���<�[x\13� � ?>50B�%'�ci�?u�W/C<>6FB����� BH/!-L��<7/';d%0(2(9/!�W?T%' �?>4$�U<>��%��2�3?@�35 ?@�x�����2��I3�Z%'<�3��/!�W/C�2 ���E=[^\£���)13�3?K��%'<vyz��Gn/0�2 ��!V � %'<>? ;A/C���3?T%S���.(9 �?> 26F 2�u/�;R\£�&��13�F/C<>/05C"$V=e�f0fCoL[

5 gCf 7 bu[­wD[Rs���<c[ ªus�t��l�AI.%C(N��-�G.%' � 2�����3�c-L?T(����2?@B�?>�.%� 2?@/C��?>��% BH/!-L��<>�&-���/0�2 2?K��%'<��3��6F�2/C�v[§�Y[o8]jed�X�_(m,npo(\qje\rbc_(Z V3{ �Co0p&«Q�Le'}mV^e�fCf0pL[

5 fCo 7 ��[ ª�[.s�1.%C(N80%'��[d�lG3G3��/'E!?>BM%' 2?@/C��G3��/CG.���2 �?>��(�/';�%�BS63<> �?><K%&"0���2��-];A����-Q;A/0�2*,%'�)-�%��2 �?��=��?K%'<�3��6F�)%'<+�F�� N*/C��8r[ tVk �Dj(ZJizY¾~ bcZ X�_(m,npo�\rje\qbc_(ZJjed } je\c�#Y[mOje\qbcih~ V+e �!e�«QgCoLV�e�fCf0�L[

5 fLe 7 ��[ ª�[3s�1.%0(980%'��[Oªl��63�Z%'<+�3�� 9*R/C��83(;A/C�u<@/!��%'<@?>���&-�%�G3G3��/'E!?>BM%' 2?@/C��/';R����%'<+;A63�.�� �?>/0�.(�[����� [ �:[r~O%'BHB �� O%�<�[@V£�&-L?> �/C��V §­Y[oN]¾jedÞZ1Yh\c¨�_(]Z©`~,^`_(]º~`byg(ZJjedënp]_;izY¾~h~`bcZeg$v¾v¾v� � ]¾_;izYhYk(bcZeg;~_w^»\c�#YÓ���(�(�Óv � � � �B� � �á_(]2©D~h�J_zn V+G.%�5C��(Se�fCo�«.e�fC�LVRªl��* �^/C�28=V^e�f0fC�C%![^� � ��� � ?@5C�.%�<i��2/!���&(2(9?@�35 � /!��?>�� 9"m[

5 fCp 7 ��[ ª�[Cs�1`%C(980%���%'�.- � [ ��[!s�?T���)13��<@<>?A[.�lG3GF�2/�EL?@B�%' �?>/0�JIL"S(N63G.���2G./$(N?> �?>/C�H/';�%�(N?>50B�/C?K-3%'<;A63�.�W 2?>/0�+[ tVk �`j(Z�izY¾~ bcZAtQn(n#dfbBYk } je\c�#Y[mOje\rbci�~ V+e�� �C�0o&«Q�Q}��!V^e�fCf0pL[

�C�

Page 55: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

5 fC� 7 ��[ ª�[!s�1.%C(N8C%��u%��.- � [ ��[3s�?K���)13��<><@?�[+��/'*� 2/H�)13/$/$(N�J%'�U%0�� 2?@4C%� 2?@/C��;A6F�.�� 2?@/C�+[^��� � [ �3[�u%��.(9/0�+V �3[+t:[ � /�*,%'�+V�%'�.- � [�q�[�k�?><@��(�V+��-L?@ 2/0�)(�V t�k �Dj(Z�izY¾~AbcZ®§�Y[o8]jed&v[Zh^`_(]zmOje\rbc_(Z� ]¾_;izY¾~h~`bcZegO�p|¸~[\3Y[mº~ � [ � %'��s�%� 2��/FV � ��3s�/0�25m%'��~O%'6L;ABM%'�3��i�63IF<>?T(N13���Z(�V+e�f0fC�![

5 f'{ 7 � [3�:[3s�?T����13��<><>?c[+���L ����2G./0<T%' �?>/0��/';¡(2��%� 2 ����2��-�-3%� )% -L?K(9 Z%'�.���jB�%' ��2?T�W��(^%'�.-U��/C�.-!?> 2?@/C�3�%'<@<>"SG./$(9?@ 2?@4$��-!���.�3?@ 2�l;A63�`�� 2?@/C�.(W[ X�_(Z�~[\q][oNiz\qb��;YºtQn(np]¾_���bcmOje\rbc_(Z VFp >e0e�«QpCpLV�e�fCg0�L[

5 fC� 7 �3[^s�/$/!-L"$[�ªl/0 2��/C�x50���3���Z%'<@?>��%� 2?>/0�+V^�2��5063<T%��2?>�&%' 2?@/C�+VR%'�`-x%'�)�)13?@ 2���� �63�2�M(9��<@���� 2?@/C��?@��3/0�3<>?@�3��%'�J<@��%'���3?>�F5�(9"F(9 2��B�(�[���� � ]¾_;izYhYk(bcZeg�~A_w^�\c�#Y��Qbc] ~[\Vv � � � �=� � ��_(]Z©`~h�J_zn�_(Z§�Y[o8]jedz§�Yh\c¨�_(]2©D~³^`_(]Ó�1byg(Z�jed � ]¾_;izY¾~h~`bcZeg V�G.%'50��( e)«.e�oLV:qr/$(���<T%'BH?> 2/m(�V � ��VOe�f0fLe�%L[� ��� � � /CB�GF63 2��� � /!��?@�� N"�i��2��(�(�[

5 fC� 7 �3[.s�/$/!-L"$[j\13� Y���Yiz\qb��;Y �!63BSIn���/';RG.%��)%�B��� 2���)( R%'��%'�.%�<>"F(9?K(l/';^50���3���Z%'<@?>��%� 2?>/0�U%'�.-�2��5C63<K%'�2?@��%' �?>/0��?>�J�F/C�3<@?>�3��%��#<@��%'���3?>�F5O(9"F(9 ���B�(�[!��� �3[ms�/$/!-L"$V � [0�u%'�.(N/C�+V!%��.-Jy_[mqr?>G3G3�B�%��3�+VL�&-L?> �/C�)(WV t�k �Dj(Z�izY¾~ bcZ�§�Y[o8]jed�bcZ�^`_(][mOje\qbc_(ZOnp]¾_;izY¾~h~`bcZeg�~�~`|¸~[\3Y[mº~�� VLG`%'5C�&(lg�{L}�«gC��{3V=i�%'<@/S�l<> �/3V � ��V+e�f0fLe�Iv[rs�/0�25$%���~O%'6L;AB�%��3��i�63I3<@?T(N13���)(W[

5 fQ} 7 �3[.s�/$/!-L"�%'�.- � [=tu%'��8$���+[�qr��%��2�3?@�35]*7?@ 21U<>/!��%�<>?>����-��2������G3 2?@4$�l�.��<K-3(�[7����k�[=�l?@�L �/C�+V\u[ � �2�N�3/�*�(N8L?cV#%��.-�t�[�\£/063�2�� ���(98!"$V+��-L?@ 2/0�)(�V � ]¾_;izYhYk(bcZeg;~»_w^»\c�#YÓ������� X�_(ZJZ1Yiz\rbc_(Z�bÉ~[\} _;k8Yhdí~"�poNmOm³Y[]ã�pih�J_�_ed V3G.%'50��(_e��C��«.e�{m�LV+i�%'<>/H�l<@ 2/3V=e�f0gCgL[

5 fCg 7 �3[�s�/$/!-L"�%��.- � [�tu%'��8$���+[��.%C(N �<@��%'���3?>�35U?>���3�� N*/0�28F(u/';�<>/!��%'<><@"L�A 26F�3��-�G3�2/!���&(2(9?@�3563�3?@ )(W[ §­Y[oN]¾jed�X�_(m,npo�\rje\rbc_(Z V+eCacpQ� pCg!e�«!p0f'{FV�e�fCg0fL[

5 fCf 7 �3[7s�/$/!-L"�%��.-�ª�[ �R%'��4L?@�+[Dªl�� N*/0�28F(]*7?> �1x<>��%��2�3�&-�63�3?> H�2��(NGn/0�.(9��;A63�.�W 2?>/0�.(�[�����3[3s�/$/!-!"$V � [3�u%��.(9/0�+Vr%��.-�y_[.qr?@G3G3B�%��3�+V!��-L?> �/C�Z(�V t�k �Dj(Z�izY¾~ bcZ�§�Y[oN]¾jed2bcZh^`_(]zmOje\rbc_(Znp]¾_;izY¾~h~`bcZ�g�~"~`|¸~[\3Y[mº~�� V3G`%'5C�&(�e�o�{$g&«`e�o0�C�LV�i�%�<>/H�l<> �/3V � ��V=e�f0fLeC[vs�/C�25m%'��~_%�6L;AB�%��3�i�63I3<@?T(91F���)(W[

5 e�oCo 7 GJ[ ��[rs�/0�2/0��/�4r[á} Yh\��J_;k�~¶^`_(]­~`_ed �DbcZegçbcZ�ih_(][]�Yiz\=df|ànJ_�~;YkOnp]¾_({zd�Y�mº~ [ � G3�2?@�35C���2�HG����2<T%�53Vb����<>?>�vVne�fCg�{3[

5 e�oLe 7 �7[ ��[Fªu%C-F%'�)%�"!%![|l����(N 2?@B�%' �?>�35:�2��50�2��(�(9?>/0�+[ ���#Y_(] � � ]¾_({���tQn(n#d � V.f >e�{Fe�«`e�{$p!V^e�fC��{3[5 e�oCp 7 i#[mªl?>"$/05C?.%��.-]�R[`k�?@�2/$(N?�[+|��] �13�l����<T%� 2?@/C�.(N13?>GJI.�� N*�����J5C���F���)%�<>?>�&%' 2?@/C�J�����2/0��V$1L"!G./C �13�

��(N?T(���/CB�GF<>��E!?> N"$V�%'�.-S(2%�B�G3<>�,��/CBHG3<>��E!?> N"7;A/C���Z%C-L?K%'<3I`%C(9?K(#;A63�.�� �?>/C�`(�[.��[ ��[�s���B�/�eW{$�$}$V�l�� 2?��n��?T%�<r���! 2��<@<>?@5C���.�W�uq+%�In/0�)%� 2/C��"$V=s�%C(2(�%C�)1L6`(9�� � )(�� �`(9 2?@ 263 ��u/';�\£���)13�3/0<>/05C"$V=e�fCf�{3[

5 e�oC� 7]� [l|�B�/01L6F�.-L�2/F[ � #���?@���! �%�<>5C/0�2?@ 213B�(J*7?> �1x�3��63�Z%'<u�F�� N*/C��8�I.��1.%�4!?>/063��[ X�_(m,n#d�Y ��p|D~[\wY[mº~ V+e p$}��LV�e�f0gQ}m[

5 e�o'{ 7 k:[!i�%'��?T(9?c[ �ó\qje\rbÉ~[\qbcihjed �QbBYhdfkl���#Y_(][| [=�u-3-L?K(9/C�F��w���(9<@��"$V$y7��%0-L?>�35FV!s�%C(2(�%C�)1L6`(9�� Z(�Vre�fCg0gL[

�'{

Page 56: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

5 e�oC� 7 �7[!i�%'�������+[+|�����(9 �?>B�%� 2?@/C�J/';£%_G3��/CI.%�I3?><@?> N"J-!���.(9?@ N"�;A63�.�� �?>/C�H%'�`-]B�/!-L�$[ t�Z�Z � } je\c� ��#\rje\qbÉ~�� V.�0� @e�oC�0�&«`e�oQ}&�3V^e�fC�0pL[

5 e�oC� 7 yO[^i#���3��/$(9�m[x� 50���3���Z%'<>?@����- ?@�L4$���)(9�S;A/C��B�%� 2��?T����(W[ � ]¾_;i���X�j(mO{D][bckDg8Y � �Jb�d±_�~����1_�i�� V�Le ­{moC�&«m{3e��LV�e�fC�C�![

5 e�oQ} 7 ��[Fi¡?@�38!6.(�[ § �N¨�bcke\��(~ bcZAtQn(np]¾_���bcmOje\qbc_(Z©���#Y_(]z| [ � G3�2?@�35C����� G^����<T%�53V3ª���* �^/C�28=Vre�fCg0�L[5 e�oCg 7 \u[$i#/05C50?>/3[+|��J/CG3 �?>B�%�<L�F/C�3<@?>�3��%��^%C(�(9/!��?K%' �?>4$�7�2�&��%'<@<�[ aVbc_ed±_�g×bcihjed2X�|e{zY[][Z1Yh\rbci�~ V.e�f p0oLe�«

pCo0fLV�e�f$}��L[5 e�oCf 7 \u[0i#/C505C?>/F[r�� 213��/C�2"O/�;r1F/'*� �13�7I3�)%�?>�JB�?@5C1! +*/0�28=[3��� X�_edfkã�×np]zbcZeg � j(][{h_(]Þ�p|�m,nJ_�~`bcj

_(Z��Õo8j(Z8\rb�\rje\qb���Y�aVbc_ed±_�g×| V^G.%'50��(]g0fCf�«!fLe�oL[ � /C<K- � G3�2?@�35��u%'��In/0��q+%�I./C�)%� 2/0�2"xi�����(2(WVe�f0fCo![

5 e0e�o 7 \u[�i#/C505C?@/�%'�.-��R[¡k�?@�2/$(N?�[�� 213��/C�2"�/�;��3�� N*/0�28F(l;A/C�J%�G3G3��/'E!?>BM%' 2?@/C��%'�.-�<>��%��2�3?@�353[��[ ��[ms���B�/Oªl/F[.eCe�{moLV.�l�� 2? �=��?T%�<.���L ���<><@?>50���.���,q+%'I./C�Z%' 2/0�2"$V=s�%C(�(2%0��1!6.(9�� 2 )(R���.(9 �?> 26F 2��/';\+����1F�3/C<@/C5C"mVre�f0gCf![

5 e0eCe 7 \u[+i#/05C50?>/�%��.-��[#k�?>��/$(9?c[Jªl�� N*R/C�28F(z;A/0��%�G3G3��/'E!?>BM%' 2?@/C��%��.-®<@��%'���3?>�F53[ � ]¾_;izYhYk(bcZeg;~_w^�\c�#Y"v � � �RVr}�gLacfQ�ZV � ��G3 2��BSI.����e�f0fCoL[

5 e0e�p 7 \u[!i#/C505C?@/J%'�`-��R[Lk�?>�2/m(9?c[ ��E! 2���`(9?>/0�]/�;�%_ �13��/C��"J/';��3�� 9*R/C��83(#;A/C�,%'G3GF�2/�EL?@B�%' �?>/0�S%'�.-<>�&%'�2�F?>�35 �-L?@B����.(N?>/0�.%'<@?> N"��2��-L6`�� 2?@/C��%'�.-��W<>6.(N 2����?>�35F[���� � ]_�izYhYk(bcZ�g�~­v�mOjDg8Yß��Z�k8Y�] �~[\rj(Z�k(bcZeg ��_(]Z©`~h�J_zn V�G.%'50��(J�Cf$}�«!�0oC�!Vli�?@ 2 )(NI363��5C1+VRi#���3�`(9"!<>40%'�3?K%LV � ��G3 2��BSI.���SeCe)«.e��e�f0fCo0%L[=s�/C�25m%'��~O%'6!;AB�%'�3�v[

5 e0e�� 7 \u[0i#/C505C?>/:%��.-J�[Lk�?>��/$(N?�[3y7��5063<T%��2?>�&%' 2?@/C�S%�<>5C/0�2?@ 213B�(r;A/C��<>��%��2�3?@�35l �1.%' R%��2�7��P$63?>40%�<>���! 2/JBS63<@ 2?><K%�"$���^�3�� N*R/C�28F(�[ �piDbBY[ZJizY V+p'{!} fQ}�g�«!f0gCpLV^e�fCfCo�I+[

5 e0e�{ 7 \u[0i#/C505C?>/�%'�.-J��[0�l63��<>I.���� �[3|�I.(9����40%' 2?@/C�J/0�S��/C�� 2?T��%'<!B����)1.%'�3?K(9B�(L;A/0��/CI3�N���W #������/C50�3?>� 2?@/C�S%��.-�<@��%'���3?>�F53[.��� � [m~�/!�)1S%'�`- �3[!tu%�4!?T(�V0��-L?> �/C�Z(�V sëj(]Bg8Y��=~`ihjed�Y§�Y[o8]_(Z�jed����#Y_(]zbBY~_w^�\c�#Y"aV]j(bcZ [3����G3�2�&(2(�[

5 e0e�� 7 \u[0i#/C505C?>/FV GJ[�\+/C���2�$V$%��.- � [0~�/!�)1+[ � /CBHG363 )%� 2?@/C�.%�<L4!?T(N?>/C�d%'�.-�����5C6F<T%'��?>��%� 2?@/C�� �13��/0�2"$[§ãje\qoN]�Y VF�Le�} �!e�{�«!�Le�f3V^e�fCg0�L[

5 e0e�� 7 \u[=i#/C505C?>/FV���[ G^/$/C��13����(WV+%'�.-���[ �^63?><@<>�$[�� �2��5C63<K%'�2?@����-U(9/C<@63 2?@/C�� �/���-L50�S-L�� 2�&�� 2?@/C�+[� _(o8][Z�jed2_w^àX�_(m,n#d�Y ��b�\r| V.{�@e�oC��«.e�pC�LV�e�fCg0gL[

5 e0e'} 7 t�[.i#/0<><K%'�)-=[ X�_(Z ��Y[]=g8Y[Z�izY _w^"~[\r_�ih�Jj�~[\qbci,np]_�izY~h~;Y¾~ [ � GF�2?>�F5C����� G^����<T%'5FV3b����<>?@�+V.e�fCg�{3[5 e0e�g 7 s�[ �3[=t�[.i#/�*��<@<�[7y�%C-!?T%'<+I`%C(9?K(z;A63�.�W 2?>/0�.(;A/C��B]63<@ 2?@4C%��2?K%'I3<@�u?>�! 2����G./C<T%� 2?@/C��R%]�2��4L?@��*O[

��� �3[ � [!s�%C(9/0�U%'�.-�s�[3k:[ � /�E=V$��-L?> �/C�Z(�V tVd g(_(]zb�\c�Jmº~�^`_(]�t�n(np]_���bcmOje\rbc_(Z [ � <T%'�����.-L/0�i��2��(�(�Vr|�E$;A/C�)-=V+e�fCg$}$[

�C�

Page 57: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

5 e0e�f 7 s�[ �3[ t�[Wi#/�*��<@<�[0\13�^ 213��/C�2"j/';F�)%C-!?T%'<$I`%C(9?K(v;A6F�.�� 2?@/C�.(+%�G3G3��/'E!?>BM%' 2?@/C�u?@�Se�fCf0oL[!���OwD[ ��[qr?>501L �V#��-!?> 2/0��V tVk �`j(Z�izY¾~AbcZ�§ãoNm³Y[]zbcihjed�t�Z�jed±|¸~`bÉ~ � _edfoNm³Y³vv

���j ��Yhd�Yh\c~h�"�poN{hk(b��DbÉ~`bc_(Z

tVd g(_(][b�\c�Jmº~Oj(ZJk ¦ j(k(bcjed�a�j�~`bÉ~ ��oNZ�iz\rbc_(Z�~ VrG.%�5C��(Je�o0�&«QpLe�o![�|�E$;A/C�)- Fl�3?@4$���)(N?> N"�i�����(2(WVe�f0fCp![

5 e�pCo 7 s�[ bu[=i��2?@��(9 �<>��"�%'�.-�s�[ \u[ � 1`%'/3[�ª�/C�3�AG.%'�Z%'B��� 2�2?K��;A63�`�� 2?@/C���. 2 �?>�35F[ � _(o8][Z�jed�_w^ \��#Y¦ _(|�jed��#\qje\rbÉ~[\rbcihjed��p_;iDbBYh\r|àa V.��{� �0gC��«!�Cf0pLV^e�f$}�p![

5 e�pLe 7 � [�y�%'I363 �[!�l/�* �/lI36F?><T-OP$6.%C(N?>�A?>�! 2����G./C<T%��L Z(�[�%�G3G3<>?K��%' �?>/0�.(r 2/�G./C<>"!1.%��2B�/0�3?T��b�c(9GF<>?>�F��(�[����i#[ � �3[+q+%�63�2���L �V#�:[+qr��s���1.%'63 ��$V+%��.- q�[ q�[ � ��1!63B�%�8$����V3�&-L?> �/C�)(WV X�o8] ��Y¾~Ôj(Z�k$�poN] �^`j(izY¾~ V3G.%�5C��(��Cf!e�«m{$oCp![+�u��%0-L��B�?K�li�����(2(WV.ªl��* ��/0�28=Vre�fCfLe0[

5 e�pCp 7 � [Ryl%�I363 �[D����?>�! 2��/!-L6.�� �?>/0�x 2/ � �)13/$���!I.���25 � (�%�G3G3��/'E!?>BM%' 2?@/C�+[ X�_(m,npo(\wY�] ~ } je\c� �tQn(n#dfbci�� V.p'{Fa2e�pQ� @e�{mf&«.e�}0�LV^e�f0fCp![

5 e�pC� 7 bu[ t:[3y7?>G3<@��"$[Rªl��63�Z%'<+�3�� N*R/C�28F(7%'�`-��2��<K%' 2�&-MBH�� 213/!-F(�;A/C�j��<T%0(2(9? �=��%� 2?>/0�+[�� ]¾_;i�� ¦ _(|ejed�p_;i���së_(Z�k(_(Z V3?@��GF�2��(�(�V+e�f0f'{F[

5 e�p'{ 7 �3[0yz?K(2(2%��3���+[Fs�/!-L��<@?>�35uI!":(913/0�2 ���(9 ^-F%' )%O-L�&(2����?>G3 �?>/C�v[ t�o(\r_(mOje\qbcihj V3eW{� {$�C��«${!}$eCV+e�fQ}&gL[5 e�pC� 7 s�[3y7/$(N���!I3<T%� 2 �[ � 6F�24$�O��(9 �?>B�%� 2��(W[ t�Z�Z � } je\�� �p�#\qje\rbÉ~[\ � V.�'{�@e�g!e��&«`e�g�{$p3V^e�f$}$eC[5 e�pC� 7 t�[ �7[=yz63BH��<>1.%��2 �V`k:[ �7[r�l?@�L �/C�+VF%'�.-�yO[ �3[3wx?><@<>?K%'B�(W[^qr��%'���3?>�35S�2��G3�2��(N���! )%' �?>/0�.(zI!"

I.%0��8!��GF�2/CG`%'5$%� 2?@�35]���2�2/0�)(W[ §ãje\qoN]�Y V.�CpC�!a�f$� �0�C��«!�C�0�LV�|j�� 2/0I.���Oe�f0gC�L[5 e�pQ} 7 �)[ �3[ � ��1F/$���LI.����53[ � /C�! 2��?>I363 �?>/0�.(� 2/� 213��G3��/CI3<@��B�/�;:%'G3GF�2/�EL?@B�%' �?>/0��/';O�&PQ63?K-L?T(N )%��L

-3%� )%�I!"�%��.%'<@"L �?T�l;A63�.�� �?>/0�.(�V!G.%'�� �% 7|l�H 213�OG3��/CI3<@��B�/�;^(NB�/$/C �13?>�F5J/';�5C�)%0-L6.%� 2?>/0�+V=%�.�Z(9 ^��<K%C(�(#/';v%'�`%'<>"! 2?K�%�G3G3�2/�E!?>B�%� 2?@/C�_;A/0�2BS63<T%��$[ �¶oNj(]�\ ��t�n(n#d�� } je\c� � V'{ ­{$��«!f0fLV+e�f�{$�0%L[

5 e�pCg 7 �)[ �3[ � ��1F/$���LI.����53[ � %��)-L?@�.%'<+?@�L ����2G./C<K%' �?>/C�U%��.-�(NG3<>?@�3�u;A63�.�� �?>/C�`(�[ � _(o8][Z�jed2_w^�t�n(np]_���b �mOje\rbc_(ZÓ\c�#Y_(]z| V3p @e��$}�«!p0oC�!V�e�fC�0fL[

5 e�pCf 7 q�[ q�[ � �)1L63BM%'8$����[ �(n#dfbcZ1Y�^`oNZ�iz\rbc_(Z�~�{hj�~`bciº\c�#Y_(]z| [ �C/013��wx?@<>��"S%��.- � /C�`(�V=ªl��* �^/C��8rV

e�f0gLe0[5 e��Co 7 \u[ �3[ � �2�N�3/�*�(N8L?�%'�.- � [vy_[=yz/m(9���!I.���25F[Oi�%'�Z%'<@<>��<+�3�� 9*R/C��83(l �1.%' j<>��%��2�� �/�G3�2/0�3/C63�`���

���350<>?K(91� 2��E! �[ X�_(m,n#d�Y �O�p|D~[\wY�mº~ V+e >eW{$��«.e��0gLV^e�f0gQ}m[5 e��Le 7 bu[­wD[ � ?@<>4$����B�%'�+[ � G3<@?>�3�S(NB�/$/C �13?>�F5�O 213�J��P$63?@4C%�<>���! u40%'��?T%�I3<>�J8$�����3��<�B��� �13/!-r[ ���#Y

t�Z�Z�jedí~O_w^��#\qje\rbÉ~[\rbci�~ V#e�p gCfCg�«!f!e��LV^e�fCg'{F[5 e��Cp 7 ª�[ � ?@40%'8!63B�%'��%��.- �3[ t:[nw�%'�Z-r[_|��� �13��I.��(N l<@��%C(N O(2P$6.%��2�_�` lI!"��)%C-!?T%'<+;A63�.�W 2?>/0�.(l �/

BS63<> �?T-L?@BJ���.(9?@/C�.%�<!(2��%� 2 ����2��-J-F%' )%![+\+����1F�3?T��%�<3y7��G./C�� RpC�Le0V � ���L ����#;A/0���G3G3�2/�E!?>B�%� 2?@/C�\13��/0�2"$VF\£��E3%0(l� � s Fl�3?@4$���)(N?> N"$V �C6F�3�Se�fCf!eC[

�C�

Page 58: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

5 e��C� 7 yO[ �3[ � /C<@/CB�/0�3/ ��[ � /CBHG3<>��E!?> N"!��I`%C(9�&-®?@�.-L6.�� �?>/0��(9"F(9 ���B�( d��/CB�G`%'�2?K(9/0��%'�.-���/0�L4$���2�5C���.���u �13��/C����B�(W[ v � � � ��]j(Z�~`j(iz\rbc_(Z�~�_(ZÓv[Zh^`_(]zmOje\rbc_(ZS���#Y_(][| VFp'{3V+e�fQ}&gL[

5 e��'{ 7 t�[ �[ � G.���)1L �[7� 5C���3���)%'<��2��5C�2�&(2(9?@/C�U�3��63�Z%'<��3�� N*/0�28=[ v � � � �J]¾j(Z(~`j(iz\qbc_(Z(~O_(Z�§�Y[o8]jed§�Yh\�¨�_(]Z©D~ V.p!a��$� �0�Cg�«!�Q}&�LV^e�f0fLe0[

5 e��C� 7 �7[ s�[ � ���?>�+[ �pbcZeg(o(dfj(]�bcZ8\3Y=g(]¾jed ~ºj(Z�k³k(b ��Y�]�Y[Z8\rbcj({Db�dfb�\r|"np]¾_zn#Y[]h\qbBY¾~�_w^�^`oNZ�iz\rbc_(Z�~ [^i��2?>�`����� 2/0�+V.ª�[ �3[>V!i��2?>�`���� 2/0� Fl�3?>4$���)(9?@ N"Si¡����(2(WV+e�f$}�oL[

5 e��C� 7 �3[ � 2��*,%'�2 �[�i#/$(N?> 2?@4$��-!���.�3?@ 2�];A63�`�� 2?@/C�.(:%'�.-�5C���3���)%'<@?>��%� 2?@/C�.(WV�%'��13?K(9 �/C�2?K��%'<,(963��4$��"$[¦ _;i�©�| } _(oNZ8\qj(bcZ � � } je\�� � VF� ­{moCf�«${$��{3V^e�f$}��![

5 e��Q} 7 � [ �3[ � �/C�3�$[R�u-3-!?> 2?@4$�l����5C����(2(N?>/0��%��.-�/0 213���l�3/0�3G.%��)%'BH�� 2��?T�lB�/!-!��<T(W[ ���#Y"t�Z�Z�jed ~ _w^�#\rje\qbÉ~[\rbci�~ V+e�� �0gCf�«3}�o0�3V�e�f0gC�![

5 e��Cg 7 ��[�ª�[�\?>8!13/C�F/'4=[ � /0<>63 �?>/0�_/�;.?>�`��/C���2���� �<>"7;A/C��B]63<K%' ���-zGF�2/CIF<>��B�(=%'�.-O 213�^����5C63<K%'��?>��%� 2?>/0�B��� �13/!-r[ �p_ �DbBYh\ } je\�� � � _'©;d � V3{�@e�o0�C�&«`e�o0�Cg3V�e�fC�C�![

5 e��Cf 7 ��[�ª�[�\?@8L13/0�3/�4O%'�`- Gd[ �J[��l�Z(9���F?>�+[ �p_edfo(\qbc_(Z(~V_w^�v d�d ��nJ_�~;Yk � ]¾_({zdxY[mº~ [CwD[���[Wwx?>�.(N 2/C�vVw�%C(91F?>�350 2/C�vVrt�[ � [>V=e�fQ}0}$[

5 eW{$o 7 ��[ �[3\?@B�%'�+[ ���#Y_(][|O_w^ jzn(np]¾_���bcmOje\rbc_(Zá_w^�^`o8Z�i[\qbc_(Z�~à_w^ jÓ]hYjed �Dj(][bcj({zd�Y [7s�%C��BH?><><K%'�+Vªl��* �^/0�28=V+e�fC�0�L[

5 eW{3e 7 GJ[!\+�2��(NG+V��3[F�l/C<@<T%' ��$V!%'�.- � [F�l13B�%0-r[�ªl�� N*/0�28S(N 2�26`�� 263��?>�35d%'�.-� ��)%'?@�3?>�F5J6.(9?@�35���63<>���I.%0(9��-J8L�F/'*7<@��-L50�$[.��� � [ �3[!�u%'�`(9/C�vV �3[mt�[ � /'*,%'�+V!%��.- � [mq�[`k�?@<>��(WVC��-L?@ 2/C�Z(�V t�k �Dj(Z�izY¾~bcZ�§�Y[o8]jed1v�Z�^`_(]zmOje\rbc_(Z � ]¾_;izY¾~h~`bcZegO�p|¸~[\3Y[mº~ � [ � %���s�%' ���/3V � � .s�/C�25m%'��~_%�6L;AB�%��3�i�63I3<@?T(91F���)(WVre�f0fC�![

5 eW{$p 7 �[#F� 2�2���)%C(W[ � �2/$(�(9�A40%'<>?K-3%' �?>/0�� 2���)13�3?KPQ6F��(,;A/0�:(9B�/$/0 213?@�35U(9G3<@?>�3��;A63�`�� 2?@/C�.(u?>��/C�F�]/0� N*/�-!?>B����`(9?>/0�.(�[d� ��\u[#kj%C(�(9���d%'�.-�s�[+yz/m(9���!I3<K%' 2 �V+��-L?> �/C�Z(�V �pmO_;_e\��JbcZ�gá\wYih�JZ�b��Do�Y¾~^`_(]­X�oN] �;Y � ~[\rbcmOje\rbc_(Z V3G.%'50��(Oe�fC��«!p0�LeC[ � GF�2?>�F5C����� G^����<T%'5FV3�l��?T-L��<@I.���25FVre�f$}�f![

5 eW{$� 7 GJ[�ª�[;G%�G3�3?@8r[ � ~[\rbcmOje\qbc_(Z)_w^ � Yqn#Y[Z�k8Y[Z�izY~Óa�j�~;YkU_(Z � m,npbc][bcihjed � je\qj [ � G3��?>�350���2�G^���2<K%'5FV3b����<>?>�vVne�fCg0pL[

5 eW{C{ 7 GJ[$ª:[ GR%'G3�3?@8J%��.-���[ �d[ � 13����4$/C�3���F8L?K(�[r|��] �13��63�3?�;A/0�2B���/0�L4$���25C���.���/�;+����<T%� 2?>4$�^;A�2���P$63���.���&(#/';���4$���L Z(£ �/� 21F��?>�^G3��/CI.%�I3?><@?> 2?@��(�[ ��� � � ]¾_({��pj(ZJkOb�\�~Vt�n(n#d±bcihje\qbc_(Z�~ V=e'}ma�pQ� p0�'{'«pCg0oLV�e�f$}$eC[

5 eW{$� 7 GJ[ ª�[ GR%�G3�3?>8S%��.-S��[ �%![ � 13����4$/C�3���38L?K(�[=\13���3������(�(2%��2"S%'�`-�(96�#M��?@���L ¡��/C�.-!?> 2?@/C�.(#;A/0� 21F�763�3?�;A/0�2B���/0�L4$���25C���.���/�;�%�4$���)%�5C��(# �/� �13��?>����ELG.���W 2��-�40%'<@63��(W[ �#Y_(]zbc|�j � Y[]_(|eje\rZ�_�~ �\3Y[b�b � Y � ][bcm³Y[Z1Y�Z�bc|ej V.p0�La��$� �'{$��«!�0�'{.V�e�fCgLe0[

�Q}

Page 59: e f$} f!h kl ?>B(N/C +V e f0gCp!hweb.cs.iastate.edu/~honavar/poggio2.pdf · 2003-03-10 · ! #"$ &%' )(+* ,%' .- /0 213 )(#1.% 4$ ,%' 25063 - 1.%' 13 7 )%0(98:/';= % 2

5 eW{$� 7 GJ[ ª�[ GR%�G3�3?>8S%��.-S��[ �%![ � 13����4$/C�3���38L?K(�[=\13���3������(�(2%��2"S%'�`-�(96�#M��?@���L ¡��/C�.-!?> 2?@/C�.(#;A/0���/0�.(9?K(9 2���.��"�?@�� 213�J��B�G3?>��?T��%�<+�2?K(98�BH?>�3?@B]?@��%� 2?>/0��B��� 21F/!-r[ � je\B\3Y[][Z ¦ Yih_hg(ZJb�\qbc_(Zßj(Z�kv[mOjDgNY,t�Z�jedf|D~`bÉ~ V+eCac�Q� pCg0�&«!�0oC�!V�e�fCf!eC[

5 eW{L} 7 GJ[ ª�['G%�G3�3?@8O%'�.-:��[ yO[ � 2��;c%��L"!638=[Cªl/0�3G.%��)%'BH�� 2��?T�#B��� 213/!-3(n;A/0�+�2��(N 2/0�2?>�F5lG3��/CI.%�I3?><@?> N"-L���`(9?> �?>��(W[ t �z\r_(mOje\rb�©�j�b,�1Y d�Y[m³Y2©D�Jj(ZJb�©�j V^a�gQ� �0g&«!�0pLV�e�f$}�gL[

5 eW{$g 7 k:[3w�%�1LI`%L[ � B�/$/C �13?>�F5]�3/0?T(N"�-3%' Z%]I!"�(NG3<>?@�3�u;A63�.�� �?>/C�`(�[ §�oNm³Y[]�� } je\�� VFp'{ �Cg0�&«Q�CfC�!Ve�f$}��![

5 eW{$f 7 k:[rw�%'1!I.%L[ � B�/$/C �13?>�F5�%��.- ?@<><>�AG./$(N��-�G3�2/0I3<>��B�(�[J����s�[#k�/C<@In���253V���-L?@ 2/C��V �p_edfo(\qbc_(Z�~m³Yh\c�J_;k�~1^`_(]�bcZ8\3Y=g(]jed1Y��DoNje\rbc_(Z�~Vj(Z�k�jzn(n#dfbcihje\rbc_(Z�~ V'G`%'5C�&(e�g0�&«.e�f'{F[Li�<@���L6FBDi��2��(�(�V$ªl��*�^/C��8rV=e�fQ}&fL[

5 e��Co 7 k:[3w�%�1LI`%L[ � G3<@?>�3�OI.%0(9��(WVn����5C63<K%'��?>��%� 2?>/0�+V=%'�.-�5C���3���)%'<@?>���&-��W�2/$(�(9�A40%'<>?K-3%' �?>/0��;A/C�j(9/C<@4L�?>�F5�%'G3GF�2/�EL?@B�%' �?>/0��G3��/CI3<@��B�(*7?> �1�<T%��25C�SP$6.%��L �?> 2?@��(7/';7�F/C?T(N"�-3%� )%![���� �3[rw�%'�Z-�%'�.-�7[ � 13���3��"mVC��-L?@ 2/C�Z(�V � ]¾_;izYhYk(bcZeg�~�_w^V\c�#Y¶v[Z8\3Y[][Z�je\rbc_(Z�jed�X�_(Z�^;Y�]�Y[Z�izYã_(ZàtQn(np]¾_���bcmOje\rbc_(Z\c�#Y_(]z|lbcZS�J_(Z�_(oN]�_w^ � Y_(]=g8Y³së_(]�Y[Z$¢ V^�l6.(9 �?>�+VR\ �JV��$%��L6.%��2"¯g&«.e�o�e�f0gCo![7�u��%0-L��B�?K�i��2��(�(�[

5 e��Le 7 k:['w�%'1!I.%![r����/CB�G`%'�2?K(9/0��/';�k � G�%'�`-Mkjs�q];A/C�^�)13/$/m(9?>�F5_ �13�7(NB�/$/C �13?>�F5uG.%'�Z%'B��� 2���?>�� �13��50���3���Z%'<>?@����-�(9GF<>?>�F��(l(NB�/$/C �13?>�F5]G3��/CI3<@��B�[ ���#Y"t�Z�Z�jed ~Ô_w^��#\rje\rbÉ~[\qbci�~ V�e�� @e��$}�g&«e�{moCp!V#e�fCgC�![

5 e��Cp 7 k:['w�%'1!I.%![ �(n#d±bcZ1Y¾~ } _;k8Yhdí~2^`_(] �¶{�~;Y�] �Dje\rbc_(Z�jed � je\qj [ � ����?>��(+?>�S�lGFG3<>?@��-Os�%' 21F��B�%' �?T��(WVG^/C<c[3�Cf!V � �N�us�V3i�13?@<T%0-L��<>GF13?T%!Vre�f0fCo![

5 e��C� 7 k:[Lw�%'1!I.%J%'�`- � [!w /0<T-r[�� ��/CBHG3<>�� ���<>"d%'63 �/CB�%� 2?K�,;A�����.�)1���63��4$�$[ X�_(mOmOo8Z �p�#\qje\rbÉ~[\ � V{�@e�«`e'}$V�e�f$}��![

5 e��'{ 7 k:[ � [!w�%� )(N/C�+[ � B�/$/C �1�����5C����(2(N?>/0��%��.%'<@"3(N?T(W[ �pj(Z$©D�J|ej³t V.pC� �C�0f&«!�$}�p!V�e�fC��{3[5 e��C� 7 ��[!wx13?> ��$[�qr��%��2�3?@�35S?>�U%'�� 2?��n��?T%�<r�3��6F�)%'<+�F�� N*/C��83(^%J(9 Z%' 2?K(9 �?T��%�<+Gn���)(9G.���W 2?>4$�m[ §�Y[o8]jed

X�_(m,npo(\qje\rbc_(Z V+e {$p0�&«${m�'{FV�e�f0gCfL[5 e��C� 7 ��[�wx13?> ��$[ � /C�3�F���� 2?@/C�3?K(9 J�3/0�3G.%��)%'BH�� 2��?T�]����5C����(2(N?>/C� �s�63<@ 2?@<T%�"$���uG.���Z����G3 ��2/C�`(]��%��

<>�&%'�2�U%��2I3?@ 2�)%��2"�BM%'G3G3?@�35$(W[ §­Y�o8]jedn§�Yh\�¨�_(]Z©D~ V=�Lac�C�0�'�c�'{$f$�)V^e�f0fCo![5 e��Q} 7 ��[ �^63?><@<>�:%'�.-�ª�[+k��2��"!*7%0���$[O\13�JB�/0 2?@/C����/013���2���.���� �13��/0�2"$[O��� � ]¾_;izYhYk(bcZeg�~ _w^ \��#Y

v[ZN\wY[][Z�je\rbc_(Z�jed�X�_(Z�^;Y[]hY[Z�izYã_(ZUX�_(m,npo(\wY[] � bÉ~`bc_(Z V3G`%'5C�&(7�'{C{�«!�0�'{3V=w�%0(913?@�35C �/C�+V.t�[ � [>Vtl���W��B]I.����e�fCgCg![r� ����� � /0B�G363 ���� � /!��?@�� N"�i��2�&(2(�[

5 e��Cg 7 wD[ i�[ �.?@��B�����[ �lYj'©;df|ßk(b ��Y[]�Y[ZN\qbcj({zdxY"^`o8Z�i[\qbc_(Z�~��p_({h_ed�Y �Ó~3nJj(izY¾~Aj(Z�kà^`oNZ�iz\rbc_(Z�~·_w^

{h_(oNZ�k8Yk �Dj(][bcje\qbc_(Z [ � GF�2?>�F5C����� G^����<T%'5FV3ªl��* �^/C��8rV=e�f0gCfL[

�Cg