Xiaowuhu/deeprnn (#366)

* udy

* xdf

* finish deep rnn

B-教学案例与实践/B6-神经网络基本原理简明教程/Data/ch19.name_language.txt

@@ -1,111 +1,3 @@
-khoury	Arabic
-nahas	Arabic
-daher	Arabic
-gerges	Arabic
-nazari	Arabic
-maalouf	Arabic
-naifeh	Arabic
-guirguis	Arabic
-baba	Arabic
-sabbagh	Arabic
-attia	Arabic
-tahan	Arabic
-haddad	Arabic
-aswad	Arabic
-najjar	Arabic
-dagher	Arabic
-maloof	Arabic
-isa	Arabic
-asghar	Arabic
-nader	Arabic
-gaber	Arabic
-abboud	Arabic
-zogby	Arabic
-srour	Arabic
-bahar	Arabic
-mustafa	Arabic
-hanania	Arabic
-tuma	Arabic
-saliba	Arabic
-shamoon	Arabic
-handal	Arabic
-amari	Arabic
-atiyeh	Arabic
-said	Arabic
-khouri	Arabic
-sleiman	Arabic
-seif	Arabic
-harb	Arabic
-asker	Arabic
-antar	Arabic
-awad	Arabic
-shadid	Arabic
-hajjar	Arabic
-kalb	Arabic
-bazzi	Arabic
-masih	Arabic
-ghanem	Arabic
-antoun	Arabic
-sarraf	Arabic
-malouf	Arabic
-naser	Arabic
-shamon	Arabic
-wasem	Arabic
-kanaan	Arabic
-boutros	Arabic
-moghadam	Arabic
-cham	Arabic
-assaf	Arabic
-quraishi	Arabic
-shalhoub	Arabic
-sabbag	Arabic
-mifsud	Arabic
-shammas	Arabic
-tannous	Arabic
-rahal	Arabic
-almasi	Arabic
-basara	Arabic
-bata	Arabic
-shamoun	Arabic
-deeb	Arabic
-touma	Arabic
-asfour	Arabic
-hadad	Arabic
-arian	Arabic
-kouri	Arabic
-toma	Arabic
-halabi	Arabic
-fakhoury	Arabic
-mansour	Arabic
-sayegh	Arabic
-morcos	Arabic
-ganim	Arabic
-hakimi	Arabic
-ganem	Arabic
-sarkis	Arabic
-maroun	Arabic
-bishara	Arabic
-ba	Arabic
-bitar	Arabic
-koury	Arabic
-nassar	Arabic
-haik	Arabic
-salib	Arabic
-botros	Arabic
-essa	Arabic
-kattan	Arabic
-kassis	Arabic
-qureshi	Arabic
-ghannam	Arabic
-kassab	Arabic
-baz	Arabic
-abadi	Arabic
-issa	Arabic
-boulos	Arabic
-samaha	Arabic
-safar	Arabic
-mikhail	Arabic
-totah	Arabic
 ang	Chinese
 auyong	Chinese
 bai	Chinese
@@ -4213,412 +4105,6 @@ yoshizawa	Japanese
 yuasa	Japanese
 yuhara	Japanese
 yunokawa	Japanese
-ahn	Korean
-baik	Korean
-bang	Korean
-byon	Korean
-cha	Korean
-chang	Korean
-chi	Korean
-chin	Korean
-cho	Korean
-choe	Korean
-choi	Korean
-chong	Korean
-chou	Korean
-chu	Korean
-chun	Korean
-chung	Korean
-chweh	Korean
-gil	Korean
-gu	Korean
-gwang	Korean
-ha	Korean
-han	Korean
-ho	Korean
-hong	Korean
-hung	Korean
-hwang	Korean
-hyun	Korean
-jang	Korean
-jeon	Korean
-jeong	Korean
-jo	Korean
-jon	Korean
-jong	Korean
-jung	Korean
-kang	Korean
-kim	Korean
-ko	Korean
-koo	Korean
-ku	Korean
-kwak	Korean
-kwang	Korean
-lee	Korean
-li	Korean
-lim	Korean
-ma	Korean
-mo	Korean
-moon	Korean
-nam	Korean
-ngai	Korean
-noh	Korean
-oh	Korean
-pae	Korean
-pak	Korean
-park	Korean
-ra	Korean
-rhee	Korean
-rheem	Korean
-ri	Korean
-rim	Korean
-ron	Korean
-ryom	Korean
-ryoo	Korean
-ryu	Korean
-san	Korean
-seo	Korean
-seok	Korean
-shim	Korean
-shin	Korean
-shon	Korean
-si	Korean
-sin	Korean
-so	Korean
-son	Korean
-song	Korean
-sook	Korean
-suh	Korean
-suk	Korean
-sun	Korean
-sung	Korean
-tsai	Korean
-wang	Korean
-woo	Korean
-yang	Korean
-yeo	Korean
-yeon	Korean
-yi	Korean
-yim	Korean
-yoo	Korean
-yoon	Korean
-you	Korean
-youj	Korean
-youn	Korean
-yu	Korean
-yun	Korean
-adamczak	Polish
-adamczyk	Polish
-andrysiak	Polish
-auttenberg	Polish
-bartosz	Polish
-bernard	Polish
-bobienski	Polish
-bosko	Polish
-broz	Polish
-brzezicki	Polish
-budny	Polish
-bukoski	Polish
-bukowski	Polish
-chlebek	Polish
-chmiel	Polish
-czajka	Polish
-czajkowski	Polish
-dubanowski	Polish
-dubicki	Polish
-dunajski	Polish
-dziedzic	Polish
-fabian	Polish
-filipek	Polish
-filipowski	Polish
-gajos	Polish
-gniewek	Polish
-gomolka	Polish
-gomulka	Polish
-gorecki	Polish
-gorka	Polish
-gorski	Polish
-grzeskiewicz	Polish
-gwozdek	Polish
-jagoda	Polish
-janda	Polish
-janowski	Polish
-jaskolski	Polish
-jaskulski	Polish
-jedynak	Polish
-jelen	Polish
-jez	Polish
-jordan	Polish
-kaczka	Polish
-kaluza	Polish
-kaminski	Polish
-kasprzak	Polish
-kava	Polish
-kedzierski	Polish
-kijek	Polish
-klimek	Polish
-kosmatka	Polish
-kowalczyk	Polish
-kowalski	Polish
-koziol	Polish
-kozlow	Polish
-kozlowski	Polish
-krakowski	Polish
-krol	Polish
-kumiega	Polish
-lawniczak	Polish
-lis	Polish
-majewski	Polish
-malinowski	Polish
-maly	Polish
-marek	Polish
-marszaek	Polish
-maslanka	Polish
-mencher	Polish
-miazga	Polish
-michel	Polish
-mikolajczak	Polish
-mozdzierz	Polish
-niemczyk	Polish
-niemec	Polish
-nosek	Polish
-nowak	Polish
-pakulski	Polish
-pasternack	Polish
-pasternak	Polish
-paszek	Polish
-piatek	Polish
-piontek	Polish
-pokorny	Polish
-poplawski	Polish
-rog	Polish
-rudaski	Polish
-rudawski	Polish
-rusnak	Polish
-rutkowski	Polish
-sadowski	Polish
-salomon	Polish
-serafin	Polish
-sienkiewicz	Polish
-sierzant	Polish
-sitko	Polish
-skala	Polish
-slaski	Polish
-slazak	Polish
-slusarczyk	Polish
-slusarski	Polish
-smolak	Polish
-sniegowski	Polish
-sobol	Polish
-sokal	Polish
-sokolof	Polish
-sokoloff	Polish
-sokolofsky	Polish
-sokolowski	Polish
-sokolsky	Polish
-sowka	Polish
-stanek	Polish
-starek	Polish
-stawski	Polish
-stolarz	Polish
-szczepanski	Polish
-szewc	Polish
-szwarc	Polish
-szweda	Polish
-szwedko	Polish
-walentowicz	Polish
-warszawski	Polish
-wawrzaszek	Polish
-wiater	Polish
-winograd	Polish
-winogrodzki	Polish
-wojda	Polish
-wojewodka	Polish
-wojewodzki	Polish
-wronski	Polish
-wyrick	Polish
-wyrzyk	Polish
-zabek	Polish
-zawisza	Polish
-zdunowski	Polish
-zielinski	Polish
-ziemniak	Polish
-zientek	Polish
-zuraw	Polish
-abreu	Portuguese
-albuquerque	Portuguese
-almeida	Portuguese
-alves	Portuguese
-araujo	Portuguese
-araullo	Portuguese
-barros	Portuguese
-basurto	Portuguese
-belo	Portuguese
-cabral	Portuguese
-campos	Portuguese
-cardozo	Portuguese
-castro	Portuguese
-coelho	Portuguese
-costa	Portuguese
-crespo	Portuguese
-cruz	Portuguese
-dcruz	Portuguese
-dcruze	Portuguese
-delgado	Portuguese
-desantigo	Portuguese
-duarte	Portuguese
-esteves	Portuguese
-fernandes	Portuguese
-ferreira	Portuguese
-ferreiro	Portuguese
-ferro	Portuguese
-fonseca	Portuguese
-franco	Portuguese
-freitas	Portuguese
-garcia	Portuguese
-gaspar	Portuguese
-gomes	Portuguese
-gouveia	Portuguese
-guerra	Portuguese
-henriques	Portuguese
-lobo	Portuguese
-machado	Portuguese
-madeira	Portuguese
-magalhaes	Portuguese
-maria	Portuguese
-mata	Portuguese
-mateus	Portuguese
-matos	Portuguese
-medeiros	Portuguese
-melo	Portuguese
-mendes	Portuguese
-moreno	Portuguese
-nunes	Portuguese
-palmeiro	Portuguese
-paredes	Portuguese
-pereira	Portuguese
-pinheiro	Portuguese
-pinho	Portuguese
-ramires	Portuguese
-ribeiro	Portuguese
-rios	Portuguese
-rocha	Portuguese
-rodrigues	Portuguese
-romao	Portuguese
-rosario	Portuguese
-salazar	Portuguese
-santana	Portuguese
-santiago	Portuguese
-santos	Portuguese
-serafim	Portuguese
-silva	Portuguese
-silveira	Portuguese
-simoes	Portuguese
-soares	Portuguese
-souza	Portuguese
-torres	Portuguese
-vargas	Portuguese
-ventura	Portuguese
-smith	Scottish
-brown	Scottish
-wilson	Scottish
-campbell	Scottish
-stewart	Scottish
-thomson	Scottish
-robertson	Scottish
-anderson	Scottish
-macdonald	Scottish
-scott	Scottish
-reid	Scottish
-murray	Scottish
-taylor	Scottish
-clark	Scottish
-ross	Scottish
-watson	Scottish
-morrison	Scottish
-paterson	Scottish
-young	Scottish
-mitchell	Scottish
-walker	Scottish
-fraser	Scottish
-miller	Scottish
-mcdonald	Scottish
-gray	Scottish
-henderson	Scottish
-hamilton	Scottish
-johnston	Scottish
-duncan	Scottish
-graham	Scottish
-ferguson	Scottish
-kerr	Scottish
-davidson	Scottish
-bell	Scottish
-cameron	Scottish
-kelly	Scottish
-martin	Scottish
-hunter	Scottish
-allan	Scottish
-mackenzie	Scottish
-grant	Scottish
-simpson	Scottish
-mackay	Scottish
-mclean	Scottish
-macleod	Scottish
-black	Scottish
-russell	Scottish
-marshall	Scottish
-wallace	Scottish
-gibson	Scottish
-kennedy	Scottish
-gordon	Scottish
-burns	Scottish
-sutherland	Scottish
-stevenson	Scottish
-munro	Scottish
-milne	Scottish
-watt	Scottish
-murphy	Scottish
-craig	Scottish
-wood	Scottish
-muir	Scottish
-wright	Scottish
-mckenzie	Scottish
-ritchie	Scottish
-johnstone	Scottish
-sinclair	Scottish
-white	Scottish
-mcmillan	Scottish
-williamson	Scottish
-dickson	Scottish
-hughes	Scottish
-cunningham	Scottish
-mckay	Scottish
-bruce	Scottish
-millar	Scottish
-crawford	Scottish
-mcintosh	Scottish
-douglas	Scottish
-docherty	Scottish
-king	Scottish
-jones	Scottish
-boyle	Scottish
-fleming	Scottish
-mcgregor	Scottish
-aitken	Scottish
-christie	Scottish
-shaw	Scottish
-maclean	Scottish
-jamieson	Scottish
-mcintyre	Scottish
-hay	Scottish
-lindsay	Scottish
-alexander	Scottish
-ramsay	Scottish
-mccallum	Scottish
-whyte	Scottish
-jackson	Scottish
-mclaughlin	Scottish
-hill	Scottish
 abana	Spanish
 abano	Spanish
 abarca	Spanish
@@ -4912,73 +4398,3 @@ zapatero	Spanish
 zavala	Spanish
 zubizarreta	Spanish
 zuniga	Spanish
-nguyen	Vietnamese
-tron	Vietnamese
-le	Vietnamese
-pham	Vietnamese
-huynh	Vietnamese
-hoang	Vietnamese
-phan	Vietnamese
-vu	Vietnamese
-vo	Vietnamese
-dang	Vietnamese
-bui	Vietnamese
-do	Vietnamese
-ho	Vietnamese
-ngo	Vietnamese
-duong	Vietnamese
-ly	Vietnamese
-an	Vietnamese
-bach	Vietnamese
-banh	Vietnamese
-cao	Vietnamese
-chau	Vietnamese
-chu	Vietnamese
-chung	Vietnamese
-diep	Vietnamese
-doan	Vietnamese
-dam	Vietnamese
-dao	Vietnamese
-dinh	Vietnamese
-giang	Vietnamese
-ha	Vietnamese
-han	Vietnamese
-kieu	Vietnamese
-kim	Vietnamese
-la	Vietnamese
-lac	Vietnamese
-lam	Vietnamese
-lieu	Vietnamese
-luc	Vietnamese
-luong	Vietnamese
-luu	Vietnamese
-ma	Vietnamese
-mach	Vietnamese
-mai	Vietnamese
-nghiem	Vietnamese
-phi	Vietnamese
-pho	Vietnamese
-phung	Vietnamese
-quach	Vietnamese
-quang	Vietnamese
-quyen	Vietnamese
-ta	Vietnamese
-thach	Vietnamese
-thai	Vietnamese
-sai	Vietnamese
-thi	Vietnamese
-than	Vietnamese
-thao	Vietnamese
-thuy	Vietnamese
-tieu	Vietnamese
-to	Vietnamese
-ton	Vietnamese
-tong	Vietnamese
-trang	Vietnamese
-trieu	Vietnamese
-trinh	Vietnamese
-truong	Vietnamese
-van	Vietnamese
-vinh	Vietnamese
-vuong	Vietnamese
-vuu	Vietnamese

B-教学案例与实践/B6-神经网络基本原理简明教程/Data/names/Korean.txt

@@ -1,94 +0,0 @@
-Ahn
-Baik
-Bang
-Byon
-Cha
-Chang
-Chi
-Chin
-Cho
-Choe
-Choi
-Chong
-Chou
-Chu
-Chun
-Chung
-Chweh
-Gil
-Gu
-Gwang 
-Ha
-Han
-Ho
-Hong
-Hung
-Hwang
-Hyun 
-Jang
-Jeon
-Jeong
-Jo
-Jon
-Jong
-Jung 
-Kang
-Kim
-Ko
-Koo
-Ku
-Kwak
-Kwang 
-Lee
-Li
-Lim 
-Ma
-Mo
-Moon
-Nam
-Ngai
-Noh
-Oh 
-Pae
-Pak
-Park 
-Ra
-Rhee
-Rheem
-Ri
-Rim
-Ron
-Ryom
-Ryoo
-Ryu
-San
-Seo
-Seok
-Shim
-Shin
-Shon
-Si
-Sin
-So
-Son
-Song
-Sook
-Suh
-Suk
-Sun
-Sung
-Tsai 
-Wang
-Woo
-Yang
-Yeo
-Yeon
-Yi
-Yim
-Yoo
-Yoon
-You
-Youj
-Youn
-Yu
-Yun

B-教学案例与实践/B6-神经网络基本原理简明教程/Data/names/Polish.txt

@@ -1,139 +0,0 @@
-Adamczak
-Adamczyk
-Andrysiak
-Auttenberg
-Bartosz
-Bernard
-Bobienski
-Bosko
-Broż
-Brzezicki
-Budny
-Bukoski
-Bukowski
-Chlebek
-Chmiel
-Czajka
-Czajkowski
-Dubanowski
-Dubicki
-Dunajski
-Dziedzic
-Fabian
-Filipek
-Filipowski
-Gajos
-Gniewek
-Gomolka
-Gomulka
-Gorecki
-Górka
-Górski
-Grzeskiewicz
-Gwozdek
-Jagoda
-Janda
-Janowski
-Jaskolski
-Jaskulski
-Jedynak
-Jelen
-Jez
-Jordan
-Kaczka
-Kaluza
-Kamiński
-Kasprzak
-Kava
-Kedzierski
-Kijek
-Klimek
-Kosmatka
-Kowalczyk
-Kowalski
-Koziol
-Kozlow
-Kozlowski
-Krakowski
-Król
-Kumiega
-Lawniczak
-Lis
-Majewski
-Malinowski
-Maly
-Marek
-Marszałek
-Maslanka
-Mencher
-Miazga
-Michel
-Mikolajczak
-Mozdzierz
-Niemczyk
-Niemec
-Nosek
-Nowak
-Pakulski
-Pasternack
-Pasternak
-Paszek
-Piatek
-Piontek
-Pokorny
-Poplawski
-Róg
-Rudaski
-Rudawski
-Rusnak
-Rutkowski
-Sadowski
-Salomon
-Serafin
-Sienkiewicz
-Sierzant
-Sitko
-Skala
-Slaski
-Ślązak
-Ślusarczyk
-Ślusarski
-Smolák
-Sniegowski
-Sobol
-Sokal
-Sokolof
-Sokoloff
-Sokolofsky
-Sokolowski
-Sokolsky
-Sówka
-Stanek
-Starek
-Stawski
-Stolarz
-Szczepanski
-Szewc
-Szwarc
-Szweda
-Szwedko
-Walentowicz
-Warszawski
-Wawrzaszek
-Wiater
-Winograd
-Winogrodzki
-Wojda
-Wojewódka
-Wojewódzki
-Wronski
-Wyrick
-Wyrzyk
-Zabek
-Zawisza
-Zdunowski
-Zdunowski
-Zielinski
-Ziemniak
-Zientek
-Żuraw

B-教学案例与实践/B6-神经网络基本原理简明教程/Data/names/Portuguese.txt

@@ -1,74 +0,0 @@
-Abreu
-Albuquerque
-Almeida
-Alves
-Araújo
-Araullo
-Barros
-Basurto
-Belo
-Cabral
-Campos
-Cardozo
-Castro
-Coelho
-Costa
-Crespo
-Cruz
-D'cruz
-D'cruze
-Delgado
-De santigo
-Duarte
-Estéves
-Fernandes
-Ferreira
-Ferreiro
-Ferro
-Fonseca
-Franco
-Freitas
-Garcia
-Gaspar
-Gomes
-Gouveia
-Guerra
-Henriques
-Lobo
-Machado
-Madeira
-Magalhães
-Maria
-Mata
-Mateus
-Matos
-Medeiros
-Melo
-Mendes
-Moreno
-Nunes
-Palmeiro
-Paredes
-Pereira
-Pinheiro
-Pinho
-Ramires
-Ribeiro
-Rios
-Rocha
-Rodrigues
-Romão
-Rosario
-Salazar
-Santana
-Santiago
-Santos
-Serafim
-Silva
-Silveira
-Simões
-Soares
-Souza
-Torres
-Vargas
-Ventura

B-教学案例与实践/B6-神经网络基本原理简明教程/Data/names/Scottish.txt

@@ -1,100 +0,0 @@
-Smith
-Brown
-Wilson
-Campbell
-Stewart
-Thomson
-Robertson
-Anderson
-Macdonald
-Scott
-Reid
-Murray
-Taylor
-Clark
-Ross
-Watson
-Morrison
-Paterson
-Young
-Mitchell
-Walker
-Fraser
-Miller
-Mcdonald
-Gray
-Henderson
-Hamilton
-Johnston
-Duncan
-Graham
-Ferguson
-Kerr
-Davidson
-Bell
-Cameron
-Kelly
-Martin
-Hunter
-Allan
-Mackenzie
-Grant
-Simpson
-Mackay
-Mclean
-Macleod
-Black
-Russell
-Marshall
-Wallace
-Gibson
-Kennedy
-Gordon
-Burns
-Sutherland
-Stevenson
-Munro
-Milne
-Watt
-Murphy
-Craig
-Wood
-Muir
-Wright
-Mckenzie
-Ritchie
-Johnstone
-Sinclair
-White
-Mcmillan
-Williamson
-Dickson
-Hughes
-Cunningham
-Mckay
-Bruce
-Millar
-Crawford
-Mcintosh
-Douglas
-Docherty
-King
-Jones
-Boyle
-Fleming
-Mcgregor
-Aitken
-Christie
-Shaw
-Maclean
-Jamieson
-Mcintyre
-Hay
-Lindsay
-Alexander
-Ramsay
-Mccallum
-Whyte
-Jackson
-Mclaughlin
-Hill

B-教学案例与实践/B6-神经网络基本原理简明教程/Data/names/Vietnamese.txt

@@ -1,73 +0,0 @@
-Nguyen
-Tron
-Le
-Pham
-Huynh
-Hoang
-Phan
-Vu
-Vo
-Dang
-Bui
-Do
-Ho
-Ngo
-Duong
-Ly
-An
-an
-Bach
-Banh
-Cao
-Chau
-Chu
-Chung
-Chu
-Diep
-Doan
-Dam
-Dao
-Dinh
-Doan
-Giang
-Ha
-Han
-Kieu
-Kim
-La
-Lac
-Lam
-Lieu
-Luc
-Luong
-Luu
-Ma
-Mach
-Mai
-Nghiem
-Phi
-Pho
-Phung
-Quach
-Quang
-Quyen
-Ta
-Thach
-Thai
-Sai
-Thi
-Than
-Thao
-Thuy
-Tieu
-To
-Ton
-Tong
-Trang
-Trieu
-Trinh
-Truong
-Van
-Vinh
-Vuong
-Vuu

B-教学案例与实践/B6-神经网络基本原理简明教程/SourceCode/ch19-RNNBasic/Level4_Base_PM25_Fitting.py

@@ -50,10 +50,10 @@ def set_predicated_value(X, A, num_step, predicated_step):
 if __name__=='__main__':
     net_type = NetType.Fitting
     output_type = OutputType.LastStep
-    num_step = 72
+    num_step = 48 # 72
     dataReader = load_data(net_type, num_step)
     eta = 0.1 #0.1
-    max_epoch = 100 # 100
+    max_epoch = 200 # 100
     batch_size = 64 #64
     num_input = dataReader.num_feature
     num_hidden = 4  # 4