1、DevelopmentOf ANExploration Period: (Beginig i th 1940s)McCulochand Pits prosed th first neural netwrk mel.A logica culs ofthe idas imanet innervus tivtyIn 194, Hebrealizd the matheaticl descripton fth ntracion bwn brain l ad rpsed Hblerig rules. 1943The Priod f the First Bom: Lat 1950s Ealy 1960sRo
2、senblat prosed amtheaticl model dcrig he trg nd ory finfomation i hua brain-Pecptron.In 195, Widrowet al. prosed an daptive liear lemnt (Adin) twrk. I1960, h nd M. Hof prose th leanig rules ofLS (east ean Squar) othm. Frank Rosenblat (1928-71)Low Tide Priod:ate 1970s 1980sIn 196, Minskyet al. reachd
3、 apesimstc oclusion t functio frcrn ,i.e, XOR, i Perpr.In 1976, Grosbergprosed th ART (Adaptive Rnac Thry) neural network.I 198, Kohne dvelopd his work n Self-Orgaizg Maps (SOM). Marvin Le Minsky(1927-016)The 2ndBom Period: 1980s t 195In 1982, Hopfield sucesively proseddiscret and ctno fu intcnct nu
4、l twork mdels.I 1986, Ruelhartn McCelandet al. prosed abck pogatio rig algithm (BP algrithm).In 1987, te first Interational Neural etwork Acadeic Coc ws hd inS Dig. BP algorithmThe 2ndBomPeriod: 1980s t 195The U.S spent aproximately 70 ilon US dolars infundig for ul netwrk sarch.The Erpean Couity in
5、vestd more than 20 milon US dolas tourt he GALTEprjc feur etwrk rerch.Japn began the dvelopment ofthe sixth-genration machine of sft loic.China implented the clibing plan tosuport neural etwork sarc.The 2ndBom Period: 1980s t 195IBM launched t AS4 workstaion.Intels 8017Ntrainble anlg eurl etwork chi
6、p.Sims launched t MA16ral signal presorJapn Mitbis Electri Corptio hs lunchd an alog eurl chp at ntgas 40 neurns ad 40, erv keys.Th Cines Acdemy ofScis cesfuly dlopd aneural twork hip based n amixtur oanog an igtl.I 195, Vapnietc. ro SVM del, whic tok AN into 2dlo td id.The 3rdBom Period: 206 t rsnt
7、Around 195, Olshauen& Field use physiolgy a cmptertod tsyvionrbematthes i, an eyproe sa cdin algorits.In 197, LSTM (aspecial kind ofRN) was prosedanh gofectiaturllagu erstandi.In 206, Hinto prose th Dep Belif Network (DBN) (adep ntwork mdel), whicuseagedy unprvisdtrangmhdtsolvroblmsadchivgod rlt.The
8、 3rdBom Period: 206 t rsntIn 201, the U.S Department ofDefns (DARP progam) funde aep learigprojctfrth fisi.In 201, lanuge rcognit resarches from Microsft &Gogle sucesivly adopteDN thly du tpchegnier ratby 20%-3.In 201, Hinto reduc the Top5 ero rate ofIaeNtimage clasifcation problemsfr26% to15.In 201
9、, Andrew Ng and Jef Dan built he Gogle Brain project, aking breakthrougsithfiloimgercognit.The 3rdBom Period: 206 t rsntIn 2014, Gogle incrased th acury oflangue rcogitn from84% to98. termsfaogin,GoglesceritnsyeFaceNtachievs9.63%n LFW.In 2016, DepMinduse AlphaGo, software bsd onep larnig with 1920 C
10、PUclustr a 280PUs, tdefatheumnGchamiL Sedol.In 2015, Microsft adopte adep nural network esidual ernig method treducthelaicinrrtofImg3.57%th ural nwrk s as rc 152 layes.The 3rdBom Period: 206 t rsntIn 201, Huaweistablished t Noahs Ak Laborty toegae inrsearch onaturlng procng,aming&mchine larni.In 201
11、3, Baiduestablished t Istiue ofDep Lrig (IDL) for langue recogitn img rcogni andrtival.In 2013, Tectse ut estblish ep lrnig platform tprovide parle implntaio frcogni, advrtismt ecoendi.In 2015, Alibrelasd the DTPAI rtifcal intligc platfor with dep learigopen modu.In 2016, th attin odel was plied tocgnitve intligenc, ad the CN for specreognibyIftkCo.Lt.Sumary: Devlopment of AN
