Kusanthula kwachidule kwa luso lomwe likutuluka mumitundu yayikulu yazilankhulo

Kafukufuku wambiri pazanzeru zopanga zaka makumi awiri zapitazi ayang'ana kwambiri pakuphunzitsa ma neural network, kuti agwire ntchito imodzi yokhala ndi seti yapadera yophunzitsira. Mwachitsanzo, sankhani ngati chithunzi chili ndi mphaka, fotokozani mwachidule nkhani, masulirani kuchokera ku Chingerezi kupita ku Swahili ...

M'zaka zaposachedwa, paradigm yatsopano yasintha mozungulira zilankhulo: ma neural network omwe amangoneneratu mawu otsatira m'chiganizo choperekedwa ndi mawu am'mbuyomu mu sentensi.

Pambuyo pophunzitsidwa pamawu ambiri osalembedwa, anthu azilankhulo amatha "kuitanidwa" kuti agwire ntchito mongoyembekezera monga kulosera mawu potsatira chiganizo. Mwachitsanzo, ntchito yomasulira chiganizo cha Chingelezi m’Chiswahili tinganenenso kuti kuneneratu mawu otsatirawa: “Matembenuzidwe a Chiswahili akuti ‘artificial intelligence’ ndi ...”

Kuchokera ku ntchito yeniyeni kupita ku ntchito yayikulu

Paradigm yatsopanoyi ikuyimira kusintha kuchokera ku zitsanzo yokhudza ntchito, ophunzitsidwa kugwira ntchito imodzi, mwa zitsanzo ntchito wamkulu, yomwe imatha kugwira ntchito zosiyanasiyana. Kuphatikizanso zitsanzo ntchito wamkulu amathanso kuchita ntchito zatsopano zomwe sizinaphatikizidwe momveka bwino muzolemba zamaphunziro. Mwachitsanzo, GPT-3 adawonetsa kuti mitundu ya zilankhulo imatha kuchulukitsa manambala a manambala awiri, ngakhale atakhala kuti sanaphunzitsidwe kutero. Komabe, kuthekera kochita ntchito zatsopano kunachitika kokha ndi zitsanzo zokhala ndi magawo angapo ndikuphunzitsidwa pagulu lalikulu lokwanira.

Zadzidzidzi ngati khalidwe

Lingaliro lakuti kusintha kwachulukidwe mu dongosolo kungayambitse khalidwe latsopano limadziwika kuti zadzidzidzi, lingaliro lodziwika ndi wolemba mphotho ya Nobel Philip Anderson mu 1972 nkhani yakuti "More is Different". M'magulu ambiri monga physics, biology, economics ndi sayansi ya makompyuta, zochitika zomwe zikubwera zawonedwa m'machitidwe ovuta.

Mu nkhani yaposachedwa Lofalitsidwa pa Zochita pa Kafukufuku Wophunzira Pamakina, lab Moni in Sukulu ya Stanford defiamalepheretsa luso lotuluka m'zilankhulo zazikulu motere:

Luso ndi emergent ngati sichipezeka muzithunzi zing'onozing'ono koma zilipo muzithunzi zazikulu.

Kuzindikiritsa kukhalapo kwa luso akutulukira, nkhani yathu inaphatikiza zomwe zapeza zamitundu yosiyanasiyana ndi njira zomwe zakhala zikuchitika zaka ziwiri zapitazi kuchokera pamene GPT-3 inatulutsidwa. Pepalalo lidasanthula kafukufuku yemwe adasanthula kuchuluka kwa sikelo: zitsanzo zamitundu yosiyanasiyana yophunzitsidwa ndi zida zosiyanasiyana zowerengera. Pazochita zambiri, machitidwe amtunduwo amakula modziwikiratu ndi kukula kapena kuwonjezereka mosayembekezereka kuchoka pakuchita mwachisawawa kupita kupamwamba kuposa zikhalidwe zachisawawa pamlingo wina wake.

Kuti mudziwe zambiri werengani nkhaniyo luso lotulukira mu zitsanzo zamalankhulidwe

Jason Wei ndi wasayansi wofufuza ku Google Brain. Rishi Bommasani ndi wophunzira wachiwiri kwa udokotala ku Stanford's Computer Science yemwe adathandizira kukhazikitsa Stanford Center for Research on Foundation Models (CRFM). Werengani phunziro lawo "Zomwe Zachitika Za Large Language Models,", yolembedwa mogwirizana ndi akatswiri a Google Research, Stanford University, UNC Chapel Hill, ndi DeepMind.

drafting BlogInnovazione.it