北京快乐8

您所在的位置: 广东残联 > 国际动态

华裔科学家成功解码脑电波AI直接从大脑中合成语音

2019-04-26 | 作者: | 来源:北京快乐8_北京快乐彩8-官方推荐
字体:

摘要: 4月25日,Nature杂志发表了加州大学旧金山分校(University of California San Francisco)的一项最新成果,该校神经外科华裔教授Edward Chang及同事开发出一种可以将脑活动转化为语音的解码器。这套人类语音合成系统,通过解码与人类下颌、喉头、嘴唇和舌头动作相关的脑信号,并合成出受试者想要表达的语音。

        4yue25ri,naturezazhifabiaolejiazhoudaxuejiujinshanfenxiao(university of california san francisco)deyixiangzuixinchengguo,gaixiaoshenjingwaikehuayijiaoshouedward changjitongshikaifachuyizhongkeyijiangnaohuodongzhuanhuaweiyuyindejiemaqi。zheitaorenleiyuyinhechengxitong,tongguojiemayurenleixiahe、houtou、zuichunheshetoudongzuoxiangguandenaoxinhao,binghechengchushoushizhexiangyaobiaodadeyuyin。

  大脑活动能够解码成语音

        shuohuasihushiyixianghaobufeilidehuodong,dantaqishishirenleizuifuzadedongzuozhiyi。shuohuaxuyaojingque、dongtaidixiediaoshengdaofayinqiguanjiegouzhongdejirou——zuichun、shetou、houbuhexiahe。dangyouyuzhongfeng、jiweisuocesuoyinghuazhenghuoqitashenjingxitongjibingerdaozhiyanyuzhongduanshi,sangshishuohuanenglikenengshihuimiexingde。

  laizijiazhoudaxuejiujinshanfenxiaodekexuejiachuangzaolegengjiejinnenggouhuifushuohuagongnengdenaojijiekou(brain–computer interface,bci)。

  naojijiekouzhizaibangzhutanhuanhuanzhezhijiecongdanaozhong“duqu”tamendeyitu,bingliyongzheixiexinxikongzhiwaibushebeihuoyidongtanhuandezhiti,zheixiangjishumuqiannenggoushitanhuanderenmeifenzhongzuiduonengdachu8gedanci,erjiazhoudaxuejiujinshanfenxiangdeyanjiurenyuankaifaleyizhongfangfa,shiyongshenduxuexifangfazhijiecongdanaoxinhaozhongchanshengkouyujuzi,dadao150gedanci,jiejinzhengchangrenshuiping!

  zheixiangyanjiufabiaozaizuixinyiqi《ziran》zazhishang,zuozheweianumanchipalliyijihuayikexuejiaedward changdengren。

  每分钟能够生成150单词,接近正常人类水平

        jiazhoudaxuejiujinshanfenxiaodeyanjiurenyuanyu5mingzhiyuanzhehezuo,zhiyuanzhemenjieshouleyixiangbeichengwei“luneijiance”deshiyan,qizhongdianjibeiyongyujiancedanaohuodong,zuoweidianxianzhiliaodeyibufen。

  xuduodianxianhuanzhedeyaowuzhiliaoxiaoguobingbuhao,tamenxuanzejieshounaobushoushu。zaishuqian,yishengbixushouxianzhaodaobingrendanaozhongdianxianfazuode“redian”,zheiyiguochengshitongguofangzhizaidanaoneibuhuobiaomiandedianjilaiwanchengde,bingjiancemingxiandedianxinhaogaofeng。

  jingquedingwei“redian”deweizhikenengxuyaoshuzhoushijian。zaiciqijian,huanzhetongguozhirudanaoquyuhuoqifujindedianjilaiduri,zheixiequyushejiyundonghetingjuexinhao。zheixiehuanzheyibanhuitongyiliyongzheixiezhiruwujinxingewaideshiyan。

  tuweiecogdianjizhenlieyoujiludanaohuodongdeluneidianjizucheng

        cicizhaomudewumingzhiyuanzhetongyiceshixuniyuyinfashengqi。meigehuanzhedouzhiruleyilianggedianjizhenlie: tuzhangdaxiaode、baohanjibaigeweidianjidexiaodian,fangzhizaidanaobiaomian。

  tuweicanyudezhiyuanzhedanaozhongdedianjizhenlieweizhi

        shiyanyaoqiucanyuzhebeisongjibaigejuzi,dianjihuijiluyundongpicengzhongshenjingyuandefangdianmoshi。yanjiurenyuanjiangzheixiemoshiyuhuanzhezaiziranshuohuashizuichun,shetou,houbuhexiahedeweixiaoyundonglianxiqilai。ranhoujiangzheixiedongzuofanyichengkouyuhuadejuzi。

  shiyanyaoqiumuyuweiyingyuderentingzheixiejuzi,yiceshixuniyuyindeliuchangxing。yanjiufaxian,dayue70%dexunixitongshengchengdeneirongshikelijiede。

  zuizhong,zheitaoxinxitongmeifenzhongnenggoushengcheng150danci,jiejinziranjianghuadeyusushuiping。eryiqianjiyuzhiruwudetongxinxitongmeifenzhongkeyishengchengdayue8gedanci。

  技术细节: 两阶段解码方法

        zaizheixianggongzuozhong,yanjiurenyuanshiyongleyizhongjiaozuogaomidupicengnaodiantudejishulaigenzongzhiyuanzheshuohuashidanaozhongkongzhiyanyuhefayinqiguanyundongdequyudehuodong,zhiyuanzhemenbeiyaoqiushuolejibaijuhua。

  tuweiyuyinhechengdenaojijiekou

        weilezhongjianhuayu,anumanchipallidengrenbushijiangdanaoxinhaozhijiezhuanhuanweiyinpinxinhao,ershishiyongyizhongliangjijiemadefangfa。tamenshouxianjiangshenjingxinhaozhuanhuanweishengdaofayinqiguanyundongdebiaoshi,ranhoujiangjiemadeyundongzhuanhuanweikouyujuzi,rutu1suoshi。liangcizhuanhuandoushiyonglediguishenjingwangluo——yizhongrengongshenjingwangluo,zaichulihezhuanhuanjuyoufuzashijianjiegoudeshujushitebieyouxiao。

  zaishangtuazhong,yiqiandeyuyinhechengyanjiucaiyongdefangfashishiyongnaodiantu(ecog)shebeijiancedanaoyuyinxiangguanquyudeshenjingxinhao,bingchangshijiangzheixiexinhaozhijiejiemahechengyuyin,shiyongyizhongchengweidiguishenjingwangluo(rnn)derengongshenjingwangluo;shangtubzhong,anumanchipallidengrenkaifaleyizhongbutongdefangfa,rnnbeiyongyuliangjieduanjiema。qizhongyigejiemabuzhoushijiangshenjingxinhaozhuanhuanchengshengdaofashengqiguan(hongse)deyuguyundong,shejidaoyuyinshengchengdejiepoujiegou(zuichun、shetou、houbuhexiahe)。weilezaidiyigejiemabuzhouzhongjinxingxunlian,zuozhexuyaomeigerendeshengdaoyundongyutamendeshenjinghuodongguanlianqilaideshuju。

  yinweiwufazhijieceliangmeigerendeshengdaoyundong,anumanchipallidengrengoujianleyigernnlaiyuguzheixieyundong,qixunlianshujushizhiqianshoujidedaliangshengdaoyundongshujuheyuyinluyin。zheigernnchanshengdeshengdaoyundonggujizuyixunliandiyigejiemaqi。diergejiemabuzhoujiangzheixiegujidedongzuozhuanhuanchenghechengyuyin。anumanchipallihetadetongshideliangbujiemafangfachanshengdekouyujuzideshizhenlvmingxiandiyuzhijiejiemafangfahuodedejuzi。

  yuzhijiejiemashengxuetezhengxiangbi,zuozhecaiyongdeliangjieduanjiemafangfanengmingxianjianxiaoshengyinshizhen。ruguokeyihuodekuaduozhongyuyintiaojiandehailiangshujuji,neimezhijiehechengkenenghuijiejinhuoyouyuliangjieduanjiemadefangfa。

  raner,kaolvdaoxianshizhongshujujidekuifa,jiemadezhongjianjieduanhuijiangshengdaofayinqiguanzhengchangyundonggongnengdexinxidairumoxing,bingxianzhibixupinggudeshenjingwangluomoxingdekenengcanshu。zheizhongfangfasihushishenjingwangluonenggoushixiangenggaodexingneng。zuizhong,fanyingzhengchangyundonggongnengde“fangsheng”fangfakenengzaifuzhiziranyuyandianxingdekuaisu、gaojingdutongxinfangmianfahuiguanjianzuoyong。

  不能说话的个体也能实现语音合成

        zainaojijiekou(bci)yanjiuzhong,baokuoxinxingdeyuyinnaojijiekoulingyu,kaifahecaiyongyunxukuayanjiujinxingyouyiyidebijiaodewenjianduliangshiyixiangtiaozhan。liru,zhonggouyuanshiyuyindecuowudengduliangkenengyunaojijiekoudegongnengxingneng(jitingzheshifounengtingdonghechengdeyuyin)jihumeiyouduiyingguanxi。

  weilejiejuezheigewenti,anumanchipallidengrencongyuyingongchenglingyuchufa,kaifaleyiyufuzhiderenleitingzhongyuyinkedongduceliangfangfa。tamenzaizhongbaoshichangamazon mechanical turkshangzhaomuyonghu,rangzhiyuanzheshibiehechengyuyinzhongdedancihuojuzi。yuzhonggoucuowuhuoyiqianshiyongdezidongkedongduceliangfangfabutong,zheizhongfangfazhijieceliangyuyinduirenleitingzhongdekedongdu,erbuxuyaoyuyuanshihuayujinxingbijiao。

  anumanchipallihetadetongshideyanjiujieguoweiyuyinhechengnaojijiekoudegainiantigonglelingrenxinfuzhengju,wulunshizaiyinpinzhongjiandezhunquexingfangmian,haishizaitingzheduichanshengdedancihejuzijinxingfenleidenenglifangmian。

  raner,zaitongwanglinchuangkexingdeyuyinnaojijiekoudedaolushangrengyouxuduotiaozhan。

  zhonggouyuyindekelijiexingrengyuandiyuziranyuyin,naojijiekounengfoutongguoshoujigengdadeshujujibingjixukaifadicengdejisuanfangfalaijinyibugaijinhaiyoudaiguancha。shiyongjilujubunaohuodongdeshenjingjiekoukenengbishiyongpicengnaodiantujiludegengweiyouxiao。liru,zainaojijiekouyanjiudeqitalingyu,pizhineiweidianjizhenlietongchangbipizhinaodiantujuyougenggaodexingneng。

  muqiansuoyouyuyinjiemafangfadelingyigexianzhishixuyaoshiyongyuyinlaixunlianjiemaqi。yinci,jiyuzheixiefangfadenaojijiekoubunengzhijieyingyongyuwufashuohuaderen。danshianumanchipallihetadetongshimenfaxian,dangzhiyuanzhezaibufashengdeqingkuangxiamofangyuyinshi,yuyinhechengrengranshikexingde,jinguanyuyinjiemadezhunquelvyaodideduo。wufachanshengyuyinxiangguandongzuodegetishifounenggoushiyongyuyinhechengnaojijiekoushiweilaiyanjiudeyigewenti。

  tuweijiyushenjingjiemadewushengmofangyuyinhecheng

        zhidezhuyideshi,zaishouciduinaojijiekoujinxinggainianyanzhengyanjiuyikongzhijiankangdongwudeshoubeiheshoudeyundongzhihou,renmenduizheizhongnaojijiekouzaitanhuanhuanzheshenshangdeshiyongxingtichuleleisidewenti。suihoudelinchuangshiyanlingrenxinfudizhengming,shiyongnaojijiekou,renleikeyikuaisubeijingkuaile8、kongzhijixiebei、huifutanhuanzhitideganjueheyundongdeng。

  zuihou,zheixielingrenxinfudegainianyanzhengzhengminglebunengshuohuadegetiyenengshixianyuyinhecheng,jiehenaojijiekouzaishangzhitanhuanhuanzhezhongdekuaisujinzhan,yanjiurenyuanrenweiyinggaidalikaolvshejiyanyuzhangaihuanzhedelinchuangyanjiu。suizhechixudejinbu,xiwanggengduoyouyuyanzhangaiderennenggouzhongxinhuodeziyoubiaodasixiangdenengli,bingzhongxinyuzhouweideshijielianxiqilai。

  华裔科学家解码,马斯克脑机接口公司也会有新动作

        naturezheipianwenzhangdezuozhezhiyishijiazhoudaxuejiujinshanfenxiaoshenjingwaikejiaoshouedward changboshi。

  tuweiedward chang

         edward changboshideyanjiuzhongdianshiyanyu、yundongherenleiqinggandedanaojizhi,tongshitayeshijiazhoudaxuejiujinshanfenxiaohejiazhoudaxuebokelifenxiaodehezuodanwei——shenjinggongchengyujiazhizhongxindelianhefuzeren。gaizhongxinhuijilegongcheng、shenjingbingxueheshenjingwaikefangmiandezhuanjia,yikaifazuixianjindeshengwuyixuejishu,yongyihuifushenjingxitongcanjihuanzhedegongneng,rutanhuanheyanyuzhangai。

  edward changboshibiaoshi,zheicizainatureshangdeyanjiu,“beijingkuaile8tongguojiemadanaohuodongtishengyuyindeqingxidu,monideyuyinbicongdanaozhongtiqushengyinbiaoshidehechengyuyingengzhunque、gengziran。”

  renleijiangdanaoyujisuanjixiangliandenuliyuelaiyueduo。

  shanggeyue,meiguoyizukexuejiazaibiorxiv.orgshangfabiaoyipianlunwen,chengzhaodaolekuaisujiangdianxianzhirudashudanaodefangfa,lunwenzhongmiaoshuzheigeguochengshi“xiangrenleidanaozhijiecharujisuanjiqianzaixitongmaichudezhongyaoyibu”。

  yanjiurenyuanjiangtamendexitongchengwei“fengrenji”(sewing machine),kexuejiazaishiyanshizhongyichuyikuailaoshudetougubingcharuyigenzhentou,jiangrouxingdianjisongrulaoshudenaozuzhi。

  tuweipengboxinwenbaodao,zheizukexuejiayumasikedenaojijiekougongsineuralinkyougezhongsongsanguanlian。

  neuralinkyu2016nianzhuceweijiazhoudeyijiayixueyanjiugongsi,gaigongsipinqinglelaizibutongdaxuedejiweizhimingshenjingkexuejia,bingyujiazhoudaxuedaiweisifenxiaodeshiyanshiqianyue,duilingzhangleidongwujinxingyanjiu。

  benzhousan,dangtwitteryonghuxunwenneurinkdejinzhanshi,masikeshuo,“kenenghuizaijigeyueneixuanbuyixiezhidezhuyideshiqing。”

  masikerenwei,naojijiekoujishunengzai2021nianzhiqianzhiliaoyanzhongdenaosunshang。ciwai,kexuekeyitongguonaojijiekoukuodarenleidenengli。tajuleyigelizi: renmenkeyitongguoxinlingganyinglaichuandafuzadegainian,“nibuxuyaoyongyuyanbiaoda”。

  renleishifouyouyitianhuiyujiqihebing?masikerenwei,renleiyijingzaimouzhongchengdushangzuodaolezheiyidian,yinweizhinengshoujidengjinhuwusuobuzaidejishu,yincinaojijiekouzheixianggongzuoyinggaijixuxiaqu。

北京快乐8_北京快乐彩8-官方推荐 重庆快乐十分_重庆快乐十分平台---首页_欢迎您 上海时时乐_上海时时乐平台〖福利多多〗 澳洲快乐3_澳洲快乐3官网-官网APP下载 秒速快3_秒速快3开奖_最佳信誉官网 秒速飞艇,秒速飞艇开户-官网 加拿大28开奖官网_加拿大28软件〖2020购彩首选〗 十分赛车_十分赛车app-点击进入 时时彩_时时彩宝典「官方首页」 幸运赛马_幸运赛马官网-手机版 秒速飞艇_秒速飞艇开户-Welcome