Technical Countermeasures for Security Risks of Artificial General Intelligence
Human beings might face significant security risks after entering into the artificial general intelligence (AGI) era. By summarizing the difference between AGI and traditional artificial intelligence, we analyze the sources of the security risks of AGI from the aspects of model uninterpretability, u...
Guardado en:
| Autor principal: | |
|---|---|
| Formato: | article |
| Lenguaje: | ZH |
| Publicado: |
《中国工程科学》杂志社
2021
|
| Materias: | |
| Acceso en línea: | https://doaj.org/article/b98eff623d98424a998a4533f7e27613 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| id |
oai:doaj.org-article:b98eff623d98424a998a4533f7e27613 |
|---|---|
| record_format |
dspace |
| spelling |
oai:doaj.org-article:b98eff623d98424a998a4533f7e276132021-11-29T08:00:54ZTechnical Countermeasures for Security Risks of Artificial General Intelligence2096-003410.15302/J-SSCAE-2021.03.005https://doaj.org/article/b98eff623d98424a998a4533f7e276132021-03-01T00:00:00Zhttp://www.engineering.org.cn/en/10.15302/J-SSCAE-2021.03.005https://doaj.org/toc/2096-0034Human beings might face significant security risks after entering into the artificial general intelligence (AGI) era. By summarizing the difference between AGI and traditional artificial intelligence, we analyze the sources of the security risks of AGI from the aspects of model uninterpretability, unreliability of algorithms and hardware, and uncontrollability over autonomous consciousness. Moreover, we propose a security risk assessment system for AGI from the aspects of ability, motivation, and behavior. Subsequently, we discuss the defense countermeasures in the research and application stages. In the research stage, theoretical verification should be improved to develop interpretable models, the basic values of AGI should be rigorously constrained, and technologies should be standardized. In the application stage, man-made risks should be prevented, motivations should be selected for AGI, and human values should be given to AGI. Furthermore, it is necessary to strengthen international cooperation and the education of AGI professionals, to well prepare for the unknown coming era of AGI. Liu Yuqing, Zhang Yuhuai, Duan Peiqi, Shi Boxin, Yu Zhaofei, Huang Tiejun, Gao Wen《中国工程科学》杂志社articleartificial general intelligence (AGI), security risk, risk assessment, coping strategyEngineering (General). Civil engineering (General)TA1-2040ZH中国工程科学, Vol 23, Iss 3, Pp 75-81 (2021) |
| institution |
DOAJ |
| collection |
DOAJ |
| language |
ZH |
| topic |
artificial general intelligence (AGI), security risk, risk assessment, coping strategy Engineering (General). Civil engineering (General) TA1-2040 |
| spellingShingle |
artificial general intelligence (AGI), security risk, risk assessment, coping strategy Engineering (General). Civil engineering (General) TA1-2040 Liu Yuqing, Zhang Yuhuai, Duan Peiqi, Shi Boxin, Yu Zhaofei, Huang Tiejun, Gao Wen Technical Countermeasures for Security Risks of Artificial General Intelligence |
| description |
Human beings might face significant security risks after entering into the artificial general intelligence (AGI) era. By summarizing the difference between AGI and traditional artificial intelligence, we analyze the sources of the security risks of AGI from the aspects of model uninterpretability, unreliability of algorithms and hardware, and uncontrollability over autonomous consciousness. Moreover, we propose a security risk assessment system for AGI from the aspects of ability, motivation, and behavior. Subsequently, we discuss the defense countermeasures in the research and application stages. In the research stage, theoretical verification should be improved to develop interpretable models, the basic values of AGI should be rigorously constrained, and technologies should be standardized. In the application stage, man-made risks should be prevented, motivations should be selected for AGI, and human values should be given to AGI. Furthermore, it is necessary to strengthen international cooperation and the education of AGI professionals, to well prepare for the unknown coming era of AGI.
|
| format |
article |
| author |
Liu Yuqing, Zhang Yuhuai, Duan Peiqi, Shi Boxin, Yu Zhaofei, Huang Tiejun, Gao Wen |
| author_facet |
Liu Yuqing, Zhang Yuhuai, Duan Peiqi, Shi Boxin, Yu Zhaofei, Huang Tiejun, Gao Wen |
| author_sort |
Liu Yuqing, Zhang Yuhuai, Duan Peiqi, Shi Boxin, Yu Zhaofei, Huang Tiejun, Gao Wen |
| title |
Technical Countermeasures for Security Risks of Artificial General Intelligence |
| title_short |
Technical Countermeasures for Security Risks of Artificial General Intelligence |
| title_full |
Technical Countermeasures for Security Risks of Artificial General Intelligence |
| title_fullStr |
Technical Countermeasures for Security Risks of Artificial General Intelligence |
| title_full_unstemmed |
Technical Countermeasures for Security Risks of Artificial General Intelligence |
| title_sort |
technical countermeasures for security risks of artificial general intelligence |
| publisher |
《中国工程科学》杂志社 |
| publishDate |
2021 |
| url |
https://doaj.org/article/b98eff623d98424a998a4533f7e27613 |
| work_keys_str_mv |
AT liuyuqingzhangyuhuaiduanpeiqishiboxinyuzhaofeihuangtiejungaowen technicalcountermeasuresforsecurityrisksofartificialgeneralintelligence |
| _version_ |
1718407484839821312 |