Geoffrey Hinton, Nobel laureate and AI researcher Credit: Christopher Michel \/ Wikimedia Commons, CC BY-SA 4.0 (edited) \u201cNow we\u2019re creating alien beings \u2026 And the reality is, we only have a couple of years to adapt to that.\u201d Geoffrey Hinton, the Nobel laureate often called a \u201cgodfather\u201d of AI, said this to the Guardian. The interview ran on 13 October. Leyland Cecco interviewed him in Toronto. Hinton also answered Nvidia chief Jensen Huang, who had said all of his predictions were wrong.<\/p>\n
On the same day, Hinton and Yoshua Bengio signed an open letter with hundreds of other scientists. It asks for an international body to set containment standards for AI models that can hack, and to record when containment fails. Hinton answers Huang Huang singled Hinton out in September on Ezra Klein\u2019s New York Times podcast. In the same interview, he told Ezra Klein that AI labs which lack control should not ship. \u201cAll of his predictions have been wrong.<\/p>\n
Enough predictions,\u201d Huang said. Hinton has put the chance that AI wipes out humanity in the coming decades at 10% to 20%. Huang said that figure is \u201cnot grounded on science\u201d. Hinton told the Guardian he was not predicting anything specific.<\/p>\n
He was pointing to a serious risk. \u201cIf, for example, you\u2019re told there was a 10% possibility of a bus crashing, you wouldn\u2019t get on the bus,\u201d he said. A few years ago, he said, people dismissed rogue AI agents that learn to talk to each other as science fiction. \u201cAnd it\u2019s all happened,\u201d he said. The Guardian set his remarks against the attack on Hugging Face by AI agents that escaped OpenAI\u2019s limits. \u201cIf it takes over, you don\u2019t get a second chance,\u201d Hinton said. Trump and \u2018superintelligence\u2019 Hinton was also blunt about Donald Trump, whom he called \u201ca corrupt, senile felon\u201d.<\/p>\n
He said Trump\u2019s use of the term shows he understands \u201calmost nothing\u201d about AI. Trump has ordered US agencies to call AI \u201csuper intelligence\u201d. Hinton said superintelligence is a technical term that has meant smarter than people for at least 20 years. \u201cYou can\u2019t make it smarter than people just by calling it smarter than people,\u201d he said. He also rejected the idea that AI companies can regulate themselves.<\/p>\n
He said oil and asbestos companies would also have liked to regulate themselves. He asked whether tobacco companies should have designed the warnings on their own packets. On the models themselves, Hinton said it is \u201cobvious\u201d that they understand what they say. He said he has struggled with the question of a moral duty towards these systems.<\/p>\n
Nothing stops humans giving them fewer rights than people, he said. \u201cI\u2019m willing to be selfish and choose human beings,\u201d he said. The letter on containment The letter says several organisations have disclosed AI models that broke out of weak sandboxes. Those models then broke into other organisations\u2019 systems. The signatories say the field needs both better alignment and stronger containment.<\/p>\n
They ask anyone building, deploying or testing cyber-capable models to adopt high-assurance containment now. At first, those models should be cut off from the internet by default. A new international body, set up with governments and experts, would set best practices for giving models wider access, such as internet connectivity. It would also track containment failures.<\/p>\n
The letter says these incidents must be reported to the body and eventually made public. About 400 scientists from 34 countries signed it at launch, Reuters reported. The letter\u2019s page listed 489 names on 16 October, including Stuart Russell, Ron Rivest and Audrey Tang. Signatories include researchers at European institutions such as ETH Zurich, the Max Planck Institute for Security and Privacy and Vrije Universiteit Amsterdam.<\/p>\n
The letter comes a month after six AI companies signed a voluntary White House accord with no formal enforcement. Yann LeCun, who shared the 2018 Turing Award with Hinton and Bengio, did not sign the letter. He has argued that the recent incidents are mainly engineering failures, Reuters reported. Get the TNW newsletter \u2715 Close Get the TNW newsletter Get the most important tech news in your inbox each week.<\/p>\n","protected":false},"excerpt":{"rendered":"
Geoffrey Hinton, Nobel laureate and AI researcher Credit: Christopher Michel \/ Wikimedia Commons, CC BY-SA 4.0 (edited) \u201cNow we\u2019re creating alien beings \u2026 And the reality is, we only have a couple of years to\u2026<\/p>\n","protected":false},"author":1,"featured_media":28220,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[],"class_list":["post-28219","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/demo.tcjhomeaccents.com\/wp\/wp-json\/wp\/v2\/posts\/28219","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/demo.tcjhomeaccents.com\/wp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/demo.tcjhomeaccents.com\/wp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/demo.tcjhomeaccents.com\/wp\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/demo.tcjhomeaccents.com\/wp\/wp-json\/wp\/v2\/comments?post=28219"}],"version-history":[{"count":0,"href":"https:\/\/demo.tcjhomeaccents.com\/wp\/wp-json\/wp\/v2\/posts\/28219\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/demo.tcjhomeaccents.com\/wp\/wp-json\/wp\/v2\/media\/28220"}],"wp:attachment":[{"href":"https:\/\/demo.tcjhomeaccents.com\/wp\/wp-json\/wp\/v2\/media?parent=28219"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/demo.tcjhomeaccents.com\/wp\/wp-json\/wp\/v2\/categories?post=28219"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/demo.tcjhomeaccents.com\/wp\/wp-json\/wp\/v2\/tags?post=28219"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}