dc.date.accessioned | 2023-02-03T17:55:50Z | |
dc.date.available | 2023-02-03T17:55:50Z | |
dc.date.created | 2022-04-06T18:23:00Z | |
dc.date.issued | 2022 | |
dc.identifier.citation | Colbrook, Matthew J. Antun, Vegard Hansen, Anders Christian . The difficulty of computing stable and accurate neural networks: On the barriers of deep learning and Smale's 18th problem. Proceedings of the National Academy of Sciences of the United States of America. 2022, 119(12) | |
dc.identifier.uri | http://hdl.handle.net/10852/99640 | |
dc.description.abstract | Significance Instability is the Achilles’ heel of modern artificial intelligence (AI) and a paradox, with training algorithms finding unstable neural networks (NNs) despite the existence of stable ones. This foundational issue relates to Smale’s 18th mathematical problem for the 21st century on the limits of AI. By expanding methodologies initiated by Gödel and Turing, we demonstrate limitations on the existence of (even randomized) algorithms for computing NNs. Despite numerous existence results of NNs with great approximation properties, only in specific cases do there also exist algorithms that can compute them. We initiate a classification theory on which NNs can be trained and introduce NNs that—under suitable conditions—are robust to perturbations and exponentially accurate in the number of hidden layers. | |
dc.language | EN | |
dc.publisher | The National Academy of Sciences | |
dc.rights | Attribution-NonCommercial-NoDerivatives 4.0 International | |
dc.rights.uri | https://creativecommons.org/licenses/by-nc-nd/4.0/ | |
dc.title | The difficulty of computing stable and accurate neural networks: On the barriers of deep learning and Smale's 18th problem | |
dc.title.alternative | ENEngelskEnglishThe difficulty of computing stable and accurate neural networks: On the barriers of deep learning and Smale's 18th problem | |
dc.type | Journal article | |
dc.creator.author | Colbrook, Matthew J. | |
dc.creator.author | Antun, Vegard | |
dc.creator.author | Hansen, Anders Christian | |
cristin.unitcode | 185,15,13,45 | |
cristin.unitname | Beregningsorientert matematikk | |
cristin.ispublished | true | |
cristin.fulltext | postprint | |
cristin.qualitycode | 2 | |
dc.identifier.cristin | 2015748 | |
dc.identifier.bibliographiccitation | info:ofi/fmt:kev:mtx:ctx&ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.jtitle=Proceedings of the National Academy of Sciences of the United States of America&rft.volume=119&rft.spage=&rft.date=2022 | |
dc.identifier.jtitle | Proceedings of the National Academy of Sciences of the United States of America | |
dc.identifier.volume | 119 | |
dc.identifier.issue | 12 | |
dc.identifier.pagecount | 0 | |
dc.identifier.doi | https://doi.org/10.1073/pnas.2107151119 | |
dc.type.document | Tidsskriftartikkel | |
dc.type.peerreviewed | Peer reviewed | |
dc.source.issn | 0027-8424 | |
dc.type.version | PublishedVersion | |