DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, S | ko |
dc.contributor.author | Park, DJ | ko |
dc.contributor.author | Chang, Dong Eui | ko |
dc.date.accessioned | 2019-08-29T01:20:17Z | - |
dc.date.available | 2019-08-29T01:20:17Z | - |
dc.date.created | 2019-08-26 | - |
dc.date.created | 2019-08-26 | - |
dc.date.created | 2019-08-26 | - |
dc.date.created | 2019-08-26 | - |
dc.date.issued | 2019-08 | - |
dc.identifier.citation | ELECTRONICS LETTERS, v.55, no.16, pp.899 - 901 | - |
dc.identifier.issn | 0013-5194 | - |
dc.identifier.uri | http://hdl.handle.net/10203/266054 | - |
dc.description.abstract | The authors present a novel gradient descent algorithm called RAPIDO for deep learning. It adapts over time and performs optimisation using current, past and future information similar to the PID controller. The proposed method is suited for optimising deep neural networks that consist of activation functions such as sigmoid, hyperbolic tangent and ReLU functions because it can adapt appropriately to sudden changes in gradients. They experimentally study the authors' method and show the performance results by comparing with other methods on the quadratic objective function and the MNIST classification task. The proposed method shows better performance than the other methods. | - |
dc.language | English | - |
dc.publisher | INST ENGINEERING TECHNOLOGY-IET | - |
dc.title | RAPIDO: a rejuvenating adaptive PID-type optimiser for deep neural networks | - |
dc.type | Article | - |
dc.identifier.wosid | 000478740300016 | - |
dc.identifier.scopusid | 2-s2.0-85070337798 | - |
dc.type.rims | ART | - |
dc.citation.volume | 55 | - |
dc.citation.issue | 16 | - |
dc.citation.beginningpage | 899 | - |
dc.citation.endingpage | 901 | - |
dc.citation.publicationname | ELECTRONICS LETTERS | - |
dc.identifier.doi | 10.1049/el.2019.1593 | - |
dc.contributor.localauthor | Chang, Dong Eui | - |
dc.contributor.nonIdAuthor | Kim, S | - |
dc.contributor.nonIdAuthor | Park, DJ | - |
dc.description.isOpenAccess | Y | - |
dc.type.journalArticle | Article | - |
dc.subject.keywordAuthor | pattern classification | - |
dc.subject.keywordAuthor | optimisation | - |
dc.subject.keywordAuthor | learning (artificial intelligence) | - |
dc.subject.keywordAuthor | neural nets | - |
dc.subject.keywordAuthor | gradient methods | - |
dc.subject.keywordAuthor | three-term control | - |
dc.subject.keywordAuthor | RAPIDO | - |
dc.subject.keywordAuthor | rejuvenating adaptive PID-type optimiser | - |
dc.subject.keywordAuthor | deep neural networks | - |
dc.subject.keywordAuthor | deep learning | - |
dc.subject.keywordAuthor | PID controller | - |
dc.subject.keywordAuthor | activation functions | - |
dc.subject.keywordAuthor | sigmoid functions | - |
dc.subject.keywordAuthor | hyperbolic tangent functions | - |
dc.subject.keywordAuthor | ReLU functions | - |
dc.subject.keywordAuthor | quadratic objective function | - |
dc.subject.keywordAuthor | gradient descent algorithm | - |
dc.subject.keywordAuthor | MNIST classification task | - |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.