ICLR 2020 中的 Attention Papers
關鍵詞：注意力機制
ICLR 2017-2019 中的 Attention Papers
Reformer: The Efficient Transformer
Nikita Kitaev, Lukasz Kaiser, Anselm Levskaya
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Maha Elbayad, Jiatao Gu, Edouard Grave, Michael Auli
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Logic and the 2-Simplicial Transformer
James Clift, Dmitry Doryn, Daniel Murfet, James Wallbridge
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
On Identifiability in Transformers
Gino Brunner, Yang Liu, Damian Pascual, Oliver Richter, Massimiliano Ciaramita, Roger Wattenhofer
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Are Transformers universal approximators of sequence-to-sequence functions?
Chulhee Yun, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank Reddi, Sanjiv Kumar
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Transformer-XH: Multi-Evidence Reasoning with eXtra Hop Attention
Chen Zhao, Chenyan Xiong, Corby Rosset, Xia Song, Paul Bennett, Saurabh Tiwary
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Robustness Verification for Transformers
Zhouxing Shi, Huan Zhang, Kai-Wei Chang, Minlie Huang, Cho-Jui Hsieh
26 Sep 2019 (modified: 07 Apr 2020) ICLR 2020 Conference Blind Submission
Compressive Transformers for Long-Range Sequence Modelling
Jack W. Rae, Anna Potapenko, Siddhant M. Jayakumar, Chloe Hillier, Timothy P. Lillicrap
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Reducing Transformer Depth on Demand with Structured Dropout
Angela Fan, Edouard Grave, Armand Joulin
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Lite Transformer with Long-Short Range Attention
Zhanghao Wu*, Zhijian Liu*, Ji Lin, Yujun Lin, Song Han
26 Sep 2019 (modified: 27 Apr 2020) ICLR 2020 Conference Blind Submission
Xutai Ma, Juan Miguel Pino, James Cross, Liezl Puzon, Jiatao Gu
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Pay Attention to Features, Transfer Learn Faster CNNs
Kafeng Wang, Xitong Gao, Yiren Zhao, Xingjian Li, Dejing Dou, Cheng-Zhong Xu
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Learning deep graph matching with channel-independent embedding and Hungarian attention
Tianshu Yu, Runzhong Wang, Junchi Yan, Baoxin Li
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Tree-Structured Attention with Hierarchical Accumulation
Xuan-Phi Nguyen, Shafiq Joty, Steven Hoi, Richard Socher
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Adaptive Structural Fingerprints for Graph Attention Networks
Kai Zhang, Yaokang Zhu, Jun Wang, Jie Zhang
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Capsules with Inverted Dot-Product Attention Routing
Yao-Hung Hubert Tsai, Nitish Srivastava, Hanlin Goh, Ruslan Salakhutdinov
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Hyper-SAGNN: a self-attention based graph neural network for hypergraphs
Ruochi Zhang, Yuesong Zou, Jian Ma
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Junho Kim, Minjae Kim, Hyeonwoo Kang, Kwang Hee Lee
26 Sep 2019 (modified: 28 Apr 2020) ICLR 2020 Conference Blind Submission
SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decomposition
Zhixuan Lin, Yi-Fu Wu, Skand Vishwanath Peri, Weihao Sun, Gautam Singh, Fei Deng, Jindong Jiang, Sungjin Ahn
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submissio
On the Relationship between Self-Attention and Convolutional Layers
Jean-Baptiste Cordonnier, Andreas Loukas, Martin Jaggi
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission
Deep Learning For Symbolic Mathematics
Guillaume Lample, François Charton
26 Sep 2019 (modified: 11 Mar 2020) ICLR 2020 Conference Blind Submission