Papers by Area

You are viewing papers by research areas

Deep Learning / Neural Modeling

Synthesizer: Rethinking Self-Attention in Transformer Models
Yi Tay, Dara Bahri, Donald Metzler, Da-Cheng Juan, Zhe Zhao, Che Zheng
arXiV preprint
PDF |

HyperGrid - Efficient Multi-Task Transformers with Grid-wise Decomposable Hyper Projections
Yi Tay, Zhe Zhao, Dara Bahri, Donald Metzler, Da-Cheng Juan
arXiV preprint
PDF |

Sparse Sinkhorn Attention
Yi Tay, Dara Bahri, Liu Yang, Donald Metzler, Da-Cheng Juan
Proceedings of ICML 2020
PDF |

Compositional De-Attention Networks
Yi Tay, Luu Anh Tuan, Aston Zhang, Shuohang Wang, Siu Cheung Hui
Proceedings of NeurIPS 2019
PDF

Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks
Yi Tay, Aston Zhang, Anh Tuan Luu, Jinfeng Rao, Shuai Zhang, Shuohang Wang, Jie Fu, Siu Cheung Hui
Proceedings of ACL 2019 (Long Paper)
PDF | Code |
Featured in ICML 2019 tutorial

Recurrently Controlled Recurrent Networks
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of NeurIPS 2018
PDF | Code

Question Answering and Language Understanding

Interactive Machine Comprehension via Information Seeking Agents
Xingdi Yuan, Jie Fu, Marc-Alexandre Cote, Yi Tay, Christopher Pal, Adam Trischler
Proceedings of ACL 2020 (Long Paper)
PDF | Code

Multi-level Head-wise Match and Aggregation in Transformer for Textual Sequence Matching
Shuohang Wang, Yunshi Lan, Yi Tay, Jing Jiang, Jingjing Liu
Proceedings of AAAI 2020
PDF |

Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives
Yi Tay, Shuohang Wang, Anh Tuan Luu, Jie Fu, Minh C. Phan, Xingdi Yuan, Jinfeng Rao, Siu Cheung Hui, Aston Zhang
Proceedings of ACL 2019 (Long Paper, Oral Presentation)
PDF |

Densely Connected Attention Propagation for Reading Comprehension
Yi Tay, Anh Tuan Luu, Siu Cheung Hui, Jian Su
Proceedings of NeurIPS 2018
PDF | Code

Compare, Compress and Propagate: Enhancing Neural Architectures with Alignment Factorizaton for Natural Language Inference
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of EMNLP 2018 (Long Paper)
PDF | Code

Co-stack Residual Affinity Networks with Multi-level Attention Refinement for Matching Text Sequences
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of EMNLP 2018 (Long Paper)
PDF | Code

Multi-Granular Sequence Encoding via Dilated Composition Units for Reading Comprehension
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of EMNLP 2018 (Long Paper)
PDF | Code

Analysis

Generative Models are Unsupervised Predictors of Page Quality: A Colossal-Scale Study
Dara Bahri, Yi Tay, Che Zheng, Donald Metzler, Cliff Brunk, Andrew Tomkins
Proceedings of WSDM 2021
PDF |

Reverse Engineering Configurations of Neural Text Generation Models
Yi Tay, Dara Bahri, Che Zheng, Clifford Brunk, Donald Metzler, Andrew Tomkins
Proceedings of ACL 2020 (Short Paper)
PDF |

General Machine Learning

Jacobian Adversarially Regularized Networks for Robustness
Alvin Chan, Yi Tay, Yew Soon Ong, Jie Fu
Proceedings of ICLR 2020
PDF |

What it Thinks is Important is Important: Robustness Transfers Through Input Gradients
Alvin Chan, Yi Tay, Yew Soon Ong
Proceedings of CVPR 2020
PDF |

Poison Attacks against Text Daatsets with Conditional Adversarially Regularized Autoencoder
Alvin Chan, Yi Tay, Yew Soon Ong, Aston Zhang
Proceedings of EMNLP 2020 (Findings)
PDF |

Information Retrieval

Choppy: Cut Transformers for Ranked List Truncation
Dara Bahri, Yi Tay, Che Zheng, Donald Metzler, Andrew Tomkins
Proceedings of SIGIR 2020 (Short Paper)
PDF |

Bridging the Gap of Relevance Matching and Semantic Matching with Hierarchical Co-Attention Network
Jinfeng Rao, Linqing Liu, Yi Tay, Wei Yang, Peng Shi, Jimmy Lin
Proceedings of EMNLP 2019 (Long Paper)
PDF | Code

Multi-Cast Attention Networks
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of KDD 2018
PDF

Hyperbolic Representation Learning for Fast and Efficient Neural Question Answering
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of WSDM 2018
PDF | Code

Cross Temporal Recurrent Networks for Ranking Question Answer Pairs
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of AAAI 2018 (Oral)
PDF | Dataset

Hermitian Co-Attention Networks for Text Matching in Asymmetrical Domains
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of IJCAI 2018
PDF

Learning to Rank Question Answer Pairs with Holographic Dual LSTM Architecture
Yi Tay, Minh C.Phan, Anh Tuan Luu, Siu Cheung Hui
Proceedings of SIGIR 2017
PDF | Dataset

Recommender Systems and User Modeling

HyperML: A Boosting Metric Learning Approach in Hyperbolic Space for Recommender Systems
Lucas Vinh Tranh, Yi Tay, Shuai Zhang, Gao Cong, Xiaoli Li
Proceedings of WSDM 2020 (Best Paper Award Runner-Up)
PDF |

Holographic Factorization Machines for Recommendation
Yi Tay, Shuai Zhang, Anh Tuan Luu, Siu Cheung Hui, Lina Yao, Lucas Vinh Tran
Proceedings of AAAI 2019
PDF |

Quaternion Collaborative Filtering for Recommendation
Shuai Zhang, Lina Yao, Lucas Vinh Tranh, Aston Zhang, Yi Tay
Proceedings of IJCAI 2019
PDF |

Interact and Decide: Medley of Sub-Attention Networks for Group Recommendation
Lucas Vinh Tranh, Tuan-Anh Nguyen Pham, Yi Tay, Yiding Liu, Gao Cong, Xiaoli Li
Proceedings of SIGIR 2019 (Full Paper)
PDF |

Deep Learning based Recommender System - A Survey and New Perspectives
Shuai Zhang, Lina Yao, Aixin Sun, Yi Tay
Proceedings of ACM Computing Surveys (2019)
PDF | Code

Multi-Pointer Co-Attention Networks for Recommendation
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of KDD 2018 (Oral)
PDF | Code

Latent Relational Metric Learning via Memory-based Attention for Collaborative Ranking
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of WWW 2018
PDF | Code

Cross Device User Linking : URL, Session, Visiting Time and Device Log Embedding
Minh C. Phan, Aixin Sun, Yi Tay
Proceedings of SIGIR 2017 (Short Paper)
PDF | Code

Sentiment, Social and Applications

Would you Rather? A New Benchmark for Learning Machine Alignment with Cultural Values and Social Preferences
Yi Tay, Donovan Ong, Jie Fu, Alvin Chan, Nancy Chen, Anh Tuan Luu and Christopher Pal
Proceedings of ACL 2020 (Short Paper)
PDF |

Reasoning with Sarcasm by Reading In-Between
Yi Tay, Anh Tuan Luu, Siu Cheung Hui, Jian Su
Proceedings of ACL 2018 (Long Paper, Oral)
PDF

Attentive Gated Lexicon Reader via Contrastive Contextual Co-Attention for Sentiment Classification
Yi Tay, Anh Tuan Luu, Siu Cheung Hui, Jian Su
Proceedings of EMNLP 2018 (Long Paper)
PDF

CoupleNet: Paying Attention to Couples with Coupled Attention for Relationship Recommendation
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of ICWSM 2018
PDF | Dataset

Learning to Attend via Word-Aspect Associative Fusion for Aspect-based Sentiment Analysis
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of AAAI 2018
PDF | Dataset

Dyadic Memory Networks for Aspect-based Sentiment Analysis
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of CIKM 2017
PDF

Knowledge and Entities

Quaternion Knowledge Graph Embedding
Shuai Zhang, Yi Tay, Lina Yao, Qi Liu
Proceedings of NeurIPS 2019
PDF

Pair-Linking for Collective Entity Disambiguation: Two Could Be Better Than All
Minh C. Phan, Aixin Sun, Yi Tay, Jialong Han, Chenliang Li
Proceedings of IEEE TKDE 2018
PDF

Random Semantic Tensor Ensemble for Scalable Link Prediction on Knowledge Graphs
Yi Tay, Anh Tuan Luu, Siu Cheung Hui, Falk Brauer
Proceedings of WSDM 2017
PDF | Dataset

Non-parametric Estimation of Multiple Embeddings for Link Prediction on Dynamic Knowledge Graphs
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of AAAI 2017
PDF

Multi-task Neural Network for Non-discrete Attribute Prediction in Knowledge Graphs
Yi Tay, Anh Tuan Luu, Minh C.Phan, Siu Cheung Hui
Proceedings of CIKM 2017
PDF

NeuPL: Attention-based Semantic Matching and Pair Linking for Entity Disambiguation
Minh C. Phan, Aixin Sun, Yi Tay, Jialong Han, Chenliang Li
Proceedings of CIKM 2017
PDF

Learning Term Embeddings for Taxonomic Relation Identification with Dynamic Weighting Neural Network
Anh Tuan Luu, Yi Tay, Siu Cheung Hui, See Kiong Ng
Proceedings of EMNLP 2016 (Long Paper)
PDF

Misc / Others

Robust Representation Learning of Biomedical Names
Minh C. Phan, Aixin Sun, Yi Tay
Proceedings of ACL 2019 (Long Paper)
PDF |

Confusionset-guided Pointer Networks for Chinese Spelling Check
Dingmin Wang, Yi Tay, Li Zhong
Proceedings of ACL 2019 (Short Paper, Oral Presentation)
PDF |

SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
Proceedings of AAAI 2018
PDF