Stop the war!Остановите войну!
for scientists:
default search action
Google
Google Scholar
Semantic Scholar
Internet Archive Scholar
CiteSeerX
ORCIDFuru Wei
Person information
Refine list
refinements active!
zoomed in on ?? of ?? records
view refined list in
export refined list as
showing all ?? records
2020 – today
- 2023
[j23]Jian Yang
, Yuwei Yin, Liqun Yang, Shuming Ma, Haoyang Huang, Dongdong Zhang, Furu Wei, Zhoujun Li:
GTrans: Grouping and Fusing Transformer Layers for Neural Machine Translation. IEEE ACM Trans. Audio Speech Lang. Process. 31: 1489-1498 (2023)- [j22]Zhiliang Peng, Li Dong, Hangbo Bao, Furu Wei, Qixiang Ye:
A Unified View of Masked Image Modeling. Trans. Mach. Learn. Res. 2023 (2023) - [c189]Jian Yang, Yuwei Yin, Shuming Ma, Liqun Yang, Hongcheng Guo, Haoyang Huang, Dongdong Zhang, Yutao Zeng, Zhoujun Li, Furu Wei:
HanoiT: Enhancing Context-aware Translation via Selective Context. DASFAA (3) 2023: 471-486 - [i183]Chengyi Wang, Sanyuan Chen, Yu Wu, Ziqiang Zhang, Long Zhou, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei:
Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers. CoRR abs/2301.02111 (2023) - [i182]Jian Yang, Yuwei Yin, Shuming Ma, Liqun Yang, Hongcheng Guo, Haoyang Huang, Dongdong Zhang, Yutao Zeng, Zhoujun Li, Furu Wei:
HanoiT: Enhancing Context-aware Translation via Selective Context. CoRR abs/2301.06825 (2023) - [i181]Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Johan Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei:
Language Is Not All You Need: Aligning Perception with Language Models. CoRR abs/2302.14045 (2023) - [i180]Wei Huang, Zhiliang Peng, Li Dong, Furu Wei, Jianbin Jiao, Qixiang Ye:
Generic-to-Specific Distillation of Masked Autoencoders. CoRR abs/2302.14771 (2023) - [i179]Haiteng Zhao, Shuming Ma, Dongdong Zhang, Zhi-Hong Deng, Furu Wei:
Are More Layers Beneficial to Graph Transformers? CoRR abs/2303.00579 (2023) - [i178]Guangyue Peng, Tao Ge, Si-Qing Chen, Furu Wei, Houfeng Wang:
Semiparametric Language Models Are Scalable Continual Learners. CoRR abs/2303.01421 (2023) - [i177]Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei:
Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling. CoRR abs/2303.03926 (2023) - [i176]Liang Wang, Nan Yang, Furu Wei:
Query2doc: Query Expansion with Large Language Models. CoRR abs/2303.07678 (2023) - [i175]Daixuan Cheng, Shaohan Huang, Junyu Bi, Yuefeng Zhan, Jianfeng Liu, Yujing Wang, Hao Sun, Furu Wei, Denvy Deng, Qi Zhang:
UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation. CoRR abs/2303.08518 (2023) - [i174]Liang Chen, Shuming Ma, Dongdong Zhang, Furu Wei, Baobao Chang:
On the Pareto Front of Multilingual Neural Machine Translation. CoRR abs/2304.03216 (2023) - [i173]Nan Yang, Tao Ge, Liang Wang, Binxing Jiao, Daxin Jiang, Linjun Yang, Rangan Majumder, Furu Wei:
Inference with Reference: Lossless Acceleration of Large Language Models. CoRR abs/2304.04487 (2023) - [i172]Beiduo Chen, Shaohan Huang, Zihan Zhang, Wu Guo, Zhenhua Ling, Haizhen Huang, Furu Wei, Weiwei Deng, Qi Zhang:
Pre-training Language Model as a Multi-perspective Course Learner. CoRR abs/2305.03981 (2023) - [i171]Hongyuan Lu, Haoyang Huang, Dongdong Zhang, Haoran Yang, Wai Lam, Furu Wei:
Chain-of-Dictionary Prompting Elicits Translation in Large Language Models. CoRR abs/2305.06575 (2023) - [i170]Haoyang Huang, Tianyi Tang, Dongdong Zhang, Wayne Xin Zhao, Ting Song, Yan Xia, Furu Wei:
Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting. CoRR abs/2305.07004 (2023) - [i169]Yuxian Gu, Li Dong, Furu Wei, Minlie Huang:
Pre-Training to Learn in Context. CoRR abs/2305.09137 (2023) - [i168]Ziheng Li, Shaohan Huang, Zihan Zhang, Zhi-Hong Deng, Qiang Lou, Haizhen Huang, Jian Jiao, Furu Wei, Weiwei Deng, Qi Zhang:
Dual-Alignment Pre-training for Cross-lingual Sentence Embedding. CoRR abs/2305.09148 (2023) - [i167]Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei:
TextDiffuser: Diffusion Models as Text Painters. CoRR abs/2305.10855 (2023) - [i166]Liang Chen, Shuming Ma, Dongdong Zhang, Furu Wei, Baobao Chang:
On the Off-Target Problem of Zero-Shot Multilingual Neural Machine Translation. CoRR abs/2305.10930 (2023) - 2022
- [j21]Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei:
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing. IEEE J. Sel. Top. Signal Process. 16(6): 1505-1518 (2022) - [j20]Haichao Zhu, Li Dong, Furu Wei, Bing Qin, Ting Liu:
Transforming Wikipedia Into Augmented Data for Query-Focused Summarization. IEEE ACM Trans. Audio Speech Lang. Process. 30: 2357-2367 (2022) - [c188]Shusheng Xu, Xingxing Zhang, Yi Wu, Furu Wei:
Sequence Level Contrastive Learning for Text Summarization. AAAI 2022: 11556-11565 - [c187]Shengqiang Zhang, Xingxing Zhang, Hangbo Bao, Furu Wei:
Attention Temperature Matters in Abstractive Summarization Distillation. ACL (1) 2022: 127-141 - [c186]Guanhua Chen, Shuming Ma, Yun Chen, Dongdong Zhang, Jia Pan, Wenping Wang, Furu Wei:
Towards Making the Most of Cross-Lingual Transfer for Zero-Shot Neural Machine Translation. ACL (1) 2022: 142-157 - [c185]Ruipeng Jia, Xingxing Zhang, Yanan Cao, Zheng Lin, Shi Wang, Furu Wei:
Neural Label Search for Zero-Shot Multi-Lingual Extractive Summarization. ACL (1) 2022: 561-570 - [c184]Jing Qian, Li Dong, Yelong Shen, Furu Wei, Weizhu Chen:
Controllable Natural Language Generation with Contrastive Prefixes. ACL (Findings) 2022: 2912-2924 - [c183]Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei A. F. Florêncio, Cha Zhang, Furu Wei:
XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding. ACL (Findings) 2022: 3214-3224 - [c182]Tianyu Chen, Hangbo Bao, Shaohan Huang, Li Dong, Binxing Jiao, Daxin Jiang, Haoyi Zhou, Jianxin Li, Furu Wei:
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption. ACL (Findings) 2022: 3510-3520 - [c181]Junyi Ao, Rui Wang, Long Zhou, Chengyi Wang, Shuo Ren, Yu Wu, Shujie Liu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei:
SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing. ACL (1) 2022: 5723-5738 - [c180]Junlong Li, Yiheng Xu, Lei Cui, Furu Wei:
MarkupLM: Pre-training of Text and Markup Language for Visually Rich Document Understanding. ACL (1) 2022: 6078-6087 - [c179]Haoyu Song, Li Dong, Weinan Zhang, Ting Liu, Furu Wei:
CLIP Models are Few-Shot Learners: Empirical Studies on VQA and Visual Entailment. ACL (1) 2022: 6088-6100 - [c178]Zewen Chi, Shaohan Huang, Li Dong, Shuming Ma, Bo Zheng, Saksham Singhal, Payal Bajaj, Xia Song, Xian-Ling Mao, Heyan Huang, Furu Wei:
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. ACL (1) 2022: 6170-6182 - [c177]Damai Dai, Li Dong, Shuming Ma, Bo Zheng, Zhifang Sui, Baobao Chang, Furu Wei:
StableMoE: Stable Routing Strategy for Mixture of Experts. ACL (1) 2022: 7085-7095 - [c176]Damai Dai, Li Dong, Yaru Hao, Zhifang Sui, Baobao Chang, Furu Wei:
Knowledge Neurons in Pretrained Transformers. ACL (1) 2022: 8493-8502 - [c175]Ze Liu, Han Hu, Yutong Lin, Zhuliang Yao, Zhenda Xie, Yixuan Wei, Jia Ning, Yue Cao, Zheng Zhang, Li Dong, Furu Wei, Baining Guo:
Swin Transformer V2: Scaling Up Capacity and Resolution. CVPR 2022: 11999-12009 - [c174]Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, Hongcheng Guo, Zhoujun Li, Furu Wei:
CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation. EMNLP (Findings) 2022: 486-496 - [c173]Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei:
XDoc: Unified Pre-training for Cross-Format Document Understanding. EMNLP (Findings) 2022: 1006-1016 - [c172]Ziqiang Zhang, Long Zhou, Junyi Ao, Shujie Liu, Lirong Dai, Jinyu Li, Furu Wei:
SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training. EMNLP 2022: 1663-1676 - [c171]Daixuan Cheng, Shaohan Huang, Jianfeng Liu, Yuefeng Zhan, Hao Sun, Furu Wei, Denvy Deng, Qi Zhang:
Snapshot-Guided Domain Adaptation for ELECTRA. EMNLP (Findings) 2022: 2226-2232 - [c170]Ting Jiang, Jian Jiao, Shaohan Huang, Zihan Zhang, Deqing Wang, Fuzhen Zhuang, Furu Wei, Haizhen Huang, Denvy Deng, Qi Zhang:
PromptBERT: Improving BERT Sentence Embeddings with Prompts. EMNLP 2022: 8826-8837 - [c169]Zekun Wang, Wenhui Wang, Haichao Zhu, Ming Liu, Bing Qin, Furu Wei:
Distilled Dual-Encoder Model for Vision-Language Understanding. EMNLP 2022: 8901-8913 - [c168]Tao Ge, Si-Qing Chen, Furu Wei:
EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation. EMNLP 2022: 10786-10798 - [c167]Lianzhe Huang, Shuming Ma, Dongdong Zhang, Furu Wei, Houfeng Wang:
Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Prompt. EMNLP 2022: 11488-11497 - [c166]Sanyuan Chen, Yu Wu, Chengyi Wang, Zhengyang Chen, Zhuo Chen, Shujie Liu, Jian Wu, Yao Qian, Furu Wei, Jinyu Li, Xiangzhan Yu:
Unispeech-Sat: Universal Speech Representation Learning With Speaker Aware Pre-Training. ICASSP 2022: 6152-6156 - [c165]Hangbo Bao, Li Dong, Songhao Piao, Furu Wei:
BEiT: BERT Pre-Training of Image Transformers. ICLR 2022 - [c164]Xin Sun, Tao Ge, Shuming Ma, Jingjing Li, Furu Wei, Houfeng Wang:
A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model. IJCAI 2022: 4367-4374 - [c163]Jian Yang, Yuwei Yin, Shuming Ma, Dongdong Zhang, Shuangzhi Wu, Hongcheng Guo, Zhoujun Li, Furu Wei:
UM4: Unified Multilingual Multiple Teacher-Student Model for Zero-Resource Neural Machine Translation. IJCAI 2022: 4454-4460 - [c162]Jian Yang, Yuwei Yin, Shuming Ma, Dongdong Zhang, Zhoujun Li, Furu Wei:
High-resource Language-specific Training for Multilingual Neural Machine Translation. IJCAI 2022: 4461-4467 - [c161]Xuyang Jin, Tao Ge, Furu Wei:
Plug and Play Knowledge Distillation for kNN-LM with External Logits. AACL/IJCNLP (2) 2022: 463-469 - [c160]Chengyi Wang, Yiming Wang, Yu Wu, Sanyuan Chen, Jinyu Li, Shujie Liu, Furu Wei:
Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training. INTERSPEECH 2022: 2643-2647 - [c159]Shuo Ren, Shujie Liu, Yu Wu, Long Zhou, Furu Wei:
Speech Pre-training with Acoustic Piece. INTERSPEECH 2022: 2648-2652 - [c158]Junyi Ao, Ziqiang Zhang, Long Zhou, Shujie Liu, Haizhou Li, Tom Ko, Lirong Dai, Jinyu Li, Yao Qian, Furu Wei:
Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data. INTERSPEECH 2022: 2658-2662 - [c157]Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Zhuo Chen, Peidong Wang, Gang Liu, Jinyu Li, Jian Wu, Xiangzhan Yu, Furu Wei:
Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition? INTERSPEECH 2022: 3699-3703 - [c156]Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei:
Separating Long-Form Speech with Group-wise Permutation Invariant Training. INTERSPEECH 2022: 5383-5387 - [c155]Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei:
DiT: Self-supervised Pre-training for Document Image Transformer. ACM Multimedia 2022: 3530-3539 - [c154]Yupan Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei:
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking. ACM Multimedia 2022: 4083-4091 - [c153]Hangbo Bao, Wenhui Wang, Li Dong, Qiang Liu, Owais Khan Mohammed, Kriti Aggarwal, Subhojit Som, Songhao Piao, Furu Wei:
VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts. NeurIPS 2022 - [c152]Zewen Chi, Li Dong, Shaohan Huang, Damai Dai, Shuming Ma, Barun Patra, Saksham Singhal, Payal Bajaj, Xia Song, Xian-Ling Mao, Heyan Huang, Furu Wei:
On the Representation Collapse of Sparse Mixture of Experts. NeurIPS 2022 - [c151]Yunzhi Yao, Shaohan Huang, Li Dong, Furu Wei, Huajun Chen, Ningyu Zhang:
Kformer: Knowledge Injection in Transformer Feed-Forward Layers. NLPCC (1) 2022: 131-143 - [i165]Xu Zhang, Jian Yang, Haoyang Huang, Shuming Ma, Dongdong Zhang, Jinlong Li, Furu Wei:
SMDT: Selective Memory-Augmented Neural Document Translation. CoRR abs/2201.01631 (2022) - [i164]Juncheng Wan, Jian Yang, Shuming Ma, Dongdong Zhang, Weinan Zhang, Yong Yu, Furu Wei:
Phrase-level Adversarial Example Generation for Neural Machine Translation. CoRR abs/2201.02009 (2022) - [i163]Ting Jiang, Shaohan Huang, Zihan Zhang, Deqing Wang, Fuzhen Zhuang, Furu Wei, Haizhen Huang, Liangjie Zhang, Qi Zhang:
PromptBERT: Improving BERT Sentence Embeddings with Prompts. CoRR abs/2201.04337 (2022) - [i162]Yunzhi Yao, Shaohan Huang, Ningyu Zhang, Li Dong, Furu Wei, Huajun Chen:
Kformer: Knowledge Injection in Transformer Feed-Forward Layers. CoRR abs/2201.05742 (2022) - [i161]Xin Sun, Tao Ge, Shuming Ma, Jingjing Li, Furu Wei, Houfeng Wang:
A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model. CoRR abs/2201.10707 (2022) - [i160]Yuxin Fang, Li Dong, Hangbo Bao, Xinggang Wang, Furu Wei:
Corrupted Image Modeling for Self-Supervised Visual Pre-Training. CoRR abs/2202.03382 (2022) - [i159]Tao Ge, Furu Wei:
EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation. CoRR abs/2202.07959 (2022) - [i158]Da Yin, Li Dong, Hao Cheng, Xiaodong Liu, Kai-Wei Chang, Furu Wei, Jianfeng Gao:
A Survey of Knowledge-Intensive NLP with Pre-Trained Language Models. CoRR abs/2202.08772 (2022) - [i157]Lianzhe Huang, Shuming Ma, Dongdong Zhang, Furu Wei, Houfeng Wang:
Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Prompt. CoRR abs/2202.11451 (2022) - [i156]Jing Qian, Li Dong, Yelong Shen, Furu Wei, Weizhu Chen:
Controllable Natural Language Generation with Contrastive Prefixes. CoRR abs/2202.13257 (2022) - [i155]Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Dongdong Zhang, Furu Wei:
DeepNet: Scaling Transformers to 1, 000 Layers. CoRR abs/2203.00555 (2022) - [i154]Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei:
DiT: Self-supervised Pre-training for Document Image Transformer. CoRR abs/2203.02378 (2022) - [i153]Haoyu Song, Li Dong, Wei-Nan Zhang, Ting Liu, Furu Wei:
CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailment. CoRR abs/2203.07190 (2022) - [i152]Heming Xia, Tao Ge, Furu Wei, Zhifang Sui:
Lossless Speedup of Autoregressive Translation with Generalized Aggressive Decoding. CoRR abs/2203.16487 (2022) - [i151]Junyi Ao, Ziqiang Zhang, Long Zhou, Shujie Liu, Haizhou Li, Tom Ko, Lirong Dai, Jinyu Li, Yao Qian, Furu Wei:
Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data. CoRR abs/2203.17113 (2022) - [i150]Shuo Ren, Shujie Liu, Yu Wu, Long Zhou, Furu Wei:
Speech Pre-training with Acoustic Piece. CoRR abs/2204.03240 (2022) - [i149]Yupan Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei:
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking. CoRR abs/2204.08387 (2022) - [i148]Damai Dai, Li Dong, Shuming Ma, Bo Zheng, Zhifang Sui, Baobao Chang, Furu Wei:
StableMoE: Stable Routing Strategy for Mixture of Experts. CoRR abs/2204.08396 (2022) - [i147]Zewen Chi, Li Dong, Shaohan Huang, Damai Dai, Shuming Ma, Barun Patra, Saksham Singhal, Payal Bajaj, Xia Song, Furu Wei:
On the Representation Collapse of Sparse Mixture of Experts. CoRR abs/2204.09179 (2022) - [i146]Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Zhuo Chen, Peidong Wang, Gang Liu, Jinyu Li, Jian Wu, Xiangzhan Yu, Furu Wei:
Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition? CoRR abs/2204.12765 (2022) - [i145]Ruipeng Jia, Xingxing Zhang, Yanan Cao, Shi Wang, Zheng Lin, Furu Wei:
Neural Label Search for Zero-Shot Multi-Lingual Extractive Summarization. CoRR abs/2204.13512 (2022) - [i144]Weizhi Wang, Li Dong, Hao Cheng, Haoyu Song, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei:
Visually-Augmented Language Modeling. CoRR abs/2205.10178 (2022) - [i143]Zhixiong Han, Yaru Hao, Li Dong, Furu Wei:
Prototypical Calibration for Few-shot Learning of Language Models. CoRR abs/2205.10183 (2022) - [i142]Tao Ge, Heming Xia, Xin Sun, Si-Qing Chen, Furu Wei:
Lossless Acceleration for Seq2seq Generation with Aggressive Decoding. CoRR abs/2205.10350 (2022) - [i141]Tianyu Chen, Hangbo Bao, Shaohan Huang, Li Dong, Binxing Jiao, Daxin Jiang, Haoyi Zhou, Jianxin Li, Furu Wei:
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption. CoRR abs/2206.00216 (2022) - [i140]Tianyu Chen, Shaohan Huang, Yuan Xie, Binxing Jiao, Daxin Jiang, Haoyi Zhou, Jianxin Li, Furu Wei:
Task-Specific Expert Pruning for Sparse Mixture-of-Experts. CoRR abs/2206.00277 (2022) - [i139]Hangbo Bao, Wenhui Wang, Li Dong, Furu Wei:
VL-BEiT: Generative Vision-Language Pretraining. CoRR abs/2206.01127 (2022) - [i138]Ziqiang Zhang, Junyi Ao, Long Zhou, Shujie Liu, Furu Wei, Jinyu Li:
The YiTrans End-to-End Speech Translation System for IWSLT 2022 Offline Shared Task. CoRR abs/2206.05777 (2022) - [i137]Yaru Hao, Haoyu Song, Li Dong, Shaohan Huang, Zewen Chi, Wenhui Wang, Shuming Ma, Furu Wei:
Language Models are General-Purpose Interfaces. CoRR abs/2206.06336 (2022) - [i136]Chengyi Wang, Yiming Wang, Yu Wu, Sanyuan Chen, Jinyu Li, Shujie Liu, Furu Wei:
Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training. CoRR abs/2206.10125 (2022) - [i135]Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang, Rangan Majumder, Furu Wei:
SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval. CoRR abs/2207.02578 (2022) - [i134]Jian Yang, Yuwei Yin, Shuming Ma, Dongdong Zhang, Shuangzhi Wu, Hongcheng Guo, Zhoujun Li, Furu Wei:
UM4: Unified Multilingual Multiple Teacher-Student Model for Zero-Resource Neural Machine Translation. CoRR abs/2207.04900 (2022) - [i133]Jian Yang, Yuwei Yin, Shuming Ma, Dongdong Zhang, Zhoujun Li, Furu Wei:
HLT-MT: High-resource Language-specific Training for Multilingual Neural Machine Translation. CoRR abs/2207.04906 (2022) - [i132]Yuan Xie, Shaohan Huang, Tianyu Chen, Furu Wei:
MoEC: Mixture of Expert Clusters. CoRR abs/2207.09094 (2022) - [i131]Jian Yang, Yuwei Yin, Shuming Ma, Haoyang Huang, Dongdong Zhang, Furu Wei, Zhoujun Li:
GTrans: Grouping and Fusing Transformer Layers for Neural Machine Translation. CoRR abs/2207.14467 (2022) - [i130]Zehan Li, Nan Yang, Liang Wang, Furu Wei:
Learning Diverse Document Representations with Deep Query Interactions for Dense Retrieval. CoRR abs/2208.04232 (2022) - [i129]Zhiliang Peng, Li Dong, Hangbo Bao, Qixiang Ye, Furu Wei:
BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers. CoRR abs/2208.06366 (2022) - [i128]Wenhui Wang, Hangbo Bao, Li Dong, Johan Bjorck, Zhiliang Peng, Qiang Liu, Kriti Aggarwal, Owais Khan Mohammed, Saksham Singhal, Subhojit Som, Furu Wei:
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks. CoRR abs/2208.10442 (2022) - [i127]Hongyuan Lu, Haoyang Huang, Shuming Ma, Dongdong Zhang, Furu Wei, Wai Lam:
Towards Multilingual Transitivity and Bidirectional Multilingual Agreement for Multilingual Document-level Machine Translation. CoRR abs/2209.13940 (2022) - [i126]Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei:
XDoc: Unified Pre-training for Cross-Format Document Understanding. CoRR abs/2210.02849 (2022) - [i125]Ziqiang Zhang, Long Zhou, Junyi Ao, Shujie Liu, Lirong Dai, Jinyu Li, Furu Wei:
SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training. CoRR abs/2210.03730 (2022) - [i124]Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei:
Foundation Transformers. CoRR abs/2210.06423 (2022) - [i123]Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, Hongcheng Guo, Zhoujun Li, Furu Wei:
CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation. CoRR abs/2210.07022 (2022) - [i122]Jinghao Zhou, Li Dong, Zhe Gan, Lijuan Wang, Furu Wei:
Non-Contrastive Learning Meets Language-Image Pre-Training. CoRR abs/2210.09304 (2022) - [i121]Zhiliang Peng, Li Dong, Hangbo Bao, Qixiang Ye, Furu Wei:
A Unified View of Masked Image Modeling. CoRR abs/2210.10615 (2022) - [i120]Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song:
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. CoRR abs/2210.14867 (2022) - [i119]Hongcheng Guo, Jiaheng Liu, Haoyang Huang, Jian Yang, Zhoujun Li, Dongdong Zhang, Furu Wei:
LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation. CoRR abs/2210.15461 (2022) - [i118]Kun Wei, Long Zhou, Ziqiang Zhang, Liping Chen, Shujie Liu, Lei He, Jinyu Li, Furu Wei:
Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation. CoRR abs/2210.17027 (2022) - [i117]Yubo Zhang, Xingxing Zhang, Xun Wang, Si-qing Chen, Furu Wei:
Latent Prompt Tuning for Text Summarization. CoRR abs/2211.01837 (2022) - [i116]