Xiaofei Wang

Principal Researcher

论文与出版物

查看方式：

- LLM can Read Spectrogram: Encoder-free Speech-Language Modeling
  
  Ruchao Fan, Yiming Wang, Yuxuan Hu, Bo Ren, Yufei Xia, Xiaofei Wang, Yao Qian, Jinyu Li
  
  June 2026
  
  arXiv | June 2026
  
  Publication
- EdiVal-Agent: An Object-Centric Framework for Automated, Scalable, Fine-Grained Evaluation of Multi-Turn Editing
  
  Tianyu Chen, Yasi Zhang, Zhi Zhang, Peiyu Yu, Shu Wang, Zhendong Wang, Kevin Lin, Xiaofei Wang, Zhengyuan Yang, Linjie Li, Chung-Ching Lin, Jianwen Xie, Oscar Leong, Lijuan Wang, Ying Nian Wu, Mingyuan Zhou
  
  September 2025
  
  September 2025
  
  Publication
- STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Models
  
  Cheng-Han Chiang, Xiaofei Wang, Linjie Li, Chung-Ching Lin, Kevin Lin, Shujie Liu, Zhendong Wang, Zhengyuan Yang, Hung-yi Lee, Lijuan Wang
  
  ICLR 2026 | July 2025
  
  Publication
- SLM-S2ST: A multimodal language model for direct speech-to-speech translation
  
  Yuxuan Hu, Haibin Wu, Ruchao Fan, Xiaofei Wang, Heng Lu, Yao Qian, Jinyu Li
  
  June 2025
  
  arXiv | June 2025
  
  DOI Publication
- Towards Efficient Speech-Text Jointly Decoding within One Speech Language Model
  
  Haibin Wu, Yuxuan Hu, Ruchao Fan, Xiaofei Wang, Kenichi Kumatani, Bo Ren, Jianwei Yu, Heng Lu, Lijuan Wang, Yao Qian, Jinyu Li
  
  2025 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) | June 2025, pp. 1-7
  
  DOI Publication Publication
- CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching
  
  Leying Zhang, Yao Qian, Xiaofei Wang, Manthan Thakker, Dongmei Wang, Jianwei Yu, Haibin Wu, Yuxuan Hu, Jinyu Li, Yanmin Qian, Sheng Zhao
  
  NeurIPS 2025 | May 2025
  
  DOI
- Investigating neural audio codecs for speech language model-based speech generation
  
  Jiaqi Li , Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li , Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Junkun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu , Michael Zeng
  
  SLT Workshop | December 2024
  
  Publication
- Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech
  
  Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai , Canrun Li, Zhen Xiao, Sheng Zhao , Jinyu Li, Naoyuki Kanda
  
  SLT Workshop | December 2024
  
  Publication
- An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
  
  Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
  
  Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
  
  Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | May 2024
  
  Publication 项目
- CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
  
  Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | April 2024
  
  DOI Publication 项目
- DiariST: Streaming Speech Translation with Speaker Diarization
  
  Mu Yang, Naoyuki Kanda, Xiaofei Wang, Junkun Chen, Peidong Wang, Jian Xue, Jinyu Li, Takuya Yoshioka
  
  ICASSP | April 2024
  
  Publication
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  arXiv:2211.05564 | November 2022
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  arXiv:2211.05172 | November 2022
  
  Publication
- Breaking trade-offs in speech separation with sparsely-gated mixture of experts
  
  Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
  
  arXiv:2211.06493 | November 2022
  
  Preprint
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2210.15715 | October 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
  
  Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
  
  INTERSPEECH 2022 | September 2022
  
  Publication
- Personalized Speech Enhancement: New Models and Comprehensive Evaluation
  
  Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
  
  ICASSP 2022 | May 2022
  
  Publication
- All-Neural Beamformer for Continuous Speech Separation
  
  Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
  
  ICASSP 2022 | May 2022
  
  Publication 项目
- Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
  
  Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
  
  ICASSP 2022 | May 2022
  
  Publication
- PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang
  
  ICASSP 2022 | May 2022
  
  Publication 项目
- Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2022 | May 2022
  
  Publication 项目项目
- VarArray: Array-Geometry-Agnostic Continuous Speech Separation
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang, Min Tang, Zirun Zhu, Zhuo Chen, Naoyuki Kanda
  
  ICASSP 2022 | May 2022
  
  Publication 项目
- A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
  
  Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ASRU 2021 | December 2021
  
  Publication 项目项目
- End-to-End Speaker-Attributed ASR with Transformer
  
  Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication 项目项目
- Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
  
  Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Preprint 项目
- Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
  
  Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication 项目项目
- Continuous Speech Separation with Ad Hoc Microphone Arrays
  
  Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
  
  EUSIPCO | August 2021
  
  Publication 项目
- Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
  
  Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
  
  Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication 项目项目
- Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
  
  Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication 项目项目
- Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication 项目项目
- Serialized Output Training for End-to-End Overlapped Speech Recognition
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication 项目项目

- LLM can Read Spectrogram: Encoder-free Speech-Language Modeling
  
  Ruchao Fan, Yiming Wang, Yuxuan Hu, Bo Ren, Yufei Xia, Xiaofei Wang, Yao Qian, Jinyu Li
  
  June 2026
  
  arXiv | June 2026
  
  Publication
- SLM-S2ST: A multimodal language model for direct speech-to-speech translation
  
  Yuxuan Hu, Haibin Wu, Ruchao Fan, Xiaofei Wang, Heng Lu, Yao Qian, Jinyu Li
  
  June 2025
  
  arXiv | June 2025
  
  DOI Publication
- CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching
  
  Leying Zhang, Yao Qian, Xiaofei Wang, Manthan Thakker, Dongmei Wang, Jianwei Yu, Haibin Wu, Yuxuan Hu, Jinyu Li, Yanmin Qian, Sheng Zhao
  
  NeurIPS 2025 | May 2025
  
  DOI
- Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
  
  Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
  
  Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | May 2024
  
  Publication 项目
- CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
  
  Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | April 2024
  
  DOI Publication 项目
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  arXiv:2211.05564 | November 2022
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  arXiv:2211.05172 | November 2022
  
  Publication
- Breaking trade-offs in speech separation with sparsely-gated mixture of experts
  
  Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
  
  arXiv:2211.06493 | November 2022
  
  Preprint
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2210.15715 | October 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
  
  Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
  
  INTERSPEECH 2022 | September 2022
  
  Publication
- Personalized Speech Enhancement: New Models and Comprehensive Evaluation
  
  Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
  
  ICASSP 2022 | May 2022
  
  Publication
- Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
  
  Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
  
  ICASSP 2022 | May 2022
  
  Publication
- PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang
  
  ICASSP 2022 | May 2022
  
  Publication 项目
- VarArray: Array-Geometry-Agnostic Continuous Speech Separation
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang, Min Tang, Zirun Zhu, Zhuo Chen, Naoyuki Kanda
  
  ICASSP 2022 | May 2022
  
  Publication 项目
- All-Neural Beamformer for Continuous Speech Separation
  
  Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
  
  ICASSP 2022 | May 2022
  
  Publication 项目
- Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2022 | May 2022
  
  Publication 项目项目
- A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
  
  Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ASRU 2021 | December 2021
  
  Publication 项目项目
- Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
  
  Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Preprint 项目
- End-to-End Speaker-Attributed ASR with Transformer
  
  Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication 项目项目
- Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
  
  Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication 项目项目
- Continuous Speech Separation with Ad Hoc Microphone Arrays
  
  Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
  
  EUSIPCO | August 2021
  
  Publication 项目
- Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
  
  Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
  
  Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication 项目项目
- Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
  
  Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication 项目项目
- Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication 项目项目
- Serialized Output Training for End-to-End Overlapped Speech Recognition
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication 项目项目
- STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Models
  
  Cheng-Han Chiang, Xiaofei Wang, Linjie Li, Chung-Ching Lin, Kevin Lin, Shujie Liu, Zhendong Wang, Zhengyuan Yang, Hung-yi Lee, Lijuan Wang
  
  ICLR 2026 | July 2025
  
  Publication
- Towards Efficient Speech-Text Jointly Decoding within One Speech Language Model
  
  Haibin Wu, Yuxuan Hu, Ruchao Fan, Xiaofei Wang, Kenichi Kumatani, Bo Ren, Jianwei Yu, Heng Lu, Lijuan Wang, Yao Qian, Jinyu Li
  
  2025 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) | June 2025, pp. 1-7
  
  DOI Publication Publication
- CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching
  
  Leying Zhang, Yao Qian, Xiaofei Wang, Manthan Thakker, Dongmei Wang, Jianwei Yu, Haibin Wu, Yuxuan Hu, Jinyu Li, Yanmin Qian, Sheng Zhao
  
  NeurIPS 2025 | May 2025
  
  DOI
- Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
  
  Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
  
  Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | May 2024
  
  Publication 项目
- CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
  
  Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | April 2024
  
  DOI Publication 项目
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  arXiv:2211.05564 | November 2022
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  arXiv:2211.05172 | November 2022
  
  Publication
- Breaking trade-offs in speech separation with sparsely-gated mixture of experts
  
  Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
  
  arXiv:2211.06493 | November 2022
  
  Preprint
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2210.15715 | October 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- Personalized Speech Enhancement: New Models and Comprehensive Evaluation
  
  Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
  
  ICASSP 2022 | May 2022
  
  Publication
- Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2022 | May 2022
  
  Publication 项目项目
- A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
  
  Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ASRU 2021 | December 2021
  
  Publication 项目项目
- Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
  
  Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Preprint 项目
- End-to-End Speaker-Attributed ASR with Transformer
  
  Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication 项目项目
- Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
  
  Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication 项目项目
- Continuous Speech Separation with Ad Hoc Microphone Arrays
  
  Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
  
  EUSIPCO | August 2021
  
  Publication 项目
- Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
  
  Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
  
  Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication 项目项目
- Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
  
  Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication 项目项目
- Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication 项目项目
- Serialized Output Training for End-to-End Overlapped Speech Recognition
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication 项目项目
- Towards Efficient Speech-Text Jointly Decoding within One Speech Language Model
  
  Haibin Wu, Yuxuan Hu, Ruchao Fan, Xiaofei Wang, Kenichi Kumatani, Bo Ren, Jianwei Yu, Heng Lu, Lijuan Wang, Yao Qian, Jinyu Li
  
  2025 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) | June 2025, pp. 1-7
  
  DOI Publication Publication
- SLM-S2ST: A multimodal language model for direct speech-to-speech translation
  
  Yuxuan Hu, Haibin Wu, Ruchao Fan, Xiaofei Wang, Heng Lu, Yao Qian, Jinyu Li
  
  June 2025
  
  arXiv | June 2025
  
  DOI Publication
- Investigating neural audio codecs for speech language model-based speech generation
  
  Jiaqi Li , Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li , Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Junkun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu , Michael Zeng
  
  SLT Workshop | December 2024
  
  Publication
- Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech
  
  Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai , Canrun Li, Zhen Xiao, Sheng Zhao , Jinyu Li, Naoyuki Kanda
  
  SLT Workshop | December 2024
  
  Publication
- An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
  
  Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- DiariST: Streaming Speech Translation with Speaker Diarization
  
  Mu Yang, Naoyuki Kanda, Xiaofei Wang, Junkun Chen, Peidong Wang, Jian Xue, Jinyu Li, Takuya Yoshioka
  
  ICASSP | April 2024
  
  Publication
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  arXiv:2211.05564 | November 2022
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  arXiv:2211.05172 | November 2022
  
  Publication
- Breaking trade-offs in speech separation with sparsely-gated mixture of experts
  
  Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
  
  arXiv:2211.06493 | November 2022
  
  Preprint
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2210.15715 | October 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
  
  Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
  
  INTERSPEECH 2022 | September 2022
  
  Publication
- Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
  
  Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
  
  ICASSP 2022 | May 2022
  
  Publication
- PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang
  
  ICASSP 2022 | May 2022
  
  Publication 项目
- VarArray: Array-Geometry-Agnostic Continuous Speech Separation
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang, Min Tang, Zirun Zhu, Zhuo Chen, Naoyuki Kanda
  
  ICASSP 2022 | May 2022
  
  Publication 项目
- All-Neural Beamformer for Continuous Speech Separation
  
  Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
  
  ICASSP 2022 | May 2022
  
  Publication 项目
- Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2022 | May 2022
  
  Publication 项目项目
- A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
  
  Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ASRU 2021 | December 2021
  
  Publication 项目项目
- End-to-End Speaker-Attributed ASR with Transformer
  
  Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication 项目项目
- Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
  
  Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication 项目项目
- Continuous Speech Separation with Ad Hoc Microphone Arrays
  
  Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
  
  EUSIPCO | August 2021
  
  Publication 项目
- Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
  
  Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
  
  Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication 项目项目
- Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
  
  Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication 项目项目
- Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication 项目项目
- Serialized Output Training for End-to-End Overlapped Speech Recognition
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication 项目项目
- EdiVal-Agent: An Object-Centric Framework for Automated, Scalable, Fine-Grained Evaluation of Multi-Turn Editing
  
  Tianyu Chen, Yasi Zhang, Zhi Zhang, Peiyu Yu, Shu Wang, Zhendong Wang, Kevin Lin, Xiaofei Wang, Zhengyuan Yang, Linjie Li, Chung-Ching Lin, Jianwen Xie, Oscar Leong, Lijuan Wang, Ying Nian Wu, Mingyuan Zhou
  
  September 2025
  
  September 2025
  
  Publication

- LLM can Read Spectrogram: Encoder-free Speech-Language Modeling
  
  Ruchao Fan, Yiming Wang, Yuxuan Hu, Bo Ren, Yufei Xia, Xiaofei Wang, Yao Qian, Jinyu Li
  
  June 2026
  
  arXiv | June 2026
  
  Publication
- EdiVal-Agent: An Object-Centric Framework for Automated, Scalable, Fine-Grained Evaluation of Multi-Turn Editing
  
  Tianyu Chen, Yasi Zhang, Zhi Zhang, Peiyu Yu, Shu Wang, Zhendong Wang, Kevin Lin, Xiaofei Wang, Zhengyuan Yang, Linjie Li, Chung-Ching Lin, Jianwen Xie, Oscar Leong, Lijuan Wang, Ying Nian Wu, Mingyuan Zhou
  
  September 2025
  
  September 2025
  
  Publication
- SLM-S2ST: A multimodal language model for direct speech-to-speech translation
  
  Yuxuan Hu, Haibin Wu, Ruchao Fan, Xiaofei Wang, Heng Lu, Yao Qian, Jinyu Li
  
  June 2025
  
  arXiv | June 2025
  
  DOI Publication
- Towards Efficient Speech-Text Jointly Decoding within One Speech Language Model
  
  Haibin Wu, Yuxuan Hu, Ruchao Fan, Xiaofei Wang, Kenichi Kumatani, Bo Ren, Jianwei Yu, Heng Lu, Lijuan Wang, Yao Qian, Jinyu Li
  
  2025 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) | June 2025, pp. 1-7
  
  DOI Publication Publication
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  arXiv:2211.05564 | November 2022
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  arXiv:2211.05172 | November 2022
  
  Publication
- Breaking trade-offs in speech separation with sparsely-gated mixture of experts
  
  Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
  
  arXiv:2211.06493 | November 2022
  
  Preprint
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2210.15715 | October 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Models
  
  Cheng-Han Chiang, Xiaofei Wang, Linjie Li, Chung-Ching Lin, Kevin Lin, Shujie Liu, Zhendong Wang, Zhengyuan Yang, Hung-yi Lee, Lijuan Wang
  
  ICLR 2026 | July 2025
  
  Publication
- CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching
  
  Leying Zhang, Yao Qian, Xiaofei Wang, Manthan Thakker, Dongmei Wang, Jianwei Yu, Haibin Wu, Yuxuan Hu, Jinyu Li, Yanmin Qian, Sheng Zhao
  
  NeurIPS 2025 | May 2025
  
  DOI
- Investigating neural audio codecs for speech language model-based speech generation
  
  Jiaqi Li , Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li , Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Junkun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu , Michael Zeng
  
  SLT Workshop | December 2024
  
  Publication
- Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech
  
  Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai , Canrun Li, Zhen Xiao, Sheng Zhao , Jinyu Li, Naoyuki Kanda
  
  SLT Workshop | December 2024
  
  Publication
- An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
  
  Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
  
  Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
  
  Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | May 2024
  
  Publication 项目
- CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
  
  Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | April 2024
  
  DOI Publication 项目
- DiariST: Streaming Speech Translation with Speaker Diarization
  
  Mu Yang, Naoyuki Kanda, Xiaofei Wang, Junkun Chen, Peidong Wang, Jian Xue, Jinyu Li, Takuya Yoshioka
  
  ICASSP | April 2024
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
  
  Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
  
  INTERSPEECH 2022 | September 2022
  
  Publication
- Personalized Speech Enhancement: New Models and Comprehensive Evaluation
  
  Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
  
  ICASSP 2022 | May 2022
  
  Publication
- Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
  
  Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
  
  ICASSP 2022 | May 2022
  
  Publication
- PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang
  
  ICASSP 2022 | May 2022
  
  Publication 项目
- VarArray: Array-Geometry-Agnostic Continuous Speech Separation
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang, Min Tang, Zirun Zhu, Zhuo Chen, Naoyuki Kanda
  
  ICASSP 2022 | May 2022
  
  Publication 项目
- All-Neural Beamformer for Continuous Speech Separation
  
  Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
  
  ICASSP 2022 | May 2022
  
  Publication 项目
- Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2022 | May 2022
  
  Publication 项目项目
- A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
  
  Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ASRU 2021 | December 2021
  
  Publication 项目项目
- Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
  
  Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Preprint 项目
- End-to-End Speaker-Attributed ASR with Transformer
  
  Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication 项目项目
- Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
  
  Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication 项目项目
- Continuous Speech Separation with Ad Hoc Microphone Arrays
  
  Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
  
  EUSIPCO | August 2021
  
  Publication 项目
- Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
  
  Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
  
  Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication 项目项目
- Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
  
  Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication 项目项目
- Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication 项目项目
- Serialized Output Training for End-to-End Overlapped Speech Recognition
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication 项目项目

Xiaofei Wang

论文与出版物

LLM can Read Spectrogram: Encoder-free Speech-Language Modeling

EdiVal-Agent: An Object-Centric Framework for Automated, Scalable, Fine-Grained Evaluation of Multi-Turn Editing

STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Models

SLM-S2ST: A multimodal language model for direct speech-to-speech translation

Towards Efficient Speech-Text Jointly Decoding within One Speech Language Model

CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching

Investigating neural audio codecs for speech language model-based speech generation

Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech

An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS

Total-Duration-Aware Duration Modeling for Text-to-Speech Systems

TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation

CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations

DiariST: Streaming Speech Translation with Speaker Diarization

SpeechX: Neural Codec Language Model as a Versatile Speech Transformer

Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition

Speech separation with large-scale self-supervised learning

Breaking trade-offs in speech separation with sparsely-gated mixture of experts

Simulating realistic speech overlaps improves multi-talker ASR

Streaming Multi-Talker ASR with Token-Level Serialized Output Training

Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings

VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition

Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation

Personalized Speech Enhancement: New Models and Comprehensive Evaluation

All-Neural Beamformer for Continuous Speech Separation

Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction

PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays

Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR

VarArray: Array-Geometry-Agnostic Continuous Speech Separation

A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio

End-to-End Speaker-Attributed ASR with Transformer

Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement

Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone

Continuous Speech Separation with Ad Hoc Microphone Arrays

Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings

Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR

Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription

Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings

Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers

Serialized Output Training for End-to-End Overlapped Speech Recognition

LLM can Read Spectrogram: Encoder-free Speech-Language Modeling

SLM-S2ST: A multimodal language model for direct speech-to-speech translation

CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching

Total-Duration-Aware Duration Modeling for Text-to-Speech Systems

TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation

CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations

SpeechX: Neural Codec Language Model as a Versatile Speech Transformer

Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition

Speech separation with large-scale self-supervised learning

Breaking trade-offs in speech separation with sparsely-gated mixture of experts

Simulating realistic speech overlaps improves multi-talker ASR

Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings

Streaming Multi-Talker ASR with Token-Level Serialized Output Training

VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition

Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation

Personalized Speech Enhancement: New Models and Comprehensive Evaluation

Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction

PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays

VarArray: Array-Geometry-Agnostic Continuous Speech Separation

All-Neural Beamformer for Continuous Speech Separation

Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR

A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio

Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement

End-to-End Speaker-Attributed ASR with Transformer

Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone

Continuous Speech Separation with Ad Hoc Microphone Arrays

Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings

Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR

Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription

Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings

Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers

Serialized Output Training for End-to-End Overlapped Speech Recognition

STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Models

Towards Efficient Speech-Text Jointly Decoding within One Speech Language Model

CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching

Total-Duration-Aware Duration Modeling for Text-to-Speech Systems

TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation

CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations

SpeechX: Neural Codec Language Model as a Versatile Speech Transformer