{"id":17,"date":"2018-08-30T09:50:52","date_gmt":"2018-08-30T01:50:52","guid":{"rendered":"http:\/\/39.106.170.37\/?page_id=17"},"modified":"2025-03-11T12:25:23","modified_gmt":"2025-03-11T04:25:23","slug":"publications","status":"publish","type":"page","link":"http:\/\/shijt.site\/index.php\/publications\/","title":{"rendered":"Publications & Awards"},"content":{"rendered":"

Publication <\/strong>(* for Equal Contribution)<\/p>\n

    \n
  1. Jiatong Shi<\/strong>, Hye-jin Shim, Jinchuan Tian, Siddhant Arora, Haibin Wu, Darius Petermann, Jia Qi Yip, You Zhang, Yuxun Tang, Wangyou Zhang, Dareen Safar Alharthi, Yichen Huang, Koichi Saito, Jionghao Han, Yiwen Zhao, Chris Donahue, and Shinji Watanabe. 2025. “VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Music”. NAACL Demo. [details here]<\/a><\/li>\n
  2. Jinchuan Tian, Chunlei Zhang, Jiatong Shi<\/strong>, Hao Zhang, Jianwei Yu, Shinji Watanabe, and Dong Yu. 2025. “Preference Alignment Improves Language Model-Based TTS”. ICASSP. [details here]<\/a><\/li>\n
  3. Jiatong Shi<\/strong>, Jinchuan Tian, Yihan Wu, Jee-weon Jung, Jia Qi Yip, Yoshiki Masuyama, William Chen, Yuning Wu, Yuxun Tang, Massa Baali, Dareen Alharthi, Dong Zhang, Ruifan Deng, Tejes Srivastava, Haibin Wu, Alexander Liu, Bhiksha Raj, Qin Jin, Ruihua Song, and Shinji Watanabe. 2024. “ESPnet-Codec: Comprehensive Training and Evaluation of Neural Codecs for Audio, Music, and Speech”. SLT. [details here]<\/a><\/li>\n
  4. Yifeng Yu, Jiatong Shi<\/strong>, Yuning Wu, Shinji Watanabe. 2024. “VISinger2+: End-to-End Singing Voice Synthesis Augmented by Self-Supervised Learning Representation” SLT. [details here]<\/a><\/li>\n
  5. Shih-Heng Wang, Jiatong Shi<\/strong>, Chien-yu Huang, Shinji Watanabe, and Hung-yi Lee. 2024. “Fusion of Discrete Representations and Self-Augmented Representations for Multilingual Automatic Speech Recognition”. SLT. [details here]<\/a><\/li>\n
  6. Masao Someki, Kwanghee Choi, Siddhant Arora, William Chen, Samuele Cornell, Jionghao Han, Yifan Peng, Jiatong Shi<\/strong>, Vaibhav Srivastav, and Shinji Watanabe. 2024. “ESPnet-EZ: Python-only ESPnet for Easy Fine-tuning and Integration”. [details here]<\/a><\/li>\n
  7. You Zhang, Yongyi Zang, Jiatong Shi<\/strong>, Ryuichi Yamamoto, Tomoki Toda, and Zhiyao Duan. 2024. “SVDD 2024: The Inaugural Singing Voice Deepfake Detection Challenge”. SLT. [details here]<\/a><\/li>\n
  8. William Chen, Wangyou Zhang, Yifan Peng, Xinjian Li, Jiatong Shi<\/strong>, Jinchuan Tian, Xuankai Chang, Soumi Maiti, Karen Livescu, and Shinji Watanabe. “Towards Robust Speech Representation Learning for Thousands of Languages”. EMNLP. [details here]<\/a><\/li>\n
  9. Kristin Qi, Jiatong Shi<\/b>, Caroline Summerour, John Batsis, and Xiaohui Liang. 2024. “Exploiting Longitudinal Speech Data via Voice Assistant Systems for Early Detection of Cognitive Decline”. IEEE Healthcom2024. [details here]<\/a><\/li>\n
  10. Ibrahim Said Ahmad, Antonios Anastasopoulos, Ond\u0159ej Bojar, Claudia Borg, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, William Chen, Qianqian Dong, Marcello Federico, Barry Haddow, D\u00e1vid Javorsk\u00fd, Mateusz Krubi\u0144ski, Tsz Kim Lam, Xutai Ma, Prashant Mathur, Evgeny Matusov, Chandresh Maurya, John McCrae, Kenton Murray, Satoshi Nakamura, Matteo Negri, Jan Niehues, Xing Niu, Atul Kr. Ojha, John Ortega, Sara Papi, Peter Pol\u00e1k, Adam Posp\u00ed\u0161il, Pavel Pecina, Elizabeth Salesky, Nivedita Sethiya, Balaram Sarkar, Jiatong Shi<\/strong>, Claytone Sikasote, Matthias Sperber, Sebastian St\u00fcker, Katsuhito Sudoh, Brian Thompson, Alex Waibel, Shinji Watanabe, Patrick Wilken, Petr Zem\u00e1nek, and Rodolfo Zevallos. 2024. “Findings of the IWSLT 2024 Evaluation Campaign”. IWSLT. [details here]<\/a><\/li>\n
  11. Jiatong Shi<\/strong>, Shih-Heng Wang, William Chen, Martijn Bartelds, Vanya Bannihatti Kumar, Jinchuan Tian, Xuankai Chang, Dan Jurafsky, Karen Livescu, Hung-yi Lee, and Shinji Watanabe. 2024. “ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets”. Interspeech. [details here]<\/a><\/li>\n
  12. Jiatong Shi<\/strong>, Xutai Ma, Hirofumi Inaguma, Anna Sun, and Shinji Watanabe. 2024. “MMM: Multi-Layer Multi-Residual Multi-Stream Discrete Speech Representation from Self-supervised Learning Model”. Interspeech. [details here]<\/a><\/li>\n
  13. Jiatong Shi<\/strong>*, Yueqian Lin*, Xinyi Bai, Keyi Zhang, Yuning Wu, Yuxun Tang, Yifeng Yu, Qin Jin, and Shinji Watanabe. 2024. “Singing Voice Data Scaling-up: An Introduction to ACE-Opencpop and ACE-KiSing”. (Accepted by Interspeech 2024) [details here]<\/a><\/li>\n
  14. Kalvin Chang, Yi-Hui Chou, Jiatong Shi<\/strong>, Hsuan-Ming Chen, Nicole Holliday, Odette Scharenborg, and David R. Mortensen. 2024. “Self-supervised Speech Representations Still Struggle with African American Vernacular English”. Interspeech. [details here]<\/a><\/li>\n
  15. Tejes Srivastava, Jiatong Shi<\/strong>, William Chen, and Shinji Watanabe. 2024. “EFFUSE: Efficient Self-Supervised Feature Fusion for E2E ASR in Multilingual and Low Resource Scenarios”. Interspeech. [details here]<\/a><\/li>\n
  16. Jee-weon Jung*, Wangyou Zhang*, Jiatong Shi<\/strong>*, Zakaria Aldeneh, Takuya Higuchi, Barry-John Theobald, Ahmed Hussen Abdelaziz, and Shinji Watanabe. 2024. “ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf models”. Interspeech. [details here]<\/a><\/li>\n
  17. Yifan Peng, Jinchuan Tian, William Chen, Siddhant Arora, Brian Yan, Yui Sudo, Muhammad Shakeel, Kwanghee Choi, Jiatong Shi<\/strong>, Xuankai Chang, Jee-weon Jung, and Shinji Watanabe. 2024. “OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer”. Interspeech. [details here]\u00a0<\/a><\/li>\n
  18. Shuhua Li, Qirong Mao, and Jiatong Shi<\/strong>. 2024. “PL-TTS: A Generalizable Prompt-based Diffusion TTS Augmented by Large Language Model”. Interspeech. [details here]<\/a><\/li>\n
  19. Xuankai Chang, Jiatong Shi<\/strong>, Jinchuan Tian, Yuning Wu, Yuxun Tang, Yihan Wu, Shinji Watanabe, Yossi Adi, Xie Chen, and Qin Jin. 2024. “The Interspeech 2024 Challenge on Speech Processing Using Discrete Units”. Interspeech. [details here]<\/a><\/li>\n
  20. Yongyi Zang, Jiatong Shi<\/strong>, You Zhang, Ryuichi Yamamoto, Jionghao Han, Yuxun Tang, Shengyuan Xu, Wenxiao Zhao, Jing Guo, Tomoki Toda, Zhiyao Duan. 2024. “CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detection”. Interspeech [details here]<\/a><\/li>\n
  21. Yuxun Tang, Yuning Wu, Jiatong Shi<\/strong>, and Qin Jin. 2024. “SingOMD: Singing Oriented Multi-resolution Discrete Representation Construction from Speech Models”. Interspeech. [details here]<\/a><\/li>\n
  22. Yuning Wu, Chunlei Zhang, Jiatong Shi<\/strong>, Yuxun Tang, and Qin Jin 2024. “TokSing: Singing Voice Synthesis based on Discrete Tokens”. Interspeech [details here]<\/a><\/li>\n
  23. Yuxun Tang, Jiatong Shi<\/strong>, Yuning Wu, and Qin Jin. 2024. “An Exploration on Singing MOS Prediction” ISCSLP. [details here]<\/a><\/li>\n
  24. Yuning Wu, Jiatong Shi<\/strong>, Yifeng Yu, Yuxun Tang, Qian Tao, Yueqian Lin, Jionghao Han, Xinyi Bai, Shinji Watanabe, and Qin Jin. 2024. “Muskits-ESPnet: a Comprehensive Toolkit for Singing Voice Synthesis in New Paradigm”. ACMMM. [details here]<\/a><\/li>\n
  25. Yuning Wu*, Yifeng Yu*, Jiatong Shi<\/strong>, Tao Qian, Qin Jin. 2024. “A Systematic Exploration of Joint-training for Singing Voice Synthesis” ISCSLP. [details here]<\/a><\/li>\n
  26. Taiqi He, Kwanghee Choi, Lindia Tjuatja, Jiatong Shi<\/strong>, Nate Robinson, Graham Neubig, Shinji Watanabe, David Mortensen, and Lori Levin. 2024. “WAV2GLOSS: Generating Interlinear Glossed Text from Speech”. ACL. [Details here]<\/a><\/li>\n
  27. Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Jinchuan Tian, Luping Liu, Zhenhui Ye, Ziyue Jiang, Xuankai Chang, Jiatong Shi<\/strong>, Chao Weng, Zhou Zhao, and Dong Yu. 2024. “Revisiting Voice Large Language Models as Scalable Multi-Lingual and Multi-Task Learners”. ACL.<\/li>\n
  28. Dongchao Yang*, Jinchuan Tian*, Xu Tan, Rongjie Huang, Songxiang Liu, Xuankai Chang, Jiatong Shi<\/strong>, Sheng Zhao, Jiang Bian, Xixin Wu, Zhou Zhao, and Helen Meng. 2024. “UniAudio: An Audio Foundation Model Toward Universal Audio Generation”. ICML. [details here]<\/a><\/li>\n
  29. Shu-wen Yang, Heng-Jui Chang*, Zili Huang*, Andy T. Liu*, Cheng-I Lai*, Haibin Wu*, Jiatong Shi<\/strong>, Xuankai Chang, Hsiang-Sheng Tsai, Wen-Chin Huang, Tzu-hsun Feng, Po-Han Chi, Yist Y. Lin, Yung-Sung Chuang, Tzu-Hsien Huang, Wei-Cheng Tseng, Kushal Lakhotia, Abdelrahman Mohamed, Shang-Wen Li, Shinji Watanabe, and Hung-yi Lee. 2024. “A Large-Scale Evaluation of Speech Foundation Models”. TASLP. [Details here]<\/a><\/li>\n
  30. Jiatong Shi<\/strong>, Hirofumi Inaguma, Xutai Ma, Ilia Kulikov, and Anna Sun. 2024. “Multi-resolution HuBERT: Multi-resolution Speech Self-Supervised Learning with Masked Unit Prediction”. ICLR. [Details here]<\/a><\/li>\n
  31. Rongjie Huang*, Mingze Li*, Dongchao Yang*, Jiatong Sh<\/strong>i*, Xuankai Chang, Zhenhui Ye, Yuning Wu, Zhiqing Hong, Jiawei Huang, Jinglin Liu, Yi Ren, Zhou Zhao, Shinji Watanabe. 2024. “AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head”. AAAI. [Details here]<\/a><\/li>\n
  32. Takashi Maekaku, Jiatong Shi<\/strong>, Xuankai Chang, Yuya Fujita, and Shinji Watanabe. 2024. “HuBERTopic: Enhancing semantic representation of HuBERT through self-supervision utilizing topic model”. ICASSP. [Details here]<\/a><\/li>\n
  33. Chien-yu Huang, Ke-Han Lu, Shih-Heng Wang, Chi-Yuan Hsiao, Chun-Yi Kuan, Haibin Wu, Siddhant Arora, Kai-Wei Chang, Jiatong Shi<\/strong>, Yifan Peng, Roshan Sharma, Shinji Watanabe, Bhiksha Ramakrishnan, Shady Shehata, and Hung-yi Lee. 2024. “Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speech”. ICASSP. [Details here]<\/a><\/li>\n
  34. Xuankai Chang, Brian Yan, Kwanghee Choi, Jeeweon Jung, Yichen Lu, Soumi Maiti, Roshan Sharma, Jiatong Shi<\/strong>, Jinchuan Tian, Shinji Watanabe, Yuya Fujita, Takashi Maekaku, Pengcheng Guo, Yao-Fei Cheng, Pavel Denisov, Kohei Saijo, and Hsiu-Hsuan Wang. 2024. “Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Study”. ICASSP. [details here]<\/a><\/li>\n
  35. Yi-Hui Chou, Kalvin Chang, Meng-Ju Wu, Winston Ou, Alice Wen-Hsin Bi, Carol Yang, Bryan Y. Chen, Rong-Wei Pai, Po-Yen Yeh, Jo-Peng Chiang, Lu-Tshiann Phoann, Winnie Chang, Chenxuan Cui, Noel Chen, and Jiatong Shi<\/strong>. 2023.\u00a0 “Evaluating Self-supervised Speech Models on a Taiwanese Hokkien Corpus”. ASRU. [details here]<\/a><\/li>\n
  36. Yifan Peng, Jinchuan Tian, Brian Yan, Dan Berrebbi, Xuankai Chang, Xinjian Li, Jiatong Shi,<\/strong> Siddhant Arora, William Chen, Roshan Sharma, Wangyou Zhang, Yui Sudo, Muhammad Shakeel, Jee-Weon Jung, Soumi Maiti, and Shinji Watanabe. 2023. “Reproducing Whisper-Style Pre-training Using an Open-Source Toolkit and Publicly Available Data”. ASRU. [details here]<\/a><\/li>\n
  37. William Chen, Jiatong Shi,<\/strong> Brian Yan, Dan Berrebbi, Wangyou Zhang, Yifan Peng, Xuankai Chang, Soumi Maiti, and Shinji Watanabe. 2023. “Joint Prediction and Denoising for Large-Scale Multilingual Self-Supervised Learning”. ASRU. [details here]<\/a><\/li>\n
  38. Jiatong Shi<\/strong>, William Chen, Dan Berrebbi, Hsiu-Hsuan Wang, Wei-Ping Huang, En-Pei Hu, Ho-Lam Chuang, Xuankai Chang, Yuxun Tang, Shang-Wen Li, Abdelrahman Mohamed, Hung-yi Lee, and Shinji Watanabe. 2023. “Findings of the 2023 ML-SUPERB Challenge: Pre-Training and Evaluation over More Languages and Beyond”. ASRU. [details here]<\/a><\/li>\n
  39. Wen-Chin Huang, Lester Phillip Violeta, Songxiang Liu, Jiatong Shi,<\/strong> and Tomoki Toda. 2023. “The Singing Voice Conversion Challenge 2023”. ASRU [details here]<\/a><\/li>\n
  40. Yui Sudo, Shakeel Muhhamad, Brian Yan, Jiatong Shi<\/strong>, and Shinji Watanabe. 2023. “4D: Joint Modeling of CTC, Attention, Transducer, and Mask-predict Decoders”. Interspeech. [details here]<\/a>.<\/li>\n
  41. Jiatong Shi<\/strong>, Dan Berrebbi*, William Chen*, En-Pei Hu*, Wei-Ping Huang*, Ho Lam Chung*, Xuankai Chang, Shang-Wen (Daniel) Li, Abdelrahman Mohamed, Hung-yi Lee, and Shinji Watanabe. 2023. “ML-SUPERB: Multilingual Speech Universal PERformance Benchmark”. Interspeech. [details here]<\/a><\/li>\n
  42. Jiatong Shi<\/strong>, Yun Tang, Hirofumi Inaguma, Hongyu Gong, Juan Pino, and Shinji Watanabe. 2023. “Exploration on HuBERT with Multiple Resolution” Interspeech. [details here]<\/a><\/li>\n
  43. Sweta Agrawal, Antonios Anastasopoulos, Luisa Bentivogli, Ond\u0159ej Bojar, Claudia Borg, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, Mingda Chen, William Chen, Khalid Choukri, Alexandra Chronopoulou, Anna Currey, Thierry Declerck, Qianqian Dong, Kevin Duh, Yannick Est\u00e8ve, Marcello Federico, Souhir Gahbiche, Barry Haddow, Benjamin Hsu, Phu Mon Htut, Hirofumi Inaguma, D\u00e1vid Javorsk\u00fd, John Judge, Yasumasa Kano, Tom Ko, Rishu Kumar, Pengwei Li, Xutai Ma, Prashant Mathur, Evgeny Matusov, Paul McNamee, John P. McCrae, Kenton Murray, Maria Nadejde, Satoshi Nakamura, Matteo Negri, Ha Nguyen, Jan Niehues, Xing Niu, Atul Kr. Ojha, John E. Ortega, Proyag Pal, Juan Pino, Lonneke van der Plas, Peter Pol\u00e1k, Elijah Rippeth, Elizabeth Salesky, Jiatong Shi<\/strong>, Matthias Sperber, Sebastian St\u00fcker, Katsuhito Sudoh, Yun Tang, Brian Thompson, Kevin Tran, Marco Turchi, Alex Waibel, Mingxuan Wang, Shinji Watanabe, and Rodolfo Zevallos. 2023. “Findings of the IWSLT 2023 Evaluation Campaign”. IWSLT. [details here]<\/a><\/li>\n
  44. Brian Yan*, Jiatong Shi<\/strong>*, Soumi Maiti, William Chen, Xinjian Li, Yifan Peng, Siddhant Arora, and Shinji Watanabe. 2023. “CMU\u2019s IWSLT 2023 Simultaneous Speech Translation System”. IWSLT. [details here]<\/a><\/li>\n
  45. Brian Yan*, Jiatong Shi<\/strong>*, Yun Tang, Hirofumi Inaguma, Yifan Peng, Siddharth Dalmia, Peter Pol\\’ak, Patrick Fernandes, Dan Berrebbi, Tomoki Hayashi, Xiaohui Zhang, Zhaoheng Ni, Moto Hira, Soumi Maiti, Juan Pino, Shinji Watanabe. 2023. “ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit”. ACL demo. [details here]<\/a><\/li>\n
  46. Tao Qian, Fan Lou, Jiatong Shi, Yuning Wu, Shuai GUo, Xiang Yin, and Qin Jin. 2023. “UniLG: A Unified Structure-aware Framework for Lyrics Generation”. ACL. [details here]<\/a><\/li>\n
  47. William Chen, Brian Yan, Jiatong Shi<\/strong>, Yifan Peng, Soumi Maiti, and Shinji Watanabe. “Improving Massively Multilingual ASR with Auxiliary CTC Objectives”. ICASSP. [details here]<\/a><\/li>\n
  48. Jiatong Shi<\/strong>, Chan-Jan Hsu, Holam Chung, Dongji Gao, Paola Garcia, Shinji Watanabe, Ann Lee, and Hung-yi Lee. “Bridging Speech and Text Pre-trained Models with Unsupervised ASR”. ICASSP. [details here]<\/a><\/li>\n
  49. Jiatong Shi<\/strong>, Yun Tang, Ann Lee, Hirofumi Inaguma, Changhan Wang, Juan Pino, and Shinji Watanabe. 2023. “Enhancing Speech-to-Speech Translation with Multiple TTS Targets”. ICASSP. [details here]<\/a><\/li>\n
  50. Dongji Gao*, Jiatong Shi<\/strong>*, Shun-Po Chuang, Leibny Paola Garcia, Hung-yi Lee, Shinji Watanabe, and Sanjeev Khudanpur. 2023\u3001”EURO: ESPnet Unsupervised ASR Open-source Toolkit”. ICASSP. [details here]<\/a><\/li>\n
  51. Yuning Wu, Jiatong Shi<\/strong>, Tao Qian, and Qin Jin. 2023. “PHONEix: Acoustic Feature Processing Strategy for Enhanced Singing Pronunciation with Phoneme Distribution Predictor”. ICASSP. [details here]<\/a><\/li>\n
  52. Tzu-hsun Feng, Annie Dong, Ching-Feng Yeh, Shu-wen Yang, Tzu-Quan Lin, Jiatong Shi<\/strong>, Kai-Wei Chang, Zili Huang, Haibin Wu, Xuankai Chang, Shinji Watanabe, Abdelrahman Mohamed, Shang-Wen Li and Hung-yi Lee. “SUPERB@ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning”. SLT. [details here]<\/a><\/li>\n
  53. Yen Meng, Hsuan-Jui Chen, Jiatong Shi<\/strong>, Shinji Watanabe, Paola Garcia, Hung-yi Lee and Hao Tang. “On Compressing Sequences for Self-Supervised Speech Models”. SLT. [details here]<\/a><\/li>\n
  54. Antonios Anastasopoulos, Lo\u00efc Barrault, Luisa Bentivogli, Marcely Zanon Boito, Ond\u0159ej Bojar, Roldano Cattoni, Anna Currey, Georgiana Dinu, Kevin Duh, Maha Elbayad, Clara Emmanuel, Yannick Est\u00e8ve, Marcello Federico, Christian Federmann, Souhir Gahbiche, Hongyu Gong, Roman Grundkiewicz, Barry Haddow, Benjamin Hsu, D\u00e1vid Javorsk\u00fd, V\u0115ra Kloudov\u00e1, Surafel Lakew, Xutai Ma, Prashant Mathur, Paul McNamee, Kenton Murray, Maria N\u01cedejde, Satoshi Nakamura, Matteo Negri, Jan Niehues, Xing Niu, John Ortega, Juan Pino, Elizabeth Salesky, Jiatong Shi<\/strong>, Matthias Sperber, Sebastian St\u00fcker, Katsuhito Sudoh, Marco Turchi, Yogesh Virkar, Alexander Waibel, Changhan Wang, and Shinji Watanabe. 2022. “Findings of the IWSLT 2022 Evaluation Campaign”. IWSLT. [details here]<\/a><\/li>\n
  55. Jiatong Shi<\/span><\/strong>, George Saon, David Haws, Shinji Watanabe and Brian Kingsbury. \u201dVQ-T: RNN Transducers using Vector-<\/span>Quantized Prediction Network States\u201d. Interspeech. [details here]<\/a><\/span><\/li>\n
  56. Jiatong Shi<\/span><\/strong>, Shuai Guo<\/span>, Tao Qian<\/span>, Nan Huo, Tomoki Hayashi, Yuning Wu, Fangzheng Xu, Xuankai Chang, Huazhe Li,\u00a0<\/span>Peter Wu, Shinji Watanabe and Qin Jin. 2022. \u201dMuskits: an End-to-end Music Processing Toolkit for Singing Voice Synthesis \u201d. Interspeech. [details here]<\/a><\/span><\/li>\n
  57. Shuai Guo*<\/em><\/span>,<\/span> Jiatong Shi*<\/span><\/strong>, Tao Qian<\/span>, Shinji Watanabe and Qin Jin. \u201dSingAug: Data Augmentation for Singing Voice\u00a0<\/span>Synthesis with Cycle-consistent Training Strategy \u201d. Interspeech. [details here]<\/a><\/span><\/li>\n
  58. Dan Berrebbi<\/span>,<\/span> Jiatong Shi<\/span><\/strong>, Brian Yan, Osbel L\u00f3pez-Francisco, Jonathan Amith and Shinji Watanabe. \u201dCombining Spec<\/span>tral and Self-Supervised Features for Low Resource Speech Recognition and Translation\u201d. Interspeech. [details here]<\/a><\/span><\/li>\n
  59. Keqi Deng, Shinji Watanabe,<\/span> Jiatong Shi<\/span><\/strong> and Siddhant Arora. \u201dBlockwise Streaming Transformer for Spoken Language\u00a0<\/span>Understanding and Simultaneous Speech Translation \u201d. Interspeech. [details here]<\/a><\/span><\/li>\n
  60. Yui Sudo, Shakeel Muhammad, Kazuhiro Nakadai,<\/span> Jiatong Shi<\/span><\/strong> and Shinji Watanabe. \u201dStreaming Automatic Speech\u00a0<\/span>Recognition with Re-blocking Processing Based on Integrated Voice Activity Detection\u201d. Interspeech. [details here]<\/a><\/span><\/li>\n
  61. Brian Yan, Patrick Fernandes, Siddharth Dalmia,<\/span> Jiatong Shi<\/span><\/strong>, Yifan Peng, Dan Berrebbi, Xinyi Wang, Graham Neubig, and\u00a0<\/span>Shinji Watanabe. 2022. \u201cCMU\u2019s IWSLT 2022 Dialect Speech Translation System\u201d,<\/span> Proceedings of the 19th International\u00a0<\/span>Conference on Spoken Language Translation (IWSLT 2022) [details here]<\/a><\/span><\/li>\n
  62. Hsiang-Sheng Tsai, Heng-Jui Chang, Wen-Chin Huang, Zili Huang, Kushal Lakhotia, Shu-wen Yang, Shuyan Dong, Andy T.\u00a0<\/span>Liu, Cheng-I Lai,<\/span> Jiatong Shi<\/span><\/strong>, Xuankai Chang, Phil Hall, Shang-Wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-<\/span>yi Lee. \u201dSUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative\u00a0<\/span>Capabilities\u201d. 2022. Proceedings of the Annual Meeting of the Association for Computational Linguistics. [details here]<\/a><\/span><\/li>\n
  63. Tao Qian<\/span>,<\/span> Jiatong Shi<\/span><\/strong>, Shuai Guo<\/span>, Peter Wu<\/span>, and Qin Jin. \u201dTraining strategies for automatic song writing: a perspec<\/span>tive with a unified framework\u201d. 2022. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). [details here]<\/a><\/span><\/li>\n
  64. Chunlei Zhang,<\/span> Jiatong Shi<\/span><\/strong>, Chao Weng, Meng Yu, and Dong Yu. 2022. \u201dTowards End-to-end Speaker Diarization with Gener<\/span>alized Neural Speaker Clustering\u201d. ICASSP. [details here]<\/a><\/span><\/li>\n
  65. Jiatong Shi<\/span><\/strong>, Chunlei Zhang, Chao Weng, Shinji Watanabe, Meng Yu, and Dong Yu. 2022. \u201dAn Investigation of Neural Un<\/span>certainty Estimation for Target Speaker Extraction Equipped RNN Transducer\u201d.<\/span> Computer Speech and Language (CSL)<\/span>.<\/span>\u00a0[details here]<\/a><\/span><\/li>\n
  66. Peter Wu<\/span>, Paul Pu Liang,<\/span> Jiatong Shi<\/span><\/strong>, Ruslan Salakhutdinov, and Shinji Watanabe, Louis-Philippe Morency. 2021. \u201dUnder<\/span>standing the Tradeoffs in Client-side Privacy for Downstream Speech Tasks\u201d.<\/span> APSIPA<\/span>. [details here]<\/a><\/span><\/li>\n
  67. Peter Wu<\/span>,<\/span> Jiatong Shi<\/span><\/strong>, Yifan Zhong, Shinji Watanabe, and Alan W Black. 2021.\u00a0 \u201dAcoustic Cross-lingual Transfer using Lan<\/span>guage Similarity\u201d. ASRU. [details here]<\/a><\/span><\/li>\n
  68. Hirofumi Inaguma, Brian Yan, Siddharth Dalmia, Pengcheng Gu, Jiatong Shi<\/strong>, Kevin Duh, Shinji Watanabe. 2021. “ESPnet-ST IWSLT 2021 Offline Speech Translation System”. IWSLT. [details here]<\/a><\/li>\n
  69. Shu-wen Yang, Po-Han Chi*, Yung-Sung Chuang*, Cheng-I Jeff Lai*, Kushal Lakhotia*, Yist Y Lin*, Andy T Liu*, Jiatong Shi*<\/strong>, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-Wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee. 2020. “SUPERB: Speech processing Universal PERformance Benchmark”. Interspeech.\u00a0[details here]<\/a><\/li>\n
  70. Jiatong Shi<\/strong>, Jonathan D. Amith, Xuankai Chang, Siddharth Dalmia, Brian Yan, and Shinji Watanabe. 2021. “Highland Puebla Nahuatl–Spanish Speech Translation Corpus for Endangered Language Documentation”. AmericasNLP [details here]<\/a><\/li>\n
  71. Jonathan D. Amith, Jiatong Shi<\/strong>, Rey Castillo Garc\u00eda. 2021. “End-to-End Automatic Speech Recognition: Its Impact on the Workflow for Documenting Yolox\u00f3chitl Mixtec”. AmericasNLP. [details here]<\/a><\/li>\n
  72. Jiatong, Shi<\/strong>, Chunlei Zhang, Chao Weng, Shinji Watanabe, Meng Yu, Dong Yu. 2021. “Improving RNN Transducer with Target Speaker Extraction and Neural Uncertainty Estimation”. ICASSP. [details here]<\/a><\/li>\n
  73. Jiatong, Shi*<\/strong>, Shuai Guo*, Nan Huo, Yuekai Zhang, Qin, Jin. 2021. “Sequence-to-sequence Singing Voice Synthesis with Perceptual Entropy Loss”. ICASSP. [details here]<\/a><\/li>\n
  74. Pengcheng Guo, Florian Boyer, Xuankai Chang, Tomoki Hayashi, Yosuke Higuchi, Hirofumi Inaguma, Naoyuki Kamo, Chenda Li, Daniel Garcia-Romero, Jiatong Shi<\/strong>, Jing Shi, Shinji Watanabe Kun Wei, Wangyou Zhang, Yuekai Zhang. 2021. “Recent Developments on ESPNet Toolkit Boosted by Conformer”.\u00a0 \u00a0ICASSP. [details here]<\/a><\/li>\n
  75. Jiatong, Shi<\/strong>, Jonathan D. Amith, Rey Castillo Garc\u00eda, Esteban Guadalupe Sierra, Kevin Duh, and Shinji Watanabe. \u201cLeveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on Yol\u00f3xochitl Mixtec\u201d. EACL.\u00a0\u00a0[details here]<\/a><\/li>\n
  76. Jiatong, Shi<\/strong>, Kunlin, Yang, Wei, Xu, and Mingming Wang.<\/i>\u00a0“Leveraging deep learning with audio analytics to predict the success of crowdfunding projects.”\u00a0Journal of Supercomputing<\/i>\u00a0(2021). https:\/\/doi.org\/10.1007\/s11227-020-03595-2 [details here]<\/a><\/li>\n
  77. Jiatong, Shi<\/strong>, Nan, Huo, and Qin Jin. 2020. “Context-aware Goodness of Pronunciation for Computer Assisted Pronunciation Training”. Interspeech<\/i>.\u00a0[details here]<\/a><\/li>\n
  78. Wenxin, Hou, Yue, Dong, Bairong Zhuang, Longfei, Yang, Jiatong, Shi<\/strong>, and Takahiro, Shinozaki. 2020. “Large-Scale End-to-End Multilingual Speech Recognition and Language Identification with Multi-Task Learning”.\u00a0 Interspeech<\/i>.\u00a0[details here]<\/a><\/li>\n
  79. Jiatong, Shi<\/strong>, Wei, Du, and Wei, Xu. 2018. \u201cIdentifying Impact Factors of Question Quality in Online Health Q&A Communities: an Empirical Analysis on MedHelp.\u201d PACIS.<\/i>\u00a0\u00a0[details here]<\/a><\/li>\n
  80. Jiatong, Shi<\/strong>. 2019. “Computer Assisted Language Learning System for Young English Learner”, Undergraduate Thesis, Renmin University of China.<\/li>\n<\/ol>\n

    Awards<\/strong><\/p>\n\n\n\n\n\n\n\n\n
    CMU Presidential Fellowship<\/td>\n2022<\/td>\n<\/tr>\n
    PhD fellowship at LTI, CMU<\/td>\n2021<\/td>\n<\/tr>\n
    Special Award in \u2018National University Data-driven Innovation & Research Competition\u2019 (1\/594)<\/td>\n2018<\/td>\n<\/tr>\n
    National Level in \u2018Training Programs of Innovation and Entrepreneurship for Undergraduates<\/td>\n2017<\/td>\n<\/tr>\n
    Scholarship of Academic Excellence (TOP 20%)<\/td>\n2016 & 2017 & 2018<\/td>\n<\/tr>\n
    Golden Prize in Beijing Art Festival of Undergraduates (Accordion Contest)<\/td>\n2016<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"excerpt":{"rendered":"

    Publication (* for Equal Contribution) Jiatong Shi, Hye-jin Shim, Jinchuan Tian, Siddhant Arora, Haibin Wu, Darius Petermann, Jia Qi Yip, You Zhang, Yuxun Tang, Wangyou Zhang, Dareen Safar Alharthi, Yichen Huang, Koichi Saito, Jionghao Han, Yiwen Zhao, Chris Donahue, and Shinji Watanabe. 2025. “VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Music”. NAACL Demo. … <\/p>\n

    Continue reading “Publications & Awards”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":84,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"http:\/\/shijt.site\/index.php\/wp-json\/wp\/v2\/pages\/17"}],"collection":[{"href":"http:\/\/shijt.site\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/shijt.site\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/shijt.site\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/shijt.site\/index.php\/wp-json\/wp\/v2\/comments?post=17"}],"version-history":[{"count":46,"href":"http:\/\/shijt.site\/index.php\/wp-json\/wp\/v2\/pages\/17\/revisions"}],"predecessor-version":[{"id":426,"href":"http:\/\/shijt.site\/index.php\/wp-json\/wp\/v2\/pages\/17\/revisions\/426"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/shijt.site\/index.php\/wp-json\/wp\/v2\/media\/84"}],"wp:attachment":[{"href":"http:\/\/shijt.site\/index.php\/wp-json\/wp\/v2\/media?parent=17"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}