Curriculum Vita

General Information

Full Name Pan Zexu
Gender Male
Nationality Chinese
Year of Birth 1994
Email (personal) xu325504@hotmail.com
Email (school) pan_zexu@u.nus.edu
Email (work) zpan@merl.com
Phone +1 (617) 233-5211
Address 201 Broadway, Cambridge, MA 02139, Level-8

Research Interests

  • I am interested in artificial intelligence, deep learning, and their applications on but not limited to speech processing, such as multi-modal speech enhancement, speaker extraction, speaker diarization, robust automatic speech recognition, multi-modal representation learning, auditory attention detection, etc.

Education

  • 2019 - 2023
    PhD
    National University of Singapore (NUS), Singapore
    • Institute of Data Science
    • Supervised by Prof. Haizhou Li
    • Research topics
      • Visual-steered/Neuro-steered speaker extraction
      • Audio-visual Speaker diarization
      • Robust automatic speech recognition
      • Audio-visual active speaker detection
      • Self-supervised audio-visual learning
  • 2015 - 2019
    Bachelor
    Nanyang Technological University (NTU), Singapore
    • Department of Electrical and Electronics Engineering
    • Supervised by Prof. Lihua Xie
    • Honours with Highest Distinction (GPA 4.87/5.0)
    • Research topics
      • Contorl and automation for Unmanned Vehicle
  • 2016 - 2016
    Bachelor (Exchange Program)
    University of Maryland, College Park, United States

Work Experience

  • 2023-Now
    Visiting Research Scientist
    Mitsubishi Electric Research Laboratories, Cambridge, United States
    • Working with Dr. Jonathan LE ROUX
    • Speech and audio processing, with a focus on audio-visual and neuro-steered speaker extraction
  • 2023-2023
    Visiting Researcher
    Cognitive system lab, University of Bremen, Germany
    • Hosted by Prof. Tanja Schultz
    • Research on Neuro-steered speaker extraction with EEG signals and more effective online deployment
  • 2022-2022
    Research Intern
    Mitsubishi Electric Research Laboratories, Cambridge, United States
    • Hosted by Dr. Jonathan LE ROUX
    • Derive and implement new models and optimization methods for Audio-visual speaker diarization for in-the-wild video recordings.
  • 2018-2018
    Intern
    Delta-NTU Cyber Physical Security Laboratory, Singapore
    • Designing control and automation algorithm for robot arms
  • 2017-2018
    Student researcher
    NTU Internet of things lab
    • Data acquisition and analysis with Millimeter-wave radar for obstacle/target detection and tracking
    • Designing autonomous obstacle bypass, target tracking, and pursuit algorithm for unmanned aerial vehicle

Honors and Awards

  • 2021
    • 2nd Runner up for ActivityNet Challenge at CVPR workshop
  • 2019-2023
    • NUS President's Graduate Fellowship (Integrative science and engineering program Scholarship)
  • 2015-2019
    • NTU Science and Engineering Undergraduate Scholarship
  • 2011-2014
    • Senior Middle 1 Scholarship from Ministry of Education in Singapore

Teaching

  • 2021-2022
    Undergraduate Teaching Assistent, Singapore
    • Introduction to Machine Learning (NUS EE2211)
  • 2020-2021
    Undergraduate Teaching Assistent, Singapore
    • Digital Design (NUS EE2026)
  • 2014-2015
    Primary school teacher, China
    • Voluntary teaching in an impoverished countryside school in Anhui Province for 1 semester
  • 2015
    Primary school teacher, China
    • Voluntary teaching in an impoverished countryside school in Henan Province for 1 semester