J. Han*, T. Xia* (*: co-first-author), D. Spathis, E. Bondareva, C. Brown, J. Chauhan, T. Dang, A. Grammenos, A. Hasthanasombat, A. Floto, P. Cicuta, and C. Mascolo. “Sounds of COVID-19: Exploring realistic performance of audio-based digital testing”, npj Digital Medicine, vol. 5, Jan. 2022. 9 pages (IF: 15.357 (2022)).
J. Han, Z. Zhang, C. Mascolo, E. André, J. Tao, Z. Zhao, and B. W.Schuller. “Deep Mental Health Analysis on Mobile Devices: Challenges and Recent Advances”, IEEE Signal Processing Magazine, 38.6, Nov. 2021, pp. 96–105 (IF: 15.204 (2022))
J. Han, Z. Zhang, M. Pantic, and B. Schuller, “Internet of Emotional People: Towards Continual Affective Computing cross Cultures via Audiovisual Signals”, Future Generation Computer Systems, vol. 114 , Jan. 2021, pp. 294-306 (IF: 7.307 (2022))
T. Dang, J. Han, T. Xia, D. Spathis, E. Bondareva, C. Siegele-Brown, J. Chauhan, A. Grammenos, A. Hasthanasombat, A. Floto, P. Cicuta, and C. Mascolo. “Exploring longitudinal cough, breath, and voice data for COVID-19 progression prediction via sequential deep learning: Model development and validation”, Journal of Medical Internet Research, vol. 24, no. 6, June 2022. 14 pages (IF: 7.076 (2022))
T. Xia, J. Han, and C. Mascolo. “Exploring machine learning for audio-based respiratory condition screening: A concise review of databases, methods, and open issues”, Experimental Biology and Medicine , 2022, 9 pages (IF: 4.088 (2022))
J. Kossaifi, R. Walecki, Y. Panagakis, J. Shen, M. Schmitt, F. Ringeval, J. Han, V. Pandit, B. Schuller, K. Star, E. Hajiyev, and M. Pantic, “SEWA DB: A Rich Database for Audio-Visual Emotion and Sentiment Research in the Wild”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 3, Mar. 2021, pp. 1022-1040 (IF: 24.314 (2022))
J. Han, Z. Zhang, Z. Ren, and B. Schuller, "EmoBed: Strengthening Emotion Recognition via Training with Crossmodal Emotion Embeddings", IEEE Transactions on Affective Computing, vol. 12, no. 3, July 2021. pp. 553-564 (IF: 13.990 (2022))
J. Han, Z. Zhang, Z. Ren, and B. Schuller, "Exploring Perception Uncertainty for Emotion Recognition in Dyadic Conversation and Music Listening", Cognitive Computation, vol. 13, Mar. 2021, pp. 231-240 (IF: 4.890 (2022))
S. Liu, J. Han, E. Laporta Puyal, S.n Kontaxis, S.g Sun, P. Locatelli, J. Dineley, F. B. Pokorny, G. D. Costa, L. Leocan, et al. “Fitbeat: COVID-19 Estimation based on Wristband Heart Rate”, Pattern Recognition , vol. 123, Mar. 2022. 10 pages (IF: 8.518 (2022))
Z. Ren, Q. Kong, J. Han, M. D. Plumbley, and B. Schuller. “CAA-Net: Conditional AtrousCNNs with Attention for Explainable Device-robust Acoustic Scene Classification”, IEEE Transactions on Multimedia, vol. 23, Nov. 2020. pp. 4131-4142 (IF: 8.182 (2022))
K. Qian, M. Schmitt, H. Zheng, T. Koike, J. Han, J. Liu, W. Ji, J. Duan, M. Song, Z. Yang, Z. Ren, S. Liu, Z. Zhang, Y. Yamamoto, B. Schuller. “Computer Audition for Fighting the SARS-CoV-2 Corona Crisis – Introducing the Multi-taskSpeech Corpus for COVID-19”. IEEE Internet of Things Journal, vol. 8, no. 21, Nov. 2021. pp. 16035-16046 (IF: 10.238 (2022))
Z. Zhang, D. Liu, J. Han, K. Qian, and B. Schuller. “Learning Audio Sequence Representations for Acoustic Event Classification”. Expert Systems with Applications, vol.178, Sep. 2021. 9 pages (IF: 8.665 (2022))
S. Amiriparian, J. Han, M. Schmitt, A. Baird, A. Mallol-Ragolta, M., M. Gerczuk, and B. Schuller, "Synchronization in Interpersonal Speech", Frontiers in Robotics and AI, Nov. 2019.
J. Han, Z. Zhang, N. Cummins, and B. Schuller, "Adversarial Training in Affective Computing and Sentiment Analysis: Recent Advances and Prospectives", IEEE Computational Intelligence Magazine, vol. 14, no. 2, May 2019. pp. 68-81 (IF: 9.809 (2022))
Z. Zhang, J. Han, K. Qian, C. Janott, Y. Guo, and B. Schuller, "Snore-GANs: Improving Automatic Snore Sound Classification with Synthesized Data", IEEE Journal of Biomedical and Health Informatics, vol.24, no. 1, Jan. 2020. pp. 300-310 (IF: 7.021 (2022))
Z. Zhang, J. Han, E. Coutinho, and B. Schuller, "Dynamic Difficulty Awareness Training for Continuous Emotion Prediction", IEEE Transactions on Multimedia, vol. 21, no. 5, May 2019. pp. 1289-1301 (IF: 8.182 (2022))
J. Han, Z. Zhang, G. Keren, and B. Schuller, "Emotion Recognition in Speech with Latent Discriminative Representations Learning", Acta Acustica united with Acustica, vol. 104, Sep. 2018. pp. 737-740 (IF: 0.960 (2022))
Z. Zhang, J. Han, J. Deng, X. Xu, F. Ringeval, B. Schuller, "Leveraging Unlabelled Data for Emotion Recognition with Enhanced Collaborative Semi-Supervised Learning", IEEE Access, vol. 6, no. 1, May 2018. pp. 22196-22209 (IF: 3.476 (2022))
J. Han, Z. Zhang, N. Cummins, F. Ringeval, and B. Schuller, "Strength Modelling for Real-World Automatic Continuous Affect Recognition from Audiovisual Signals", Image and Vision Computing, vol. 65, Sep. 2017. pp. 76-86 (IF: 3.860 (2022))
T. Xia, J. Han, and C. Mascolo. “Benchmarking Uncertainty Quantification on Biosignal Classification Tasks under Dataset Shift”, in Proceedings of the 6th International Workshop on Health Intelligence (W3PHIAI-22), in conjunction with AAAI-22. Vancouver, Canada, 2022, 9 pages
E. Bondareva, T. Xia, J. Han, and C. Mascolo. “Towards Uncertainty-Aware Murmur Detection in Heart Sounds via Tandem Learning”, in Proceedings of Computing in Cardiology (CinC). Tampere, Finland, 2022, 4 pages
J. Han, C. Brown, J. Chauhan, A. Grammenos, A. Hasthanasombat, D. Spathis, T. Xia, P. Cicuta, and C. Mascolo. “Exploring Automatic COVID-19 Diagnosis via Voice and Symptoms from Crowdsourced Data”, in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). Toronto, Canada, 2021, pp. 8328–8332.
T. Xia, D. Spathis, C. Brown*, J. Chauhan*, A. Grammenos*, J. Han*, A. Hasthanasombat*, E. Bondareva*, T. Dang*, A. Floto, P. Cicuta, and C. Mascolo. “COVID-19 Sounds: A Large-Scale Audio Dataset for Digital COVID-19 Detection”, in Proceedings of the 35th Conference on Neural Information Processing Systems (NeurIPS) Track on Datasets and Benchmarks. virtual conference, 2021, 13 pages. (*: equal contribution)
T. Xia, J. Han, L. Qendro, T. Dang, and C. Mascolo. “Uncertainty-Aware COVID-19Detection from Imbalanced Sound Data”, in Proceedings of Annual Conference of the International Speech Communication Association (INTERSPEECH), Brno, Czech, 2021, pp. 2951-2955
B. W. Schuller, A. Batliner, C. Bergler, C. Mascolo, J. Han, I. Lefter, H. Kaya, et al, “The INTERSPEECH 2021Computational Paralinguistics Challenge: COVID-19 Cough, COVID-19 Speech, Escalation & Primates”, in Proceedings of Annual Conference of the International Speech Communication Association (INTERSPEECH), Brno, Czech, 2021, pp. 431-435
E. Bondareva, J. Han, W. Bradlow, and C. Mascolo. “Segmentation-free Heart MurmurDetection Using Deep Learning”, in Proceedings 43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Virtual, 2021, pp. 669-672
J. Han, C. Brown, J. Chauhan, A. Grammenos, A. Hasthanasombat, D. Spathis, T. Xia, P. Cicuta, and C. Mascolo. “Exploring Automatic COVID-19 Diagnosis via Voice and Symptoms from Crowdsourced Data”, in Proceedings 46th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Toronto, Canada, 2021, pp. 8328-8332
J. Han, K. Qian, M. Song, Z. Yang, Z. Ren, S. Liu, J. Liu, H. Zheng, W. Ji, T. Koike, X. Li, Z. Zhang, Y. Yamamoto, and B. Schuller. “An Early Study on Intelligent Analysis of Speech under COVID-19: Severity, Sleep Quality, Fatigue, and Anxiety”, in Proceedings of Annual Conference of the International Speech Communication Association (INTERSPEECH), Shanghai, China, 2020, pp. 4946-4950
Z. Ren, J. Han, N. Cummins, and B. Schuller. “Enhancing Transferability of Black-boxAdversarial Attacks via Lifelong Learning for Speech Emotion Recognition Models”, in Proceedings of Annual Conference of the International Speech Communication Association (INTERSPEECH), Shanghai, China, 2020, pp. 496-500
C. Brown*, J. Chauhan*, A. Grammenos*, J. Han*, A. Hasthanasombat*, D. Spathis*, T. Xia*, P. Cicuta, and C. Mascolo. “Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data”, in Proceedings of KDD, San Diego, CA, 2020, pp. 3474-3484. (*: equal contribution)
Z. Ren, A. Baird, J. Han, Z. Zhang, and B. Schuller. "Generating and protecting against adversarial attacks for deep speech-based emotion recognition models", in Proceedings 45th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Barcelona, Spain, 2020. pp. 7184-7188
Z. Ren, J. Han, N. Cummins, Q. Kong, M. Plumbley, and B. Schuller, "Multi-instance Learning for Bipolar Disorder Diagnosis using Weakly Labelled Speech Data", in Proceedings 9th International Conference on Digital Public Health (DPH), Marseille, France, Nov. 2019. pp. 79-83
J. Han, Z. Zhang, Z. Ren, and B. Schuller, "Implicit Fusion by Joint Audiovisual Training for Emotion Recognition in Mono Modality", Proceedings 44th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Brighton, UK, May 2019. pp. 5861-5865 (oral)
Z. Ren, Q. Kong, J. Han, M. Plumbley, and B. Schuller, "Attention-based Atrous Convolutional Neural Networks: Visualisation and Understanding Perspectives of Acoustic Scenes", Proceedings 44th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Brighton, UK, May 2019. pp. 56-60
H. Zhao, Y. Xiao, J. Han, and Z. Zhang. “Compact Convolutional Recurrent Neural Networks via Binarization for Speech Emotion Recognition”, Proceedings 44th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Brighton, UK, May 2019. pp. 6690–6694.
Z. Ren, N. Cummins, J. Han, S. Schnieder, J. Krajewski, and B. Schuller, "Evaluation of the Pain Level from Speech: Introducing a Novel Pain Database and Benchmarks", in Proceedings 13th ITG Conference on Speech Communication, Oldenburg, Germany, October 2018. pp. 56-60
Y. Guo, J. Han, Z. Zhang, B. Schuller, and Y. Ma, "Exploring a New Method for Food Likability Rating Based on DT-CWT Theory", in Proceedings 20th ACM International Conference on Multimodal Interaction (ICMI), Boulder, CO, October 2018. pp. 569-576
G. Keren, J. Han, and B. Schuller, "Scaling Speech Enhancement in Unseen Environments with Noise Embeddings", in Proceedings The 5th CHiME Workshop on Speech Processing in Everyday Environments held in conjunction with INTERSPEECH 2018, Hyderabad, India, September, 6 pages.
J. Han, Z. Zhang, M. Schmitt, Z. Ren, F. Ringeval, B. Schuller, "Bags in Bag: Generating Context-Aware Bags for Tracking Emotions from Speech", in Proceedings of Annual Conference of the International Speech Communication Association (INTERSPEECH), Hyderabad, India, September 2018. pp. 3082-3086 (oral)
Z. Zhang, J. Han, K. Qian, B. Schuller, "Evolving Learning for Analysing Mood-Related Infant Vocalisation", in Proceedings of Annual Conference of the International Speech Communication Association (INTERSPEECH), Hyderabad, India, September 2018. pp. 142-146
J. Han, M. Schmitt, and B. Schuller, "You Sound Like Your Counterpart: Interpersonal Speech Analysis", in Proceedings 20th International Conference Speech and Computer (SPECOM), Leipzig, Germany, September 2018. pp. 188-197 (oral)
J. Han, Z. Zhang, Z. Ren, F. Ringeval, and B. Schuller, "Towards Conditional Adversarial Training for Predicting Emotions from Speech", in Proceedings 43rd IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Calgary, Canada, April 2018. pp. 6822-6826 (oral)
Z. Ren, N. Cummins, V. Pandit, J. Han, K. Qian, and B. Schuller, "Learning Image-based Representations for Heart Sound Classification", in Proceedings 8th International Conference on Digital Health (DH), Lyon, France, April 2018. pp. 143-147
J. Han, Z. Zhang, M. Schmitt, M. Pantic, and B. Schuller, "From Hard to Soft: Towards more Human-like Emotion Recognition by Modelling the Perception Uncertainty", in Proceedings 25th ACM International Conference on Multimedia (MM), San Francisco, CA, October 2017. pp. 890-897
Z. Zhang, F. Weninger, M. Wöllmer, J. Han, and B. Schuller, "Towards Intoxicated Speech Recognition", in Proceedings 30th International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, May 2017. pp. 1555-1559
J. Han, Z. Zhang, F. Ringeval, and B. Schuller, "Prediction-based Learning from Continuous Emotion Recognition in Speech", in Proceedings 42nd IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), New Orleans, LA, March 2017. pp. 5005-5009 (oral)
J. Han, Z. Zhang, F. Ringeval, and B. Schuller, "Reconstruction-error-based Learning for Continuous Emotion Recognition in Speech", in Proceedings 42nd IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), New Orleans, LA, March 2017. pp. 2367-2371 (oral)
J. Deng, N. Cummins, J. Han, X. Xu, Z. Ren, V. Pandit, Z. Zhang, and B. Schuller, "The University of Passau Open Emotion Recognition System for the Multimodal Emotion Challenge", in Proceedings 7th Chinese Conference on Pattern Recognition (CCPR), Chengdu, China, November 2016. pp. 652-666
Z. Zhang, F. Ringeval, J. Han, J. Deng, E. Marchi, and B. Schuller, "Facing Realism in Spontaneous Emotion Recognition from Speech: Feature Enhancement by Autoencoder with LSTM Neural Networks", in Proceedings of Annual Conference of the International Speech Communication Association (INTERSPEECH), San Francisco, CA, September 2016. pp. 3593-3597
H. Sagha, J. Deng, M. Gavryukova, J. Han, and B. Schuller, "Cross Lingual Speech Emotion Recognition using Canonical Correlation Analysis on Principal Component Subspace", in Proceedings 41st IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Shanghai, China, March 2016, pp. 5800-5804
P. Kindt, J. Han, N. Peters, and S. Chakraborty, "ExPerio - Exploiting Periodicity for Opportunistic Energy Efficient Data Transmission", in Proceedings 42nd IEEE International Conference on Computer Communications (INFOCOM), Hong Kong, China, April 2015, pp. 82-90
Z. Zhang, D. Liu, J. Han, and B. Schuller, “Learning Audio Sequence Representations for Acoustic Event Classification,” arxiv.org, July 2017. 8 pages