I am a Research Assistant Professor at the School of Psychology, Shanghai Jiao Tong University, where I lead the Cross innovation Lab(CiL). I am an Area Editor of CAAI Artificial Intelligence Research, and also as a senior member of China Computer Federation(CCF), a member of the Chinese Psychological Society and a member of Affective Computing Specialised Committee, Chinese Information Society of China. My research interests include Computational Affection, Quantitative Affective Computing and Computational Psychiatry.
Previously I was as an Visitor Scholar at MSIIP Lab in Tsinghua University(Oct.2021-Dec.2021) and New York University Shanghai(Aug.2023-Dec.2024).
We have multiple openings for Visitor Student/Internship positions. Please make contact for further information by email.
2026/09[NEW!]
2026/07
2026/06: Our work is online now at conference 16th-ACM ICMR in From Physics to Representation: Audio Learning with Synthetic Pre-training via Procedural Generation.
2026/04: Our work is online now at Journal Pattern Recognition in Temporal-spatial Cross-fusion for Dynamic Micro Expression Recognition.
2026/03: Our work is online now at Journal IEEE Transactions on Affective Computing in Evaluating and Correcting Human Annotation Bias in Dynamic Micro-Expression Recognition.
2026/03: Our work is online now at Journal International Journal of Human-Computer Studies in Enhancing Trust through a Human-Centered Evaluation Framework from an Accessibility Perspective: The Case of Graph Anomaly Detection.
2026: Our work "Multimodal Visual Cues Empower Psychological Counselling with LLMs" is under review at Journal Journal of Social Computing
2025/10: Our work is online now at conference ACM Multimedia 2025 in Action Unit Enhanced Dynamic Facial Expression Recognition, which incorporates action unit knowledge to improve dynamic facial expression recognition.
2025/10: Our work is online now at Journal IEEE T-CSS in Reward-based Gradient Modulation for Multi-modal Emotion Recognition with LoRA, which introduces reward-based gradient modulation and parameter-efficient fine-tuning for balanced multimodal emotion recognition.
2025/10: Our work is online now at Journal IEEE Transactions on Affective Computing in speaker-unknown emotion recognition in conversation via progressive contrastive deep supervision.
2025/09: Our work is online now at Journal IEEE Transactions on Biometrics, Behavior, and Identity Science in Robust Dynamic Facial Expression Recognition, which explores robust learning under hard and noisy samples for dynamic facial expression recognition.
2025/08: Our work is online now at Journal Intelligent Computing (Science Partner Journal) which explores the impact of color and daytime/nighttime on visual memory in VR teaching environments using explainable machine learning.
2025/08: Our work is online now at Journal Applied Sciences in Evaluating Psychological Competency via Chinese Q&A in Large Language Models, which systematically evaluates the psychological knowledge and question-answering capabilities of LLMs in the Chinese context.
2025/07: Our work is online now at Journal "《信息网络安全》" which proposes an active decentralized regulatory sensor network architecture based on smart contract oracle technology.
2025/07: Our work is online now at conference 31st-ICONIP in GAF-FusionNet, which explores multimodal ECG analysis via Gramian Angular Fields and split attention.
2025/04: Our work is online now at conference IJCNN 2025 in MTLP-MDG, which proposes a multi-task learning framework using probabilistic distribution perception for missing data generation.
2025/03: Our work is online now at conference CGI 2025 in Conv-cut, a visual facial expression signal feature processing network based on streamlined ConvNeXt.
2025/03: Our work is online now at Journal Neural Networks in BC-PMJRS, which introduces brain computing-inspired predefined multimodal joint representation spaces for enhanced cross-modal learning.
2025/03: Our work is online now at Journal "《心理科学进展》" which investigates the social cognitive characteristics of social anxiety within a Bayesian framework.
2025/03: Our work is online now at conference 37th-CASA in Emotion Loss Attacking, which explores adversarial attack perception for skeleton-based representations using multi-dimensional features.
2025/03: Our work is online now at conference 41st-CGI in Mamba-Spike, which enhances the Mamba architecture with a spiking front-end for efficient temporal data processing.
2025/02: Our work is online now at conference 41st-CGI in GSMC, a global-local scalable multi-task contrastive learning framework.
2025/02: Our work is online now at Journal Applied Sciences in Dual-Modality Transformer with Time Series Imaging for Robust Epileptic Seizure Prediction, which integrates temporal EEG signals and time-series imaging for seizure prediction.
2025/01: Our latest review work "The Ethical Security of Large Language Models: A Systematic Review" has been published in the journal of Frontiers of Engineering Management, which reviews the security risks, privacy concerns, defense strategies, and ethical governance of large language models.
2025/01: Our work is online now at conference 58th-HICSS in Advanced BERT-Based Commodity Classification on Amazon Online Malls Based on Consumer Cognitive Attributes.
2025/01: Our work is online now at conference 58th-HICSS in OCC-PAD-OCEAN, which presents a psychologically explanatory architecture for a quantitative personality recognition paradigm.
2024/12: Our latest premium work "A psychologically interpretable artificial intelligence framework for the screening of loneliness, depression, and anxiety" has been published in the journal of "Applied Psychology: Health and Well" which show the potential for prediction of loneliness, depression, and anxiety only using facial information.
2024/12: "Survey on blockchain privacy protection techniques in cryptography/区块链密码学隐私保护技术综述" was selected as Outstanding Paper of the Year 2022 at the "《网络与信息安全学报》" which present our overview of protection with blockchain technology.
2024/12: Our work is online now at Journal IEEE T-CSS : Bitcoin Address Clustering Based on Change Address Improvement which proposes a clustering method based on multiconditional recognition of one-time change addresses and conduct experiments with on-chain bitcoin transaction data.
2024/10: Our work is online now at Journal "《计算机科学》" which present our overview of our perceptions related to computable emotions in intelligent education.
2024/09: Our work is online now at Journal Current Opinion in Behavioral Sciences which Demonstrates our understanding of AI in Mental Health.
2024/09: Our work is online now at Journal applied sciences to Exploring Inner-Speech Recognition via Cross-Perception approach in EEG and fMRI.
2024/08: Our work is online now at Journal CAAI Artificial Intelligent Research as invited paper by AE in AI Emotion Quantification.
2024/07: Our work is online now at Journal "《新闻大学》" which carried out in computational communication using OCC-PAD-OCEAN.
2024/03: Our work is online now at conference 49rd-ICASSP in Emotion Neural Transducer for Fine-Grained Speech Emotion Recognition.
2024/02: Our work is online now at Journal Heliyon(Cell Family Journal) as invited paper by AE with attention allocation in scenarios of emotional conflict was explored through VR.
2024/02: Our work is online now at Journal Intelligent Computing(Science Partner Journal) : Extends the conference paper on Temporal Shift for Speech Emotion Recognition (ICASSP-48) and further deepens the design of a fundamental framework for the field of speech emotion recognition.
2023/10: Our work is online now at Journal Frontiers of Computer Science in Multimodal Sentiment Analysis.
2023/10: Our work is online now at Journal CAAI Artificial Intelligent Research as invited paper by AE in Multimodal Sentiment Analysis.
2023/08: Received the Funding from the Beijing Key Laboratory of Behavior and Mental Health, Peking University to support research on Computational Affection.
2023/05: Our work is online now at conference 37rd-IEEE/CVF CVPR which Formal presentation of the DFER domain task at the CVPR conference.
2023/05: Our work is online now at conference 48rd-ICASSP in Temporal Shift for Speech Emotion Recognition.
2023/02: "A Secure Multi-party Computation Protocol for Universal Data Privacy Protection based on Blockchain/《一种基于区块链的泛用型数据隐私保护的安全多方计算协议》" was selected as one of the top academic papers in "Leader F5000" Chinese high-quality science and technology journals in 2021 by the Ministry of Science and Technology.
2023/01: Our work is online now at conference 56rd-HICSS in Identity Change through Affordances Actualization.
2022/11: Our work is online now at Journal Journal of Social Computing : First validation using the OCC-PAD-OCEAN model in an educational scenario..
2022/11: Our work is online now at Journal IEEE T-CSS : The first basic computational paradigm OCC-PAD-OCEAN based on psychologically interpretable quantitative affective computing is presented, and the first validation is performed on the Big Five personality.
2022/09: Our work is online now at conference 23rd-ICME in Multimodal Sentiment Analysis.
2022/01: Our work is online now at Journal NEUROCOMPUTING : Proof-of-concept of basic emotion theory for facial emotion quantification based on generative technical validation.
2021/10: Our work is online now at conference 18rd-PRICAI in Micro-expression recognition.
2021/10: Our project "Computational Affection" is publicised now in article "Computational affection: A catalyst for human-centered education" by Science.
2021/09: Our work is online now at conference 33rd-ICMR in Skeleton-Based Human Action Recognition.