Junjie (Jorji) Chen

I was born in November 2002 in Lu’an, Anhui, China. I am currently in the final year of my Master’s degree at Anhui Polytechnic University (AHPU), supervised by Prof. Subin Huang.

I am a Research Intern at the Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, supervised by Prof. Meng Wang, and I plan to apply for PhD studies in Fall 2026. I am also working with Linfeng Zhang and his research group, where I am learning and exploring research problems related to Efficient AI.

💡 I am broadly interested in understanding how AI systems can better model human psychological and emotional states, and how such understanding can be incorporated into practical and efficient interactive systems.

🎯 Research Focus

I am primarily interested in the following research question:

How can we build psychologically grounded, fine-grained, multimodal, efficient, and full-duplex conversational AI systems that better understand and respond to human emotions?

In particular, I am learning and exploring:

🧠 Psychology-informed modeling of emotion and cognition in dialogue systems.
🎭 Fine-grained emotion perception, including subtle, dynamic, and context-dependent affect.
🔊🖼️ Multimodal interaction, combining language with visual, acoustic, and behavioral cues.
⚡ Efficiency-aware methods for building deployable and scalable dialogue models.

For a deeper dive into my long-term roadmap and methodology, please visit my Research Vision.

🔬 Research Interests

The following areas reflect my current interests and learning directions, which support the above research focus:

🧠 AI4Psychology
Computational approaches to modeling psychological processes.
⚡ Efficient AI
Model compression, acceleration, and efficiency-oriented learning.
🎭 Multimodal AI
Representation learning and fusion across multiple modalities.
🖌️ Generative AI
Controlled and interpretable generation for dialogue and simulation.
🧭 Spatial Intelligence
Embodied and environment-aware reasoning related to interaction and behavior.

These directions are not independent goals, but are explored as part of a broader effort to understand and build psychologically informed conversational AI.

💬 Let’s Collaborate!

I am always happy to learn from and collaborate with researchers interested in:

Emotion and affect modeling grounded in psychology
Multimodal dialogue systems
Efficient and practical conversational AI

If our interests overlap, I would be glad to connect and exchange ideas.

news

view all

Nov 06, 2025	🥰 Our paper “InterCLIP-MEP: Interactive CLIP and Memory-Enhanced Predictor for Multi-modal Sarcasm Detection” has been accepted for publication in ACM Transactions on Multimedia Computing, Communications and Applications!
Sep 05, 2025	🎉 Our paper “Seeing Sarcasm Through Different Eyes: Analyzing Multimodal Sarcasm Perception in Large Vision-Language Models” has been accepted for publication in IEEE Transactions on Computational Social Systems!
Jul 03, 2025	✨ I joined the Institute of Artificial Intelligence, Hefei Comprehensive National Science Center as a research intern to study conversational AI systems grounded in psychological theories with an emphasis on efficiency.
Mar 24, 2025	🥳 I joined TeleAI as a research intern to study two-stage text-to-video technology.
Feb 28, 2025	🥳 Our paper “DE-ESD: Dual Encoder-based Entity Synonym Discovery using Pre-trained Contextual Embeddings” has been accepted for publication in Expert Systems With Applications!

selected publications

full list

TIMAR

Towards Seamless Interaction: Causal Turn-Level Modeling of Interactive 3D Conversational Head Dynamics

Junjie Chen, Fei Wang, Zhihao Hunag, Qing Zhou, Kun Li, Dan Guo, and 2 more authors

arXiv preprint arXiv:2512.15340, 2025

arXiv Bib PDF Code

@article{chen2025timar,
  title = {Towards Seamless Interaction: Causal Turn-Level Modeling of Interactive 3D Conversational Head Dynamics},
  author = {Chen, Junjie and Wang, Fei and Hunag, Zhihao and Zhou, Qing and Li, Kun and Guo, Dan and Zhang, Linfeng and Yang, Xun},
  journal = {arXiv preprint arXiv:2512.15340},
  url = {https://arxiv.org/abs/2512.15340},
  year = {2025},
}

InterCLIP-MEP

InterCLIP-MEP: Interactive CLIP and Memory-Enhanced Predictor for Multi-modal Sarcasm Detection

Junjie Chen, Hang Yu, Subin Huang, Sanmin Liu, and Linfeng Zhang

ACM Transactions on Multimedia Computing, Communications and Applications, 2025

arXiv Bib PDF Code

@article{chen2025interclipmep,
  title = {InterCLIP-MEP: Interactive CLIP and Memory-Enhanced Predictor for Multi-modal Sarcasm Detection},
  author = {Chen, Junjie and Yu, Hang and Huang, Subin and Liu, Sanmin and Zhang, Linfeng},
  year = {2025},
  publisher = {Association for Computing Machinery},
  address = {New York, NY, USA},
  issn = {1551-6857},
  url = {https://doi.org/10.1145/3776561},
  doi = {10.1145/3776561},
  journal = {ACM Transactions on Multimedia Computing, Communications and Applications},
}

SarcasmAnalysis

Seeing Sarcasm Through Different Eyes: Analyzing Multimodal Sarcasm Perception in Large Vision-Language Models

Junjie Chen, Xuyang Liu, Subin Huang, Linfeng Zhang, and Hang Yu

IEEE Transactions on Computational Social Systems, 2025

arXiv Bib PDF Code

@article{chen2025seeingsarcasmdifferenteyes,
  title = {Seeing Sarcasm Through Different Eyes: Analyzing Multimodal Sarcasm Perception in Large Vision-Language Models},
  author = {Chen, Junjie and Liu, Xuyang and Huang, Subin and Zhang, Linfeng and Yu, Hang},
  year = {2025},
  journal = {IEEE Transactions on Computational Social Systems},
  url = {https://doi.org/10.1109/TCSS.2025.3608484},
  doi = {10.1109/TCSS.2025.3608484},
}

DE-ESD

DE-ESD: Dual encoder-based entity synonym discovery using pre-trained contextual embeddings

Subin Huang, Junjie Chen, Chengzhen Yu, Daoyu Li, Qing Zhou, and Sanmin Liu

Expert Systems with Applications, 2025

Bib PDF Code

@article{chen2025deesd,
  title = {DE-ESD: Dual encoder-based entity synonym discovery using pre-trained contextual embeddings},
  journal = {Expert Systems with Applications},
  volume = {276},
  pages = {127102},
  year = {2025},
  issn = {0957-4174},
  doi = {https://doi.org/10.1016/j.eswa.2025.127102},
  url = {https://www.sciencedirect.com/science/article/pii/S0957417425007249},
  author = {Huang, Subin and Chen, Junjie and Yu, Chengzhen and Li, Daoyu and Zhou, Qing and Liu, Sanmin},
  keywords = {Entity synonym set, Entity synonym discovery, Dual encoder, Pre-trained language model, Contextual embedding},
}

experience

drag or scroll

Jul. 2025 - Present

Research Intern

Institute of Artificial Intelligence (IAI), Hefei Comprehensive National Science Center

Mentored by: Meng Wang

Pursuing ongoing research on emotion-aware conversational AI, emphasizing psychological grounding, multimodal affect understanding, and efficient full-duplex dialogue systems.

Mar. 2025 - July. 2025

Research Intern

TeleAI, China Telecom

Mentored by: Xi Qiu

Focused on text-to-3D human motion techniques to support controllable video generation.

Jul. 2024 - Present

Research Assistant

EPIC Lab, Shanghai Jiao Tong University

Mentored by: Linfeng Zhang

Focused on Efficient AI, with emphasis on Model Merging, KV Cache Compression, and Diffusion Cache techniques.

Apr. 2024 - Jul. 2024

Remote Intern

Lehigh University

Mentored by: Lichao Sun

Engaged in weekly remote group meetings focused on learning and academic discussion.

Jul. 2021 - Apr. 2024

Egineering Intern

Megvii Research

Mentored by: Xi Qiu

High-precision map (HDMap) data format and algorithm design; development of a visualization platform; and development of the mapping module for autonomous driving software.