Research Interests & Vision
Published:
1. Efficient Adaptation and Generalization for Multimodal Foundation Models
“以不变应万变,随物而赋形” (Mastering the constant to adapt to the changing, taking shape according to the task)
技术核心 (Technical Core): The universality of foundation models and the efficiency of fine-tuning. By utilizing parameter-efficient techniques (like LoRA and Prompt learning), we can unlock the power of massive models with minimal parameters to adapt to diverse downstream tasks.
哲学映射 (Philosophical Mapping): “不变” (The Constant) 对应基础模型强大的通用表征底座;“随物赋形” (Taking shape according to the object,出自苏轼) 完美契合了 Efficient Fine-Tuning 的精髓——模型主体无需重构,只需根据万千具体的下游任务(物),轻巧、高效地改变其应用形态。
2. Trustworthy and Controllable Large Models
“君子有所为,有所不为” (A gentleman knows what to do, and more importantly, what not to do)
技术核心 (Technical Core): Enhancing the controllability, traceability, and reliability of large models in real-world deployment through machine unlearning and watermarking & fingerprinting.
哲学映射 (Philosophical Mapping): In my research, I view a trustworthy AI as a ‘gentleman’ (君子). ‘有所为’ (Action) represents the power of Machine Learning—what the model can and should do to assist human reasoning. But more importantly, ‘有所不为’ (Principled Restraint) represents Machine Unlearning and controllability—ensuring the model knows what it must not do, such as generating harmful content or violating privacy. True intelligence requires not just capability, but principled restraint.
3. Egocentric Multimodal Intelligence and Human-AI Co-Embodied Intelligence
“以我观物,知行合一” (Observing the world through the self, unifying knowledge and action)
技术核心 (Technical Core): Building first-person AI systems based on egocentric vision, egocentric agents, and egocentric multimodal large models, aiming for human-centered perception, reasoning, and long-term physical collaboration.
哲学映射 (Philosophical Mapping): “以我观物” (出自王国维《人间词话》) 是对“第一人称视觉” (Egocentric Vision) 极其完美的中国文化翻译,强调 AI 必须像人一样,从“自我”的具身视角去感知复杂的物理世界;“知行合一” (出自王阳明心学) 则精准概括了具身智能(Embodied AI)的终极闭环——将多模态的感知与推理(知),与物理世界中长程的动作执行与人机协同(行)深度融合。
