简 历:
曹娟,研究员,博士生导师,中国科学院计算所前瞻研究实验室主任、数字内容合成与伪造检测实验室主任,中国科学院大学岗位教授,中国科学院“青年促进会”首批成员。获2024年公安部科学技术一等奖、2020年北京市科技进步一等奖、2020年北京市“三八红旗奖章”和2022年“世界互联网大会领先科技成果”奖。长期从事人工智能安全、虚假伪造信息检测、多媒体技术研究,在领域内主流期刊和会议发表论文100余篇,谷歌引用1万余次,其中第一作者单篇最高引用1175次。申请专利100余项,其中授权44项。主持国家级重点项目11项,其中千万级项目2项。面向国家安全重大需求,带领团队从算法创新、系统搭建、设备研制三个层面长期布局,研发了“AI识谣”虚假新闻检测平台、“睿鉴图灵”伪造检测专用模型及基于国产芯片的伪造检测专用设备,成果在多个国家重大任务中规模化部署使用。
2019-09 至今, 中国科学院计算技术研究所, 研究员,前瞻研究实验室副主任、主任
2016-01 至今, 中国科学院大学, 计算机学院, 教授
2010-11 至 2011-11, 美国哥伦比亚大学, 电子系,访问学者
2009-05 至 2009-09, 香港城市大学, 计算机系,访问学者
数字内容合成与伪造检测实验室以“用技术让世界更可信”为使命,长期专注于数字内容安全方面的基础方法研究与应用实践,承担计算所“十四五”规划重点方向研究,主要研究人员包括曹娟研究员、唐胜研究员、唐帆副研究员、汪旦丁副研究员、李瑜副研究员、盛强助理研究员。研究方向包括:
1. 数字内容伪造检测与溯源:人工智能生成内容(AIGC)技术与应用蓬勃发展,不断涌现里程碑式突破,但其恶意利用也带来了新的公共安全隐患,严重威胁国家安全和社会稳定。依托实验室研发的专用系统,我们重点关注检测溯源中的可泛化、可部署、可解释问题。
2. 多模态虚假信息检测与验证:虚假信息泛滥风险已连续两次位居《全球风险报告》短期风险榜首。基于“AI识谣”系统积累的丰富数据,我们从多模态理解、推理分析、影响度量等角度出发,深度挖掘虚假信息特性,力求实现快速、准确、有依据的虚假信息检测。
3. 数字内容可控生成:研究图像视频的定制化生成与编辑技术,并针对数字人场景探索身份-外观-运动的一体化生成框架。此外,伪造检测与内容生成有一体两面的关系,我们希望依靠利用生成技术来打击恶意伪造内容,研究面向安全场景的数据保护、水印等手段,降低伪造内容产生的负面影响。
研究生培养理念:注重培养学生的综合能力,强调从学科前沿到落地实用贯通,个人成长与团队作战并重,做“顶天立地”的科研工作。(更多研究分享见公众号“数字内容合成与伪造检测”)
主要论著:
【数字内容伪造检测】
[ICLR 25] Tianyun Yang, Ziniu Li, Juan Cao, Chang Xu. Understanding and Mitigating Hallucination in Large Vision-Language Models via Modular Attribution and Intervention.
[TMM 25] Tianyun Yang, Juan Cao, Danding Wang, Chang Xu. Model Synthesis for Zero-Shot Model Attribution.
[SIGIR 25] Beizhe Hu, Qiang Sheng, Juan Cao, Yang Li, Danding Wang. LLM-Generated Fake News Induces Truth Decay in News Ecosystem: A Case Study on Neural News Recommendation.
[MM 24] Yuyan Bu, Qiang Sheng, Juan Cao, Peng Qi, Danding Wang, Jintao Li. FakingRecipe: Detecting Fake News on Short Video Platforms from the Perspective of Creative Process.
[MM 24] Zhihao Sun, Haipeng Fang, Xinying Zhao, Danding Wang, Juan Cao. Rethinking Image Editing Detection in the Era of Generative AI Revolution
[IJCAI 24] Yuhui Shi, Qiang Sheng, Juan Cao, Hao Mi, Beizhe Hu, Danding Wang. Ten Words Only Still Help: Improving Black-Box AI-Generated Text Detection via Proxy-Guided Efficient Re-Sampling.
[AAAI 24] Beizhe Hu, Qiang Sheng, Juan Cao, Yuhui Shi, Yang Li, Danding Wang, Peng Qi. Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detection.
[AAAI 23] Peng Qi, Yuyan Bu, Juan Cao, Wei Ji, Ruihao Shui, Junbin Xiao, Danding Wang, Tat-seng Chua. FakeSV: A Multimodal Benchmark with Rich Social Context for Fake News Detection on Short Video Platforms. AAAI 2023.
[TPAMI 23] Chengbo Dong, Xinru Chen, Ruohan Hu, Juan Cao, Xirong Li. MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detection.
[CVPR 23] Tianyun Yang, Danding Wang, Fan Tang, Xinying Zhao, Juan Cao, Sheng Tang. Progressive Open Space Expansion for Open-Set Model Attribution.
[MM 23] Yuyan Bu, Qiang Sheng, Juan Cao, Peng Qi, Danding Wang, Jintao Li. Combating Online Misinformation Videos: Characterization, Detection, and Future Directions.
[ACL 23] Beizhe Hu, Qiang Sheng, Juan Cao, Yongchun Zhu, Danding Wang, Zhengjia Wang, Zhiwei Jin. Learn over Past, Evolve for Future: Forecasting Temporal Trends for Fake News Detection.
[ICCV 23] Zhihao Sun, Haoran Jiang, Danding Wang, Xirong Li, Juan Cao. SAFL-Net: Semantic-Agnostic Feature Learning Network with Auxiliary Plugins for Image Manipulation Detection.
[TKDE 23] Yongchun Zhu, Qiang Sheng, Juan Cao, Qiong Nan, Kai Shu, Ming-hui Wu, Jindong Wang, Fuzhen Zhuang. Memory-Guided Multi-View Multi-Domain Fake News Detection.
[ACL 22] Qiang Sheng, Juan Cao, Xueyao Zhang, Rundong Li, Danding Wang, Yongchun Zhu. Zoom Out and Observe: News Environment Perception for Fake News Detection.
[SIGIR 22] Yongchun Zhu, Qiang Sheng, Juan Cao, Shuokai Li, Danding Wang, Fuzhen Zhuang. Generalizing to the Future: Mitigating Entity Bias in Fake News Detection.
[AAAI 22] Tianyun Yang, Zi Huang, Juan Cao, Lei Li, Xirong Li. Deepfake Network Architecture Attribution.
[ACL 21] Qiang Sheng, Juan Cao, Xueyao Zhang, Xirong Li, Lei Zhong. Article Reranking by Memory-Enhance d Key Sentence Matching for Detecting Previously Fact-Checked Claims.
[WWW 21] Xueyao Zhang, Juan Cao, Xirong Li, Qiang Sheng, Lei Zhong, Kai Shu. Mining Dual Emotion for Fake News Detection.
[MM 21] Peng Qi, Juan Cao, Xirong Li, Huan Liu, Qiang Sheng, Xiaoyue Mi, Qin He, Yongbiao Lv, Chenyang Guo, Yingchao Yu. Improving Fake News Detection by Using an Entity-enhanced Framework to Fuse Diverse Multimodal Clues.
[Springer Book] Juan Cao, Peng Qi, Qiang Sheng, Tianyun Yang, Junbo Guo, Jintao Li. Exploring the Role of Visual Content in Fake News Detection. In Disinformation, Misinformation and Fake News in Social Media.
【数字内容合成】
[TOG 25] Yu Xu, Fan Tang, Juan Cao, Yuxing Zhang, Oliver Deussen, Weiming Dong, Jintao Li, Tong-Yee Lee. B4M: Modular Low-Rank Adapter for Making Content-Style Customization.
[TVCG 25] Zijun Zhou, Fan Tang, Yuxin Zhang, Oliver Deussen, Juan Cao, Weiming Dong, Xiangtao Li, Tong-Yee Lee. A Comprehensive Evaluation of Arbitrary Image Style Transfer Methods.
[CVPR 25] Haipeng Fang, Sheng Tang, Juan Cao, Enshuo Zhang, Fan Tang, Tong-Yee Lee. Attend to Not Attended: Structure-then-Detail Token Merging for Post-training DiT Acceleration.
[SIGGRAPH ASIA 2025] Ziyao Huang, Zixiang Zhou, Juan Cao, Yifeng Ma, Yi Chen, Zejing Rao, Zhiyong Xu, Hongmei Wang, Qin Lin, Yuan Zhou, Qinglin Lu, Fan Tang. HOMA: Towards Generic Human-Object Interaction in Multimodal Driven Human Animation with Weak Conditions.
[SIGGRAPH ASIA 2025] Yu Xu, Fan Tang, You Wu, Lin Gao, Oliver Deussen, Hongbin Yan, Jintao Li, Juan Cao, Tong-Yee Lee. In-Context Brush: Zero-shot Customized Subject Insertion with Context-Aware Latent Space Manipulation.
[TOG 24] Ziyao Huang, Fan Tang, Yong Zhang, Juan Cao, Chengyu Li, Sheng Tang, Jintao Li, Tong-Yee Lee. Identity-Preserving Face Swapping via Dual Surrogate Generative Models.
[CVPR 24] You Wu, Kean Liu, Xiaoyue Mi, Fan Tang, Juan Cao, Jintao Li. U-VAP: User-specified Visual Appearance Personalization via Decoupled Self Augmentation.
[CVPR 24] Ziyao Huang, Fan Tang, Yong Zhang, Xiaodong Cun, Juan Cao, Jintao Li, Tong-Yee Lee. Make-Your-Anchor: A Diffusion-based 2D Avatar Generation Framework.
[MM 24] Zhang Wan, Sheng Tang, Jiawei Wei, Ruize Zhang, Juan Cao. DragEntity: Trajectory Guided Video Generation using Entity and Positional Relationships
[AAAI 23] Guang Yang, Juan Cao, Danding Wang, Peng Qi, Jintao Li. ERASER: Adversarial Sensitive Element Remover for Image Privacy Preservation.
[MM 22] Guang Yang, Wu Liu, Xinchen Liu, Xiaoyan Gu, Juan Cao, Jintao Li. Delving into the Frequency: Temporally Consistent Human Motion Transfer in the Fourier Space.
[CVPR 21] Lei Li, Ke Gao, Juan Cao, Ziyao Huang, Yepeng Weng, Xiaoyue Mi, Zhengze Yu, Xiaoya Li, Boyang Xia. Progressive Domain Expansion Network for Single Domain Generalization.
科研项目:
[1] 国家自然科学基金委联合重点基金项目:网络谣言检测与舆论引导算法研究,项目负责人
[2] 国家自然科学基金委面上项目:基于深度学习的互联网多媒体谣言检测理论与方法研究, 国家自然科学基金项目,项目负责人
[3] 国家自然科学基金委面上项目:大规模网络视频在线定位与地理信息挖掘技术研究,项目负责人
[4] 国家自然科学基金委青年基金项目:基于轨迹的网络话题检测和可视化研究,项目负责人
获奖及荣誉:
[1] 公安部科学技术一等奖,第二完成人,2024
[2] 世界互联网大会领先科技成果奖全球Top15,“数字内容虚假伪造检测系统和设备”,第一完成人,2022
[3] 北京市科技进步一等奖,“开放环境下数字伪造内容检测关键技术与服务平台建设”,第一完成人,2020
[4] 北京市“三八红旗奖章”,2020
[5] 第三届中国人工智能大赛人工智能“创新人物”奖,2021
[6] 第三届中国人工智能大赛“深度伪造视频生成方法识别”任务最高级(A级)奖, 2021
[7] 中国科学院计算技术研究所“卓越之星”,2019
曹娟 研究员
研究方向:
所属部门:前瞻研究实验室
导师类别:博导计算机应用技术
联系方式:caojuan@ict.ac.cn
个人网页:http://mcg.ict.ac.cn/people/caojuan.html