Ag2Manip: Learning Novel Manipulation Skills with Agent-Agnostic Visual and Action Representations | Computer Vision, Robotics | 2024 | IROS | Puhao Li*, Tengyu Liu*, Yuyang Li, Muzhi Han, Haoran Geng, Shu Wang, Yixin Zhu, Song-Chun Zhu, Siyuan Huang | View | cv robotics | iros |
Flight Structure Optimization of Modular Reconfigurable UAVs | Robotics | 2024 | IROS | Yao Su, Ziyuan Jiao, Zeyu Zhang, Jingwen Zhang, Hang Li, Meng Wang, Hangxin Liu | View | robotics | iros |
Large-scale Deployment of Vision-based Tactile Sensors on Multi-fingered Grippers | Robotics | 2024 | IROS | Meng Wang, Wanlin Li, Hao Liang, Boren Li, Kaspar Althoefer, Yao Su, Hangxin Liu | View | robotics | iros |
Driving Animatronic Robot Facial Expression From Speech | Robotics | 2024 | IROS | Boren Li*†, Hang Li*, Hangxin Liu† | View | robotics | iros |
Learning Concept-Based Causal Transition and Symbolic Reasoning for Visual Planning | Cognition and Reasoning | 2024 | IROS | Yilue Qian, Peiyu Yu, Ying Nian Wu, Yao Su, Wei Wang, Lifeng Fan | View | cognition-and-reasoning | iros |
LLM3: Large Language Model-based Task and Motion Planning with Motion Failure Reasoning | Robotics | 2024 | IROS | Shu Wang, Muzhi Han, Ziyuan Jiao, Zeyu Zhang, Ying Nian Wu, Song-Chun Zhu, Hangxin Liu | View | robotics | iros |
Efficient Temporal Extrapolation of Multimodal Large Language Models with Temporal Grounding Bridge | Language | 2024 | EMNLP | Yuxuan Wang, Yueqian Wang, Pengfei Wu, Jianxin Liang, Dongyan Zhao, Yang Liu, Zilong Zheng* | View | language | emnlp |
Varying Sentence Representations via Condition-Specified Routers | Language | 2024 | EMNLP | ZiyongLin*, QuansenWang, ZixiaJia†, ZilongZheng† | View | language | emnlp |
Dynamic Planning for Sequential Whole-body Mobile Manipulation | Robotics | 2024 | ICIEA | Zhitian Li*, Yida Niu*, Yao Su, Hangxin Liu, Ziyuan Jiao† | View | robotics | iciea |
Simulating Thin Shells by Bicubic Hermite Elements | Simulation | 2024 | Computer-Aided Design | Xingyu Ni*, Xuwen Chen, Cheng Yu, Bin Wang† , Baoquan Chen | View | sim | computer-aided-design |
In Situ 3D Scene Synthesis for Ubiquitous Embodied Interfaces | Simulation | 2024 | ACM Multimedia | Haiyan Jiang*, Leiyu Song†, Dongdong Weng, Zhe Sun, Huiying Li, Xiaonuo Dongye, Zhenliang Zhang† | View | sim | acm-multimedia |
Empowering Embodied Visual Tracking with Visual Foundation Models and Offline RL | Multi-Agent System | 2024 | ECCV | Fangwei Zhong*†, Kui Wu, Hai Ci, Churan Wang, Hao Chen | View | mas | eccv |
SlotLifter: Slot-guided Feature Lifting for Learning Object-centric Radiance Fields | Computer Vision | 2024 | ECCV | Yu Liu*, Baoxiong Jia*, Yixin Chen, and Siyuan Huang† | View | cv | eccv |
F-HOI: Toward Fine-grained Semantic-Aligned 3D Human-Object Interactions | Computer Vision | 2024 | ECCV | Jie Yang⋆ , Xuesong Niu⋆, Nan Jiang⋆, Ruimao Zhang†, and Siyuan Huang† | View | cv | eccv |
VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding | Machine Learning | 2024 | ECCV | Yue Fan*, Xiaojian Ma*†, Rujie Wu, Yuntao Du, Jiaqi Li, Zhi Gao, Qing Li | View | ml | eccv |
SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding | Computer Vision | 2024 | ECCV | Baoxiong Jia*, Yixin Chen˚*, Huangyue Yu, Yan Wang, Xuesong Niu, Tengyu Liu, Qing Li, Siyuan Huang | View | cv | eccv |
Unifying 3D Vision-Language Understanding via Promptable Queries | Computer Vision | 2024 | ECCV | Ziyu Zhu⋆ Zhuofan Zhang, Xiaojian Ma, Xuesong Niu, Yixin Chen, Baoxiong Jia, Zhidong Deng†, Siyuan Huang†, Qing Li† | View | cv | eccv |
LangSuit⋅E: Controlling, Planning, and Interacting with Large Language Models in Embodied Text Environments | Language | 2024 | ACL | Zixia Jia, Mengmeng Wang, Baichen Tong, Song-Chun Zhu, Zilong Zheng | View | language | acl |
Combining Supervised Learning and Reinforcement Learning for Multi-Label Classification Tasks with Partial Labels | Language | 2024 | ACL | Zixia Jia, Junpeng Li, Shichuan Zhang, Anji Liu, Zilong Zheng | View | language | acl |
Boosting LLM Agents with Recursive Contemplation for Effective Deception Handling | Language | 2024 | ACL | Shenzhi Wang*, Chang Liu*, Zilong Zheng†, Siyuan Qi, Shuo Chen, Qisen Yang, Andrew Zhao, Chaofei Wang, Shiji Song, Gao Huang† | View | language | acl |
LooGLE: Can Long-Context Language Models Understand Long Contexts? | Language | 2024 | ACL | Jiaqi Li, Mengmeng Wang, Zilong Zheng, Muhan Zhang | View | language | acl |
Auto-focusing Femtosecond Laser Manufacturing System via Acoustic Emission Technology | Robotics | 2024 | Optics Letters | Yanzhe Fu, Yao Su, Jiayong Wei, Bing Wang, Jiebo Li | View | robotics | optics-letters |
A Contextual Combinatorial Bandit Approach to Negotiation | Multi-Agent System | 2024 | ICML | Yexin Li, Zhancun Mu, Siyuan Qi† | View | mas | icml |
Fast Peer Adaptation with Context-aware Exploration | Multi-Agent System | 2024 | ICML | Long Ma*, Yuanfei Wang*, Fangwei Zhong†, Song-chun Zhu, Yizhou Wang | View | mas | icml |
Efficient Adaptation in Mixed-Motive Environments via Hierarchical Opponent Modeling and Planning | Multi-Agent System | 2024 | ICML | Yizhe Huang*, Fanqi Kong, Song-chun Zhu, Xue Feng† | View | mas | icml |
End-to-End Neuro-Symbolic Reinforcement Learning with Textual Explanations | Machine Learning | 2024 | ICML | Lirui Luo, Guoxi Zhang, Hongming Xu, Yaodong Yang, Cong Fang, Qing Li | View | ml | icml |
An Embodied Generalist Agent in 3D World | Computer Vision | 2024 | ICML | Jiangyong Huang*, Silong Yong*, Xiaojian Ma*†, Xiongkun Linghu*, Puhao Li, Yan Wang, Qing Li, Song-Chun Zhu, Baoxiong Jia, Siyuan Huang† | View | cv | icml |
Evaluating and Modeling Social Intelligence: A Comparative Study of Human and AI Capabilities | Cognition | 2024 | CogSci | Junqi Wang, Chunhui Zhang, Jiapeng Li, Yuxi Ma, Lixing Niu, Jiaheng Han, Yujia Peng, Yixin Zhu, Lifeng Fan | View | core | cogsci |
An Induce-on-Boundary Magnetostatic Solver for Grid-Based Ferrofluids | Simulation | 2024 | SIGGRAPH | Xingyu Ni, Ruicheng Wang, Bin Wang, Baoquan Chen | View | sim | siggraph |
A Vortex Particle-on-Mesh Method for Soap Film Simulation | Simulation | 2024 | SIGGRAPH | Ningxiao Tang, Liangwang Ruan, Yitong Deng, Bo Zhu, Bin Wang, Baoquan Chen | View | sim | siggraph |
CDM-MPC: An Integrated Dynamic Planning and Control Framework for Bipedal Robots Jumping | Robotics | 2024 | RA-L | Zhicheng He, Jiayang Wu, Shibowen Zhang, Jingwen Zhang, Lining Sun, Yao Su, Xiaokun Leng | View | robotics | ra-l |
Human-level few-shot concept induction through minimax entropy learning | Cognition and Reasoning | 2024 | Science Advances | Chi Zhang*, Baoxiong Jia, Yixin Zhu*, Song-Chun Zhu | View | cognition-and-reasoning | science-advances |
PHYSCENE: Physically Interactable 3D Scene Synthesis for Embodied AI | Computer Vision | 2024 | CVPR | Yandan Yang, Baoxiong Jia, Peiyuan Zhi, Siyuan Huang | View | cv | cvpr |
AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agents | Computer Vision | 2024 | CVPR | Jiemin Cui*, Tengyu Liu*, Nian Liu*, Yaodong Yang, Yixin Zhu† , Siyuan Huang† | View | cv | cvpr |
Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance | Computer Vision | 2024 | CVPR | Zan Wang, Yixin Chen, Baoxiong Jia, Puhao Li, Jinlu Zhang, Jingze Zhang, Tengyu Liu, Yixin Zhu, Wei Liang, Siyuan Huang | View | cv | cvpr |
Smart Help: Strategic Opponent Modeling for Proactive and Adaptive Robot Assistance in Households | Cognition and Reasoning | 2024 | CVPR | Zhihao Cao, ZiDong Wang, Siwen Xie, Anji Liu, Lifeng Fan | View | cognition-and-reasoning | cvpr |
CLOVA: A Closed-Loop Visual Assistant with Tool Usage and Update | Machine Learning | 2024 | CVPR | Zhi Gao, Yuntao Du, Xintong Zhang, Xiaojian Ma, Wenjuan Han, Song-chun Zhu, Qing Li | View | ml | cvpr |
ProAgent: Building Proactive Cooperative Agents with Large Language Models | Multi-Agent System | 2024 | AAAI | Ceyao Zhang, Kaijie Yang, Siyi Hu, Zihao Wang, Guanghe Li, Yihang Sun, Cheng Zhang, Zhaowei Zhang, Anji Liu, Song-Chun Zhu, Xiaojun Chang, Junge Zhang, Feng Yin, Yitao Liang, Yaodong Yang | View | mas | aaai |
Scaling Up Dynamic Human-Scene Interaction Modeling | Computer Vision | 2024 | CVPR | Nan Jiang, Zhiyuan Zhang, Hongjie Li, Xiaoxuan Ma, Zan Wang, Yixin Chen, Tengyu Liu, Yixin Zhu, Siyuan Huang | View | cv | cvpr |
CivRealm: A Learning and Reasoning Odyssey in Civilization for Decision-Making Agents | Multi-Agent System | 2024 | ICLR | Siyuan Qi, Shuo Chen, Yexin Li, Xiangyu Kong, Junqi Wang, Bangcheng Yang, Pring Wong, Yifan Zhong, Xiaoyuan Zhang, Zhaowei Zhang, Nian Liu, Wei Wang, Yaodong Yang, Song-Chun Zhu | View | mas | iclr |
ASPIRe: An Informative Trajectory Planner with Mutual Information Approximation for Target Search and Tracking | Robotics | 2024 | ICRA | Kangjie Zhou, Pengying Wu, Yao Su, Han Gao, Ji Ma, Hangxin Liu, and Chang Liu | View | robotics | icra |
Probabilistic Visibility-Aware Trajectory Planning for Target Tracking in Cluttered Environments | Robotics | 2024 | ACC | Han Gao, Pengying Wu, Yao Su, Kangjie Zhou, Ji Ma, Hangxin Liu, Chang Liu | View | robotics | acc |
Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture | Computer Vision | 2024 | 3D Vision | Yixin Chen, Junfeng Ni, Nan Jiang, Yaowei Zhang, Yixin Zhu, Siyuan Huang | View | cv | 3d-vision |
Grasp Multiple Objects with One Hand | Computer Vision | 2024 | RA-L | Yuyang Li, Bo Liu, Yiran Geng, Puhao Li, Yaodong Yang, Yixin Zhu, Tengyu Liu, Siyuan Huang | View | cv | ra-l |
Real-time Dynamic-Consistent Motion Planning for Over-actuated UAV | Robotics | 2024 | ICRA | Yao Su, Jingwen Zhang, Hang Li, Meng Wang, Hangxin Liu | View | robotics | icra |
On the Emergence of Symmetrical Reality | Simulation | 2024 | IEEE VR | Zhenliang Zhang, Zeyu Zhang, Ziyuan Jiao, Yao Su, Hangxin Liu, Wei Wang, Song-Chun Zhu | View | sim | ieee-vr |
I-PHYRE: Interactive Physical Reasoning | Cognition and Reasoning | 2024 | ICLR | Shiqian Li, Kewen Wu, Chi Zhang, Yixin Zhu | View | cognition-and-reasoning | iclr |
Maximum Entropy Heterogeneous-Agent Reinforcement Learning | Machine Learning, Multi-Agent System | 2024 | ICLR | Jiarong Liu, Yifan Zhong, Siyi Hu, Haobo Fu, QIANG FU, Xiaojun Chang, Yaodong Yang | View | ml mas | iclr |
Bongard-OpenWorld: Few-Shot Reasoning for Free-form Visual Concepts in the Real World | Machine Learning | 2024 | ICLR | Rujie Wu, Xiaojian Ma, Qing Li, Zhenliang Zhang, Wei Wang, Song-Chun Zhu, Yizhou Wang | View | ml | iclr |
Neural-Symbolic Recursive Machine for Systematic Generalization | Machine Learning | 2024 | ICLR | Qing Li, Yixin Zhu, Yitao Liang, Ying Nian Wu, Song-Chun Zhu, Siyuan Huang | View | ml | iclr |
Adapting Large Language Models via Reading Comprehension | Machine Learning | 2024 | ICLR | Daixuan Cheng, Shaohan Huang, Furu Wei | View | ml | iclr |
Tangible Diffusion: Exploring Artwork Generation via Tangible Elements and Artificial Intelligence in Arts and Design Education | Robotics | 2024 | TEI | Kuntong Han, Keyang Tang, Meng Wang | View | robotics | tei |
Programming structural and magnetic anisotropy for tailored interaction and control of soft microrobots | Simulation | 2024 | Communications Engineering | Simone Schuerle, Yimo Yan, Chao Song, Zaiyi Shen, Yuechen Zhu, Xingyu Ni, Bin Wang, Michael Christiansen, Stavros Stavrakis, Juho Lintuvuori, Baoquan Chen, Andrew deMello | View | sim | communications-engineering |
Heterogeneous-Agent Reinforcement Learning | Multi-Agent System | 2023 | Journal of Machine Learning Research | Yifan Zhong, Jakub Grudzien Kuba, Xidong Feng, Siyi Hu, Jiaming Ji, Yaodong Yang | View | mas | journal-of-machine-learning-research |
Bi-DexHands: Towards Human-Level Bimanual Dexterous Manipulation | Multi-Agent System | 2023 | IEEE TPAMI | Yuanpei Chen, Yiran Geng, Fangwei Zhong, Jiaming Ji, Jiechuang, Jiang, Zongqing Lu, Hao Dong, Yaodong Yang | View | mas | ieee-tpami |
Attention Based Models for Cell Type Classification on Single-Cell RNA-Seq Data | Machine Learning | 2023 | ECAI | Tianxu Wang, Yue Fan, Xiuli Ma | View | ml | ecai |
GARM-LS: A Gradient-Augmented Reference-Map Method for Level-Set Fluid Simulation | Simulation | 2023 | SIGGRAPH Asia | Xingqiao Li, Xingyu Ni, Bo Zhu, Bin Wang, Baoquan Chen | View | sim | siggraph-asia |
Commonsense Knowledge-driven Joint Reasoning Approach for Object Retrieval in Virtual Reality | Simulation | 2023 | SIGGARPH Asia | Haiyan Jiang, Dongdong Weng, Dongye Xiaonuo, Le Luo, Zhenliang Zhang | View | sim | siggarph-asia |
Semi-automatic Data Enhancement for Document-Level Relation Extraction with Distant Supervision from Large Language Models | Language | 2023 | EMNLP | Junpeng Li, Zixia Jia, Zilong Zheng | View | language | emnlp |
A Novel Actuation Mechanism for High-bandwidth Bidirectional Rotation of Cable-driven Revolute Joints | Robotics | 2023 | The 16th IFToMM World Congress on Mechanism and Machine Science | Zhihao Zhou, Zihang Zhao, Lecheng Ruan, Qining Wang | View | robotics | the-16th-iftomm-world-congress-on-mechanism-and-machine-science |
DiploMAT: A Dialogue Dataset for Situated PragMATic Reasoning | Language | 2023 | NeurIPS Datasets and Bechmarks | Hengli Li, Song-Chun Zhu, Zilong Zheng | View | language | neurips-datasets-and-bechmarks |
Interactive Visual Reasoning Under Uncertainty | Cognition and Reasoning | 2023 | NeurIPS | Manjie Xu, Guangyuan Jiang, Wei Liang, Chi Zhang, Yixin Zhu | View | cognition-and-reasoning | neurips |
Active Reasoning in an Open-World Environment | Cognition and Reasoning | 2023 | NeurIPS | Manjie Xu, Guangyuan Jiang, Wei Liang, Chi Zhang, Yixin Zhu | View | cognition-and-reasoning | neurips |
Evaluating and Inducing Personality in Pre-trained Language Models | Cognition and Reasoning | 2023 | NeurIPS | Guangyuan Jiang, Manjie Xu, Song-Chun Zhu, Wenjuan Han, Chi Zhang, Yixin Zhu | View | cognition-and-reasoning | neurips |
Learning non-Markovian Decision-Making from State-only Sequences | Machine Learning | 2023 | NeurIPS | Aoyang Qin, Feng Gao, Qing Li, Song-Chun Zhu, Sirui Xie | View | ml | neurips |
Neighbor-Environment Observer: An Intelligent Agent for Immersive Working Companionship | Simulation | 2023 | UIST | Zhe Sun, Qixuan Liang, Meng Wang, Zhenliang Zhang | View | sim | uist |
A Learning-Free Method for Locomotion Mode Prediction by Terrain Reconstruction and Visual Inertial Odometry | Robotics | 2023 | IEEE Transactions on Neural Systems and Rehabilitation Engineering | Shunyi Zhao, Zehuan Yu, Zhaoyang Wang, Hangxin Liu, Zhihao Zhou, Lecheng Ruan, Qining Wang | View | robotics | ieee-transactions-on-neural-systems-and-rehabilitation-engineering |
UniDexGrasp++: Improving Dexterous Grasping Policy Learning via Geometry-aware Curriculum and Iterative Generalist-Specialist Learning | Computer Vision | 2023 | ICCV | Weikang Wan, Haoran Geng, Yun Liu, Zikang Shan, Yaodong Yang, Li Yi, He Wang | View | cv | iccv |
ARNOLD: A Benchmark for Language-Grounded Task Learning with Continuous States in Realistic 3D Scenes | Computer Vision | 2023 | ICCV | Ran Gong∗, Jiangyong Huang∗, Yizhou Zhao, Haoran Geng, Xiaofeng Gao, Qingyang Wu, Wensi Ai, Ziheng Zhou, Demetri Terzopoulos, Song-Chun Zhu, Baoxiong Jia, Siyuan Huang | View | cv | iccv |
Learning Semantic-Agnostic and Spatial-Aware Representation for Generalizable Visual-Audio Navigation | Robotics | 2023 | RA-L | Hongcheng Wang, Yuxuan Wang, Fangwei Zhong, Mingdong Wu, Jianwei Zhang, Yizhou Wang, Hao Dong | View | robotics | ra-l |
The Tong Test: Evaluating Artificial General Intelligence Through Dynamic Embodied Physical and Social Interactions | Cognition and Reasoning | 2023 | Engineering | Yujia Peng, Jiaheng Han, Zhenliang Zhang, Lifeng Fan, Tengyu Liu, Siyuan Qi, Xue Feng, Yuxi Ma, Yizhou Wang, Song-Chun Zhu | View | cognition-and-reasoning | engineering |
UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policy | Computer Vision | 2023 | CVPR | Yinzhen Xu, Weikang Wan, Jialiang Zhang, Haoran Liu, Zikang Shan, Hao Shen, Ruicheng Wang, Haoran Geng, Yijia Weng, Jiayi Chen, Tengyu Liu, Li Yi, He Wang | View | cv | cvpr |
IntentQA: Context-aware Video Intent Reasoning | Cognition and Reasoning | 2023 | ICCV | Jiapeng Li, Ping Wei, Wenjuan Han, Lifeng Fan | View | cognition-and-reasoning | iccv |
Few-Shot Physically-Aware Articulated Mesh Generation via Hierarchical Deformation | Computer Vision | 2023 | ICCV | Xueyi Liu, Bin Wang, He Wang, Li Yi | View | cv | iccv |
E^2VPT: An Effective and Efficient Approach for Visual Prompt Tuning | Computer Vision | 2023 | ICCV | Cheng Han, Qifan Wang, Yiming Cui, Zhiwen Cao, Wenguan Wang, Siyuan Qi, Dongfang Liu | View | cv | iccv |
Full-Body Articulated Human-Object Interaction | Computer Vision | 2023 | ICCV | Nan Jiang, Tengyu Liu, Jieming Cui, Zhiyuan Zhang, Yixin Chen, He Wang, Siyuan Huang, Yixin, Zhu | View | cv | iccv |
X-VoE: Measuring eXplanatory Violation of Expectation in Physical Events | Computer Vision | 2023 | ICCV | Bo Dai, Linge Wang, Baoxiong Jia, Zeyu Zhang, Song-Chun Zhu, Chi Zhang, Yixin Zhu | View | cv | iccv |
3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment | Computer Vision | 2023 | ICCV | Ziyu Zhu, Xiaojian Ma, Yixin Chen, Zhidong Deng, Siyuan Huang, Qing Li | View | cv | iccv |
Learning a Causal Transition Model for Object Cutting | Robotics | 2023 | IROS | Zeyu Zhang, Muzhi Han, Baoxiong Jia, Ziyuan Jiao, Yixin Zhu, Song-Chun Zhu, Hangxin Liu | View | robotics | iros |
Part-level Scene Reconstruction Affords Robot Interaction | Robotics | 2023 | IROS | Zeyu Zhang, Lexing Zhang, Zaijin Wang, Ziyuan Jiao, Muzhi Han, Yixin Zhu, Song-Chun Zhu, Hangxin Liu | View | robotics | iros |
Sequential Manipulation Planning for Over-actuated Uumanned Aerial Manipulators | Robotics | 2023 | IROS | Yao Su, Jiarui Li, Ziyuan Jiao, Meng Wang, Chi Chu, Hang Li, Yixin Zhu, Hangxin Liu | View | robotics | iros |
Aggregating Single-wheeled Mobile Robots for Omnidirectional Movements | Robotics | 2023 | IROS | Meng Wang, Yao Su, Hang Li, Jiarui Li, Jixiang Liang, Hangxin Liu | View | robotics | iros |
L3 F-TOUCH: A Wireless GelSight With Decoupled Tactile and Three-Axis Force Sensing | Robotics | 2023 | RA-L | Wanlin Li, Meng Wang, Jiarui Li, Yao Su, Devesh K. Jha, Xinyuan Qian, Kaspar Althoefer, Hangxin Liu | View | robotics | ra-l |
Modeling Instance Interactions for Joint Information Extraction with Neural High-Order Conditional Random Field | Language | 2023 | ACL | Zixia Jia, Zhaohui Yan, Wenjuan Han, Zilong Zheng, Kewei Tu | View | language | acl |
VSTAR: A Video-grounded Dialogue Dataset for Situated Semantic Understanding with Scene and Topic Transitions | Language | 2023 | ACL | Yuxuan Wang, Zilong Zheng, Xueliang Zhao, Jinpeng Li, Yueqian Wang, Dongyan Zhao | View | language | acl |
Shu ̄o Wén Jiˇe Zì: Rethinking Dictionaries and Glyphs for Chinese Language Pre-training | Language | 2023 | ACL | Yuxuan Wang, Jianghui Wang, Dongyan Zhao, Zilong Zheng | View | language | acl |
MEWL: Few-shot multimodal word learning with referential uncertainty | Cognition and Reasoning | 2023 | ICML | Guangyuan Jiang, Manjie Xu, Shiji Xin, Wei Liang, Yujia Peng, Chi Zhang, Yixin Zhu | View | cognition-and-reasoning | icml |
RSPT: Reconstruct Surroundings and Predict Trajectories for Generalizable Active Object Tracking | Robotics | 2023 | AAAI | Fangwei Zhong, Xiao Bi, Yudi Zhang, Wei Zhang, Yizhou Wang | View | robotics | aaai |
Communicative Learning: A Unified Learning Formalism | Machine Learning | 2023 | Engineering | Luyao Yuan, Song-Chun Zhu | View | ml | engineering |
Detecting Human-Object Contact in Images | Computer Vision | 2023 | CVPR | Yixin Chen, Sai Kumar Dwivedi, Michael J. Black, Dimitrios Tzionas | View | cv | cvpr |
Diffusion-based Generation, Optimization, and Planning in 3D Scenes | Computer Vision | 2023 | CVPR | Siyuan Huang, Zan Wang, Puhao Li, Baoxiong Jia, Tengyu Liu, Yixin Zhu, Wei Liang, Song-Chun Zhu | View | cv | cvpr |
GFPose: Learning 3D Human Pose Prior with Gradient Fields | Computer Vision | 2023 | CVPR | Hai Ci, Mingdong Wu, Wentao Zhu, Xiaoxuan Ma, Hao Dong, Fangwei Zhong, Yizhou Wang | View | cv | cvpr |
Artificial Social Intelligence: A Comparative and Holistic View | Cognition | 2022 | CAAI AIR | Lifeng Fan, Manjie Xu, Zhihao Cao, Yixin Zhu, Song-Chun Zhu | View | core | caai-air |
A Reconfigurable Data Glove for Reconstructing Physical and Virtual Grasps | Robotics | 2023 | Engineering | Hangxin Liu, Zeyu Zhang, Ziyuan Jiao, Zhenliang Zhang, Minchen Li, Chenfanfu Jiang, Yixin Zhu, Song-Chun Zhu | View | robotics | engineering |
Unsupervised Object-Centric Learning with Bi-level Optimized Query Slot Attention | Computer Vision | 2023 | ICLR | Baoxiong Jia, Yu Liu, Siyuan Huang | View | cv | iclr |
A Minimalist Dataset for Systematic Generalization of Perception, Syntax, and Semantics | Machine Learning | 2023 | ICLR | Qing Li, Siyuan Huang, Yining Hong, Yixin Zhu, Ying Nian Wu, Song-Chun Zhu | View | ml | iclr |
SQA3D: Situated Question Answering in 3D Scenes | Machine Learning | 2023 | ICLR | Xiaojian Ma, Silong Yong, Zilong Zheng, Qing Li, Yitao Liang, Song-Chun Zhu, Siyuan Huang | View | ml | iclr |
Proactive Multi-Camera Collaboration for 3D Human Pose Estimation | Multi-Agent System | 2023 | ICLR | Hai Ci, Mickel Liu, Xuehai Pan, fangwei zhong, Yizhou Wang | View | mas | iclr |
GenDexGrasp: Generalizable Dexterous Grasping | Robotics | 2023 | ICRA | Puhao Li, Tengyu Liu, Yuyang Li, Yiran Geng, Yixin Zhu, Yaodong Yang, Siyuan Huang | View | robotics | icra |
Rearrange Indoor Scenes for Human-Robot Co-Activity | Robotics | 2023 | ICRA | Weiqi Wang, Zihang Zhao, Ziyuan Jiao, Yixin Zhu, Song-Chun Zhu, Hangxin Liu | View | robotics | icra |
Multi-Agent Reinforcement Learning is A Sequence Modeling Problem | Multi-Agent System | 2022 | NeurIPS | Muning Wen, Jakub Grudzien Kuba, Runji Lin, Weinan Zhang, Ying Wen, Jun Wang, Yaodong Yang | View | mas | neurips |
DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulation | Robotics | 2023 | ICRA | Ruicheng Wang, Jialiang Zhang, Jiayi Chen, Yinzhen Xu, Puhao Li, Tengyu Liu, He Wang | View | robotics | icra |
Meta-Reward-Net: Implicitly Differentiable Reward Learning for Preference-based Reinforcement Learning | Multi-Agent System | 2022 | NeurIPS | Runze Liu, Fengshuo Bai, Yali Du, Yaodong Yang | View | mas | neurips |
A Theoretical Understanding of Gradient Bias in Meta-Reinforcement Learning | Multi-Agent System | 2022 | NeurIPS | Bo Liu, Xidong Feng, Jie Ren, Luo Mai, Rui Zhu, Haifeng Zhang, Jun Wang, Yaodong Yang | View | mas | neurips |
A Unified Diversity Measure for Multiagent Reinforcement Learning | Multi-Agent System | 2022 | NeurIPS | Zongkai Liu, Chao Yu, Yaodong Yang, Peng Sun, Zifan Wu, Yuan Li | View | mas | neurips |
Efficient Meta Reinforcement Learning for Preference-based Fast Adaptation | Multi-Agent System | 2022 | NeurIPS | Zhizhou Ren, Anji Liu, Yitao Liang, Jian Peng, Jianzhu Ma | View | mas | neurips |
Camera Keyframing with Style and Control | Simulation | 2021 | TOG | Hongda Jiang, Marc Christie, Xi Wang, Libin Liu, Bin Wang, Baoquan Chen | View | sim | tog |
A Material Point Method for Nonlinearly Magnetized Materials | Simulation | 2021 | TOG | Yuchen Sun, Xingyu Ni, Bo Zhu, Bin Wang, Baoquan Chen | View | sim | tog |
Modeling and Balance Control of Supernumerary Robotic Limb for Overhead Tasks | Robotics | 2021 | RA-L | Jianwen Luo, Zelin Gong, Yao Su, Lecheng Ruan, Ye Zhao, H. Harry Asada, Chenglong Fu | View | robotics | ra-l |
Robust Transfer Learning with Pretrained Language Models through Adapters | Language | 2021 | ACL | Wenjuan Han, Bo Pang, Ying Nian Wu | View | language | acl |
Adapting Unsupervised Syntactic Parsing Methodology for Discourse Dependency Parsing | Language | 2021 | ACL | Liwen Zhang, Ge Wang, Wenjuan Han, Kewei Tu | View | language | acl |
Constrained Update Projection Approach to Safe Policy Optimization | Multi-Agent System | 2022 | NeurIPS | Long Yang, Jiaming Ji, Juntao Dai, Linrui Zhang, Binbin Zhou, Pengfei Li, Yaodong Yang, Gang Pan | View | mas | neurips |
Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning | Multi-Agent System | 2022 | NeurIPS | Yuanpei Chen, Tianhao Wu, Shengjie Wang, Xidong Feng, Jiechuang Jiang, Stephen Marcus McAleer, Yiran Geng, Hao Dong, Zongqing Lu, Song-Chun Zhu, Yaodong Yang | View | mas | neurips |
Online Tensor Low-Rank Representation for Streaming Data Clustering | Engineering | 2022 | IEEE TCSVT | Tong Wu | View | engineering | ieee-tcsvt |
MATE: Benchmarking Multi-Agent Reinforcement Learning in Distributed Target Coverage Control | Multi-Agent System | 2022 | NeurIPS | Xuehai Pan, Mickel Liu, fangwei zhong, Yaodong Yang, Song-Chun Zhu, Yizhou Wang | View | mas | neurips |
TarGF: Learning Target Gradient Field for Object Rearrangement | Multi-Agent System | 2022 | NeurIPS | Mingdong Wu, Fangwei Zhong, Yulong Xia, Hao Dong | View | mas | neurips |
EgoTaskQA: Understanding Human Tasks in Egocentric Videos | Computer Vision | 2022 | NeurIPS | Baoxiong Jia, Ting Lei, Song-Chun Zhu, Siyuan Huang | View | cv | neurips |
HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes | Computer Vision | 2022 | NeurIPS | Zan Wang, Yixin Chen, Tengyu Liu, Yixin Zhu, Wei Liang, Siyuan Huang | View | cv | neurips |
On the Learning Mechanisms in Physical Reasoning | Reasoning | 2022 | NeurIPS | Shiqian Li, Kewen Wu, Chi Zhang, Yixin Zhu | View | reasoning | neurips |
Scene Reconstruction with Functional Objects for Robot Autonomy | Robotics | 2022 | IJCV | Muzhi Han, Zeyu Zhang, Ziyuan Jiao, Xu Xie, Yixin Zhu, Song-Chun Zhu, Hangxin Liu | View | robotics | ijcv |
In situ bidirectional human-robot value alignment | Robotics | 2022 | Science Robotics | Luyao Yuan, Xiaofeng Gao, Zilong Zheng, Mark Edmonds, Ying Nian Wu Federico Rossano, Hongjing Lu, Yixin Zhu, Song-Chun Zhu | View | robotics | science-robotics |
Understanding Physical Effects for Effective Tool-use | Robotics | 2022 | RA-L | Zeyu Zhang, Ziyuan Jiao, Weiqi Wang, Yixin Zhu, Song-Chun Zhu, Hangxin Liu | View | robotics | ra-l |
Sequential Manipulation Planning on Scene Graph | Robotics | 2022 | IROS | Ziyuan Jiao, Yida Niu, Zeyu Zhang, Song-Chun Zhu, Yixin Zhu, Hangxin Liu | View | robotics | iros |
Downwash-aware Control Allocation for Over-actuated UAV Platforms | Robotics | 2022 | IROS | Yao Su, Chi Chu, Meng Wang, Jiarui Li, Liu Yang, Yixin Zhu, Hangxin Liu | View | robotics | iros |
How Powerful are Spectral Graph Neural Networks | Machine Learning | 2022 | ICML | Xiyuan Wang, Muhan Zhang | View | ml | icml |
3DLinker: An E(3) Equivariant Variational Autoencoder for Molecular Linker Design | Machine Learning | 2022 | ICML | Yinan Huang, Xingang Peng, Jianzhu Ma, Muhan Zhang | View | ml | icml |
SHARP: Search-Based Adversarial Attack for Structured Prediction | Language | 2022 | NAACL | Liwen Zhang, Zixia Jia, Wenjuan Han, Zilong Zheng, Kewei Tu | View | language | naacl |
Learning Algebraic Representation for Systematic Generalization in Abstract Reasoning | Reasoning | 2022 | ECCV | Chi Zhang, Sirui Xie, Baoxiong Jia, Ying Nian Wu, Song-Chun Zhu, Yixin Zhu | View | reasoning | eccv |
Unsupervised Vision-Language Parsing: Seamlessly Bridging Visual Scene Graphs with Language Structures via Dependency Relationships | Language | 2022 | CVPR | Chao Lou, Wenjuan Han, Yuhuan Lin, Zilong Zheng | View | language | cvpr |
LIGS:Learning Intrinstic-reward Generation Selection for Multi-Agent Learning | Multi-Agent System | 2022 | ICLR | David Henry Mguni, Taher Jafferjee, Jianhong Wang, Nicolas Perez-Nieves, Oliver Slumbers, Feifei Tong, Yang Li, Jiangcheng Zhu, Yaodong Yang, Jun Wang | View | mas | iclr |
GLASS: GNN with Labeling Tricks for Subgraph Representation Learning | Machine Learning | 2022 | ICLR | Xiyuan Wang, Muhan Zhang | View | ml | iclr |
Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networks | Machine Learning | 2022 | ICLR | Haorui Wang, Haoteng Yin, Muhan Zhang, Pan Li | View | ml | iclr |
DRM-Based Colour Photometric Stereo Using Diffuse-Specular Separation for Non-Lambertian Surfaces | Robotics | 2022 | Journal of Imaging | Boren Li, Tomonari Furukawa | View | robotics | journal-of-imaging |
Simulation and Optimization of Magnetoelastic Thin Shells | Simulation | 2022 | TOG | Xuwen Chen, Xingyu Ni, Bo Zhu, Bin Wang, Baoquan Chen | View | sim | tog |
Unsupervised Vision-Language Grammar Induction with Shared Structure Modeling | Language | 2022 | ICLR | Bo Wan, Wenjuan Han, Zilong Zheng, Tinne Tuytelaars | View | language | iclr |
Object Gathering With a Tethered Robot Duo | Robotics | 2022 | RA-L | Yao Su, Yuhong Jiang, Yixin Zhu, Hangxin Liu | View | robotics | ra-l |
ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mind | Multi-Agent System | 2022 | ICLR | Yuanfei Wang, Fangwei zhong, Jing Xu, Yizhou Wang | View | mas | iclr |
Projective Manifold Gradient Layer for Deep Rotation Regression | Computer Vision | 2022 | CVPR | Jiayi Chen, Yingda Yin, Tolga Birdal, Baoquan Chen, Leonidas Guibas, He Wang | View | cv | cvpr |
Latent Diffusion Energy-Based Model for Interpretable Text Modeling | Machine Learning | 2022 | ICML | Peiyu Yu, Sirui Xie, Xiaojian Ma, Baoxiong Jia, Bo Pang, Ruiqi Gao, Yixin Zhu, Ying Nian Wu, Song-Chun Zhu | View | ml | icml |
Weakly Supervised Video Moment Localization with Contrastive Negative Sample Mining | Computer Vision | 2022 | AAAI | Minghang Zheng, Yanjie Huang*, Qingchao Chen, Yang Liu | View | cv | aaai |
Weakly Supervised Temporal Sentence Grounding with Gaussian-based Contrastive Proposal Learning | Computer Vision | 2022 | CVPR | Minghang Zheng, Yanjie Huang, Qingchao Chen, Yuxin Peng, Yang Liu | View | cv | cvpr |
Synthesizing Diverse and Physically Stable Grasps with Arbitrary Hand Structures using Differentiable Force Closure Estimator | Computer Vision | 2021 | RA-L | Tengyu Liu, Zeyu Liu, Ziyuan Jiao, Yixin Zhu, Song-Chun Zhu | View | cv | ra-l |
Big Data-drive Agent-based Modeling of Online Polarized Opinions | Multi-Agent System | 2021 | Complex & Intelligent Systems | Peng Lu, Zhuo Zhang, Mengdi Li | View | mas | complex-intelligent-systems |
Spatio-temporal Self-Supervised Representation Learning for 3D Point Clouds | Computer Vision | 2021 | ICCV | Siyuan Huang, Yichen Xie, Song-Chun Zhu, Yixin Zhu | View | cv | iccv |
VLGrammar: Grounded Grammar Induction of Vision and Language | Computer Vision | 2021 | ICCV | Yining Hong, Qing Li, Song-Chun Zhu, Siyuan Huang | View | cv | iccv |
YouRefIt: Embodied Reference Understanding with Language and Gesture | Computer Vision | 2021 | ICCV | Yixin Chen, Qing Li, Deqian Kong, Yik Lun Kei, Song-Chun Zhu, Tao Gao, Yixin Zhu, Siyuan Huang | View | cv | iccv |
Decoupling the Depth and Scope of Graph Neural Networks | Machine Learning | 2021 | NeurIPS | Hanqing Zeng, Muhan Zhang, Yinglong Xia, Ajitesh Srivastava, Andrey Malevich, Rajgopal Kannan, Viktor Prasanna, Long Jin, Ren Chen | View | ml | neurips |
Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation Learning | Machine Learning | 2021 | NeurIPS | Muhan Zhang, Pan Li, Yinglong Xia, Kai Wang, Long Jin | View | ml | neurips |
Nested Graph Neural Networks | Machine Learning | 2021 | NeurIPS | Muhan Zhang, Pan Li | View | ml | neurips |
Unsupervised Foreground Extraction via Deep Region Competition | Machine Learning | 2021 | NeurIPS | Peiyu Yu, Sirui Xie, Xiaojian Ma, Yixin Zhu, Ying Nian Wu, Song-Chun Zhu | View | ml | neurips |
Multi-agent Modeling of Crowd Dynamics under Mass Shooting Cases | Multi-Agent System | 2021 | Chaos Solitons & Fractals | Peng Lu, Feier Wen, Yan Li, Dianhan Chen | View | mas | chaos-solitons-fractals |