【机器人】具身导航 VLN 最新论文汇总 | Vision-and-Language Navigation

【机器人】具身导航 VLN 最新论文汇总 | Vision-and-Language Navigation

本文汇总了具身导航的论文,供大家参考学习,涵盖2026、2025、2024、2023等

覆盖的会议和期刊:CVPR、IROS、ICRA、RSS、arXiv等等

论文和方法会持续更新的~

一、🏠 中文标题版

2026 

  • [2026] SeqWalker:基于分层规划的时序视野视觉语言导航方法 [ 论文 ] [ GitHub ]  
  • [2026] UrbanNav:从网络规模人类轨迹中学习语言引导的城市导航方法 [ 论文 ] [ GitHub
  • [2026] VLN-MME:面向语言引导视觉导航智能体的多模态大语言模型诊断基准 [ 论文 ] [ GitHub
  • [2026] ASCENT: 实现楼层感知的零样本物体目标导航  [ 论文] [ GitHub ]

2025 😆

  • [2025] ETP-R1:面向连续环境VLN的进化拓扑规划与强化微调方法 [ 论文 ] [ GitHub ]
  • [2025] NaviTrace:评估视觉语言模型在真实世界场景中的导航能力 [ 论文 ] [ GitHub ]
  • [2025] AstraNav-World:面向具身导航的物理一致性世界模型 [ 论文 ] [ GitHub ]
  • [2025] OneMap:面向零样本多目标导航的实时开放词汇建图方法 [ 论文 ] [ GitHub ]
  • [2025] VLNVerse:面向视觉语言导航的通用化具身真实仿真与评估基准论文 ] [ GitHub ]
  • [2025] Nav-R2:面向开放词汇目标导航的双关系推理框架 [ 论文 ] [ GitHub ]
  • [2025] DualVLN:面向泛化视觉语言导航的双系统基础模型论文 ] [ GitHub ]
  • [2025] SeeNav-Agent:基于视觉提示与步级策略优化RL微调的VLN [ 论文 ] [ GitHub ]
  • [2025] NeuPAN:基于端到端模型化学习的机器人直接点位导航方法 [ 论文 ] [ GitHub ]
  • [2025] i2Nav-Robot:面向多传感器融合导航与建图的大规模室内外机器人数据集 [ 论文 ] [ GitHub ]
  • [2025] CE-Nav:基于流引导强化学习的跨实体局部导航优化 [ 论文 ] [ GitHub ]
  • [2025] VLN-R1: 使用大型视觉语言模型 LVLM,结合微调和强化训练,实现连续环境导航 [ 论文 ] [ GitHub ]
  • [2025] StreamVLN:  连续导航,通过在线、多轮对话的方式,输入连续视频,输出动作序列 [ 论文 ] [ GitHub ]
  • [2025] REGNav:“先学房间风格,再学导航决策”的分层思路,解决跨房间导航的视觉关联难题 [ 论文 ] [ GitHub ]
  • [2025] ForesightNav:基于场景想象的探索策略,用于机器人在未知环境中高效导航 [ 论文 ] [ GitHub ]
  • [2025] DualMap:在线开放词汇制图系统,使用自然语言理解和导航动态 3D 环境 [ 论文 ] [ GitHub ]
  • [2025] WMNav:将视觉语言模型集成到世界模型中以实现对象目标导航 [ 论文 ] [ 项目 ] [ GitHub ]
  • [2025] UniGoal:迈向通用零样本目标导向导航 [ 论文 ] [ 项目 ] [ GitHub ]
  • [2025] CityNavAgent:具有分层语义规划和全局记忆的空中视觉和语言导航 [ 论文 ] [ GitHub ]
  • [2025] VL-Nav:基于空间推理的实时视觉语言导航 [ 论文 ]
  • [2025] HA-VLN:具有动态多人交互、真实世界验证和开放排行榜的离散-连续环境中人机感知导航基准 [ 论文 ] [ 项目 ]  [ GitHub ]
  • [2025] FlexVLN:灵活适应多样化视觉和语言导航任务 [ 论文 ]
  • [2025] 3D-Mem:用于具身探索和推理的 3D 场景记忆 [ 论文] [ 项目 ] [ GitHub ]
  • [2025] EfficientEQA:一种高效的开放词汇具体化问答方法 [ 论文
  • [2025] 用于安全和平台感知机器人导航的学习感知前向动力学模型 [ 论文 ] [ GitHub]
  • [2025] 室内体现人工智能中的语义映射——全面综述及未来方向 [ 论文 ]
  • [2025] TRAVEL:用于视觉和语言导航的免训练检索与对齐 [ 论文 ]
  • [2025] VR-Robo:用于视觉机器人导航和运动的真实到模拟到真实的框架 [ 论文 ]
  • [2025] NavigateDiff:视觉预测器是零样本导航助手 [ 论文 ]
  • [2025] MapNav:一种通过带注释的语义图实现的新型记忆表征,用于基于 VLM 的视觉和语言导航 [ 论文 ]
  • [2025] OpenFly:用于空中视觉语言导航的多功能工具链和大规模基准测试 [ 论文 ]
  • [2025] 连续环境中的地面视点视觉和语言导航 [ 论文 ]
  • [2025] 基于 LLM 推理的运动代理动态路径导航 [ 论文 ]
  • [2025] SmartWay:增强型航点预测和回溯,用于零样本视觉和语言导航 [ 论文 ]
  • [2025] Vi-LAD:视觉语言注意力蒸馏在动态环境中实现社交感知机器人导航 [ 论文 ]
  • [2025] PanoGen++:面向视觉和语言导航的领域自适应文本引导全景环境生成 [ 论文 ]
  • [2025] 视觉想象能改善视觉和语言导航代理吗?[ 论文 ] [ 项目 ]
  • [2025] P3Nav:集成感知、规划和预测的体现导航统一框架 [ 论文 ]
  • [2025] 从所见到未见:使用基础模型重写观察-指令以增强视觉-语言导航 [ 论文 ] [ GitHub]
  • [2025] COSMO:结合选择性记忆实现低成本视觉和语言导航 [ 论文 ]
  • [2025] ForesightNav:学习场景想象以实现高效探索 [ 论文 ] [ GitHub]
  • [2025] NavDP:利用特权信息引导学习模拟到现实的导航扩散策略 [ 论文 ]
  • [2025] VISTA:视觉和语言导航的生成视觉想象 [ 论文 ]
  • [2025] Dynam3D:动态分层 3D 令牌赋能 VLM 实现视觉和语言导航 [ 论文 ] [ GitHub]
  • [2025] Aux-Think:探索数据高效视觉语言导航的推理策略 [ 论文 ]

2024 😄

  • [2024] E2Map:基于语言模型的自反思机器人导航体验与情感地图 [论文]  [GitHub] 
  • [2024] 移动机器人对大规模室内环境的自主探索和语义更新  [论文]  [GitHub] 
  • [2024] 通过像素引导导航技能连接零样本目标导航和基础模型 [论文]  [GitHub] 
  • [2024] InstructNav:未探索环境中通用指令导航的零样本系统 [论文]  [GitHub] 
  • [2024] NaVILA:用于导航的腿式机器人视觉 - 语言 - 行动模型[论文]   [GitHub] 
  • [2024] ReMEmbR:用于机器人导航的长视界时空记忆构建与推理 [[论文]  [GitHub] 
  • [2024] Aim My Robot:对任何物体的精准局部导航 [论文] 
  • [2024] 标签地图:基于文本的地图用于空间推理和导航与大型语言模型 [论文]  [项目页面] 
  • [2024] MapGPT:用于视觉 - 语言导航的基于地图引导的提示与自适应路径规划 [论文]  [GitHub] 
  • [2024] CANVAS:用于直观人机交互的常识感知导航系统 [论文]  [GitHub] 
  • [2024] VLFM:用于零样本语义导航的视觉 - 语言前沿地图 [论文]  [GitHub] 
  • [2024] 注意错误!检测和定位视觉 - 语言导航中的指令错误 [论文]  [GitHub] 
  • [2024] 从想象中规划:用于视觉 - 语言导航的情景模拟和情景记忆 [论文] 
  • [2024] MC-GPT:通过记忆地图和推理链增强的视觉 - 语言导航 [论文] 
  • [2024] 持续的视觉 - 语言导航 [论文] 
  • [2024] Open-Nav:使用开源大型语言模型在连续环境中探索零样本视觉 - 语言导航 [论文] 
  • [2024] 查找一切:多目标搜索的通用视觉语言模型方法 [论文]  [GitHub] 
  • [2024] NavGPT:在视觉 - 语言导航中使用大型语言模型进行显式推理 [论文]  [GitHub] 
  • [2024] NavGPT-2:释放大型视觉 - 语言模型的导航推理能力 [论文]  [GitHub] 
  • [2024] 带有神经辐射表示的前瞻探索用于连续视觉 - 语言导航 [论文]  [GitHub] 
  • [2024] 通过 3D 特征场实现视觉 - 语言导航的仿真到现实转移 [论文]  [GitHub] 
  • [2024] LangNav:将语言作为导航的感知表示 [论文]  [GitHub] 
  • [2024] 使用大型语言模型模块化构建协作具身智能体 [论文]  [GitHub] 
  • [2024] Navid:基于视频的 VLM 规划视觉和语言导航的下一步 [ 论文 ]
  • [2024] The One RING:机器人室内导航通才 [ 论文 ]
  • [2024] Mobility VLA:基于长上下文 VLM 和拓扑图的多模态指令导航 [ 论文 ]

2023 😲

  • [2023] 通过像素引导导航技能连接零样本对象导航和基础模型 [ 论文 ]
  • [2023] 视觉目标导航的前沿语义探索  [论文]  [GitHub] 
  • [2023] GrASPE:基于图形的多模态融合,用于户外环境中的机器人导航  [论文] 
  • [2023] LANA:用于指令跟踪和生成的语言导航器  [论文]  [GitHub] 
  • [2023] Dreamwalker: 持续视觉语言导航的心理规划  [论文]  [GitHub] 
  • [2023] A2Nav:利用基础模型的视觉和语言能力实现动作感知零样本机器人导航  [论文] 
  • [2023] 基于语义前沿的无训练具体化对象目标导航  [论文] 

二、🔄 英文原版

2025 🐻

  • [2025] 3D-Mem: 3D Scene Memory for Embodied Exploration and Reasoning [ 论文] [ 项目 ]
  • [2025] EfficientEQA: An Efficient Approach for Open Vocabulary Embodied Question Answering [ 论文
  • [2025] Learned Perceptive Forward Dynamics Model for Safe and Platform-aware Robotic Navigation [paper] [project]
  • [2025] Semantic Mapping in Indoor Embodied AI - A Comprehensive Survey and Future Directions [paper]
  • [2025] VL-Nav: Real-time Vision-Language Navigation with Spatial Reasoning [paper]
  • [2025] TRAVEL: Training-Free Retrieval and Alignment for Vision-and-Language Navigation [paper]
  • [2025] VR-Robo: A Real-to-Sim-to-Real Framework for Visual Robot Navigation and Locomotion [paper]
  • [2025] NavigateDiff: Visual Predictors are Zero-Shot Navigation Assistants [paper]
  • [2025] MapNav: A Novel Memory Representation via Annotated Semantic Maps for VLM-based Vision-and-Language Navigation [paper]
  • [2025] OpenFly: A Versatile Toolchain and Large-scale Benchmark for Aerial Vision-Language Navigation [paper]
  • [2025] Ground-level Viewpoint Vision-and-Language Navigation in Continuous Environments [paper]
  • [2025] WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigation [paper] [project]
  • [2025] Dynamic Path Navigation for Motion Agents with LLM Reasoning [paper]
  • [2025] SmartWay: Enhanced Waypoint Prediction and Backtracking for Zero-Shot Vision-and-Language Navigation [paper]
  • [2025] Vi-LAD: Vision-Language Attention Distillation for Socially-Aware Robot Navigation in Dynamic Environments [paper]
  • [2025] UniGoal: Towards Universal Zero-shot Goal-oriented Navigation [paper] [project]
  • [2025] PanoGen++: Domain-Adapted Text-Guided Panoramic Environment Generation for Vision-and-Language Navigation [paper]
  • [2025] Do Visual Imaginations Improve Vision-and-Language Navigation Agents? [paper] [project]
  • [2025] HA-VLN: A Benchmark for Human-Aware Navigation in Discrete-Continuous Environments with Dynamic Multi-Human Interactions, Real-World Validation, and an Open Leaderboard [paper] [project]
  • [2025] FlexVLN: Flexible Adaptation for Diverse Vision-and-Language Navigation Tasks [paper]
  • [2025] P3Nav: A Unified Framework for Embodied Navigation Integrating Perception, Planning, and Prediction [paper]
  • [2025] Unseen from Seen: Rewriting Observation-Instruction Using Foundation Models for Augmenting Vision-Language Navigation [paper] [project]
  • [2025] COSMO: Combination of Selective Memorization for Low-cost Vision-and-Language Navigation [paper]
  • [2025] ForesightNav: Learning Scene Imagination for Efficient Exploration [paper] [project]
  • [2025] CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memory [paper] [project]
  • [2025] NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidance [paper]
  • [2025] VISTA: Generative Visual Imagination for Vision-and-Language Navigation [paper]
  • [2025] Dynam3D: Dynamic Layered 3D Tokens Empower VLM for Vision-and-Language Navigation [paper] [project]
  • [2025] Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation [paper]

2024 🐵

  • [2024] [RSS 24] Navid: Video-based vlm plans the next step for vision-and-language navigation [paper]
  • [2024] [RSS 24] NaVILA: Legged Robot Vision-Language-Action Model for Navigation [paper]
  • [2024] The One RING: a Robotic Indoor Navigation Generalist [paper]
  • [2024] Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphs [paper]
  • E2Map: Experience-and-Emotion Map for Self-Reflective Robot Navigation with Language Models [Paper][GitHub]
  • Autonomous Exploration and Semantic Updating of Large-Scale Indoor Environments with Mobile Robots [Paper][GitHub]
  • Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skill [Paper][GitHub]
  • InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environment [Paper][GitHub]
  • NaVILA: Legged Robot Vision-Language-Action Model for Navigation [Paper][GitHub]
  • ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigation [Paper][GitHub]
  • Aim My Robot: Precision Local Navigation to Any Object [Paper]
  • Tag Map: A Text-Based Map for Spatial Reasoning and Navigation with Large Language Models [Paper][Project Page]
  • Adaptive Zone-aware Hierarchical Planner for Vision-Language Navigation [Paper][GitHub]
  • MapGPT: Map-Guided Prompting with Adaptive Path Planning for Vision-and-Language Navigation [Paper][GitHub]
  • CANVAS: Commonsense-Aware Navigation System for Intuitive Human-Robot Interaction [Paper][GitHub]
  • VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigation [Paper][GitHub]
  • Mind the Error! Detection and Localization of Instruction Errors in Vision-and-Language Navigation [Paper][GitHub]
  • Planning from Imagination: Episodic Simulation and Episodic Memory for Vision-and-Language Navigation [Paper]
  • MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chains [Paper]
  • Continual Vision-and-Language Navigation [Paper]
  • Open-Nav: Exploring Zero-Shot Vision-and-Language Navigation in Continuous Environment with Open-Source LLMs [Paper]
  • Find Everything: A General Vision Language Model Approach to Multi-Object Search [Paper][GitHub]
  • NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models [Paper][GitHub]
  • NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Models [Paper][GitHub]
  • Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigation [Paper][GitHub]
  • Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigation [Paper][GitHub]
  • LangNav: Language as a Perceptual Representation for Navigation [Paper][GitHub]
  • Building Cooperative Embodied Agents Modularly with Large Language Models [Paper][GitHub]

2023 🦆

  • [2023] Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skill [paper]
  • [2023] Frontier semantic exploration for visual target navigation  [论文]  [GitHub] 
  • [2023] GrASPE: Graph based Multimodal Fusion for Robot Navigation in Outdoor Environment [论文] 
  • [2023] LANA: A Language-Capable Navigator for Instruction Following and Generatio [论文]  [GitHub] 
  • [2023] Dreamwalker: Mental planning for continuous vision-language navigation  [论文]  [GitHub] 
  • [2023] A2Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Models  [论文] 
  • [2023] How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontiers  [论文] 

分享完成~

Read more

FPGA光通信2——Aurora 64B/66B的开发使用

FPGA光通信2——Aurora 64B/66B的开发使用

可参考GZH:小蘇的FPGA         FPGA光通信的开发过程中,最简便的方式为Aurora 64B66B,开发人员无需关注2bit同步头,加解扰等过程,开放给开发人员的主要是AXI-Stream用户数据接口。         Aurora是一款可扩展的轻量级、高数据速率链路层高速串行通信协议,支持全双工或单工,支持64B/66B,8B/10B编码。 一、Aurora 64B/66B使用介绍         该核的使用架构主要如下:借助xilinx 核,开发人员可根据用户接口实现多通道间的光通信。最大支持16lane。 1.1 、IP核的介绍         参考PG074, 该核的内部结构如下:         其中,Lane logic:每个GT收发器由一个lane逻辑模块实例驱动,初始化每个收发器,处理控制字符的编解码,并执行错误检测。         Global logic: 全局逻辑模块执行通道绑定以进行通道初始化。在运行过程中,该通道跟踪Aurora 64B/66B协议定义的Not Ready空闲字符,并监控所有通道逻辑模块的错误。

Stable Diffusion 提示词高阶用法:从新手到精通的实战指南

快速体验 在开始今天关于 Stable Diffusion 提示词高阶用法:从新手到精通的实战指南 的探讨之前,我想先分享一个最近让我觉得很有意思的全栈技术挑战。 我们常说 AI 是未来,但作为开发者,如何将大模型(LLM)真正落地为一个低延迟、可交互的实时系统,而不仅仅是调个 API? 这里有一个非常硬核的动手实验:基于火山引擎豆包大模型,从零搭建一个实时语音通话应用。它不是简单的问答,而是需要你亲手打通 ASR(语音识别)→ LLM(大脑思考)→ TTS(语音合成)的完整 WebSocket 链路。对于想要掌握 AI 原生应用架构的同学来说,这是个绝佳的练手项目。 从0到1构建生产级别应用,脱离Demo,点击打开 从0打造个人豆包实时通话AI动手实验 Stable Diffusion 提示词高阶用法:从新手到精通的实战指南 刚接触 Stable Diffusion 时,我经常遇到这样的困扰:明明输入了详细的描述,

【大作业-46】基于YOLO12的无人机(航拍)视角的目标检测系统

【大作业-46】基于YOLO12的无人机(航拍)视角的目标检测系统

基于YOLO12的无人机(航拍)视角的目标检测系统 🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳 【大作业-46】基于yolo12的航拍(无人机)视角目标检测与追踪系统 🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳🥳 各位小伙伴大家好,今天我们为大家带来的是基于无人机视角下的目标检测,主要是对常规的行人、车辆这些目标进行检测,并且接着这个机会我们对yolo12的新模块进行一下说明,和之前的内容一样,我们的教程中包含了标注好的数据集、训练好的yolov5、yolov8、yolo11以及yolo12的模型,还有一个配套的图形化界面。本次的数据集包含的类别如下: 0: pedestrian 行人 1: people 人 2: bicycle 自行车 3: car 汽车 4: van 货车 5: truck 卡车 6: tricycle 三轮车 7: awning-tricycle 遮阳篷三轮车 8: bus 公交车 9: motor 摩托车 以下是部分数据示例。

[论文阅读] AI + 软件工程 | 突破LLM上下文瓶颈:上下文内存虚拟化CMV的设计与实践

[论文阅读] AI + 软件工程 | 突破LLM上下文瓶颈:上下文内存虚拟化CMV的设计与实践

突破LLM上下文瓶颈:上下文内存虚拟化CMV的设计与实践 论文基础信息 * 原标题:Contextual Memory Virtualisation: DAG-Based State Management and Structurally Lossless Trimming for LLM Agents * 主要作者:Cosmo Santoni * 研究机构:帝国理工学院(Imperial College London) * 发表时间:2026年2月 * 引文格式(GB/T 7714):SANTONI C. Contextual memory virtualisation: DAG-based state management and structurally lossless trimming for LLM agents[EB/OL]. [2026-02-25]. arXiv: