Skip to content

Conversation

@yangchen73
Copy link
Collaborator

Description

This PR migrates EmbodiAgent, a LLM-based agent system for autonomous robot task execution in EmbodiChain. The system enables robots to perceive, plan, code, execute, and validate complex manipulation tasks through a closed-loop control cycle, which is developed by https://github.com/Jasonxu1225 .

Key Features

Three specialized agents working in coordination:

  • TaskAgent: High-level reasoning and task decomposition from visual observations
  • CodeAgent: Translates natural language plans into executable Python code using atomic actions
  • ValidationAgent: Validates task execution and provides feedback for refinement

Key Related Files

  • Core agent implementation: embodichain/agents/hierarchy/
  • Agent environments: embodichain/lab/gym/envs/tasks/tableware/
  • Toolkit interfaces: embodichain/toolkits/interfaces.py
  • Motion generation: embodichain/lab/gym/motion_generation/
  • Documentation: embodichain/agents/README.md

Type of change

  • New feature (non-breaking change which adds functionality)

Screenshots

Pour Water

pour_waterr.mp4

Rearrangement

rearrangement.mp4

Dual Arm Pour Water

pour_water_dual.mp4

Checklist

  • I have run the black . command to format the code base.

  • I have made corresponding changes to the documentation

  • I have added tests that prove my fix is effective or that my feature works

  • Dependencies have been updated, if applicable.

"""


def draw_axis(env, pose):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why put so many help function here? toolkits should not contain module from lab. The correct denpendency relationship is lab <- toolkits. Please discusss this with @yhnsu for a better organization.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'v discussed with haonan. I move the function related to math into embodichain/utils/math.py . For the remaining part, I seperated it into atom_action and atom_action_utils and move them to sim.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yangchen73 yangchen73 merged commit b2953af into main Jan 27, 2026
1 of 2 checks passed
@yangchen73 yangchen73 deleted the yc/agent-migration branch January 27, 2026 07:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

agent Features related to agentic system gym robot learning env and its related features

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants