Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement pick and place tasks + some improvements and fixes #289

Open
wants to merge 73 commits into
base: master
Choose a base branch
from

Conversation

lf-zhao
Copy link
Collaborator

@lf-zhao lf-zhao commented May 23, 2024

This builds on top of PR #285 (#285), which has not been merged yet.

The runtime pipeline is similar as #285, but it fixes some issues that appear in Spot pick and place task.

Command:
--spot_robot_ip 192.168.80.3 --spot_graph_nav_map b45-621 --env lis_spot_block_bowl_env --approach spot_wrapper[oracle] --bilevel_plan_without_sim True --seed 0 --perceiver spot_perceiver --spot_vlm_eval_predicate True --vlm_eval_verbose True --num_train_tasks 0 --num_test_tasks 1

Changes compared to #285:

  • add pick and place task
  • fix VLM ground atom update issue (previously it was overwritten by new obs, not updated)
  • update VLM predicate class to incorporate prompt
  • implement some VLM predicates that include prompts
  • add better visualization of predicate evaluation using Rich Table

…; we need to figure out a better way to sync later!
…e-eval

# Conflicts:
#	predicators/pretrained_model_interface.py
#	setup.py
@lf-zhao lf-zhao changed the base branch from lis-spot/update-vlm-predicate-pipeline to master May 23, 2024 18:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant