Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Full vision pipeline for multiple objects! #88

Merged
merged 11 commits into from
Jul 26, 2023
Merged

Conversation

nkumar-bdai
Copy link

This PR enables us to run our pipeline with perception directly from vision without making the hard assumption that there is only one object in the world (i.e, the brush). We can now easily modify the numbers and types of objects!

Example Command:

python predicators/main.py --env spot_bike_env --approach spot_wrapper[oracle] --debug --strips_learner oracle --sampler_learner oracle --bilevel_plan_without_sim True --num_test_tasks 1 --explorer active_sampler --spot_robot_ip 10.17.30.30 --spot_grasp_use_sam True --perceiver spot_bike_env --execution_monitor expected_atoms --horizon 15 --spot_initialize_surfaces_to_default False --spot_visualize_vision_model_outputs False --seed 123 --test_task_json_dir predicators/envs/assets/task_jsons/spot_bike_env/brush_screwdriver_perception/

@nkumar-bdai nkumar-bdai self-assigned this Jul 25, 2023
@nkumar-bdai nkumar-bdai marked this pull request as ready for review July 25, 2023 20:36
Copy link

@tsilver-bdai tsilver-bdai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

halfway through, looking good so far!

predicators/spot_utils/perception_utils.py Outdated Show resolved Hide resolved
predicators/spot_utils/perception_utils.py Show resolved Hide resolved
Copy link

@tsilver-bdai tsilver-bdai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great work!

predicators/spot_utils/perception_utils.py Show resolved Hide resolved
predicators/spot_utils/perception_utils.py Outdated Show resolved Hide resolved
@nkumar-bdai nkumar-bdai merged commit 0e47837 into master Jul 26, 2023
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants