Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Vlm pipeline testing #292

Draft
wants to merge 26 commits into
base: master
Choose a base branch
from
Draft

Vlm pipeline testing #292

wants to merge 26 commits into from

Commits on Sep 9, 2024

  1. Initial commit.

    @ashay-bdai
    ashay-bdai committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    4e13836 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Some more progress.

    @ashay-bdai
    ashay-bdai committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    0a25b2d View commit details
    Browse the repository at this point in the history

  2. Some more progress.

    @ashay-bdai
    ashay-bdai committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    e62e8cf View commit details
    Browse the repository at this point in the history

  3. More progress after pair programming.

    @ashay-bdai
    ashay-bdai committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    aed5708 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. Get plumbing to work.

    @ashay-bdai
    ashay-bdai committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    c832fb0 View commit details
    Browse the repository at this point in the history

  2. initial test working

    @ashay-bdai
    ashay-bdai committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    ea5f1bf View commit details
    Browse the repository at this point in the history

  3. Rotate spot camera images.

    @ashay-bdai
    ashay-bdai committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    0b8d125 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Play-test other VLM predicates and update annotation in spot images.

    @ashay-bdai
    ashay-bdai committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    d255810 View commit details
    Browse the repository at this point in the history

  2. making some progress; took way longer than expected though...

    @NishanthJKumar
    NishanthJKumar committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    803683d View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Progress towards object detection result.

    @ashay-bdai
    ashay-bdai committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    cf40334 View commit details
    Browse the repository at this point in the history

  2. finish up implementation!

    @NishanthJKumar
    NishanthJKumar committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    369b399 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2024

  1. Get camera annotation + object detection annotation to work on all im… 

    …ages.
    @ashay-bdai
    ashay-bdai committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    94dff09 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2024

  1. Update annotation text font and background.

    @ashay-bdai
    ashay-bdai committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    aec3f86 View commit details
    Browse the repository at this point in the history

  2. Run autoformatter.

    @ashay-bdai
    ashay-bdai committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    ac9fc2f View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Fix indent.

    @ashay-bdai
    ashay-bdai committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    5a461cc View commit details
    Browse the repository at this point in the history

  2. fixes for comments

    @NishanthJKumar
    NishanthJKumar committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    c4c978f View commit details
    Browse the repository at this point in the history

  3. autoformat

    @NishanthJKumar
    NishanthJKumar committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    199698e View commit details
    Browse the repository at this point in the history

  4. Merge branch 'vlm-pipeline-testing' into change-perceiver-to-have-his… 

    …tory
    @ashay-bdai
    ashay-bdai authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    9ce43d3 View commit details
    Browse the repository at this point in the history

  5. Merge pull request #293 from bdaiinstitute/change-perceiver-to-have-h… 

    …istory

Change perceiver to have history
    @ashay-bdai
    ashay-bdai authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    37b5245 View commit details
    Browse the repository at this point in the history

  6. Add last skill execution to _TruncatedSpotObservation.

    @ashay-bdai
    ashay-bdai committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    6e25b72 View commit details
    Browse the repository at this point in the history

  7. Debugging progressm.

    @ashay-bdai
    ashay-bdai committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    fe7da30 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Some progress towards fixing vlm atom history.

    @ashay-bdai
    ashay-bdai committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    4cc0336 View commit details
    Browse the repository at this point in the history

  2. Progress towards passing history into VLM at test time.

    @ashay-bdai
    ashay-bdai committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    41b58ea View commit details
    Browse the repository at this point in the history

  3. Update and fix computation of history and how it gets passed into the… 

    … VLM query.
    @ashay-bdai
    ashay-bdai committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    71fe6d3 View commit details
    Browse the repository at this point in the history

  4. Fix bugs related to image history to VLM and abstracting the state.

    @ashay-bdai
    ashay-bdai committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    5232fa2 View commit details
    Browse the repository at this point in the history

  5. Fix skill action history in case of done action.

    @ashay-bdai
    ashay-bdai committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    6303130 View commit details
    Browse the repository at this point in the history