Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Webdataset + reading images right from zipfile stream #8

Open
wants to merge 22 commits into
base: main
Choose a base branch
from

Commits on Nov 1, 2023

  1. add juwels script

    Marianna Nezhurina committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    1c9553a View commit details
    Browse the repository at this point in the history
  2. add webdataset and zip dataset

    Marianna Nezhurina committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    d3cb4c5 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. add juwels script

    Marianna Nezhurina committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    d1e9fa0 View commit details
    Browse the repository at this point in the history
  2. add webdataset utils

    Marianna Nezhurina committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    aac1a2a View commit details
    Browse the repository at this point in the history
  3. full support for wds

    Marianna Nezhurina committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    6a3c092 View commit details
    Browse the repository at this point in the history
  4. add juwels script

    Marianna Nezhurina committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    81e46c0 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2023

  1. add dataset resampling

    Marianna Nezhurina committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    54c672b View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2023

  1. dataset bug fix

    Marianna Nezhurina committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    ca72dc8 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2023

  1. added DFN vision tower support

    Marianna Nezhurina committed Dec 6, 2023
    1 Configuration menu
    Copy the full SHA
    070168c View commit details
    Browse the repository at this point in the history
  2. added DFN vision tower support

    Marianna Nezhurina committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    2a86405 View commit details
    Browse the repository at this point in the history
  3. added DFN vision tower support

    Marianna Nezhurina committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    56b4e63 View commit details
    Browse the repository at this point in the history
  4. add dfn support

    Marianna Nezhurina committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    e5ae9fd View commit details
    Browse the repository at this point in the history
  5. add dfn support

    Marianna Nezhurina committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    5f40249 View commit details
    Browse the repository at this point in the history
  6. add hf hub requirements

    Marianna Nezhurina committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    362d658 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2023

  1. bug fix

    Marianna Nezhurina committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    ee758ef View commit details
    Browse the repository at this point in the history

Commits on Jan 28, 2024

  1. add Phi support

    nezhurina1 committed Jan 28, 2024
    Configuration menu
    Copy the full SHA
    3403f58 View commit details
    Browse the repository at this point in the history
  2. added more evals

    marianna13 committed Jan 28, 2024
    Configuration menu
    Copy the full SHA
    04d3c55 View commit details
    Browse the repository at this point in the history
  3. added phi support

    marianna13 committed Jan 28, 2024
    Configuration menu
    Copy the full SHA
    4c9fa3e View commit details
    Browse the repository at this point in the history
  4. updated requirements

    marianna13 committed Jan 28, 2024
    Configuration menu
    Copy the full SHA
    862b877 View commit details
    Browse the repository at this point in the history
  5. Update __init__.py

    marianna13 authored Jan 28, 2024
    Configuration menu
    Copy the full SHA
    f92774e View commit details
    Browse the repository at this point in the history
  6. Update builder.py

    marianna13 authored Jan 28, 2024
    Configuration menu
    Copy the full SHA
    e8af758 View commit details
    Browse the repository at this point in the history
  7. Update conversation.py

    marianna13 authored Jan 28, 2024
    Configuration menu
    Copy the full SHA
    1561e74 View commit details
    Browse the repository at this point in the history