Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release EgoCVR on Hugging Face #2

Open
NielsRogge opened this issue Oct 3, 2024 · 2 comments
Open

Release EgoCVR on Hugging Face #2

NielsRogge opened this issue Oct 3, 2024 · 2 comments

Comments

@NielsRogge
Copy link

Hello @hummelth 🤗

I'm Niels and work as ML engineer at Hugging Face. I discovered your work through ECCV, congrats! I indexed
your paper page here: https://huggingface.co/papers/2407.16658. The paper page lets people discuss about your paper and lets them find artifacts about it (your dataset for instance) you can also claim the paper as yours which will show up on your public profile at HF.

Would you like to host the datasets on https://huggingface.co/datasets? I see you're using Google Drive for it. Hosting on Hugging Face will give you more visibility, and will also allow people to do:

from datasets import load_dataset

dataset = load_dataset("your-hf-org/ego-cvr")

If you're down, leaving a guide here: https://huggingface.co/docs/datasets/image_dataset. We also support Webdataset, useful for image/video datasets: https://huggingface.co/docs/datasets/en/loading#webdataset.

Besides that, there's the dataset viewer which allows people to quickly explore the first few rows of the data in the browser.

After uploaded, we can also link the datasets to the paper page (read here) so people can discover your work.

What do you think?

Kind regards,

Niels

@NielsRogge NielsRogge changed the title Release EgoCVR on Hugging Faceg Release EgoCVR on Hugging Face Oct 3, 2024
@sgk98
Copy link
Collaborator

sgk98 commented Oct 4, 2024

Hey @NielsRogge,
Thanks for the suggestion. This is a great idea, and we will try to do this in the next 1-2 weeks. A quick question: since we have videos to be uploaded, I assume that we would need to use Webdataset rather than the image_dataset format that you have?

@NielsRogge
Copy link
Author

Yes I think webdataset might be the best format here, @mfarre (who works on video models at Hugging Face) has put together a script for uploading: https://github.com/mfarre/hf_pushvideo_dataset/blob/main/snippets.ipynb.

This was also leveraged for the FineVideo dataset, which can be explored here: https://huggingface.co/spaces/HuggingFaceFV/FineVideo-Explorer.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants