Hugging Face's logo
Jacob Marks's picture
2 9 64

Jacob Marks

jamarks
harpreetsahota's profile picture sudanenator's profile picture Achiando's profile picture
·
https://jacobmarks.github.io/

AI & ML interests

meta learning, deep learning as a science, computer vision, data curation

Recent Activity

liked a dataset about 1 month ago
Voxel51/LVIS
updated a dataset about 1 month ago
jamarks/apples
updated a dataset about 1 month ago
jamarks/CrowdHuman-train
View all activity

Articles

Organizations

Blog-explorers's profile picture Voxel51's profile picture Cookbook Authors's profile picture

Posts 1

view post
Post
2169
FiftyOne Datasets <> Hugging Face Hub Integration!

As of yesterday's release of FiftyOne 0.23.8, the FiftyOne open source library for dataset curation and visualization is now integrated with the Hugging Face Hub!

You can now load Parquet datasets from the hub and have them converted directly into FiftyOne datasets. To load MNIST, for example:

pip install -U fiftyone


import fiftyone as fo
import fiftyone.utils.huggingface as fouh

dataset = fouh.load_from_hub(
    "mnist",
    format="ParquetFilesDataset",
    classification_fields="label",
)
session = fo.launch_app(dataset)


You can also load FiftyOne datasets directly from the hub. Here's how you load the first 1000 samples from the VisDrone dataset:

import fiftyone as fo
import fiftyone.utils.huggingface as fouh

dataset = fouh.load_from_hub("jamarks/VisDrone2019-DET", max_samples=1000)

# Launch the App
session = fo.launch_app(dataset)


And tying it all together, you can push your FiftyOne datasets directly to the hub:

import fiftyone.zoo as foz
import fiftyone.utils.huggingface as fouh

dataset = foz.load_zoo_dataset("quickstart")
fouh.push_to_hub(dataset, "my-dataset")


Major thanks to @tomaarsen @davanstrien @severo @osanseviero and @julien-c for helping to make this happen!!!

Full documentation and details here: https://docs.voxel51.com/integrations/huggingface.html#huggingface-hub