Home Projects petastorm
petastorm

petastorm

by uber · GitHub

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

# deep-learning# machine-learning# parquet# parquet-files
View on GitHub
⭐ Stars
1.9k
🍴 Forks
283
📜 License
Apache-2.0
Commercial use OK
📅 Created
2018
🔄 Last commit
6 mo ago
🏷️ Category
deep-learning
💻 Language
You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
petastorm — GitHub preview card
📈 Star history
1 8891 888
2026-07-202026-07-22
📄 About

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

Frequently asked questions

What is petastorm?

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

Is petastorm open source?

petastorm is an open-source project. It is released under the Apache-2.0 license.

Is petastorm free?

Yes. petastorm is free and open source — you can use, modify and self-host it.

🏅 Maintainer of this project?
olud.ai badge — petastorm

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=uber-petastorm)](https://olud.ai/project/uber-petastorm.html)
More badge options →
🧬 Related projects