What file format is best for data science?

Favorites

• ndjson
• DuckDB

Available Options

• CSV
• JSON
• ndjson
• Parquet files
• SQLite
• DuckDB
• Pickle files - Python specific
• Excel
• XML
• Feather files

Other pandas formats

• pandas.read_table — pandas 2.2.1 documentation
• pandas.read_fwf — pandas 2.2.1 documentation

Questions

• What is the difference between pickle files and parquet files

Backlinks

• Daily Learnings