Custom PySpark Connectors
-
Updated
Aug 21, 2026 - Python
Custom PySpark Connectors
PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it
PySpark custom data source for Hugging Face Datasets
Google BigQuery data source for Apache Spark
Allows reading ROOT TTrees into Apache Spark as DataFrames
Contains the code and examples for my article on Medium, which explains how to create a custom JDBC read-only data source in Apache Spark 3
Scala/Spark Netcdf for reading Netcdf files
To associate your repository with the spark-datasource topic, visit your repo's landing page and select "manage topics."