data-preparation

Scalable data pre processing and curation toolkit for LLMs

Machine learning with dataframes

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

visual data prep powered by python

Open source project for data preparation for GenAI applications

Continuously updated paper list on advancements in Data Agents. Companion repo to our paper "A Survey of Data Agents: Emerging Paradigm or Overstated Hype?"

Data Preparation for Satellite Machine Learning

All-in-one intelligent assistant powered by LlamaIndex — RAG, GraphRAG, NL2SQL, Skills & Memory with multimodal support.

A New, Interactive Approach to Learning Data Science

An open source book to learn data science, data analysis and machine learning, suitable for all ages!

🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)

【AAAI'2021】MVFNet: Multi-View Fusion Network for Efficient Video Recognition

Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

ABAP unit testing framework, prepare in Excel, reuse in abap code

Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)

This repository contains my implementations of the algorithms which MoNuSAC participants could use for data preparation to train their models at ISBI 2020.

Automated data preparation for machine learning. Load a dataset, clean, transform, encode, scale and split it, explore it with built-in analysis, and export model-ready data with a full report. Built with Python and Streamlit.

“Data science” is just about as broad of a term as they come. It may be easiest to describe what it is by listing its more concrete components: Data exploration & analysis. Included here: Pandas; NumPy; SciPy; a helping hand from Python's Standard Library.

Market Mix Modelling for an eCommerce firm to estimate the impact of various marketing levers on sales