Synthetic Data Generation

End-to-end pipeline for synthetic instruction data.

High-performance data processing for LLM training.

Open-source data labeling + synthetic data platform.

High-fidelity tabular and relational synthetic data.

Platform-agnostic data processing pipelines for LLM training at scale. Handles filtering, deduplication, and tokenization on local machines or SLURM clusters.

Synthetic data curation for post-training and structured data extraction. Makes it easy to build pipelines around LLMs with batching and progress tracking. Apache 2.0 licensed.

Specialized framework for generating high-quality structured tabular synthetic data with CTGAN models supporting billion-level data processing. Apache 2.0 licensed.