Dominion Akinrotimi
Home / Projects / PyDataQuality
Open source · Python · PyPI

PyDataQuality

Know whether a data file is safe to use, and what changed since the last one.

Status: Published on PyPI · Preprint on Zenodo · Built by Dominion Akinrotimi
PyDataQuality app showing problems found in a sample file

PyDataQuality tells you whether a data file is safe to use, and what changed since the last one, in plain language and on your own computer. It finds duplicates, repeated IDs, impossible values, future dates, mixed formats, invalid emails, inconsistent spellings and far-off numbers, then shows the exact rows behind each finding.

v0.3.1On PyPI. Fix feature coming next
3 waysDesktop app, command, library
No networkNo account, no telemetry
TestedPython 3.8 to 3.13

Quick start

pip install pydataquality

pdq check customers.csv      # is it safe to use?
pdq accept customers.csv     # remember this file as normal
pdq check customers_nov.csv  # what changed since last time?
pdq rows customers_nov.csv   # save the affected rows, with reasons
pdq ui                       # the same, in a page in your browser

In Python: result = pdq.check(df), then result.verdict, result.problems and result.bad_rows().

Research

PyDataQuality: An Actionable, Lightweight Data Profiling and Distribution Drift Detection Framework for Production Machine Learning Pipelines. Dominion Akinrotimi, 2026. Preprint on Zenodo, DOI 10.5281/zenodo.22211750. Each software release is archived under DOI 10.5281/zenodo.23344748. The paper is a preprint (not yet peer reviewed) and I am seeking a suitable journal; suggestions are welcome.

Learn the maths behind it

Need this kind of work done?

I take on data engineering, analytics, machine learning and research projects, and I speak and train teams on data and AI.