datacompy
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
Safety scan
A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.
Check it deeper on your machine
It has changed since its scan on 11 Nov 2026.
As a Claude Code plugin, install it and then ask Claude Code:
/plugin marketplace add keithmackay/mackayi/plugin install scanskillsafety@mackayiDo a deep scan of https://github.com/capitalone/datacompy with scanskillsafety
Or from a terminal, clone it and run it:
git clone https://github.com/keithmackay/scanskillsafety-skill ~/.claude/skills/scanskillsafetynode ~/.claude/skills/scanskillsafety/cli.cjs --deep 'https://github.com/capitalone/datacompy'
It checks the exact commit: every file, its packages against OSV (api.osv.dev), how it compares with this page's scan (findsafeskills.com receives the repository's address), and, if you agree, Claude reading every file with your own Claude subscription. It never runs the code.
Badge for your README
Markdown
[](/listings/capitalone--datacompy)HTML
<a href="/listings/capitalone--datacompy"><img src="/api/listings/capitalone--datacompy/badge.svg" alt="findsafeskills safety rating" /></a>Install
Install instructions from the README
As written by the repo's author. findsafeskills has not verified these steps.
pip install datacompy
or
conda install datacompy
Installing extras
If you would like to use Spark or any other backends please make sure you install via extras:
pip install datacompy[spark] pip install datacompy[snowflake]
What was scanned
The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.
README.md · README · 120 lines
View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)
- # DataComPy
- 
- [](https://github.com/astral-sh/ruff)
- [](https://badge.fury.io/py/datacompy)
- [](https://anaconda.org/conda-forge/datacompy)
- 
- DataComPy is a package to compare two DataFrames (or tables) such as Pandas, Spark, Polars, and
- even Snowflake. Originally it was created to be something of a replacement
- for SAS's ``PROC COMPARE`` for Pandas DataFrames with some more functionality than
- just ``Pandas.DataFrame.equals(Pandas.DataFrame)`` (in that it prints out some stats,
- and lets you tweak how accurate matches have to be). Supported types include:
- - Pandas
- - Polars
- - Spark (classic and Spark Connect)
- - Snowflake
- > [!IMPORTANT]
- > datacompy has released `v1`. The `v0.19.x` line is no longer supported — users should upgrade to `v1` going forward.
- > The `support/0.19.x` branch is archived and will only receive critical security fixes on a best-effort basis; no new features or regular maintenance will be provided.
- > All active development targets `main`.
- ## Quick Installation
- ```shell
- pip install datacompy
- ```
- or
- ```shell
- conda install datacompy
- ```
- ### Installing extras
- If you would like to use Spark or any other backends please make sure you install via extras:
- ```shell
- pip install datacompy[spark]
- pip install datacompy[snowflake]
- ```
- ## Supported backends
- - Pandas: ([See documentation](https://capitalone.github.io/datacompy/pandas_usage.html))
- - Spark: ([See documentation](https://capitalone.github.io/datacompy/spark_usage.html))
- - Polars: ([See documentation](https://capitalone.github.io/datacompy/polars_usage.html))
- - Snowflake/Snowpark: ([See documentation](https://capitalone.github.io/datacompy/snowflake_usage.html))
- ## Command Line Interface
- DataComPy ships a `datacompy` command, so ad hoc checks and CI pipelines do not
- need a throw-away script ([see documentation](https://capitalone.github.io/datacompy/cli.html)):
- ```bash
- # Compare two files and print a report
- datacompy compare --left before.csv --right after.csv --on id
- # Fail a build on any difference, with a JSON report saved as an artifact
- datacompy compare \
- --left before.parquet --right after.parquet \
- --on account_id,as_of_date \
- --abs-tol balance=0.01 \
- --max-unequal-rows 0 \
- --report-format json --output reports/diff.json --quiet
- ```
- It exits `0` when the datasets match, `1` when they differ, and `2` on error.
- CSV, Parquet, and JSON inputs are supported on the pandas, polars, and Spark
- backends, including tab separated CSV via a `.tsv` extension, and Snowflake
- tables can be compared in place.
- ## Programmatic Report Access
- Every compare object exposes `build_report_data()` which returns a typed
- [`ReportData`](https://capitalone.github.io/datacompy/report_api.html) object
- — useful for dashboards, JSON export, or custom rendering without relying on
- the string report:
- ```python
- import pandas as pd
- from datacompy import PandasCompare
- df1 = pd.DataFrame({"id": [1, 2, 3], "val": [10, 20, 30]})
- df2 = pd.DataFrame({"id": [1, 2, 3], "val": [10, 99, 30]})
- compare = PandasCompare(df1, df2, join_columns="id")
- # Access structured data directly
- data = compare.build_report_data()
- print(data.row_summary.unequal_rows) # 1
- print(data.mismatch_stats.stats[0].column) # 'val'
- # Render / export — methods live on ReportData itself
- print(data.render()) # same text as compare.report()
- data.save("report.html") # HTML file
- data.to_dict() # JSON-serializable dict
- ```
- See the [Report API documentation](https://capitalone.github.io/datacompy/report_api.html) for the full reference.
- ## Contributors
- We welcome and appreciate your contributions! Before we can accept any contributions, we ask that you please be sure to
- sign the [Contributor License Agreement (CLA)](https://cla-assistant.io/capitalone/datacompy).
- To run the CI test matrix locally, including the Spark and Spark Connect tracks without a hand-managed JDK,
- see the [Developer Instructions](https://capitalone.github.io/datacompy/developer_instructions.html).
- This project adheres to the [Open Source Code of Conduct](https://developer.capitalone.com/resources/code-of-conduct/).
- By participating, you are expected to honor this code.
Ratings and comments
Sign in to rate this skill.
Sign inFree to use. If it’s helped, pass it on.