Skip to content
Back to search

dataskills

Agent skills that make AI coding agents do data science correctly: EDA reports, logged data cleaning and leakage checks, with tested Python helpers

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today
Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/m-shahmeer-kz--dataskills/badge.svg)](/listings/m-shahmeer-kz--dataskills)

HTML

<a href="/listings/m-shahmeer-kz--dataskills"><img src="/api/listings/m-shahmeer-kz--dataskills/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

git clone --depth 1 https://github.com/m-shahmeer-kz/dataskills ~/dataskills && mkdir -p ~/.claude/skills && cp -r ~/dataskills/skills/* ~/.claude/skills/ && pip install -r ~/dataskills/requirements.txt

That copies the three skills to `~/.claude/skills/` (available in all your projects). For one project only, copy them to `.claude/skills/` inside that project instead. Other agents: put the `skills/` folders wherever your agent reads `SKILL.md` files, or tell it to read `skills/<name>/SKILL.md`.

Then just ask, for example: *"Explore data/sales.csv"*, *"Clean this file"*, *"Is my churn model leaking?"*. The agent picks the skill from its description. You can also call one directly: `/leakage-check`.

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 125 lines
  1. # DataSkills
  2. [![tests](https://github.com/m-shahmeer-kz/dataskills/actions/workflows/tests.yml/badge.svg)](https://github.com/m-shahmeer-kz/dataskills/actions/workflows/tests.yml)
  3. [![license: MIT](https://img.shields.io/badge/license-MIT-black.svg)](LICENSE)
  4. **[See the example reports ↗](https://m-shahmeer-kz.github.io/dataskills/)**
  5. Reusable **agent skills** that make AI coding agents (Claude Code and other tools that read `SKILL.md`) do data science work **correctly**: explore before modelling, clean without hiding anything, and catch leakage before it fakes a great score.
  6. | Skill | Use it when | What you get |
  7. |---|---|---|
  8. | [`eda-report`](skills/eda-report/SKILL.md) | a new dataset arrives | a markdown report with charts: shape, column types, missing values, distributions, correlations, target |
  9. | [`data-cleaning`](skills/data-cleaning/SKILL.md) | the data has format problems | a cleaned file + a log of **every** change (before → after) and a list of things to check |
  10. | [`leakage-check`](skills/leakage-check/SKILL.md) | before trusting any model | HIGH / MEDIUM / LOW findings: target leakage and train/test contamination |
  11. Each skill = short instructions (`SKILL.md`) + one tested Python script. Free libraries only (pandas, numpy, matplotlib, scikit-learn). No API keys.
  12. ## Install (one line)
  13. ```bash
  14. git clone --depth 1 https://github.com/m-shahmeer-kz/dataskills ~/dataskills && mkdir -p ~/.claude/skills && cp -r ~/dataskills/skills/* ~/.claude/skills/ && pip install -r ~/dataskills/requirements.txt
  15. ```
  16. That copies the three skills to `~/.claude/skills/` (available in all your projects). For one project only, copy them to `.claude/skills/` inside that project instead. Other agents: put the `skills/` folders wherever your agent reads `SKILL.md` files, or tell it to read `skills/<name>/SKILL.md`.
  17. Then just ask, for example: *"Explore data/sales.csv"*, *"Clean this file"*, *"Is my churn model leaking?"*. The agent picks the skill from its description. You can also call one directly: `/leakage-check`.
  18. ## Why this exists
  19. AI agents write pandas fast, but they repeat the same quiet mistakes that a senior data scientist would catch:
  20. - training on a column that is only filled in **after** the outcome, and celebrating a 97% score;
  21. - `fillna(df.mean())` or `StandardScaler().fit(X)` **before** the train/test split, so test data leaks into training;
  22. - a random split on time data, or the same customer in train and test;
  23. - `dropna()` that silently deletes most of the rows, or "cleaning" that nobody can check afterwards.
  24. A skill gives the agent the right checklist **and** a tested tool at the moment it needs them. Instructions are short on purpose: what to do, what comes out, what not to do.
  25. ## Before / after (real data)
  26. The Titanic passenger list ([`examples/titanic3.csv`](examples/titanic3.csv), 1,309 people). Same model, same pipeline, 5-fold cross-validation × 3 ([`examples/titanic_before_after.py`](examples/titanic_before_after.py)):
  27. | | Columns used | Accuracy | ROC AUC |
  28. |---|---|---|---|
  29. | **Before**: agent uses every column | 12, including `boat` and `body` | **0.974** 🤩 | 0.993 |
  30. | **After**: `leakage-check` first | 10 (`boat`, `body` removed) | **0.787** | 0.847 |
  31. 97% looks great and is **fake**: `boat` is the lifeboat a passenger got into, and `body` is the number given to a recovered body. Neither is known before the ship sinks. The skill flagged both as HIGH, with plain-language reasons:
  32. ```text
  33. HIGH missing_predicts_target boat Just knowing whether `boat` is empty predicts the target (AUC 0.971).
  34. Values that get filled in only after the outcome look exactly like this.
  35. HIGH one_sided_value body When `body` is filled in, the target is `0` in 100% of 121 rows
  36. (overall only 62%).
  37. ```
  38. The honest 79% is the number you can actually use. Full outputs of all three skills on this file: [`examples/output/`](examples/output/) ([EDA report](examples/output/eda/eda_report.md) · [cleaning log](examples/output/cleaning/cleaning_log.md) · [leakage report](examples/output/leakage/leakage_report.md)).
  39. ## Measured results
  40. Problems were planted on purpose into four real datasets (scikit-learn's breast cancer, wine and diabetes, plus Titanic without `boat`/`body`) and the scripts had to find or fix them ([`benchmarks/run_benchmarks.py`](benchmarks/run_benchmarks.py), [`results.json`](benchmarks/results.json)).
  41. **leakage-check**: **81 of 81** planted leaks found, across 7 kinds: copy of the target, value recorded after the outcome, value present for one outcome only, file sorted by target, same group in train and test, test older than train, rows copied into test. **0 HIGH false alarms** on the 4 clean datasets and on 24 correct splits (group and time). Notes:
  42. - In breast cancer, 10 genuinely strong measurements are marked MEDIUM ("check when this value is known"). That is the intended behaviour: strong is not the same as leaking.
  43. - The wine file really is sorted by class, and the check says so.
  44. **data-cleaning**: **1,811 of 1,811** planted broken cells restored (spaces, "N/A"-style text, `$1,234.50` money strings, `-999` placeholders, `MALE`/`male ` spelling variants, mixed date formats), **74 of 74** duplicate rows removed, **0** untouched cells changed. On the clean originals it changed nothing, except 2 real problems it found in Titanic (4 names with trailing spaces; `Sweden Worcester, MA` with a double space).
  45. **eda-report**: Titanic in 1.8 s; a 1,000,000-row × 21-column table in 5.5 s (profiled on a 200,000-row sample).
  46. **Tests**: 32 pytest tests, including a check that every `SKILL.md` follows the [Agent Skills](https://agentskills.io) format, run on GitHub Actions.
  47. **Limits, honestly**: the planted problems and the thresholds were designed by me, so these numbers show the scripts do what they promise, not that they find every leak in the wild. Leakage that looks like a normal feature (a strong, plausible column recorded later) can only be found by asking *"would I know this value at prediction time?"*, which is why the skill makes the agent ask it. I did not measure how much agents improve with the skills (that needs paid model APIs).
  48. ## Repository structure
  49. ```text
  50. dataskills/
  51. ├── skills/
  52. │ ├── eda-report/
  53. │ │ ├── SKILL.md when to use · steps · outputs · mistakes to avoid
  54. │ │ └── scripts/eda_report.py profile + markdown report + charts
  55. │ ├── data-cleaning/
  56. │ │ ├── SKILL.md
  57. │ │ └── scripts/clean_data.py safe fixes + change log
  58. │ └── leakage-check/
  59. │ ├── SKILL.md
  60. │ └── scripts/leakage_check.py target leakage + train/test contamination
  61. ├── tests/ pytest for each script + SKILL.md format check
  62. ├── benchmarks/run_benchmarks.py planted-problem benchmarks -> results.json
  63. ├── examples/ titanic3.csv, before/after script, example outputs
  64. └── docs/ example reports page (GitHub Pages)
  65. ```
  66. ## How a skill works (in one minute)
  67. 1. At start-up the agent reads only each skill's `name` and `description` (a couple of lines).
  68. 2. When your request matches a description ("clean this CSV"), the agent loads that skill's `SKILL.md`.
  69. 3. It follows the steps, runs the script in `scripts/` (the script does the heavy, tested work), reads the report it produced, and explains the result to you.
  70. ## Use the scripts without an agent
  71. ```bash
  72. python skills/eda-report/scripts/eda_report.py data.csv --target y --out reports/eda
  73. python skills/data-cleaning/scripts/clean_data.py data.csv --out data/clean.csv --log-dir reports/cleaning --dry-run
  74. python skills/leakage-check/scripts/leakage_check.py data.csv --target y --out reports/leakage # exit 2 if HIGH
  75. ```
  76. ## Develop
  77. ```bash
  78. pip install -r requirements.txt pytest
  79. python -m pytest -q # 32 tests
  80. python benchmarks/run_benchmarks.py # ~35 s
  81. python examples/titanic_before_after.py
  82. ```
  83. New skill: add `skills/<name>/SKILL.md` (frontmatter `name` = folder name, a `description` that says *Use when...*, and the four sections) plus one script in `skills/<name>/scripts/` with tests. `tests/test_skill_format.py` checks the format.
  84. ## Data
  85. `examples/titanic3.csv`: the Titanic passenger list compiled by Thomas Cason from the *Encyclopedia Titanica*, distributed by the Vanderbilt University Department of Biostatistics (Frank Harrell). Copy taken from [amueller/scipy-2016-sklearn](https://github.com/amueller/scipy-2016-sklearn) (identical to a second independent copy). Benchmark datasets ship with scikit-learn.
  86. ## License
  87. MIT © 2026 Muhammad Shahmeer

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.