cudf-spark
NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs
Safety scan
A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.
Check it deeper on your machine
It has changed since its scan on 11 Nov 2026.
As a Claude Code plugin, install it and then ask Claude Code:
/plugin marketplace add keithmackay/mackayi/plugin install scanskillsafety@mackayiDo a deep scan of https://github.com/NVIDIA/cudf-spark with scanskillsafety
Or from a terminal, clone it and run it:
git clone https://github.com/keithmackay/scanskillsafety-skill ~/.claude/skills/scanskillsafetynode ~/.claude/skills/scanskillsafety/cli.cjs --deep 'https://github.com/NVIDIA/cudf-spark'
It checks the exact commit: every file, its packages against OSV (api.osv.dev), how it compares with this page's scan (findsafeskills.com receives the repository's address), and, if you agree, Claude reading every file with your own Claude subscription. It never runs the code.
Badge for your README
Markdown
[](/listings/nvidia--cudf-spark)HTML
<a href="/listings/nvidia--cudf-spark"><img src="/api/listings/nvidia--cudf-spark/badge.svg" alt="findsafeskills safety rating" /></a>Install
What was scanned
The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.
README.md · README · 84 lines
View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)
This file has changed since it was scanned, so this is not exactly the text that was scanned, and no line is marked. The findings are listed with the safety scan above.
- # NVIDIA cuDF plugin for Apache Spark
- NOTE: For the latest stable [README.md](https://github.com/NVIDIA/cudf-spark/blob/main/README.md) ensure you are on the main branch.
- The NVIDIA cuDF plugin for [Apache Spark](https://spark.apache.org) provides a plugin library that
- leverages GPUs to accelerate processing via the [cuDF](https://github.com/NVIDIA/cudf) (CUDA
- DataFrame) libraries.
- Documentation on the current release can be found [here](https://nvidia.github.io/cudf-spark/).
- To get started and try the plugin out use the [getting started guide](https://docs.nvidia.com/spark-rapids/user-guide/latest/getting-started/overview.html).
- [](https://deepwiki.com/NVIDIA/cudf-spark)
- Note: The NVIDIA cuDF plugin for Apache Spark was formerly known as the RAPIDS Accelerator for
- Apache Spark. The RAPIDS name will be sunset over time. GitHub links from `spark-rapids` will
- redirect to `cudf-spark`. Artifact names will remain the same for now.
- ## Compatibility
- The SQL plugin tries to produce results that are bit for bit identical with Apache Spark.
- Operator compatibility is documented [here](./docs/compatibility.md)
- ## Tuning
- To get started tuning your job and get the most performance out of it please start with the
- [tuning guide](https://docs.nvidia.com/spark-rapids/user-guide/latest/tuning-guide.html).
- ## Configuration
- The plugin has a set of Spark configs that control its behavior and are documented
- [here](docs/configs.md).
- ## Issues & Questions
- We use github to track bugs, feature requests, and answer questions. File an
- [issue](https://github.com/NVIDIA/cudf-spark/issues/new/choose) for a bug or feature request. Ask
- or answer a question on the [discussion board](https://github.com/NVIDIA/cudf-spark/discussions).
- ## Download
- The jar files for the most recent release can be retrieved from the [download](https://nvidia.github.io/cudf-spark/docs/download.html)
- page.
- ## Building From Source
- See the [build instructions in the contributing guide](CONTRIBUTING.md#building-from-source).
- ## Testing
- Tests are described [here](tests/README.md).
- ## Integration
- The cuDF plugin provides some APIs for doing zero copy data transfer into other GPU enabled
- applications. It is described
- [here](https://docs.nvidia.com/spark-rapids/user-guide/latest/additional-functionality/ml-integration.html).
- Currently, we are working with XGBoost to try to provide this integration out of the box.
- You may need to disable RMM caching when exporting data to an ML library as that library
- will likely want to use all of the GPU's memory and if it is not aware of RMM it will not have
- access to any of the memory that RMM is holding.
- ## Qualification and Profiling tools
- The Qualification and Profiling tools are available in the
- [NVIDIA/cudf-spark-tools](https://github.com/NVIDIA/cudf-spark-tools) repository.
- Please refer to [Qualification tool documentation](https://docs.nvidia.com/spark-rapids/user-guide/latest/qualification/overview.html)
- and [Profiling tool documentation](https://docs.nvidia.com/spark-rapids/user-guide/latest/profiling/overview.html)
- for more details on how to use the tools.
- ## Dependency for External Projects
- If you develop functionality on top of the cuDF plugin (we currently limit support to
- GPU-accelerated UDFs) we recommend you declare the distribution artifact as a `provided` dependency.
- ```xml
- <dependency>
- <groupId>com.nvidia</groupId>
- <artifactId>cudf-spark_2.12</artifactId>
- <version>26.12.0-SNAPSHOT</version>
- <scope>provided</scope>
- </dependency>
- ```
Ratings and comments
Sign in to rate this skill.
Sign inFree to use. If it’s helped, pass it on.