Skip to content
Back to search

cudf-spark

NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today

Check it deeper on your machine

It has changed since its scan on 11 Nov 2026.

As a Claude Code plugin, install it and then ask Claude Code:

/plugin marketplace add keithmackay/mackayi/plugin install scanskillsafety@mackayiDo a deep scan of https://github.com/NVIDIA/cudf-spark with scanskillsafety

Or from a terminal, clone it and run it:

git clone https://github.com/keithmackay/scanskillsafety-skill ~/.claude/skills/scanskillsafetynode ~/.claude/skills/scanskillsafety/cli.cjs --deep 'https://github.com/NVIDIA/cudf-spark'

It checks the exact commit: every file, its packages against OSV (api.osv.dev), how it compares with this page's scan (findsafeskills.com receives the repository's address), and, if you agree, Claude reading every file with your own Claude subscription. It never runs the code.

Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/nvidia--cudf-spark/badge.svg)](/listings/nvidia--cudf-spark)

HTML

<a href="/listings/nvidia--cudf-spark"><img src="/api/listings/nvidia--cudf-spark/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 84 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

This file has changed since it was scanned, so this is not exactly the text that was scanned, and no line is marked. The findings are listed with the safety scan above.

  1. # NVIDIA cuDF plugin for Apache Spark
  2. NOTE: For the latest stable [README.md](https://github.com/NVIDIA/cudf-spark/blob/main/README.md) ensure you are on the main branch.
  3. The NVIDIA cuDF plugin for [Apache Spark](https://spark.apache.org) provides a plugin library that
  4. leverages GPUs to accelerate processing via the [cuDF](https://github.com/NVIDIA/cudf) (CUDA
  5. DataFrame) libraries.
  6. Documentation on the current release can be found [here](https://nvidia.github.io/cudf-spark/).
  7. To get started and try the plugin out use the [getting started guide](https://docs.nvidia.com/spark-rapids/user-guide/latest/getting-started/overview.html).
  8. [![Ask DeepWiki](https://deepwiki.com/badge.svg)](https://deepwiki.com/NVIDIA/cudf-spark)
  9. Note: The NVIDIA cuDF plugin for Apache Spark was formerly known as the RAPIDS Accelerator for
  10. Apache Spark. The RAPIDS name will be sunset over time. GitHub links from `spark-rapids` will
  11. redirect to `cudf-spark`. Artifact names will remain the same for now.
  12. ## Compatibility
  13. The SQL plugin tries to produce results that are bit for bit identical with Apache Spark.
  14. Operator compatibility is documented [here](./docs/compatibility.md)
  15. ## Tuning
  16. To get started tuning your job and get the most performance out of it please start with the
  17. [tuning guide](https://docs.nvidia.com/spark-rapids/user-guide/latest/tuning-guide.html).
  18. ## Configuration
  19. The plugin has a set of Spark configs that control its behavior and are documented
  20. [here](docs/configs.md).
  21. ## Issues & Questions
  22. We use github to track bugs, feature requests, and answer questions. File an
  23. [issue](https://github.com/NVIDIA/cudf-spark/issues/new/choose) for a bug or feature request. Ask
  24. or answer a question on the [discussion board](https://github.com/NVIDIA/cudf-spark/discussions).
  25. ## Download
  26. The jar files for the most recent release can be retrieved from the [download](https://nvidia.github.io/cudf-spark/docs/download.html)
  27. page.
  28. ## Building From Source
  29. See the [build instructions in the contributing guide](CONTRIBUTING.md#building-from-source).
  30. ## Testing
  31. Tests are described [here](tests/README.md).
  32. ## Integration
  33. The cuDF plugin provides some APIs for doing zero copy data transfer into other GPU enabled
  34. applications. It is described
  35. [here](https://docs.nvidia.com/spark-rapids/user-guide/latest/additional-functionality/ml-integration.html).
  36. Currently, we are working with XGBoost to try to provide this integration out of the box.
  37. You may need to disable RMM caching when exporting data to an ML library as that library
  38. will likely want to use all of the GPU's memory and if it is not aware of RMM it will not have
  39. access to any of the memory that RMM is holding.
  40. ## Qualification and Profiling tools
  41. The Qualification and Profiling tools are available in the
  42. [NVIDIA/cudf-spark-tools](https://github.com/NVIDIA/cudf-spark-tools) repository.
  43. Please refer to [Qualification tool documentation](https://docs.nvidia.com/spark-rapids/user-guide/latest/qualification/overview.html)
  44. and [Profiling tool documentation](https://docs.nvidia.com/spark-rapids/user-guide/latest/profiling/overview.html)
  45. for more details on how to use the tools.
  46. ## Dependency for External Projects
  47. If you develop functionality on top of the cuDF plugin (we currently limit support to
  48. GPU-accelerated UDFs) we recommend you declare the distribution artifact as a `provided` dependency.
  49. ```xml
  50. <dependency>
  51. <groupId>com.nvidia</groupId>
  52. <artifactId>cudf-spark_2.12</artifactId>
  53. <version>26.12.0-SNAPSHOT</version>
  54. <scope>provided</scope>
  55. </dependency>
  56. ```

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.