Skip to content
Back to search

Eventual-Inc

MarketplaceWorks with Claude CodeGitHub

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today

Check it deeper on your machine

Its scripts were only partly scanned.

As a Claude Code plugin, install it and then ask Claude Code:

/plugin marketplace add keithmackay/mackayi/plugin install scanskillsafety@mackayiDo a deep scan of https://github.com/Eventual-Inc/Daft with scanskillsafety

Or from a terminal, clone it and run it:

git clone https://github.com/keithmackay/scanskillsafety-skill ~/.claude/skills/scanskillsafetynode ~/.claude/skills/scanskillsafety/cli.cjs --deep 'https://github.com/Eventual-Inc/Daft'

It checks the exact commit: every file, its packages against OSV (api.osv.dev), how it compares with this page's scan (findsafeskills.com receives the repository's address), and, if you agree, Claude reading every file with your own Claude subscription. It never runs the code.

Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/eventual-inc--daft/badge.svg)](/listings/eventual-inc--daft)

HTML

<a href="/listings/eventual-inc--daft"><img src="/api/listings/eventual-inc--daft/badge.svg" alt="findsafeskills safety rating" /></a>

Install

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

Installation ^^^^^^^^^^^^

Install Daft with ``pip install daft``. Requires Python 3.10 or higher.

For more advanced installations (e.g. installing from source or with extra dependencies such as Ray and AWS utilities), please see our `Installation Guide <https://docs.daft.ai/en/stable/install/>`_

Quickstart ^^^^^^^^^^

Get started in minutes with our `Quickstart <https://docs.daft.ai/en/stable/quickstart/>`_ - load a real-world e-commerce dataset, process product images, and run AI inference at scale.

More Resources ^^^^^^^^^^^^^^

* `Examples <https://docs.daft.ai/en/stable/examples/>`_ - see Daft in action with use cases across text, images, audio, and more * `User Guide <https://docs.daft.ai/en/stable/>`_ - take a deep-dive into each topic within Daft * `API Reference <https://docs.daft.ai/en/stable/api/>`_ - API reference for public classes/functions of Daft

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

.claude-plugin/marketplace.json · Manifest · 15 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

  1. {
  2. "name": "Eventual-Inc",
  3. "owner": {
  4. "name": "Eventual, Inc.",
  5. "email": "yksu@eventualcomputing.com"
  6. },
  7. "plugins": [
  8. {
  9. "name": "daft",
  10. "source": "./",
  11. "description": "Skills for working with Daft: UDF tuning, distributed scaling, and docs navigation",
  12. "version": "0.1.0"
  13. }
  14. ]
  15. }
README.rst · README · 135 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

  1. |Banner|
  2. |CI| |PyPI| |Latest Tag| |Coverage| |Slack|
  3. `Website <https://www.daft.ai>`_ • `Docs <https://docs.daft.ai>`_ • `Installation <https://docs.daft.ai/en/stable/install/>`_ • `Daft Quickstart <https://docs.daft.ai/en/stable/quickstart/>`_ • `Community and Support <https://github.com/Eventual-Inc/Daft/discussions>`_
  4. Daft: High-Performance Data Engine for AI and Multimodal Workloads
  5. ==================================================================
  6. |TrendShift|
  7. `Daft <https://www.daft.ai>`_ is a high-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale.
  8. * **Native multimodal processing:** Process images, audio, video, and embeddings alongside structured data in a single framework
  9. * **Built-in AI operations:** Run LLM prompts, generate embeddings, and classify data at scale using OpenAI, Transformers, or custom models
  10. * **Python-native, Rust-powered:** Skip the JVM complexity with Python at its core and Rust under the hood for blazing performance
  11. * **Seamless scaling:** Start local, scale to distributed clusters on `Ray <https://docs.daft.ai/en/stable/distributed/ray/>`_, `Kubernetes <https://docs.daft.ai/en/stable/distributed/kubernetes/>`_
  12. * **Universal connectivity:** Access data anywhere (S3, GCS, Iceberg, Delta Lake, Hugging Face, Unity Catalog)
  13. * **Out-of-box reliability:** Intelligent memory management and sensible defaults eliminate configuration headaches
  14. Getting Started
  15. ---------------
  16. Installation
  17. ^^^^^^^^^^^^
  18. Install Daft with ``pip install daft``. Requires Python 3.10 or higher.
  19. For more advanced installations (e.g. installing from source or with extra dependencies such as Ray and AWS utilities), please see our `Installation Guide <https://docs.daft.ai/en/stable/install/>`_
  20. Quickstart
  21. ^^^^^^^^^^
  22. Get started in minutes with our `Quickstart <https://docs.daft.ai/en/stable/quickstart/>`_ - load a real-world e-commerce dataset, process product images, and run AI inference at scale.
  23. More Resources
  24. ^^^^^^^^^^^^^^
  25. * `Examples <https://docs.daft.ai/en/stable/examples/>`_ - see Daft in action with use cases across text, images, audio, and more
  26. * `User Guide <https://docs.daft.ai/en/stable/>`_ - take a deep-dive into each topic within Daft
  27. * `API Reference <https://docs.daft.ai/en/stable/api/>`_ - API reference for public classes/functions of Daft
  28. Benchmarks
  29. ----------
  30. |Benchmark Image|
  31. To see the full benchmarks, detailed setup, and logs, check out our `benchmarking page. <https://docs.daft.ai/en/stable/benchmarks>`_
  32. Contributing
  33. ------------
  34. We ❤️ developers! To start contributing to Daft, please read `CONTRIBUTING.md <https://github.com/Eventual-Inc/Daft/blob/main/CONTRIBUTING.md>`_. This document describes the development lifecycle and toolchain for working on Daft. It also details how to add new functionality to the core engine and expose it through a Python API.
  35. Here's a list of `good first issues <https://github.com/Eventual-Inc/Daft/issues?q=is%3Aopen+is%3Aissue+label%3A%22good+first+issue%22>`_ to get yourself warmed up with Daft. Comment in the issue to pick it up, and feel free to ask any questions!
  36. Telemetry
  37. ---------
  38. To help improve Daft, we collect non-identifiable data via Scarf (https://scarf.sh).
  39. To disable this behavior, set the environment variable ``DO_NOT_TRACK=true``.
  40. The data that we collect is:
  41. 1. **Non-identifiable:** No session IDs or user identifiers are collected
  42. 2. **Metadata-only:** We do not collect any of our users’ proprietary code or data
  43. 3. **For development only:** We do not buy or sell any user data
  44. Please see our `documentation <https://docs.daft.ai/en/stable/telemetry/>`_ for more details.
  45. .. image:: https://static.scarf.sh/a.png?x-pxid=31f8d5ba-7e09-4d75-8895-5252bbf06cf6
  46. Related Projects
  47. ----------------
  48. +---------------------------------------------------+-----------------+---------------+-------------+-----------------+-----------------------------+-------------+
  49. | Engine | Query Optimizer | Multimodal | Distributed | Arrow Backed | Vectorized Execution Engine | Out-of-core |
  50. +===================================================+=================+===============+=============+=================+=============================+=============+
  51. | Daft | Yes | Yes | Yes | Yes | Yes | Yes |
  52. +---------------------------------------------------+-----------------+---------------+-------------+-----------------+-----------------------------+-------------+
  53. | `Pandas <https://github.com/pandas-dev/pandas>`_ | No | Python object | No | optional >= 2.0 | Some(Numpy) | No |
  54. +---------------------------------------------------+-----------------+---------------+-------------+-----------------+-----------------------------+-------------+
  55. | `Polars <https://github.com/pola-rs/polars>`_ | Yes | Python object | No | Yes | Yes | Yes |
  56. +---------------------------------------------------+-----------------+---------------+-------------+-----------------+-----------------------------+-------------+
  57. | `Modin <https://github.com/modin-project/modin>`_ | Yes | Python object | Yes | No | Some(Pandas) | Yes |
  58. +---------------------------------------------------+-----------------+---------------+-------------+-----------------+-----------------------------+-------------+
  59. | `Ray Data <https://github.com/ray-project/ray>`_ | No | Yes | Yes | Yes | Some(PyArrow) | Yes |
  60. +---------------------------------------------------+-----------------+---------------+-------------+-----------------+-----------------------------+-------------+
  61. | `PySpark <https://github.com/apache/spark>`_ | Yes | No | Yes | Pandas UDF/IO | Pandas UDF | Yes |
  62. +---------------------------------------------------+-----------------+---------------+-------------+-----------------+-----------------------------+-------------+
  63. | `Dask DF <https://github.com/dask/dask>`_ | No | Python object | Yes | No | Some(Pandas) | Yes |
  64. +---------------------------------------------------+-----------------+---------------+-------------+-----------------+-----------------------------+-------------+
  65. License
  66. -------
  67. Daft has an Apache 2.0 license - please see the LICENSE file.
  68. .. |Quickstart Image| image:: https://github.com/Eventual-Inc/Daft/assets/17691182/dea2f515-9739-4f3e-ac58-cd96d51e44a8
  69. :alt: Dataframe code to load a folder of images from AWS S3 and create thumbnails
  70. :height: 256
  71. .. |Benchmark Image| image:: https://raw.githubusercontent.com/Eventual-Inc/Daft/refs/heads/main/assets/benchmark.png
  72. :alt: AI Benchmarks
  73. .. |Banner| image:: https://daft.ai/images/diagram.png
  74. :target: https://www.daft.ai
  75. :alt: Daft dataframes can load any data such as PDF documents, images, protobufs, csv, parquet and audio files into a table dataframe structure for easy querying
  76. .. |CI| image:: https://github.com/Eventual-Inc/Daft/actions/workflows/pr-test-suite.yml/badge.svg
  77. :target: https://github.com/Eventual-Inc/Daft/actions/workflows/pr-test-suite.yml?query=branch:main
  78. :alt: GitHub Actions tests
  79. .. |PyPI| image:: https://img.shields.io/pypi/v/daft.svg?label=pip&logo=PyPI&logoColor=white
  80. :target: https://pypi.org/project/daft
  81. :alt: PyPI
  82. .. |Latest Tag| image:: https://img.shields.io/github/v/tag/Eventual-Inc/Daft?label=latest&logo=GitHub
  83. :target: https://github.com/Eventual-Inc/Daft/tags
  84. :alt: latest tag
  85. .. |Coverage| image:: https://codecov.io/gh/Eventual-Inc/Daft/branch/main/graph/badge.svg?token=J430QVFE89
  86. :target: https://codecov.io/gh/Eventual-Inc/Daft
  87. :alt: Coverage
  88. .. |Slack| image:: https://img.shields.io/badge/slack-@distdata-purple.svg?logo=slack
  89. :target: https://daft.ai/slack
  90. :alt: slack community
  91. .. |TrendShift| image:: https://trendshift.io/api/badge/repositories/8239
  92. :target: https://trendshift.io/repositories/8239
  93. :alt: Eventual-Inc/Daft | Trendshift
  94. :width: 250px
  95. :height: 55px

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.