BeClaude

databricks-ai-dev-kit

New
1.6kCommunity RegistryData & Analyticsby Databricks Solutions

Databricks development toolkit with 19 skills and MCP tools for direct Databricks operations

Community PluginView Source

Overview

<p align="center"> <img src="https://img.shields.io/badge/Databricks-Certified%20Gold%20Project-FFD700?style=for-the-badge&logo=databricks&logoColor=black" alt="Databricks Certified Gold Project"> </p>


🔒 Proactive Dependency Security

As part of our commitment to supply chain integrity, we continually monitor our dependency tree against known vulnerabilities and industry advisories. In response to a recently disclosed supply chain incident affecting litellm versions 1.82.7–1.82.8, we have audited our packages and removed the litellm dependency for most usage. It is solely used in the test directory for skills evaluation and optimization, and has been pinned to a safe version.

For full third-party attribution, see NOTICE.txt.


AI-Assisted Development on Databricks

Databricks offers two paths for AI-assisted coding. Choose the one that matches your environment.

<table> <tr> <td width="50%" align="center" valign="top">

<br>

<img src="https://img.shields.io/badge/Genie_Code-1B3139?style=for-the-badge&logo=databricks&logoColor=FF3621" alt="Genie Code" height="42">

<br><br>

Free, first-party AI coding inside Databricks

Built into every Databricks workspace at no extra cost, with deep native product context — your notebooks, jobs, and Unity Catalog data are already in scope. Ideal for users who have not started using AI-driven development tools or that are comfortable in Databricks.

</td> <td width="50%" align="center" valign="top">

<br>

<img src="https://img.shields.io/badge/AI_Dev_Kit-FF3621?style=for-the-badge&logo=databricks&logoColor=white" alt="AI Dev Kit" height="42">

<br><br>

Databricks expertise, in the editor you already use

Curated by Databricks field experts. Brings the patterns, skills, and 75+ executable tools your AI assistant needs to build on Databricks — wherever you're already coding.

<br>

<img src="https://img.shields.io/badge/Claude_Code-D97757?style=flat-square&logo=anthropic&logoColor=white" alt="Claude Code"> <img src="https://img.shields.io/badge/Cursor-000000?style=flat-square&logo=cursor&logoColor=white" alt="Cursor"> <img src="https://img.shields.io/badge/Codex-412991?style=flat-square&logo=openai&logoColor=white" alt="Codex"> <img src="https://img.shields.io/badge/Gemini-1B72E8?style=flat-square&logo=googlegemini&logoColor=white" alt="Gemini CLI"> <img src="https://img.shields.io/badge/Copilot-000000?style=flat-square&logo=github&logoColor=white" alt="GitHub Copilot"> <br> <sub>+ Antigravity · Windsurf · OpenCode · and more!</sub>

</td> </tr> <tr> <td align="center">

<a href="https://docs.databricks.com/aws/en/genie-code/"><img src="https://img.shields.io/badge/Learn_more-→-1B3139?style=for-the-badge" alt="Learn more" height="36"></a>

<br>

</td> <td align="center">

<a href="#install-in-existing-project"><img src="https://img.shields.io/badge/Get_started-→-FF3621?style=for-the-badge" alt="Get started" height="36"></a>

<br>

</td> </tr> </table>


What Can I Build?

  • Spark Declarative Pipelines (streaming tables, CDC, SCD Type 2, Auto Loader)
  • Databricks Jobs (scheduled workflows, multi-task DAGs)
  • AI/BI Dashboards (visualizations, KPIs, analytics)
  • Unity Catalog (tables, volumes, governance)
  • Genie Spaces (natural language data exploration)
  • Knowledge Assistants (RAG-based document Q&A)
  • MLflow Experiments (evaluation, scoring, traces)
  • Model Serving (deploy ML models and AI agents to endpoints)
  • Databricks Apps (full-stack web applications with foundation model integration)
  • ...and more

Choose Your Own Adventure

AdventureBest ForStart Here
:star: **Install AI Dev Kit**Start here! Follow quick install instructions to add to your existing project folderQuick Start (install)
**Visual Builder App**Web-based UI for Databricks developmentdatabricks-builder-app/
**Builder App + Genie Code MCP**Builder UI + MCP server for Genie Code in one deploymentdeploy.sh --enable-mcp
**Core Library**Building custom integrations (LangChain, OpenAI, etc.)pip install
**Skills Only**Provide Databricks patterns and best practices (without MCP functions)Install skills
**Genie Code Skills**Install skills into your workspace for Genie Code (--install-to-genie)Genie Code skills (install)
**MCP Tools Only**Just executable actions (no guidance)Register MCP server

Quick Start

Prerequisites

  • uv - Python package manager
  • Databricks CLI - Command line interface for Databricks
  • AI coding environment (one or more):

- Claude Code - Cursor - Gemini CLI - Antigravity - Codex - Copilot - Windsurf - OpenCode - Kiro

Install in existing project

By default this will install at a project level rather than a user level. This is often a good fit, but requires you to run your client from the exact directory that was used for the install. _Note: Project configuration files can be re-used in other projects. You find these configs under .claude, .cursor, .gemini, .codex, .github, .agents, .windsurf, .codeium, .opencode, .kiro, or opencode.json_

Basic installation (uses DEFAULT profile, project scope)

bash
bash <(curl -sL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.sh)

<details> <summary><strong>Advanced Options</strong> (click to expand)</summary>

Global installation with force reinstall

bash
bash <(curl -sL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.sh) --global --force

Specify profile and force reinstall

bash
bash <(curl -sL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.sh) --profile DEFAULT --force

Install for specific tools only

bash
bash <(curl -sL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.sh) --tools cursor,gemini,antigravity,windsurf,opencode

</details>

Next steps: Respond to interactive prompts and follow the on-screen instructions.

  • Note: Cursor and Copilot require updating settings manually after install.

Basic installation (uses DEFAULT profile, project scope)

powershell
irm https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.ps1 | iex

<details> <summary><strong>Advanced Options</strong> (click to expand)</summary>

Download script first

powershell
irm https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/install.ps1 -OutFile install.ps1

Global installation with force reinstall

powershell
.\install.ps1 -Global -Force

Specify profile and force reinstall

powershell
.\install.ps1 -Profile DEFAULT -Force

Install for specific tools only

powershell
.\install.ps1 -Tools cursor,gemini,antigravity

</details>

Next steps: Respond to interactive prompts and follow the on-screen instructions.

  • Note: Cursor and Copilot require updating settings manually after install.

Visual Builder App

Full-stack web application with chat UI for Databricks development. Deploys a Lakebase database and Databricks App with a single command:

bash
cd ai-dev-kit/databricks-builder-app

# Deploy everything (Lakebase + app + permissions)
./scripts/deploy.sh my-builder-app --profile <your-profile>

# Deploy with MCP Gateway for Genie Code (name must start with mcp-)
./scripts/deploy.sh mcp-builder-app --enable-mcp --profile <your-profile>

With --enable-mcp, the app also serves as an MCP server at /mcp, exposing all 75+ Databricks tools to Genie Code, AI Playground, and other MCP clients. The builder UI and MCP server run in a single deployment.

For local development:

bash
./scripts/setup.sh        # Install dependencies
# Edit .env.local with your credentials
./scripts/start_dev.sh    # Start locally at http://localhost:3000

See `databricks-builder-app/` for full documentation.

Core Library

Use databricks-tools-core directly in your Python projects:

python
from databricks_tools_core.sql import execute_sql

results = execute_sql("SELECT * FROM my_catalog.schema.table LIMIT 10")

Works with LangChain, OpenAI Agents SDK, or any Python framework. See databricks-tools-core/ for details.


Genie Code Skills

Install skills into ./.claude/skills (relative to the directory where you run the script), then upload them to your workspace at /Workspace/Users/<you>/.assistant/skills so Genie Code can use them in the UI. Requires the Databricks CLI authenticated for your workspace.

Always run from the project directory where you want .claude/skills created (for example your repo root or ai-dev-kit).

From this repo (recommended if you have a clone):

bash
# Databricks skills from this checkout + upload (DEFAULT CLI profile)
./databricks-skills/install_skills.sh --local --install-to-genie

# Download all skills from GitHub, then upload
./databricks-skills/install_skills.sh --install-to-genie

# Explicit Databricks CLI profile
./databricks-skills/install_skills.sh --install-to-genie --profile YOUR_PROFILE

Without cloning (run from the directory that should contain .claude/skills):

bash
curl -sSL https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/databricks-skills/install_skills.sh | bash -s -- --install-to-genie

Combine --profile, --local, specific skill names, --mlflow-version, etc. as needed; see ./databricks-skills/install_skills.sh --help or databricks-skills/README.md.

From a Databricks notebook (no local terminal needed):

Import `databricks-skills/install_genie_code_skills.py` into your workspace as a notebook and run it. It downloads skills from GitHub and uploads them to your workspace using the Databricks SDK. This works on any compute, including serverless.

Skill modification or Custom Skill

After the script successfully installs the skills to your workspace, you may find the skills under /Workspace/Users/<your_user_name>/.assistant/skills.

This directory is customizable if you wish to only use certain skills or even create custom skills that are related to your organization to make Genie Code even better. You can modify/remove existing skills or create new skills folders that Genie Code will automatically use in any session.

Architecture

The AI Dev Kit ships as four composable pieces — install the whole kit, or pick just the parts you need.

<p align="center"> <img src="databricks-tools-core/docs/architecture.svg" alt="Architecture" width="700"> </p>

What's Included

ComponentDescription
`databricks-tools-core/`Python library with high-level Databricks functions
`databricks-mcp-server/`MCP server exposing 50+ tools for AI assistants
`databricks-skills/`20 markdown skills teaching Databricks patterns
`databricks-builder-app/`Full-stack web app with Claude Code integration

Star History

<a href="https://star-history.com/#databricks-solutions/ai-dev-kit&Date"> <picture> <source media="(prefers-color-scheme: dark)" srcset="https://api.star-history.com/svg?repos=databricks-solutions/ai-dev-kit&type=Date&theme=dark" /> <source media="(prefers-color-scheme: light)" srcset="https://api.star-history.com/svg?repos=databricks-solutions/ai-dev-kit&type=Date" /> <img alt="Star History Chart" src="https://api.star-history.com/svg?repos=databricks-solutions/ai-dev-kit&type=Date" /> </picture> </a>


License

(c) 2026 Databricks, Inc. All rights reserved.

The source in this project is provided subject to the Databricks License. See LICENSE.md for details.

<details> <summary><strong>Third-Party Licenses</strong></summary>

PackageVersionLicenseProject URL
fastmcp≥0.1.0MIThttps://github.com/jlowin/fastmcp
mcp≥1.0.0MIThttps://github.com/modelcontextprotocol/python-sdk
sqlglot≥20.0.0MIThttps://github.com/tobymao/sqlglot
sqlfluff≥3.0.0MIThttps://github.com/sqlfluff/sqlfluff
plutoprint==0.19.0MIThttps://github.com/plutoprint/plutoprint
claude-agent-sdk≥0.1.19MIThttps://github.com/anthropics/claude-code
fastapi≥0.115.8MIThttps://github.com/fastapi/fastapi
uvicorn≥0.34.0BSD-3-Clausehttps://github.com/encode/uvicorn
httpx≥0.28.0BSD-3-Clausehttps://github.com/encode/httpx
sqlalchemy≥2.0.41MIThttps://github.com/sqlalchemy/sqlalchemy
alembic≥1.16.1MIThttps://github.com/sqlalchemy/alembic
asyncpg≥0.30.0Apache-2.0https://github.com/MagicStack/asyncpg
greenlet≥3.0.0MIThttps://github.com/python-greenlet/greenlet
psycopg2-binary≥2.9.11LGPL-3.0https://github.com/psycopg/psycopg2

</details>


<details> <summary><strong>Acknowledgments</strong></summary>

MCP Databricks Command Execution API from databricks-exec-code by Natyra Bajraktari and Henryk Borzymowski.

</details>

Install & Usage

1
Create the skills directory
mkdir -p .claude/skills
2
Download the skill file
mkdir -p .claude/skills && curl -o .claude/skills/databricks-ai-dev-kit.md https://raw.githubusercontent.com/databricks-solutions/ai-dev-kit/main/SKILL.md
3
Invoke in Claude Code
/databricks-ai-dev-kit
View source on GitHub
mcp

Frequently Asked Questions

What is databricks-ai-dev-kit?

Databricks development toolkit with 19 skills and MCP tools for direct Databricks operations

How to install databricks-ai-dev-kit?

To install databricks-ai-dev-kit, create the .claude/skills directory in your project, then run the curl command to download the skill file. Once installed, invoke it in Claude Code with /databricks-ai-dev-kit.

What is databricks-ai-dev-kit best for?

databricks-ai-dev-kit is a community categorized under Data & Analytics. It is designed for: mcp. Created by Databricks Solutions.