# Dataflint for Spark

## Dataflint for Spark

- [Welcome to DataFlint](https://dataflint.gitbook.io/dataflint-for-spark/welcome-to-dataflint.md)
- [Our Features](https://dataflint.gitbook.io/dataflint-for-spark/overview/our-features.md)
- [How It Works](https://dataflint.gitbook.io/dataflint-for-spark/overview/how-it-works.md)
- [Security & Stability](https://dataflint.gitbook.io/dataflint-for-spark/overview/security-and-stability.md)
- [Supported Versions](https://dataflint.gitbook.io/dataflint-for-spark/overview/supported-versions.md)
- [Release Notes](https://dataflint.gitbook.io/dataflint-for-spark/overview/release-notes.md)
- [Install on Spark](https://dataflint.gitbook.io/dataflint-for-spark/getting-started/install-on-spark.md)
- [Install on DataBricks](https://dataflint.gitbook.io/dataflint-for-spark/getting-started/install-on-databricks.md)
- [Install on Spark History Server](https://dataflint.gitbook.io/dataflint-for-spark/getting-started/install-on-spark-history-server.md)
- [Usage](https://dataflint.gitbook.io/dataflint-for-spark/getting-started/usage.md)
- [Databricks](https://dataflint.gitbook.io/dataflint-for-spark/integrations/databricks.md): DataFlint Integration with Databricks
- [Spark Instrumentation](https://dataflint.gitbook.io/dataflint-for-spark/integrations/spark-instrumentation.md): Optional, opt-in instrumentation that adds extra metrics and metadata to Spark UI.
- [PySpark UDF instrumentation](https://dataflint.gitbook.io/dataflint-for-spark/integrations/spark-instrumentation/pyspark-udf-instrumentation.md)
- [window instrumentation](https://dataflint.gitbook.io/dataflint-for-spark/integrations/spark-instrumentation/window-instrumentation.md)
- [SQL nodes instrumentation](https://dataflint.gitbook.io/dataflint-for-spark/integrations/spark-instrumentation/sql-nodes-instrumentation.md): Optional instrumentation for core Spark SQL physical plan nodes.
- [Delta Lake Integration](https://dataflint.gitbook.io/dataflint-for-spark/integrations/delta-lake-integration.md)
- [Apache Iceberg](https://dataflint.gitbook.io/dataflint-for-spark/integrations/apache-iceberg.md)
- [DCU calculation](https://dataflint.gitbook.io/dataflint-for-spark/advanced/dcu-calculation.md)
- [Alerts](https://dataflint.gitbook.io/dataflint-for-spark/advanced/alerts.md)
- [Analyze Your Job in Claude Code](https://dataflint.gitbook.io/dataflint-for-spark/dataflint-analyze-your-job/analyze-your-job-in-claude-code.md)
- [Analyze Your Job in Cursor](https://dataflint.gitbook.io/dataflint-for-spark/dataflint-analyze-your-job/analyze-your-job-in-cursor.md)
- [SaaS Security & Stability](https://dataflint.gitbook.io/dataflint-for-spark/saas-platform/saas-security-and-stability.md)
- [Databricks SaaS installation](https://dataflint.gitbook.io/dataflint-for-spark/saas-platform/databricks-saas-installation.md)
- [EMR SaaS Installation](https://dataflint.gitbook.io/dataflint-for-spark/saas-platform/emr-saas-installation.md)
- [DataProc SaaS Installation](https://dataflint.gitbook.io/dataflint-for-spark/saas-platform/dataproc-saas-installation.md)
- [Spark on K8s SaaS Installation](https://dataflint.gitbook.io/dataflint-for-spark/saas-platform/spark-on-k8s-saas-installation.md)
- [DataFlint Copilot](https://dataflint.gitbook.io/dataflint-for-spark/dataflint-copilot/dataflint-copilot.md)
- [Copilot in Claude Desktop](https://dataflint.gitbook.io/dataflint-for-spark/dataflint-copilot/copilot-in-claude-desktop.md): Learn how to install the DataFlint MCP server in Claude Desktop to enable AI-powered Spark optimization directly in your conversations with Claude
- [Copilot in Claude Code](https://dataflint.gitbook.io/dataflint-for-spark/dataflint-copilot/copilot-in-claude-code.md): Learn how to install the DataFlint MCP server in Claude Code to enable AI-powered Spark optimization directly in your terminal
- [Copilot in Cursor](https://dataflint.gitbook.io/dataflint-for-spark/dataflint-copilot/copilot-in-cursor.md)
- [Copilot in InteliJi](https://dataflint.gitbook.io/dataflint-for-spark/dataflint-copilot/copilot-in-inteliji.md): Learn how to install the DataFlint MCP server in IntelliJ IDEA to enable AI-powered Spark optimization directly in your IDE
- [Copilot Usage](https://dataflint.gitbook.io/dataflint-for-spark/dataflint-copilot/copilot-usage.md)
- [BYOC Customer Onboarding](https://dataflint.gitbook.io/dataflint-for-spark/byoc-bring-your-own-account/byoc-customer-onboarding.md)


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information, you can query the documentation dynamically by asking a question.
Perform an HTTP GET request on a page URL with the `ask` query parameter:
```
GET https://dataflint.gitbook.io/dataflint-for-spark/welcome-to-dataflint.md?ask=<question>
```
The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.
Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.