Source profileQuality 90/100

MicrosoftDocs/Agent-Skills/skills/azure-databricks/SKILL.md

azure-databricks

Expert knowledge for Azure Databricks development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when working with Unity Catalog, Lakehouse/Lakeflow, MLflow/Model Serving, Lakebase, or Genie/AI agents, and other Azure Databricks related development tasks. Not for Azure Synapse Analytics (use azure-synapse-analytics), Azure HDInsight (use azure-hdinsight), Azu

Source repository stars
717
Declared platforms
0
Static risk flags
1
Last source update
2026-08-17
Source checked
2026-08-25

Decision brief

What it does: where it fits

This skill provides expert guidance for Azure Databricks. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content…

Best for

  • Use when working with Unity Catalog, Lakehouse/Lakeflow, MLflow/Model Serving, Lakebase, or Genie/AI agents, and other Azure Databricks related development tasks.

Not for

  • Tasks that require unconfirmed production actions or broad system permissions.
  • Environments where the pinned source and install steps cannot be inspected.

Compatibility matrix

Platform support, with evidence labels

PlatformStatusEvidenceWhat to check
CodexNot declaredNo explicit evidencePortability before use
Claude CodeNot declaredNo explicit evidencePortability before use
CursorNot declaredNo explicit evidencePortability before use
Gemini CLINot declaredNo explicit evidencePortability before use
Open the compatibility checker

Installation

Inspect first. Install second.

The source command is displayed only when detected. A safe inspection prompt is always available so your agent can explain every action before execution.

Source-detected install commandSource
npx skills add https://github.com/MicrosoftDocs/Agent-Skills --skill "skills/azure-databricks"
Safe inspection promptEditorial

Inspect the Agent Skill "azure-databricks" from https://github.com/MicrosoftDocs/Agent-Skills/blob/c579bb4b37e7969ffc8bc071ca0f53048c3bfe41/skills/azure-databricks/SKILL.md at commit c579bb4b37e7969ffc8bc071ca0f53048c3bfe41. List every install step, command, network request, credential, file read/write, external action, and rollback step. Explain whether it fits my task. Do not install or execute anything until I approve.

Workflow

What the source asks the agent to do

  1. 01

    How to Use This Skill

    IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use readfile with the specified lines. For categories with file links (e.g., security.md), use readfile on the linked reference file

    Preferred: Use mcpmicrosoftdocs:microsoftdocsfetch with query string from=learn-agent-skill. Returns Markdown.Fallback: Use fetchwebpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use readfile with the specified lines. For categories with file links (e.g., security.md),…
  2. 02

    Category Index

    Review the “Category Index” section in the pinned source before continuing.

    Review and apply the “Category Index” source section.
  3. 03

    Troubleshooting

    Review the “Troubleshooting” section in the pinned source before continuing.

    Review and apply the “Troubleshooting” source section.
  4. 04

    Best Practices

    Review the “Best Practices” section in the pinned source before continuing.

    Review and apply the “Best Practices” source section.
  5. 05

    Decision Making

    Review the “Decision Making” section in the pinned source before continuing.

    Review and apply the “Decision Making” source section.

Permission review

Static risk signals and limitations

Network access

medium · line 183

The documentation includes network, browsing, or remote request actions.

| Load test Databricks AI Search endpoints for sizing | https://learn.microsoft.com/en-us/azure/databricks/ai-search/endpoint-load-test |

Network access

medium · line 367

The documentation includes network, browsing, or remote request actions.

| Download internet data into Azure Databricks volumes | https://learn.microsoft.com/en-us/azure/databricks/volumes/download-internet-files |

Evidence record

Why each signal appears

EvidenceSourceComputedTestedEditorial
SignalValueEvidence typeMeaning
Quality score90/100ComputedDocumentation, specificity, maintenance, and trust rules
Repository stars717SourceRepository attention, not individual Skill quality
Compatibility0 platformsSourceDeclared in the catalog source record
Usage guideautomated source guideEditorialGenerated or reviewed according to the visible evidence level

Pinned source

Provenance and original SKILL.md

Repository
MicrosoftDocs/Agent-Skills
Skill path
skills/azure-databricks/SKILL.md
Commit
c579bb4b37e7969ffc8bc071ca0f53048c3bfe41
License
CC-BY-4.0
Collected
2026-08-25
Default branch
main
View the original SKILL.md

Azure Databricks Skill

This skill provides expert guidance for Azure Databricks. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

  • Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
  • Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.

Category Index

CategoryLocationDescription
TroubleshootingL37-L171Diagnosing and fixing Databricks errors and failures across compute, Spark/SQL, connectors, Lakeflow, ML/serving, Feature Store, and Unity Catalog, including logs, performance, and parsing issues.
Best PracticesL172-L376Best practices for Databricks architecture, performance, cost, governance, streaming, Lakehouse/RAG/AI apps, Lakeflow, ML/GenAI observability, and production operations across Azure Databricks.
Decision MakingL377-L481Guidance on choosing Azure Databricks tiers, compute, runtimes, networking, and AI/ML options, plus detailed migration plans for Unity Catalog, Lakehouse, Lakeflow, MLflow, and external integrations.
Architecture & Design Patternsarchitecture-patterns.mdArchitectural blueprints and patterns for Databricks: DR/HA, networking, storage, medallion/Delta design, streaming and Lakeflow, AI/agent systems, MLOps, security, and dashboard/data modeling.
Limits & Quotaslimits-quotas.mdQuotas, limits, and constraints for Databricks compute, AI/GenAI, Lakeflow pipelines, connectors, SQL features, Unity Catalog, Lakebase, and related performance, timeout, and scaling behaviors.
Securitysecurity.mdIdentity, access, encryption, networking, compliance, and governance for Azure Databricks and Lakebase, including Unity Catalog, RBAC/ABAC, OAuth, secrets, Private Link, and secure external integrations.
Configurationconfiguration.mdConfiguring every aspect of Azure Databricks: accounts, security, networking, compute, Lakehouse/Lakeflow, AI/ML/GenAI, Unity Catalog, connectors, SQL behavior, bundles, apps, and observability.
Integrations & Coding Patternsintegrations.mdPatterns and APIs for integrating Databricks with external systems, tools, and LLMs: connectors, federation, streaming, AI/ML, MLflow, Lakeflow, Lakebase, Genie, SDKs, SQL/PySpark UDFs, and CLI/Terraform.
Deploymentdeployment.mdDeploying and migrating Azure Databricks workspaces, apps, agents, pipelines, and dashboards using IaC, CI/CD, Model Serving, Lakeflow, Unity Catalog, and various Azure/GitHub/Jenkins tools.

Troubleshooting

TopicURL
Interpret Azure Databricks diagnostic audit log eventshttps://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/audit-logs
Troubleshoot Databricks MLflow Agent Evaluation issueshttps://learn.microsoft.com/en-us/azure/databricks/agents/agent-evaluation/troubleshooting
Debug custom code agents on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/agents/custom-agents/debug-agent
Troubleshoot Azure Databricks compute startup issueshttps://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/
Diagnose Azure Databricks classic compute termination errorshttps://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/cluster-error-codes
Debug Spark applications using Databricks Spark UIhttps://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/debugging-spark-ui
Troubleshoot file events for Unity Catalog external locationshttps://learn.microsoft.com/en-us/azure/databricks/connect/unity-catalog/cloud-storage/file-events-faq
Troubleshoot common Databricks CLI issueshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/troubleshooting
Diagnose and fix Databricks Connect Python issueshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/troubleshooting
Diagnose and fix Databricks Connect Scala issueshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/troubleshooting
Troubleshoot common Databricks Terraform provider errorshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/terraform/troubleshoot
Troubleshoot common Databricks IDE extension errorshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/troubleshooting
Resolve ARITHMETIC_OVERFLOW errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/arithmetic-overflow-error-class
Handle CAST_INVALID_INPUT errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/cast-invalid-input-error-class
Diagnose DC_GA4_RAW_DATA_ERROR in GA4 connectorhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-ga4-raw-data-error-error-class
Understand DC_SFDC_API_ERROR in Databricks connectorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sfdc-api-error-error-class
Diagnose DC_SQLSERVER_ERROR in SQL Server connectorhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sqlserver-error-error-class
Understand DELTA_ICEBERG_COMPAT_V1_VIOLATION errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/delta-iceberg-compat-v1-violation-error-class
Resolve DIVIDE_BY_ZERO error in Azure Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/divide-by-zero-error-class
Interpret Azure Databricks error condition stringshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/error-classes
Fix EWKB_PARSE_ERROR geometry parsing issueshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/ewkb-parse-error-error-class
Fix EWKT_PARSE_ERROR geometry parsing issueshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/ewkt-parse-error-error-class
Resolve GEOJSON_PARSE_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/geojson-parse-error-error-class
Address GROUP_BY_AGGREGATE errors in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/group-by-aggregate-error-class
Handle H3_INVALID_CELL_ID errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-cell-id-error-class
Interpret and resolve H3_INVALID_GRID_DISTANCE_VALUE in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-grid-distance-value-error-class
Handle H3_INVALID_RESOLUTION_VALUE errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-resolution-value-error-class
Resolve H3_NOT_ENABLED errors and tier requirementshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-not-enabled-error-class
Fix INSUFFICIENT_TABLE_PROPERTY errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/insufficient-table-property-error-class
Troubleshoot INVALID_ARRAY_INDEX errors in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-error-class
Troubleshoot INVALID_ARRAY_INDEX_IN_ELEMENT_AT in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-in-element-at-error-class
Resolve MISSING_AGGREGATION errors in Databricks querieshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/missing-aggregation-error-class
Diagnose ROW_COLUMN_ACCESS errors for filters and maskshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/row-column-access-error-class
Map Azure Databricks errors to SQLSTATE codeshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/sqlstates
Fix TABLE_OR_VIEW_NOT_FOUND errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/table-or-view-not-found-error-class
Resolve UNRESOLVED_ROUTINE function resolution errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/unresolved-routine-error-class
Understand UNSUPPORTED_TABLE_OPERATION errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-table-operation-error-class
Understand UNSUPPORTED_VIEW_OPERATION errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-view-operation-error-class
Troubleshoot WKB_PARSE_ERROR for geometry parsinghttps://learn.microsoft.com/en-us/azure/databricks/error-messages/wkb-parse-error-error-class
Troubleshoot WKT_PARSE_ERROR for geometry parsinghttps://learn.microsoft.com/en-us/azure/databricks/error-messages/wkt-parse-error-error-class
Troubleshoot common Genie Agent issueshttps://learn.microsoft.com/en-us/azure/databricks/genie-agents/troubleshooting
Monitor and troubleshoot Auto Loader ingestion pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/observability
Troubleshoot Databricks Aha! ingestion connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/aha-troubleshoot
Troubleshoot Databricks Amplitude connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/amplitude-troubleshoot
Troubleshoot Databricks Anthropic connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/anthropic-troubleshoot
Resolve common Confluence connector ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-faq
Resolve common Databricks Confluence connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-troubleshoot
Troubleshoot Dynamics 365 ingestion pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/d365-troubleshoot
Resolve common issues with Lakeflow managed connectorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/faq
Troubleshoot Databricks Gmail ingestion connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/gmail-troubleshoot
Troubleshoot Google Ads Lakeflow connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-ads-troubleshoot
Troubleshoot Google Analytics Raw Data ingestionhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-analytics-troubleshoot
Troubleshoot Databricks Google Drive connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-drive-faq
Troubleshoot Databricks Google Drive ingestion failureshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-drive-troubleshoot
Troubleshoot Databricks Google Search Console connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-search-console-troubleshoot
Troubleshoot HubSpot Lakeflow connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/hubspot-troubleshoot
Resolve common Azure Databricks Jira connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/jira-faq
Diagnose and fix Jira Lakeflow Connect issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/jira-troubleshoot
Troubleshoot Databricks Kafka connector ingestion errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/kafka-troubleshoot
Troubleshoot Databricks Marketo connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/marketo-troubleshoot
Troubleshoot Meta Ads ingestion connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/meta-ads-troubleshoot
Troubleshoot Monday.com Lakeflow Connect ingestion errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/monday-com-troubleshoot
Troubleshoot MySQL ingestion issues in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql-troubleshoot
Troubleshoot Netskope Logs Lakeflow Connect errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/netskope-logs-troubleshoot
Troubleshoot Databricks Notion connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/notion-troubleshoot
Resolve common issues with the Databricks OpenAI connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/openai-faq
Troubleshoot Databricks Lakeflow OpenAI connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/openai-troubleshoot
Troubleshoot Databricks Oracle CDC ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/oracle-troubleshoot
Troubleshoot Databricks Outlook ingestion connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/outlook-troubleshoot
Troubleshoot Databricks PagerDuty ingestion connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pagerduty-troubleshoot
Troubleshoot Databricks Pendo connector ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pendo-troubleshoot
Troubleshoot PostgreSQL ingestion issues in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-troubleshoot
Troubleshoot Databricks query-based connectorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/query-based-troubleshoot
Resolve Databricks RabbitMQ connector ingestion problemshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/rabbitmq-troubleshoot
Resolve common Reddit Ads connector errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/reddit-ads-troubleshoot
Diagnose and fix Databricks Salesforce ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-troubleshoot
Troubleshoot SendGrid connector errors and rate limitshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sendgrid-troubleshoot
Diagnose and fix Databricks ServiceNow connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/servicenow-troubleshoot
Troubleshoot Salesforce Marketing Cloud connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sfmc-troubleshoot
Resolve common issues with the SharePoint connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sharepoint-faq
Troubleshoot Microsoft SharePoint connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sharepoint-troubleshoot
Troubleshoot Databricks Smartsheet connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/smartsheet-troubleshoot
Answer common SQL Server Lakeflow Connect connector questionshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-faq
Troubleshoot SQL Server ingestion in Lakeflow Connecthttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-troubleshoot
Use SQL Server utility script for Databricks ingestionhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-utility-reference
Troubleshoot Square connector authentication and rate limit errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/square-troubleshoot
Troubleshoot common Strac connector errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/strac-troubleshoot
Troubleshoot TikTok Ads connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/tiktok-ads-troubleshoot
Troubleshoot Databricks Lakeflow managed ingestion pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/troubleshoot
Diagnose and fix UNITY_CATALOG_INITIALIZATION_FAILED in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/uc-initialization-troubleshoot
Troubleshoot Veeva Vault connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/veeva-vault-troubleshoot
Troubleshoot Wiz Audit Logs connector problemshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/wiz-audit-logs-troubleshoot
Troubleshoot Workday HCM connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-hcm-troubleshoot
Troubleshoot Workday Reports ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-reports-troubleshoot
Resolve common issues with the Workiva connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workiva-faq
Troubleshoot Databricks Workiva connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workiva-troubleshoot
Troubleshoot Azure Databricks Zendesk Support connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zendesk-support-troubleshoot
Troubleshoot Databricks Zip connector authentication and rate limitshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zip-troubleshoot
Troubleshoot Zoho Books connector authentication and rate limitshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zoho-books-troubleshoot
Diagnose Zerobus Ingest API errors and handlinghttps://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-errors
Inspect logs for Databricks init script executionhttps://learn.microsoft.com/en-us/azure/databricks/init-scripts/logs
Test and validate Databricks ODBC driver connectionshttps://learn.microsoft.com/en-us/azure/databricks/integrations/odbc/testing
Diagnose and improve Lakeflow Jobs performancehttps://learn.microsoft.com/en-us/azure/databricks/jobs/diagnose-job-performance
Troubleshoot and repair Azure Databricks job failureshttps://learn.microsoft.com/en-us/azure/databricks/jobs/repair-job-failures
Manage and debug Foundation Model Fine-tuning runshttps://learn.microsoft.com/en-us/azure/databricks/large-language-models/foundation-model-training/view-manage-runs
Monitor and troubleshoot Databricks materialized viewshttps://learn.microsoft.com/en-us/azure/databricks/ldp/dbsql/materialized-monitor
Monitor and troubleshoot Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/observability
Recover Lakeflow pipelines from checkpoint failureshttps://learn.microsoft.com/en-us/azure/databricks/ldp/recover-streaming
Inspect and debug Databricks Feature Views in Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/explore-feature-views
Troubleshoot Databricks Feature Store errors and limitshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/troubleshooting-and-limitations
Debug Azure Databricks model serving endpointshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-debug
Diagnose Databricks model serving with Genie Codehttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-genie-code
Use Insights to detect and resolve Lakebase issueshttps://learn.microsoft.com/en-us/azure/databricks/oltp/projects/observability-ai-insights
Diagnose and fix Lakebase Postgres issues with Geniehttps://learn.microsoft.com/en-us/azure/databricks/oltp/projects/observability-genie
Resolve common OpenSharing data access errorshttps://learn.microsoft.com/en-us/azure/databricks/opensharing/troubleshooting
Troubleshoot failing Spark jobs and executors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/failing-spark-jobs
Use Databricks Spark jobs timeline for debugginghttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/jobs-timeline
Diagnose long-running Spark stages in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage
Debug slow low-I/O Spark stages in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/slow-spark-stage-low-io
Identify expensive reads in Spark DAG on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-dag-expensive-read
Diagnose gaps between Spark jobs in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-job-gaps
Diagnose and fix Spark memory issues on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-memory-issues
Diagnose and fix Azure Databricks Partner Connect issueshttps://learn.microsoft.com/en-us/azure/databricks/partner-connect/troubleshoot
Troubleshoot Azure Databricks publishing to Power BIhttps://learn.microsoft.com/en-us/azure/databricks/partners/bi/power-bi/troubleshooting
Retrieve exceptions from terminated StreamingQueryhttps://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/streamingquery/exception
Debug streaming queries with explain planshttps://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/streamingquery/explain
Troubleshoot Databricks Git folder sync errorshttps://learn.microsoft.com/en-us/azure/databricks/repos/errors-troubleshooting
Detect and repair Delta table metadata and file issueshttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-fsck
Use Databricks SQL query history for troubleshootinghttps://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-history
Troubleshoot Databricks SQL queries with profileshttps://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-profile
Inspect and debug Structured Streaming state on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/read-state

Best Practices

TopicURL
Tag Databricks resources for cost attributionhttps://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/usage-detail-tags
Use default Databricks policy families to enforce compute best practiceshttps://learn.microsoft.com/en-us/azure/databricks/admin/clusters/policy-families
Apply identity federation best practices in Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/admin/users-groups/best-practices
Apply best practices for serverless Databricks workspaceshttps://learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces-best-practices
Build and refine Knowledge Assistant chatbots on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/agents/agent-bricks/knowledge-assistant
Design effective evaluation sets for Databricks agentshttps://learn.microsoft.com/en-us/azure/databricks/agents/agent-evaluation/evaluation-set
Load test Databricks Apps agents for QPS limitshttps://learn.microsoft.com/en-us/azure/databricks/agents/custom-agents/load-test-agent-app
Measure RAG performance with retrieval and response metricshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/evaluate-assess-performance
Define RAG application quality with evaluation setshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/evaluate-define-quality
Set up Databricks infrastructure to measure RAG qualityhttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/evaluate-enable-measurement
Evaluate and monitor RAG applications for quality, cost, latencyhttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/fundamentals-evaluation-monitoring-rag
Design and optimize RAG inference chains on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/fundamentals-inference-chain-rag
Build and tune Databricks RAG data pipelineshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/quality-data-pipeline-rag
Improve RAG application quality via key tuning knobshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/quality-overview
Optimize RAG chain components for better responseshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/quality-rag-chain
Optimize Databricks AI Search performancehttps://learn.microsoft.com/en-us/azure/databricks/ai-search/best-practices
Load test Databricks AI Search endpoints for sizinghttps://learn.microsoft.com/en-us/azure/databricks/ai-search/endpoint-load-test
Apply Databricks AI Search filter expressions effectivelyhttps://learn.microsoft.com/en-us/azure/databricks/ai-search/filtering-guide
Improve Databricks AI Search retrieval qualityhttps://learn.microsoft.com/en-us/azure/databricks/ai-search/retrieval-quality
Evaluate Databricks AI Search retrieval strategieshttps://learn.microsoft.com/en-us/azure/databricks/ai-search/retrieval-quality-eval
Detect and clean up unused Databricks AI Search endpointshttps://learn.microsoft.com/en-us/azure/databricks/ai-search/unused-endpoints
Migrate Databricks library installs from init scriptshttps://learn.microsoft.com/en-us/azure/databricks/archive/compute/libraries-init-scripts
Apply compute policy best practices in Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/archive/compute/policies-best-practices
Use DBIO for transactional writes to cloud storage in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/archive/legacy/dbio-commit
Optimize skewed joins in Databricks using skew hintshttps://learn.microsoft.com/en-us/azure/databricks/archive/legacy/skew-join
Migrate from Databricks Deep Learning Pipelineshttps://learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/deep-learning-pipelines
Apply Azure Databricks administration best practiceshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/administration
Optimize BI performance with Databricks SQL warehouseshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving
Optimize BI performance with Databricks data preparationhttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-data-prep
Configure Databricks SQL warehouses for optimal BI servinghttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-sql-serving
Apply Azure Databricks compute creation best practiceshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/compute
Implement Azure Databricks production job scheduling best practiceshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/jobs
Apply Power BI performance best practices with Databricks datahttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/power-bi
Apply classic compute configuration best practices in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/compute/cluster-config-best-practices
Use flexible node types for reliable Databricks computehttps://learn.microsoft.com/en-us/azure/databricks/compute/flexible-node-types
Apply best practices for Databricks poolshttps://learn.microsoft.com/en-us/azure/databricks/compute/pool-best-practices
Use serverless compute effectively on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/compute/serverless/best-practices
Tune Databricks SQL warehouses for BI workloadshttps://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/bi-workload-settings
Control large interactive queries with Query Watchdoghttps://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/query-watchdog
Optimize Azure Databricks dashboard caching and datasetshttps://learn.microsoft.com/en-us/azure/databricks/dashboards/caching
Apply observability best practices for Databricks jobs and pipelineshttps://learn.microsoft.com/en-us/azure/databricks/data-engineering/observability-best-practices
Apply ABAC policy best practices in Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/best-practices
Optimize performance of ABAC row and column policieshttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/performance
Understand ABAC policy evaluation behaviorhttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/policy-evaluation
Apply Unity Catalog data governance best practiceshttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/best-practices
Manage Unity Catalog object storage lifecycle and recoveryhttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/object-storage-lifecycle
Apply service policy examples for AI governancehttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/service-policies/policy-examples
Work with legacy Hive metastore objects in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/database-objects/hive-metastore
Follow DBFS root storage recommendations in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/dbfs/dbfs-root
Apply DBFS and Unity Catalog usage best practiceshttps://learn.microsoft.com/en-us/azure/databricks/dbfs/unity-catalog
Apply Delta Lake best practices on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/delta/best-practices
Handle Delta Lake limitations and risks on Amazon S3https://learn.microsoft.com/en-us/azure/databricks/delta/s3-limitations
Apply selective overwrite patterns with Delta Lakehttps://learn.microsoft.com/en-us/azure/databricks/delta/selective-overwrite
Apply MLOps Stack best practices with bundleshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/bundles/mlops-stacks
Apply CI/CD workflow best practices on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/ci-cd/flows
Apply security and performance best practices for Databricks appshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/best-practices
Implement horizontal scaling for Azure Databricks appshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/horizontal-scaling
Test Databricks Connect for Python code with pytesthttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/testing
Handle async queries and interruptions in Databricks Connecthttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/queries
Apply Databricks developer and CI/CD best practiceshttps://learn.microsoft.com/en-us/azure/databricks/developers/best-practices
Explore Unity Catalog volumes and storage files in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/discover/files
Choose between Databricks volumes and workspace fileshttps://learn.microsoft.com/en-us/azure/databricks/files/files-recommendations
Curate effective Genie Agents for accuracyhttps://learn.microsoft.com/en-us/azure/databricks/genie-agents/best-practices
Apply prompt best practices for Genie Codehttps://learn.microsoft.com/en-us/azure/databricks/genie-code/tips
Apply Auto Loader best practices for reliable ingestionhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/best-practices
Optimize Databricks Auto Loader directory listing modehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/directory-listing-mode
Configure Databricks Auto Loader for production workloadshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/production
Configure Auto Loader automatic type wideninghttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/type-widening
Apply common COPY INTO data loading patternshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/examples
Incrementally clone Parquet and Iceberg tables to Deltahttps://learn.microsoft.com/en-us/azure/databricks/ingestion/data-migration/clone-parquet
Use the Anthropic connector effectively in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/anthropic-faq
Apply Lakeflow Connect patterns for managed ingestionhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/common-patterns
Apply Marketo connector FAQs and usage guidancehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/marketo-faq
Query system.billing.usage to monitor Lakeflow costshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/monitor-costs
Apply Notion connector FAQs and usage tipshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/notion-faq
Apply Outlook connector FAQs and guidancehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/outlook-faq
Maintain Databricks Lakeflow managed ingestion pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pipeline-maintenance
Maintain and operate PostgreSQL Lakeflow ingestion pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-maintenance
Apply limitations and tuning best practices for query-based connectorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/query-based-limits
RabbitMQ connector behavioral FAQs and guidancehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/rabbitmq-faq
Filter rows during Lakeflow Connect ingestionhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/row-filtering
Optimize Databricks smart closure for CDC pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/smart-closure
Use and configure init scripts on Azure Databricks clustershttps://learn.microsoft.com/en-us/azure/databricks/init-scripts/
Reference external files safely in Databricks init scriptshttps://learn.microsoft.com/en-us/azure/databricks/init-scripts/referencing-files
Use continuous mode for Databricks streaming jobshttps://learn.microsoft.com/en-us/azure/databricks/jobs/continuous
Apply classic compute best practices for Databricks jobshttps://learn.microsoft.com/en-us/azure/databricks/jobs/run-classic-jobs
Apply Databricks cost optimization best practiceshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/cost-optimization/best-practices
Apply Databricks data and AI governance best practiceshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/data-governance/best-practices
Design compute and workspace configuration for Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/compute
Design observability and monitoring for Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/observability
Apply interoperability and usability best practices in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/best-practices
Apply operational excellence best practices for Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/operational-excellence/best-practices
Optimize Databricks performance with efficiency best practiceshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/best-practices
Apply reliability best practices on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reliability/best-practices
Implement Databricks security, compliance, and privacy best practiceshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/security-compliance-and-privacy/best-practices
Classify documents with large label taxonomies in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/large-language-models/classify-documents-labels-tutorial
Optimize Lakeflow clusters with enhanced and vertical autoscalinghttps://learn.microsoft.com/en-us/azure/databricks/ldp/auto-scaling
Apply Lakeflow pipeline best practices in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/ldp/best-practices
Handle compatibility issues with pipeline environment versionshttps://learn.microsoft.com/en-us/azure/databricks/ldp/developer/environment-version-compatibility
Apply data quality expectations in pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-expectations
Apply advanced expectation patterns in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ldp/expectation-patterns
Reduce high initialization times in Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/fix-high-init
Design REPLACE USING flows for partial snapshots in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ldp/flows-replace-using
Use from_json for schema inference in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ldp/from-json-schema-evolution
Run full refreshes on Lakeflow streaming tables safelyhttps://learn.microsoft.com/en-us/azure/databricks/ldp/full-refresh-st
Optimize stateful streaming with watermarks in pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/stateful-processing
Implement CDC ETL pipelines with Lakeflow and Auto Loaderhttps://learn.microsoft.com/en-us/azure/databricks/ldp/tutorial-pipelines
Build geospatial Lakeflow pipelines with native spatial typeshttps://learn.microsoft.com/en-us/azure/databricks/ldp/tutorial-spatial-pipelines
Unit test Lakeflow pipelines with mock datahttps://learn.microsoft.com/en-us/azure/databricks/ldp/unit-testing
Restart the Python process to refresh Databricks librarieshttps://learn.microsoft.com/en-us/azure/databricks/libraries/restart-python-process
Apply performance and resiliency patterns on AI Runtimehttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/guides/performance-and-resiliency
Apply Hyperopt best practices on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-best-practices
Implement point-in-time correct feature joinshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/time-series
Benchmark Databricks LLM endpoints for performancehttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/prov-throughput-run-benchmark
Apply Databricks batch model inference patternshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-inference/
Implement function calling in Databricks AI applicationshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/function-calling
Validate models before Databricks serving deploymenthttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-pre-deployment-validation
Monitor Databricks model quality and endpoint healthhttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/monitor-diagnose-endpoints
Optimize Databricks Model Serving endpoints for productionhttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/production-optimization
Plan and execute load testing for Databricks serving endpointshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/what-is-load-test
Tune and autoscale Ray clusters on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/scale-ray
Apply deep learning best practices on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/dl-best-practices
Adapt Apache Spark workloads for Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/migration/spark
Log model dependencies for reproducible deploymentshttps://learn.microsoft.com/en-us/azure/databricks/mlflow/log-model-dependencies
Apply MLflow 3 best practices for GenAI observabilityhttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/
Align MLflow judges with human feedbackhttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/align-judges
Apply MLflow Tracing for GenAI observabilityhttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/
Use manual MLflow tracing for production GenAI appshttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/app-instrumentation/manual-tracing/
Collect and log user feedback on GenAI traces with MLflowhttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/collect-user-feedback/
Analyze GenAI traces with MLflow Trace SDKhttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/observe-with-traces/analyze-traces
Apply software engineering practices to Databricks notebookshttps://learn.microsoft.com/en-us/azure/databricks/notebooks/best-practices
Run Databricks notebooks safely and efficientlyhttps://learn.microsoft.com/en-us/azure/databricks/notebooks/run-notebook
Apply unit testing patterns in Databricks notebookshttps://learn.microsoft.com/en-us/azure/databricks/notebooks/test-notebooks
Optimize OpenSharing egress costs for data providershttps://learn.microsoft.com/en-us/azure/databricks/opensharing/manage-egress
Apply performance optimization recommendations on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/
Use adaptive query execution on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/aqe
Migrate away from deprecated Bloom filter indexeshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/bloom-filters
Optimize Spark SQL queries with Databricks CBOhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/cbo
Improve read performance with Databricks disk cachehttps://learn.microsoft.com/en-us/azure/databricks/optimizations/disk-cache
Improve Delta query performance with dynamic file pruninghttps://learn.microsoft.com/en-us/azure/databricks/optimizations/dynamic-file-pruning
Choose and configure Databricks Delta isolation levelshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/isolation/isolation-levels
Use row-level concurrency to reduce Delta write conflictshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/isolation/row-level-concurrency
Optimize Delta MERGE performance with low shuffle mergehttps://learn.microsoft.com/en-us/azure/databricks/optimizations/low-shuffle-merge
Use predictive I/O optimizations on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-io
Optimize Azure Databricks range join performancehttps://learn.microsoft.com/en-us/azure/databricks/optimizations/range-join
Diagnose Databricks Spark cost and performance in UIhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/
Diagnose high I/O Spark stages using Databricks UIhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-io
Debug skew and spill in Databricks Spark stageshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-page
Handle Databricks spot instance losses effectivelyhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/losing-spot-instances
Resolve long Spark stages with a single taskhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/one-spark-task
Optimize many small Spark jobs on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/small-spark-jobs
Mitigate overloaded Spark driver on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-driver-overloaded
Detect unnecessary data rewriting in Databricks Spark writeshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-rewriting-data
Apply Partner Connect setup best practices in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/partner-connect/best-practice
Handle to_utc_timestamp semantics in Spark Databrickshttps://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_utc_timestamp
Apply networking recommendations for Lakehouse Federationhttps://learn.microsoft.com/en-us/azure/databricks/query-federation/networking
Optimize performance of Lakehouse Federation querieshttps://learn.microsoft.com/en-us/azure/databricks/query-federation/performance-recommendations
Understand Databricks Runtime 14.3 LTS changeshttps://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/14.3lts
Leverage Databricks Runtime 15.4 LTS updateshttps://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/15.4lts
Use Databricks Runtime 18 LTS changes and fixeshttps://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/18
Apply Databricks Runtime 19 feature and fix detailshttps://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/19
Transform complex and nested data types in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/semi-structured/complex-types
Use higher-order functions on arrays in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/semi-structured/higher-order-functions
Use VARIANT instead of JSON strings in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/semi-structured/variant-json-diff
Convert Parquet tables to Delta Lake in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-convert-to-delta
Optimize Delta Lake table layout with Databricks OPTIMIZEhttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-optimize
Vacuum unused files from Delta and Spark tableshttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-vacuum
Apply partitioning and liquid clustering best practices in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-partition
Use ANALYZE TABLE statistics for Databricks optimizationhttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-analyze-compute-statistics
Use Databricks SQL query hints for performancehttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-hints
Use OFFSET and LIMIT safely for pagination in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-offset
Benchmark Databricks SQL warehouses with the TPC-DS datasethttps://learn.microsoft.com/en-us/azure/databricks/sql/tpcds-eval
Author effective SQL patterns for Databricks alertshttps://learn.microsoft.com/en-us/azure/databricks/sql/user/alerts/query-patterns
Act on Azure Databricks SQL query performance insightshttps://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/performance-insights
Optimize Databricks SQL queries with RELY constraintshttps://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-optimization-constraints
Operate multiple Databricks streaming queries per clusterhttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/multiple-streams
Run Databricks Structured Streaming in productionhttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/production
Understand Databricks real-time mode limitations and constraintshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time/limitations
Optimize and monitor Databricks real-time streaming performancehttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time/performance
Optimize and manage stateful Structured Streaming on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stateful-streaming
Optimize stateless Structured Streaming queries on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stateless-streaming
Monitor Structured Streaming queries on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stream-monitoring
Tune Databricks Structured Streaming trigger intervalshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/triggers
Apply watermarks for stateful streaming on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/watermarks
Use automatic upgrades for Unity Catalog tableshttps://learn.microsoft.com/en-us/azure/databricks/tables/automatic-upgrades
Optimize Databricks tables using liquid clusteringhttps://learn.microsoft.com/en-us/azure/databricks/tables/clustering
Leverage data skipping on Databricks tableshttps://learn.microsoft.com/en-us/azure/databricks/tables/data-skipping
Optimize external table partition discovery in Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/tables/external-partition-discovery
Optimize Azure Databricks VARIANT columns with shreddinghttps://learn.microsoft.com/en-us/azure/databricks/tables/features/variant-shredding
Use table history and time travel safely in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/tables/history
Optimize Delta and Iceberg table file layouthttps://learn.microsoft.com/en-us/azure/databricks/tables/operations/optimize
Run VACUUM to clean Delta and Iceberg tableshttps://learn.microsoft.com/en-us/azure/databricks/tables/operations/vacuum
Interpret table size versus storage usagehttps://learn.microsoft.com/en-us/azure/databricks/tables/size
Tune Delta and Iceberg data file sizes in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/tables/tune-file-size
Safely evolve Delta and Iceberg table schemashttps://learn.microsoft.com/en-us/azure/databricks/tables/update-schema
Design Delta Lake data models on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/transform/data-modeling
Optimize join performance in Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/transform/optimize-joins
Implement data cleaning and validation on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/transform/validate
Use level of detail expressions in metric viewshttps://learn.microsoft.com/en-us/azure/databricks/uc-semantics/metric-views/level-of-detail
Define session-scoped Scala and Java UDFs in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/udf/scala
Download internet data into Azure Databricks volumeshttps://learn.microsoft.com/en-us/azure/databricks/volumes/download-internet-files

Decision Making

TopicURL
Manage and change Azure Databricks subscription tierhttps://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/account
Plan migration from Standard to Premium Databricks tierhttps://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/standard-tier
Decide when to enable Mission Critical add-on for Databrickshttps://learn.microsoft.com/en-us/azure/databricks/admin/mission-critical
Decide when to use serverless Databricks workspaceshttps://learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces
Decide and migrate agents from Model Serving to Databricks Appshttps://learn.microsoft.com/en-us/azure/databricks/agents/custom-agents/migrate-agent-to-apps
Choose approaches to connect Databricks agents to external serviceshttps://learn.microsoft.com/en-us/azure/databricks/agents/mcp-tools/connect-external
Plan AI governance using Unity AI Gatewayhttps://learn.microsoft.com/en-us/azure/databricks/ai-gateway/ai-governance
Manage Unity AI Gateway budgets and AI spend controlshttps://learn.microsoft.com/en-us/azure/databricks/ai-gateway/budgets
Analyze Unity AI Gateway cost with billing-based observabilityhttps://learn.microsoft.com/en-us/azure/databricks/ai-gateway/cost-observability
Optimize Databricks AI Search costs and usagehttps://learn.microsoft.com/en-us/azure/databricks/ai-search/cost-management
Decide and migrate from dbx to Databricks bundleshttps://learn.microsoft.com/en-us/azure/databricks/archive/dev-tools/dbx/dbx-migrate
Migrate optimized LLM endpoints to provisioned throughputhttps://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/migrate-provisioned-throughput
Decide when to use Databricks Light runtimehttps://learn.microsoft.com/en-us/azure/databricks/archive/runtime/light
Plan migration of Databricks workloads to Spark 3.xhttps://learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/
Choose and manage the default Unity Catalog cataloghttps://learn.microsoft.com/en-us/azure/databricks/catalogs/default
Choose appropriate Azure Databricks compute typeshttps://learn.microsoft.com/en-us/azure/databricks/compute/choose-compute
Decide when and how to use GPU Databricks computehttps://learn.microsoft.com/en-us/azure/databricks/compute/gpu
Plan migration from classic to serverless Databricks computehttps://learn.microsoft.com/en-us/azure/databricks/compute/serverless/migration
Choose serverless streaming configurations in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/compute/serverless/streaming
Evaluate Lakehouse Real-Time pricing and discounts in Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/real-time-pricing
Choose the right Azure Databricks SQL warehouse typehttps://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/warehouse-types
Choose Databricks connection options for external datahttps://learn.microsoft.com/en-us/azure/databricks/connect/
Choose data modeling options in Databricks AI/BI dashboardshttps://learn.microsoft.com/en-us/azure/databricks/dashboards/manage/data-modeling/
Choose between ABAC and table-level filtershttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/abac-vs-rls-cm
Update Databricks jobs when migrating to Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/jobs-update
Decide between managed and external Unity Catalog assetshttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/managed-versus-external
Prepare and migrate to Unity Catalog–only Databricks workspaceshttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/upgrade/uc-only-migration
Migrate from legacy to new Databricks CLIhttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/migrate
Migrate from older to new Databricks Connect for Pythonhttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/migrate
Migrate Scala projects to Databricks Connect 13.3+https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/migrate
Decide between CDKTF and Databricks Terraform providerhttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/terraform/cdktf
Use Compatibility Mode for external table readshttps://learn.microsoft.com/en-us/azure/databricks/external-access/compatibility-mode
Configure Genie budgets and cost controls in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/genie/budgets
Choose between Azure Databricks free optionshttps://learn.microsoft.com/en-us/azure/databricks/getting-started/free-trial-vs-free-edition
Choose Auto Loader file detection mode in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/file-detection-modes
Plan migration of existing data to Delta Lake on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/data-migration/
Decide how to use the Databricks Aha! connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/aha-faq
Choose and plan MySQL ingestion workflowshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql
Choose and plan Oracle CDC ingestion workflowshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/oracle-integrated-overview
Answer PagerDuty connector FAQs and plan requirementshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pagerduty-faq
Plan PostgreSQL ingestion workflows in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql
Understand SendGrid connector requirements and usage FAQshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sendgrid-faq
Review Square connector FAQs and account requirementshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/square-faq
Choose and start with Databricks ODBC and JDBC drivershttps://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc-odbc-bi
Plan and execute migration to Databricks ODBC driverhttps://learn.microsoft.com/en-us/azure/databricks/integrations/odbc/migration
Choose and run Databricks jobs on serverless workflowshttps://learn.microsoft.com/en-us/azure/databricks/jobs/run-serverless-jobs
Migrate from Spark Submit tasks to JAR and notebook taskshttps://learn.microsoft.com/en-us/azure/databricks/jobs/tasks/spark-submit
Design Azure Databricks workspace architecture strategyhttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/workspace-strategy
Choose the right development language on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/languages/overview
Plan migration from deprecated Foundation Model Fine-tuninghttps://learn.microsoft.com/en-us/azure/databricks/large-language-models/foundation-model-training/
Clone Hive metastore pipelines to Unity Catalog via REST APIhttps://learn.microsoft.com/en-us/azure/databricks/ldp/clone-hms-to-uc
Use materialized views in Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/concepts/materialized-views
Choose serverless vs classic compute for Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ldp/concepts/serverless-vs-classic-compute
Compare Lakeflow pipelines with Spark Declarative Pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/concepts/spark-declarative-pipelines
Choose between standalone and Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/concepts/standalone-pipelines
Decide when to use Lakeflow streaming tableshttps://learn.microsoft.com/en-us/azure/databricks/ldp/concepts/streaming-tables
Map Delta Live Tables features to Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/concepts/where-is-dlt
Choose between standalone tables and Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/dbsql/dbsql-for-ldp
Choose SQL or Python for Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/developer/sql-vs-python
Choose and configure incremental refresh for Databricks materialized viewshttps://learn.microsoft.com/en-us/azure/databricks/ldp/incremental-refresh
Migrate from legacy LIVE schema in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ldp/live-schema
Choose triggered or continuous Lakeflow pipeline modehttps://learn.microsoft.com/en-us/azure/databricks/ldp/pipeline-mode
Optimize Databricks Feature Store usage costshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/cost-management
Upgrade workspace feature tables to Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/uc/upgrade-feature-table-to-uc
Plan capacity using model units for throughputhttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/model-units
Migrate Databricks ML workflows to Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-to-uc
Upgrade ML workflows to Unity Catalog modelshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/upgrade-workflows
Decide and migrate to Databricks Model Servinghttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/migrate-model-serving
Choose between Spark and Ray on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/spark-ray-overview
Plan for Databricks AI model lifecycle changeshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/retired-models-policy
Decide when to use distributed training on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/distributed-training/
Choose and train deep-learning recommenders on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-recommender-models
Plan and execute Azure Databricks app migrationhttps://learn.microsoft.com/en-us/azure/databricks/migration/
Assess and migrate ETL pipelines to Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/migration/etl
Plan migration from Parquet data lake to Delta Lakehttps://learn.microsoft.com/en-us/azure/databricks/migration/parquet-to-delta-lake
Decide how to migrate data warehouses to lakehousehttps://learn.microsoft.com/en-us/azure/databricks/migration/warehouse-to-lakehouse
Choose between open source and managed MLflow on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/overview/oss-managed-diff
Decide and migrate MLflow traces to Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/migrate-traces-to-uc
Migrate legacy Unity Catalog trace tables to table-prefix formathttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/migrate-uc-trace-table-prefix
Choose and upgrade between Lakebase Provisioned and Autoscalinghttps://learn.microsoft.com/en-us/azure/databricks/oltp/instances/
Migrate Databricks Asset Bundles to Autoscaling Lakebasehttps://learn.microsoft.com/en-us/azure/databricks/oltp/update-to-autoscaling-dabs
Decide and plan upgrade to Lakebase Autoscalinghttps://learn.microsoft.com/en-us/azure/databricks/oltp/upgrade-to-autoscaling
Choose Microsoft Fabric integration for Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/partners/bi/fabric
Choose Azure Databricks options for external data accesshttps://learn.microsoft.com/en-us/azure/databricks/query-federation/
Choose and configure Databricks-to-Databricks federationhttps://learn.microsoft.com/en-us/azure/databricks/query-federation/databricks
Migrate legacy Databricks query federation to Lakehouse Federationhttps://learn.microsoft.com/en-us/azure/databricks/query-federation/migrate
Plan and execute Databricks Runtime 11.x migrationhttps://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/11.x-migration
Migrate workloads to Databricks Runtime 12.x safelyhttps://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/12.x-migration
Plan and execute Databricks Runtime 13.x migrationhttps://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/13.x-migration
Migrate workloads to Databricks Runtime 14.x safelyhttps://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/14.x-migration
Assess Databricks Runtime support lifecycle and upgradeshttps://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/databricks-runtime-ver
Choose Azure Databricks serverless SKUs and DBU rateshttps://learn.microsoft.com/en-us/azure/databricks/resources/pricing
Plan and manage Azure Databricks networking costshttps://learn.microsoft.com/en-us/azure/databricks/security/network/serverless-network-security/cost-management
Choose and configure Databricks workspace data export optionshttps://learn.microsoft.com/en-us/azure/databricks/security/privacy/export-workspace-data
Choose between Spark Connect and Spark Classichttps://learn.microsoft.com/en-us/azure/databricks/spark/connect-vs-classic
Choose between SparkR and sparklyr on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/sparkr/sparkr-vs-sparklyr
Choose and size SQL warehouses for alertshttps://learn.microsoft.com/en-us/azure/databricks/sql/user/alerts/compute
Choose Structured Streaming output modes on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/output-mode
Decide when to use real-time mode in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time/concepts
Choose BI connection patterns for Databricks metric viewshttps://learn.microsoft.com/en-us/azure/databricks/uc-semantics/metric-views/bi-tools
Choose aggregated vs unaggregated metric view materializationshttps://learn.microsoft.com/en-us/azure/databricks/uc-semantics/metric-views/choose-materialization-type

Frequently asked questions

What to verify before installation and use

What does the azure-databricks source document cover?

This skill provides expert guidance for Azure Databricks. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content…

How do I install azure-databricks?

The source record exposes this install command: npx skills add https://github.com/MicrosoftDocs/Agent-Skills --skill "skills/azure-databricks". Inspect the command and pinned source before running it.

Which permission-related actions were detected?

Static rules flagged network in the source; the page lists the matching lines and excerpts.

Alternatives

Compare before choosing

Computed 92717

MicrosoftDocs/Agent-Skills

azure-data-factory

Expert knowledge for Azure Data Factory development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when building ADF pipelines with data flows, SHIR/SSIS IR, VNets/private endpoints, CI/CD templates, or SAP CDC, and other Azure Data Factory related development tasks. Not for Azure Synapse Analytics (use azure-synapse-analytics), Azure Databricks (use azure-da

Computed 92717

MicrosoftDocs/Agent-Skills

azure-migrate

Expert knowledge for Azure Migrate development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when configuring Azure Migrate projects/appliances, VMware/Hyper-V discovery, SQL/PostgreSQL assessments, AppCAT, or Resource Mover, and other Azure Migrate related development tasks. Not for Azure Database Migration Service (use azure-database-migration), Azure Site

Computed 92717

MicrosoftDocs/Agent-Skills

azure-sentinel

Expert knowledge for Azure Sentinel development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when configuring data connectors, ASIM analytics, KQL/REST integrations, playbooks, or Sentinel deployments, and other Azure Sentinel related development tasks. Not for Azure Defender For Cloud (use azure-defender-for-cloud), Azure Security (use azure-security), Azu

Computed 92717

MicrosoftDocs/Agent-Skills

azure-sql-database

Expert knowledge for Azure SQL Database development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when configuring serverless billing, Hyperscale, geo-replication/DR, Data Sync/sharding, or elastic pools, and other Azure SQL Database related development tasks. Not for Azure SQL Managed Instance (use azure-sql-managed-instance), SQL Server on Azure Virtual Ma