skillZs
★ LIVE SKILL TAGS ★
>>> LIVE SKILLS INDEX <<<
* OPEN SOURCE *
NO LOGIN, NO TRACKING
※ REAL INSTALL DATA ※
← back to all skills
microsoftdocs/agent-skills227 installs

azure-databricks

Expert knowledge for Azure Databricks development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when using Spark clusters, Unity Catalog, Delta Lake, Lakeflow/Lakebase pipelines, or Model Serving, and other Azure Databricks related development tasks. Not for Azure Synapse Analytics (use azure-synapse-analytics), Azure HDInsight (use azure-hdinsight), Azure Machine Learning (use azure-machine-learning), Azure Data Factory (use azure-data-factory).

How do I install this agent skill?

npx skills add https://github.com/microsoftdocs/agent-skills --skill azure-databricks
view source ↗

Is this agent skill safe to install?

  • Gen Agent Trust Hubpass

    This skill acts as a comprehensive documentation index for Azure Databricks, providing the agent with categorized links to official Microsoft documentation. It is designed for information retrieval and contains no malicious code or behaviors.

  • Socketpass

    No alerts

  • Snykpass

    Risk: LOW · No issues

  • ZeroLeakspass

    Score: 93/100 · 2 sections analyzed

What does this agent skill do?

Azure Databricks Skill

This skill provides expert guidance for Azure Databricks. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

  • Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
  • Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.

Category Index

CategoryLocationDescription
TroubleshootingL37-L198Diagnosing and fixing Azure Databricks issues: cluster/jobs, Spark/SQL errors, agents, Auto Loader/Lakeflow pipelines, connectors (SaaS/DB), audit logs, Git/Power BI, Feature Store, Model Serving.
Best PracticesL199-L427Best-practice patterns for Databricks: cost, performance, reliability, governance, security, networking, streaming, Lakeflow, RAG/AI Search, ML/LLM, Model Serving, Unity Catalog, and BI.
Decision Makingdecision-making.mdGuides for making architecture and migration decisions in Azure Databricks: choosing runtimes, compute, AI/ML options, connectors, Lakeflow/Lakehouse patterns, costs, and upgrade paths.
Architecture & Design Patternsarchitecture-patterns.mdArchitectural blueprints and design patterns for Databricks/Lakebase: data modeling, CDC/ETL, streaming, governance, HA/DR, networking, security, feature stores, and multi-agent/AI apps.
Limits & Quotaslimits-quotas.mdLimits, quotas, and constraints for Databricks compute, AI/agents, Lakeflow pipelines/connectors, model serving, Lakebase, Unity Catalog, and workspace/SQL features.
Securitysecurity.mdIdentity, access control, encryption, networking, compliance, and secrets for securing Azure Databricks, Unity Catalog, AI/agents, Lakeflow, Lakebase, and external connectors.
Configurationconfiguration.mdConfiguring Azure Databricks and Lakebase: account/workspace/network settings, security/compliance, cost controls, AI/ML/agents, Lakeflow pipelines, connectors, CLI/bundles, and SQL/storage options.
Integrations & Coding Patternsintegrations.mdPatterns and how‑tos for connecting Databricks to external systems (SQL/NoSQL, cloud storage, BI, AI/LLM tools), building agents and Lakeflow pipelines, and using SDKs/CLIs for programmatic integration.
Deploymentdeployment.mdDeploying and automating Azure Databricks workspaces, apps, agents, ML models, Lakeflow/Lakebase pipelines, and GPU workloads using IaC (ARM, Bicep, Terraform), Bundles, CI/CD, and various CLIs/UIs.

Troubleshooting

TopicURL
Reference Azure Databricks diagnostic audit log eventshttps://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/audit-logs
Handle long-running tasks with Supervisor Agent continuationhttps://learn.microsoft.com/en-us/azure/databricks/agents/agent-bricks/multi-agent-supervisor-long-running-tasks
Agent Bricks FAQ for building and running agentshttps://learn.microsoft.com/en-us/azure/databricks/agents/concepts/faq
Debug custom code agents on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/agents/custom-agents/debug-agent
Monitor Genie Agents activity with audit logshttps://learn.microsoft.com/en-us/azure/databricks/ai-bi/admin/audit
Troubleshoot Azure Databricks Artifact Registry issueshttps://learn.microsoft.com/en-us/azure/databricks/artifact-registry/troubleshooting
Troubleshoot Azure Databricks classic compute termination errorshttps://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/cluster-error-codes
Debug Spark applications using Databricks Spark UIhttps://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/debugging-spark-ui
Monitor Databricks dashboard usage with audit logshttps://learn.microsoft.com/en-us/azure/databricks/dashboards/monitor-usage
Troubleshoot common Databricks CLI issueshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/troubleshooting
Use Databricks app details for monitoring and troubleshootinghttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/view-app-details
Diagnose and fix Databricks Connect for Python issueshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/troubleshooting
Troubleshoot Databricks Connect for Scala issueshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/troubleshooting
Troubleshoot Databricks Terraform provider issueshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/terraform/troubleshoot
Troubleshoot issues with the Databricks IDE extensionhttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/troubleshooting
Handle ARITHMETIC_OVERFLOW errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/arithmetic-overflow-error-class
Resolve CAST_INVALID_INPUT errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/cast-invalid-input-error-class
Diagnose DC_GA4_RAW_DATA_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-ga4-raw-data-error-error-class
Understand DC_SFDC_API_ERROR in Databricks connectorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sfdc-api-error-error-class
Diagnose DC_SQLSERVER_ERROR in Databricks connectorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sqlserver-error-error-class
Handle DELTA_ICEBERG_COMPAT_V1_VIOLATION errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/delta-iceberg-compat-v1-violation-error-class
Resolve DIVIDE_BY_ZERO error in Azure Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/divide-by-zero-error-class
Use Azure Databricks error conditions programmaticallyhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/error-classes
Troubleshoot EWKB_PARSE_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/ewkb-parse-error-error-class
Troubleshoot EWKT_PARSE_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/ewkt-parse-error-error-class
Troubleshoot GEOJSON_PARSE_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/geojson-parse-error-error-class
Resolve GROUP_BY_AGGREGATE errors in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/group-by-aggregate-error-class
Handle H3_INVALID_CELL_ID errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-cell-id-error-class
Fix H3_INVALID_GRID_DISTANCE_VALUE errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-grid-distance-value-error-class
Fix H3_INVALID_RESOLUTION_VALUE errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-resolution-value-error-class
Resolve H3_NOT_ENABLED errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-not-enabled-error-class
Handle INSUFFICIENT_TABLE_PROPERTY errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/insufficient-table-property-error-class
Resolve INVALID_ARRAY_INDEX errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-error-class
Resolve INVALID_ARRAY_INDEX_IN_ELEMENT_AT errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-in-element-at-error-class
Fix MISSING_AGGREGATION errors in GROUP BYhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/missing-aggregation-error-class
Troubleshoot ROW_COLUMN_ACCESS errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/row-column-access-error-class
Interpret Azure Databricks SQLSTATE error codeshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/sqlstates
Resolve TABLE_OR_VIEW_NOT_FOUND errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/table-or-view-not-found-error-class
Diagnose UNRESOLVED_ROUTINE errors in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/error-messages/unresolved-routine-error-class
Handle UNSUPPORTED_TABLE_OPERATION errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-table-operation-error-class
Handle UNSUPPORTED_VIEW_OPERATION errorshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-view-operation-error-class
Troubleshoot WKB_PARSE_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/wkb-parse-error-error-class
Troubleshoot WKT_PARSE_ERROR in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/error-messages/wkt-parse-error-error-class
Diagnose and fix common Genie Agent issueshttps://learn.microsoft.com/en-us/azure/databricks/genie-agents/troubleshooting
Troubleshoot Azure Databricks Auto Loader issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/faq
Monitor and troubleshoot Auto Loader pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/observability
Troubleshoot 1Password Event Logs connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/1password-event-logs-troubleshoot
Troubleshoot Aha! managed connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/aha-troubleshoot
Troubleshoot Akamai WAF connector authentication and errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/akamai-waf-troubleshoot
Troubleshoot Databricks Amplitude connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/amplitude-troubleshoot
Troubleshoot Databricks Anaplan connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/anaplan-troubleshoot
Troubleshoot Anthropic connector ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/anthropic-troubleshoot
Troubleshoot Anysphere Audit Logs connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/anysphere-audit-logs-troubleshoot
Troubleshoot Anysphere Organization connector problemshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/anysphere-organization-troubleshoot
Troubleshoot Databricks Asana connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/asana-troubleshoot
Troubleshoot Atlassian audit logs connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/atlassian-audit-logs-troubleshoot
Troubleshoot Databricks Azure DevOps connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/azure-devops-troubleshoot
Troubleshoot Databricks Box Audit Logs connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/box-audit-logs-troubleshoot
Troubleshoot Databricks Celigo managed connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/celigo-troubleshoot
Troubleshoot Databricks Confluence ingestion errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-troubleshoot
Troubleshoot Databricks Cribl connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/cribl-troubleshoot
Troubleshoot CrowdStrike Falcon Event Stream connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/crowdstrike-falcon-event-stream-troubleshoot
Troubleshoot Databricks Dynamics 365 connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/d365-faq
Troubleshoot Dynamics 365 ingestion via Synapse Linkhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/d365-troubleshoot
Troubleshoot full refresh of Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/full-refresh
Troubleshoot common GitLab connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/gitlab-troubleshoot
Troubleshoot Glean connector errors in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/glean-troubleshoot
Troubleshoot Gmail connector ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/gmail-troubleshoot
Troubleshoot Google Ads connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-ads-troubleshoot
Troubleshoot GA Aggregated connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-analytics-aggregated-troubleshoot
Troubleshoot GA4 Raw Data connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-analytics-troubleshoot
Troubleshoot Databricks Google Drive connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-drive-faq
Troubleshoot Google Drive ingestion in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-drive-troubleshoot
Answer Databricks Google Search Console connector FAQshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-search-console-faq
Troubleshoot Databricks Google Search Console connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-search-console-troubleshoot
Troubleshoot Databricks Google Workspace connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-workspace-troubleshoot
Troubleshoot HubSpot connector ingestion problemshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/hubspot-troubleshoot
Troubleshoot Jira ingestion issues in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/jira-troubleshoot
Troubleshoot Databricks Kafka ingestion connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/kafka-troubleshoot
Troubleshoot LinkedIn Ads connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/linkedin-ads-troubleshoot
Troubleshoot Marketo connector pipeline errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/marketo-troubleshoot
Diagnose and fix Meta Ads Lakeflow Connect ingestion errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/meta-ads-troubleshoot
Troubleshoot Microsoft 365 audit connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/microsoft-365-troubleshoot
Troubleshoot Databricks Entra ID connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/microsoft-entra-id-troubleshoot
Troubleshoot Databricks Microsoft Graph Logs connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/microsoft-graph-logs-troubleshoot
Troubleshoot Monday.com Lakeflow connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/monday-com-troubleshoot
Troubleshoot MySQL ingestion issues in Lakeflow Connecthttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql-troubleshoot
Troubleshoot Netskope Logs Lakeflow connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/netskope-logs-troubleshoot
Troubleshoot Notion connector authentication and sync issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/notion-troubleshoot
Troubleshoot Databricks Okta System Logs connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/okta-system-logs-troubleshoot
Troubleshoot Databricks Okta connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/okta-troubleshoot
Troubleshoot Databricks OpenAI connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/openai-troubleshoot
Troubleshoot Azure Databricks Oracle Eloqua connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/oracle-eloqua-troubleshoot
Address common questions for Oracle integrated CDChttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/oracle-faq
Troubleshoot Oracle integrated CDC ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/oracle-troubleshoot
Troubleshoot Databricks Outlook ingestion connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/outlook-troubleshoot
Troubleshoot Databricks PagerDuty connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pagerduty-troubleshoot
Troubleshoot Databricks PayPal connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/paypal-troubleshoot
Troubleshoot Databricks Pendo connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pendo-troubleshoot
Resolve common issues with the PostgreSQL Lakeflow connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-faq
Troubleshoot Databricks PostgreSQL ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-troubleshoot
Troubleshoot Databricks Productboard connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/productboard-troubleshoot
Troubleshoot query-based connectors in Lakeflow Connecthttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/query-based-troubleshoot
Troubleshoot Databricks QuickBooks connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/quickbooks-troubleshoot
Troubleshoot Databricks RabbitMQ ingestion connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/rabbitmq-troubleshoot
Troubleshoot Databricks Reddit Ads connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/reddit-ads-troubleshoot
FAQ for Databricks Salesforce ingestion connectorhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-faq
Troubleshoot Databricks Salesforce ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-troubleshoot
Troubleshoot SendGrid connector authentication and rate limitshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sendgrid-troubleshoot
Troubleshoot ServiceNow connector ingestion problemshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/servicenow-troubleshoot
Troubleshoot Salesforce Marketing Cloud ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sfmc-troubleshoot
Troubleshoot Databricks SharePoint connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sharepoint-faq
Troubleshoot Databricks SharePoint ingestion errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sharepoint-troubleshoot
Troubleshoot Databricks Shopify connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/shopify-troubleshoot
Troubleshoot Databricks Smartsheet connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/smartsheet-troubleshoot
Resolve common SQL Server connector issues in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-faq
Troubleshoot Databricks SQL Server ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-troubleshoot
Troubleshoot Databricks Square connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/square-troubleshoot
Troubleshoot Databricks Strac connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/strac-troubleshoot
Troubleshoot Databricks SurveyMonkey connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/surveymonkey-troubleshoot
Troubleshoot Databricks TikTok Ads connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/tiktok-ads-troubleshoot
Troubleshoot Databricks Lakeflow ingestion pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/troubleshoot
Resolve UNITY_CATALOG_INITIALIZATION_FAILED in pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/uc-initialization-troubleshoot
Troubleshoot Databricks Veeva Vault connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/veeva-vault-troubleshoot
Troubleshoot Databricks Verkada connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/verkada-troubleshoot
Troubleshoot Databricks Vimeo connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/vimeo-troubleshoot
Troubleshoot Wiz Audit Logs connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/wiz-audit-logs-troubleshoot
Troubleshoot Workday Activity Logging connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-activity-logging-troubleshoot
Troubleshoot common Workday HCM connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-hcm-troubleshoot
Troubleshoot Databricks Workday ingestion issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-reports-troubleshoot
Troubleshoot common Workiva connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workiva-troubleshoot
Troubleshoot Xero connector errors in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/xero-troubleshoot
Troubleshoot Zendesk Support connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zendesk-support-troubleshoot
Troubleshoot Databricks Zip connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zip-troubleshoot
Troubleshoot Databricks Zoho Books connector issueshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zoho-books-troubleshoot
Troubleshoot Databricks Zoho CRM connector errorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zoho-crm-troubleshoot
Handle Zerobus Ingest error codes and failureshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-errors
Troubleshoot and repair Azure Databricks job failureshttps://learn.microsoft.com/en-us/azure/databricks/jobs/repair-job-failures
Resolve high initialization times in pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/fix-high-init
Recover Lakeflow pipelines from checkpoint failureshttps://learn.microsoft.com/en-us/azure/databricks/ldp/recover-streaming
Debug and explore Databricks Feature Views in Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/explore-feature-views
Troubleshoot Databricks Feature Store and limitshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/troubleshooting-and-limitations
Troubleshoot Databricks Model Serving endpoint issueshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-debug
Use Genie Code to troubleshoot Databricks model servinghttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-genie-code
Troubleshoot Lakebase logical replication issueshttps://learn.microsoft.com/en-us/azure/databricks/oltp/projects/logical-replication-manage
Troubleshoot common Databricks OpenSharing errorshttps://learn.microsoft.com/en-us/azure/databricks/opensharing/troubleshooting
Troubleshoot failing Spark jobs and removed executorshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/failing-spark-jobs
Handle lost spot instances in Databricks clustershttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/losing-spot-instances
Troubleshoot Spark executor memory issues in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-memory-issues
Troubleshoot Databricks Partner Connect issueshttps://learn.microsoft.com/en-us/azure/databricks/partner-connect/troubleshoot
Troubleshoot Databricks publishing and connections to Power BIhttps://learn.microsoft.com/en-us/azure/databricks/partners/bi/power-bi/troubleshooting
Troubleshoot Azure Databricks Git folder errorshttps://learn.microsoft.com/en-us/azure/databricks/repos/errors-troubleshooting
Understand RBAC feature limitations in Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/security/auth/rbac/limitations
Detect and repair Delta table issues with FSCK REPAIR TABLEhttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-fsck
Handle INVALID_UTF8_STRING errors in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/validate_utf8
Monitor and troubleshoot Databricks materialized view refresheshttps://learn.microsoft.com/en-us/azure/databricks/sql/mv-st/materialized-monitor
Use query history to troubleshoot Databricks SQL performancehttps://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-history
Interpret Databricks SQL query profiles for performance troubleshootinghttps://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-profile

Best Practices

TopicURL
Tag Databricks resources for cost attributionhttps://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/usage-detail-tags
Use default Databricks compute policy familieshttps://learn.microsoft.com/en-us/azure/databricks/admin/clusters/policy-families
Design cross-region disaster recovery for Databrickshttps://learn.microsoft.com/en-us/azure/databricks/admin/disaster-recovery
Use managed disaster recovery for Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/admin/managed-disaster-recovery
Monitor Lakeflow job costs and performance using system tableshttps://learn.microsoft.com/en-us/azure/databricks/admin/system-tables/jobs-cost
Apply identity best practices in Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/admin/users-groups/best-practices
Apply best practices for Databricks serverless workspaceshttps://learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces-best-practices
Synthetically generate agent evaluation setshttps://learn.microsoft.com/en-us/azure/databricks/agents/agent-evaluation/synthesize-evaluation-set
Load test Databricks Apps agents for QPS capacityhttps://learn.microsoft.com/en-us/azure/databricks/agents/custom-agents/load-test-agent-app
Measure RAG performance with retrieval and response metricshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/evaluate-assess-performance
Define RAG application quality with evaluation setshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/evaluate-define-quality
Evaluate and monitor RAG applications for quality, cost, latencyhttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/fundamentals-evaluation-monitoring-rag
Design and optimize RAG inference chains on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/fundamentals-inference-chain-rag
Build Databricks unstructured RAG data pipelineshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/quality-data-pipeline-rag
Improve RAG application quality via key tuning knobshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/quality-overview
Optimize RAG chain components for better responseshttps://learn.microsoft.com/en-us/azure/databricks/agents/tutorials/ai-cookbook/quality-rag-chain
Optimize Databricks AI Search performance and scalinghttps://learn.microsoft.com/en-us/azure/databricks/ai-search/best-practices
Load test Azure Databricks AI Search endpointshttps://learn.microsoft.com/en-us/azure/databricks/ai-search/endpoint-load-test
Improve Databricks AI Search retrieval qualityhttps://learn.microsoft.com/en-us/azure/databricks/ai-search/retrieval-quality
Identify and clean up unused Databricks AI Search endpointshttps://learn.microsoft.com/en-us/azure/databricks/ai-search/unused-endpoints
Migrate Databricks library installs from init scriptshttps://learn.microsoft.com/en-us/azure/databricks/archive/compute/libraries-init-scripts
Apply best practices for Databricks compute policieshttps://learn.microsoft.com/en-us/azure/databricks/archive/compute/policies-best-practices
Use DBIO for transactional writes to cloud storage in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/archive/legacy/dbio-commit
Optimize skewed joins in Databricks using skew hintshttps://learn.microsoft.com/en-us/azure/databricks/archive/legacy/skew-join
Migrate from Databricks Deep Learning Pipelineshttps://learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/deep-learning-pipelines
Apply Azure Databricks platform admin best practiceshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/administration
Optimize BI serving performance on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving
Apply Databricks BI data preparation best practiceshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-data-prep
Optimize Azure Databricks SQL warehouses for BIhttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-sql-serving
Apply Azure Databricks compute creation best practiceshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/compute
Implement Azure Databricks production job scheduling best practiceshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/jobs
Apply Databricks-specific Power BI performance best practiceshttps://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/power-bi
Use AI-generated comments for Unity Catalog documentationhttps://learn.microsoft.com/en-us/azure/databricks/comments/ai-comments
Apply best practices for Databricks classic computehttps://learn.microsoft.com/en-us/azure/databricks/compute/cluster-config-best-practices
Improve Databricks compute reliability with flexible node typeshttps://learn.microsoft.com/en-us/azure/databricks/compute/flexible-node-types
Apply best practices for Databricks poolshttps://learn.microsoft.com/en-us/azure/databricks/compute/pool-best-practices
Apply Databricks serverless compute best practiceshttps://learn.microsoft.com/en-us/azure/databricks/compute/serverless/best-practices
Use DataFrame caching on serverless computehttps://learn.microsoft.com/en-us/azure/databricks/compute/serverless/dataframe-cache
Use Lakehouse Replay to validate runtime upgradeshttps://learn.microsoft.com/en-us/azure/databricks/compute/serverless/lakehouse-replay
Tune SQL warehouse settings for BI workloadshttps://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/bi-workload-settings
Control large interactive queries with Query Watchdoghttps://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/query-watchdog
Configure dataset materialization for Databricks dashboardshttps://learn.microsoft.com/en-us/azure/databricks/dashboards/materialization
Apply Azure Databricks data engineering best practiceshttps://learn.microsoft.com/en-us/azure/databricks/data-engineering/best-practices
Apply observability best practices to Databricks streaminghttps://learn.microsoft.com/en-us/azure/databricks/data-engineering/observability-best-practices
Best practices for Unity Catalog ABAC policieshttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/best-practices
Apply common ABAC row filter and column mask patternshttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/common-patterns
Optimize ABAC row filter and mask performancehttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/performance
Mask PII columns using ABAC tag introspection in Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/tag-introspection
Apply Unity Catalog best practices for data governancehttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/best-practices
Apply Unity Catalog service policy examples for AIhttps://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/service-policies/policy-examples
Work with legacy Hive metastore objects in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/database-objects/hive-metastore
Safely manage data in DBFS root on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/dbfs/dbfs-root
Follow DBFS and Unity Catalog usage best practiceshttps://learn.microsoft.com/en-us/azure/databricks/dbfs/unity-catalog
Apply Delta Lake best practices on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/delta/best-practices
Use selective overwrite options with Delta Lake on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/delta/selective-overwrite
View Databricks policy families via CLIhttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/policy-families-commands
Develop Databricks Apps using supported frameworks and patternshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/app-development
Apply security and performance best practices for Databricks Appshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/best-practices
Add and use model serving endpoints in Databricks Appshttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/model-serving
Advanced configuration and usage of Databricks Connecthttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/advanced
Test Databricks Connect Python code with pytesthttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/testing
Handle async queries and interruptions with Databricks Connecthttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/queries
Test Databricks Connect Scala code with ScalaTesthttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/testing
Use and optimize Azure Databricks REST APIhttps://learn.microsoft.com/en-us/azure/databricks/dev-tools/rest-api
Apply Databricks developer and CI/CD best practiceshttps://learn.microsoft.com/en-us/azure/databricks/developers/best-practices
Apply Databricks file storage recommendationshttps://learn.microsoft.com/en-us/azure/databricks/files/files-recommendations
Store and reference Databricks init scripts in workspace fileshttps://learn.microsoft.com/en-us/azure/databricks/files/workspace-init-scripts
Curate effective Genie Agents for accurate answershttps://learn.microsoft.com/en-us/azure/databricks/genie-agents/best-practices
Apply prompt and schema tips for Genie Codehttps://learn.microsoft.com/en-us/azure/databricks/genie-code/tips
Deep clone managed Iceberg tables in Unity Cataloghttps://learn.microsoft.com/en-us/azure/databricks/iceberg/clone
Apply Auto Loader best practices for reliable ingestionhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/best-practices
Configure Auto Loader for production workloadshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/production
Use automatic type widening in Databricks Auto Loaderhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/type-widening
Apply common COPY INTO data loading patternshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/examples
Celigo connector FAQ and usage guidancehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/celigo-faq
Apply common patterns to Lakeflow ingestion pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/common-patterns
Apply Confluence connector behaviors and FAQshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-faq
CrowdStrike Falcon Event Stream connector FAQhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/crowdstrike-falcon-event-stream-faq
Use Databricks ingestion gateway event logshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/gateway-event-logs
Apply Glean connector FAQs and usage guidancehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/glean-faq
Use Marketo connector effectively in Lakeflow Connecthttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/marketo-faq
Apply Meta Ads connector usage guidance and FAQshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/meta-ads-faq
Apply MySQL column selection rules in CDC pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql-column-selection
MySQL Lakeflow connector FAQ and usage guidancehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql-faq
Use the PayPal connector effectively in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/paypal-faq
Maintain and operate PostgreSQL Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-maintenance
Use Productboard connector features and behaviorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/productboard-faq
Use the QuickBooks connector effectively in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/quickbooks-faq
Reddit Ads connector usage FAQs and behaviorshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/reddit-ads-faq
Incrementally ingest Salesforce formula fields in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-formula-fields
Configure smart closure for Databricks CDC pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/smart-closure
Xero connector FAQ and usage guidancehttps://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/xero-faq
Use Zerobus acknowledgment callbacks effectivelyhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-callbacks
Choose Zerobus blocking methods for durabilityhttps://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-message-blocking
Implement resilient Zerobus recovery patternshttps://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-recovery
Use and configure Databricks cluster init scriptshttps://learn.microsoft.com/en-us/azure/databricks/init-scripts/
Reference external files in Databricks init scriptshttps://learn.microsoft.com/en-us/azure/databricks/init-scripts/referencing-files
Test applications using the legacy Simba JDBC Driverhttps://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc/testing
Test Databricks ODBC driver connections in codehttps://learn.microsoft.com/en-us/azure/databricks/integrations/odbc/testing
Run backfill operations for scheduled Lakeflow Jobshttps://learn.microsoft.com/en-us/azure/databricks/jobs/backfill-jobs
Diagnose and optimize Lakeflow Jobs performancehttps://learn.microsoft.com/en-us/azure/databricks/jobs/diagnose-job-performance
Implement recurring, backfillable Lakeflow SQL jobshttps://learn.microsoft.com/en-us/azure/databricks/jobs/how-to/create-recurring-job
Apply classic compute best practices for Lakeflow Jobshttps://learn.microsoft.com/en-us/azure/databricks/jobs/run-classic-jobs
Apply Databricks well-architected platform practiceshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/
Implement cost optimization best practices on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/cost-optimization/best-practices
Implement data and AI governance best practices in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/data-governance/best-practices
Apply interoperability and usability best practices in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/best-practices
Apply operational excellence best practices in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/operational-excellence/best-practices
Optimize Databricks performance and efficiencyhttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/best-practices
Implement reliability best practices on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reliability/best-practices
Size and configure Databricks Lakewatch detection warehousehttps://learn.microsoft.com/en-us/azure/databricks/lakewatch/admin/detection-warehouse
Run Lakewatch SIEM workflows end to endhttps://learn.microsoft.com/en-us/azure/databricks/lakewatch/quickstart-guide
Optimize pipeline clusters with enhanced autoscalinghttps://learn.microsoft.com/en-us/azure/databricks/ldp/auto-scaling
Apply Lakeflow pipeline best practices and patternshttps://learn.microsoft.com/en-us/azure/databricks/ldp/best-practices/
Apply processing guarantees in Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/best-practices/processing-guarantees
Prepare Lakeflow pipelines for production readinesshttps://learn.microsoft.com/en-us/azure/databricks/ldp/best-practices/production-readiness
Implement AUTO CDC for SCD tables in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ldp/cdc
Handle environment version compatibility in Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/developer/environment-version-compatibility
Manage external Python dependencies in Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/developer/external-dependencies
Apply data quality expectations in pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-expectations
Implement advanced expectation patterns in Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/ldp/expectation-patterns
Apply data quality expectations in Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/expectations
Use from_json schema inference in Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/from-json-schema-evolution
Perform full refreshes of streaming tables safelyhttps://learn.microsoft.com/en-us/azure/databricks/ldp/full-refresh-st
Load data into Lakeflow pipelines using streaming tableshttps://learn.microsoft.com/en-us/azure/databricks/ldp/load
Optimize stateful streaming with watermarks in pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/stateful-processing
Define transformations in Lakeflow pipelineshttps://learn.microsoft.com/en-us/azure/databricks/ldp/transform
Unit test Lakeflow pipeline transformations with mock datahttps://learn.microsoft.com/en-us/azure/databricks/ldp/unit-testing
Optimize AI Runtime training performance and resiliencyhttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/guides/performance-and-resiliency
Apply Hyperopt best practices and troubleshooting on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-best-practices
Improve Databricks AutoML forecasting with covariateshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl/automl-covariate-forecast
Backfill Databricks Feature Views after source data changeshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/backfill-features
Implement point-in-time correct feature joinshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/time-series
Benchmark Databricks LLM endpoints for latency and throughputhttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/prov-throughput-run-benchmark
Prepare large datasets for distributed training on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/load-data/ddl-data
Configure load testing for Databricks model endpointshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/configure-load-test
Validate models before Databricks Model Serving deploymenthttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-pre-deployment-validation
Optimize Databricks Model Serving for productionhttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/production-optimization
Write effective queries for Unity Gateway reasoning modelshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/query-reason-models
Load test Databricks model serving endpoints with Locusthttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/what-is-load-test
Tune and scale Ray clusters on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/scale-ray
Apply deep learning best practices on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/dl-best-practices
Adapt existing Apache Spark workloads to Databrickshttps://learn.microsoft.com/en-us/azure/databricks/migration/spark
Implement agent observability and quality on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/agent-observability-and-quality
Align MLflow LLM judges with human feedbackhttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/align-judges
Create guidelines-based LLM judges in MLflowhttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/concepts/judges/guidelines
Collect human feedback and build MLflow datasetshttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/human-feedback/
Enable experts to label MLflow traces with Review Apphttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/human-feedback/expert-feedback/label-existing-traces
Evaluate and compare MLflow prompt versionshttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/evaluate-prompts
Enrich MLflow traces with tags, context, and feedbackhttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/enrich-traces
Use MLflow traces to observe and debug agentshttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/observe-with-traces/
Optimize multiple chained prompts with MLflowhttps://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tutorials/examples/multi-prompt-optimization
Apply software engineering practices to Databricks notebookshttps://learn.microsoft.com/en-us/azure/databricks/notebooks/best-practices
Run Databricks notebooks safely and efficientlyhttps://learn.microsoft.com/en-us/azure/databricks/notebooks/run-notebook
Monitor Lakebase Postgres queries with pg_stat_statementshttps://learn.microsoft.com/en-us/azure/databricks/oltp/projects/pg-stat-statements
Tune Lakebase Postgres planner statistics and autovacuumhttps://learn.microsoft.com/en-us/azure/databricks/oltp/projects/postgres-statistics
Apply Azure Databricks performance optimization recommendationshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/
Optimize Azure Databricks performance with disk cachinghttps://learn.microsoft.com/en-us/azure/databricks/optimizations/disk-cache
Use dynamic file pruning to optimize Delta joinshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/dynamic-file-pruning
Manage isolation levels and write conflicts for Delta tableshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/isolation/
Use row-level concurrency to reduce Delta write conflictshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/isolation/row-level-concurrency
Optimize Delta MERGE operations with low shuffle mergehttps://learn.microsoft.com/en-us/azure/databricks/optimizations/low-shuffle-merge
Leverage predictive I/O optimizations with Photonhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-io
Use predictive optimization for Unity Catalog tableshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-optimization
Optimize interval and range joins on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/range-join
Use Spark UI to optimize Databricks cost and performancehttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/
Analyze Spark jobs timeline for Databricks performancehttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/jobs-timeline
Diagnose long Spark jobs using Databricks UIhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage
Optimize high I/O Spark stages in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-io
Diagnose skew and spill in Databricks Spark stageshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-page
Fix long Spark stages with one task in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/one-spark-task
Debug slow low-I/O Spark stages in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/slow-spark-stage-low-io
Optimize many small Spark jobs on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/small-spark-jobs
Identify expensive reads in Databricks SQL DAGhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-dag-expensive-read
Resolve overloaded Spark drivers on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-driver-overloaded
Fix gaps between Spark jobs in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-job-gaps
Detect excessive Delta rewrites in Databricks Sparkhttps://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-rewriting-data
Apply best practices for Partner Connect setuphttps://learn.microsoft.com/en-us/azure/databricks/partner-connect/best-practice
Apply networking best practices for Lakehouse Federationhttps://learn.microsoft.com/en-us/azure/databricks/query-federation/networking
Optimize Azure Databricks Lakehouse Federation performancehttps://learn.microsoft.com/en-us/azure/databricks/query-federation/performance-recommendations
Encrypt inter-node traffic for Databricks clustershttps://learn.microsoft.com/en-us/azure/databricks/security/keys/encrypt-otw
Apply custom DNS best practices for Databricks VNetshttps://learn.microsoft.com/en-us/azure/databricks/security/network/classic/custom-dns
Apply best practices for Unity Catalog secretshttps://learn.microsoft.com/en-us/azure/databricks/security/secrets/best-practices
Use SIGNAL and RESIGNAL in Databricks SQL handlershttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/signal-stmt
Estimate distinct counts with approx_count_distincthttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/approx_count_distinct
Use session_user instead of deprecated current_userhttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/current_user
Use OFFSET and LIMIT for pagination in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-offset
Use REPLACE WHERE flows for targeted recomputeshttps://learn.microsoft.com/en-us/azure/databricks/sql/mv-st/flows-replace-where
Author effective SQL patterns for Databricks alertshttps://learn.microsoft.com/en-us/azure/databricks/sql/user/alerts/query-patterns
Apply Databricks SQL query performance insightshttps://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/performance-insights
Optimize Databricks SQL with RELY constraintshttps://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-optimization-constraints
Use asynchronous transformWithState for higher throughputhttps://learn.microsoft.com/en-us/azure/databricks/stateful-applications/async
Manage schema evolution in Databricks transformWithState state storehttps://learn.microsoft.com/en-us/azure/databricks/stateful-applications/schema-evolution
Manage Structured Streaming checkpoints correctlyhttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/checkpoints
Run multiple Structured Streaming queries per clusterhttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/multiple-streams
Run production Structured Streaming on Lakeflowhttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/production
Use real-time mode for ultra-low latency streaminghttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time/
Optimize and monitor Databricks real-time streaming querieshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time/performance
Use rolling windows for real-time aggregations in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/rolling-window
Optimize stateful Structured Streaming queries on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stateful-streaming
Optimize stateless Structured Streaming querieshttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stateless-streaming
Apply watermarks for stateful streaming controlhttps://learn.microsoft.com/en-us/azure/databricks/structured-streaming/watermarks
Use automatic upgrades for Unity Catalog tableshttps://learn.microsoft.com/en-us/azure/databricks/tables/automatic-upgrades
Optimize tables with liquid clustering in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/tables/clustering
Use data skipping statistics for faster Databricks querieshttps://learn.microsoft.com/en-us/azure/databricks/tables/data-skipping
Optimize partition discovery for external tableshttps://learn.microsoft.com/en-us/azure/databricks/tables/external-partition-discovery
Use deletion vectors to optimize Databricks table writeshttps://learn.microsoft.com/en-us/azure/databricks/tables/features/deletion-vectors
Optimize VARIANT performance with shreddinghttps://learn.microsoft.com/en-us/azure/databricks/tables/features/variant-shredding
Manage Delta and Iceberg table history and time travelhttps://learn.microsoft.com/en-us/azure/databricks/tables/history
Enrich Databricks tables with comments and metadatahttps://learn.microsoft.com/en-us/azure/databricks/tables/operations/custom-metadata
Optimize Delta and Iceberg table file layouthttps://learn.microsoft.com/en-us/azure/databricks/tables/operations/optimize
Vacuum Delta and Iceberg tables for cost and compliancehttps://learn.microsoft.com/en-us/azure/databricks/tables/operations/vacuum
Interpret table size and reclaim storage in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/tables/size
Control Delta and Iceberg data file sizeshttps://learn.microsoft.com/en-us/azure/databricks/tables/tune-file-size
Safely evolve Delta and Iceberg table schemashttps://learn.microsoft.com/en-us/azure/databricks/tables/update-schema
Aggregate data using batch, materialized views, and streaminghttps://learn.microsoft.com/en-us/azure/databricks/transform/aggregation
Design Delta Lake data models on Databrickshttps://learn.microsoft.com/en-us/azure/databricks/transform/data-modeling
Implement joins for batch and streaming in Databrickshttps://learn.microsoft.com/en-us/azure/databricks/transform/join
Optimize join performance on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/transform/optimize-joins
Clean and validate data on Azure Databrickshttps://learn.microsoft.com/en-us/azure/databricks/transform/validate
Use Python scalar UDFs safely in Databricks SQLhttps://learn.microsoft.com/en-us/azure/databricks/udf/python
Define session-scoped Scala and Java UDFshttps://learn.microsoft.com/en-us/azure/databricks/udf/scala
Access task context inside Databricks UDFshttps://learn.microsoft.com/en-us/azure/databricks/udf/udf-task-context
Scale Unity Gateway model inference throughput safelyhttps://learn.microsoft.com/en-us/azure/databricks/unity-gateway/scaling-throughput
Download internet data into Azure Databricks volumeshttps://learn.microsoft.com/en-us/azure/databricks/volumes/download-internet-files

Add the canonical catalog link to the repository README so users can inspect current installs and available audits. The publishing guide covers the complete discovery path.

<a href="https://skillzs.dev/skills/microsoftdocs/agent-skills/azure-databricks">View azure-databricks on skillZs</a>