Source profileQuality 92/100

MicrosoftDocs/Agent-Skills/skills/azure-data-factory/SKILL.md

azure-data-factory

Expert knowledge for Azure Data Factory development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when building ADF pipelines with data flows, SHIR/SSIS IR, VNets/private endpoints, CI/CD templates, or SAP CDC, and other Azure Data Factory related development tasks. Not for Azure Synapse Analytics (use azure-synapse-analytics), Azure Databricks (use azure-da

Source repository stars
717
Declared platforms
0
Static risk flags
0
Last source update
2026-08-17
Source checked
2026-08-25
DecisionCompatibilityInstallWorkflowPermissionsEvidenceSourceFAQ

Decision brief

What it does: where it fits

This skill provides expert guidance for Azure Data Factory. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference conten…

Best for

  • Use when building ADF pipelines with data flows, SHIR/SSIS IR, VNets/private endpoints, CI/CD templates, or SAP CDC, and other Azure Data Factory related development tasks.

Not for

  • Tasks that require unconfirmed production actions or broad system permissions.
  • Environments where the pinned source and install steps cannot be inspected.

Compatibility matrix

Platform support, with evidence labels

PlatformStatusEvidenceWhat to check
CodexNot declaredNo explicit evidencePortability before use
Claude CodeNot declaredNo explicit evidencePortability before use
CursorNot declaredNo explicit evidencePortability before use
Gemini CLINot declaredNo explicit evidencePortability before use
Open the compatibility checker

Installation

Inspect first. Install second.

The source command is displayed only when detected. A safe inspection prompt is always available so your agent can explain every action before execution.

Source-detected install commandSource
npx skills add https://github.com/MicrosoftDocs/Agent-Skills --skill "skills/azure-data-factory"
Safe inspection promptEditorial

Inspect the Agent Skill "azure-data-factory" from https://github.com/MicrosoftDocs/Agent-Skills/blob/c579bb4b37e7969ffc8bc071ca0f53048c3bfe41/skills/azure-data-factory/SKILL.md at commit c579bb4b37e7969ffc8bc071ca0f53048c3bfe41. List every install step, command, network request, credential, file read/write, external action, and rollback step. Explain whether it fits my task. Do not install or execute anything until I approve.

Workflow

What the source asks the agent to do

  1. 01

    How to Use This Skill

    IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use readfile with the specified lines. For categories with file links (e.g., security.md), use readfile on the linked reference file

    Preferred: Use mcpmicrosoftdocs:microsoftdocsfetch with query string from=learn-agent-skill. Returns Markdown.Fallback: Use fetchwebpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use readfile with the specified lines. For categories with file links (e.g., security.md),…
  2. 02

    Category Index

    Review the “Category Index” section in the pinned source before continuing.

    Review and apply the “Category Index” source section.
  3. 03

    Troubleshooting

    Review the “Troubleshooting” section in the pinned source before continuing.

    Review and apply the “Troubleshooting” source section.
  4. 04

    Best Practices

    Review the “Best Practices” section in the pinned source before continuing.

    Review and apply the “Best Practices” source section.
  5. 05

    Decision Making

    Review the “Decision Making” section in the pinned source before continuing.

    Review and apply the “Decision Making” source section.

Permission review

Static risk signals and limitations

No configured static risk pattern was detected

This is not proof of safety. Runtime behavior, indirect dependencies, and hidden external systems are outside the static scan.

Evidence record

Why each signal appears

EvidenceSourceComputedTestedEditorial
SignalValueEvidence typeMeaning
Quality score92/100ComputedDocumentation, specificity, maintenance, and trust rules
Repository stars717SourceRepository attention, not individual Skill quality
Compatibility0 platformsSourceDeclared in the catalog source record
Usage guideautomated source guideEditorialGenerated or reviewed according to the visible evidence level

Pinned source

Provenance and original SKILL.md

Repository
MicrosoftDocs/Agent-Skills
Skill path
skills/azure-data-factory/SKILL.md
Commit
c579bb4b37e7969ffc8bc071ca0f53048c3bfe41
License
CC-BY-4.0
Collected
2026-08-25
Default branch
main
View the original SKILL.md

Azure Data Factory Skill

This skill provides expert guidance for Azure Data Factory. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

  • Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
  • Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.

Category Index

CategoryLinesDescription
TroubleshootingL37-L91Diagnosing and fixing ADF failures: connector/format errors, CDC, pipelines, triggers, data flows, SHIR/SSIS IR, performance, security, and known issues with concrete error patterns and workarounds.
Best PracticesL92-L114Performance tuning, schema drift/error handling, reusable patterns, and migration best practices for Data Factory mapping data flows, copy activity, runtimes, and data lake writes.
Decision MakingL115-L133Guidance on cost planning, connector upgrades, integration runtime and compute choices, and migration/modernization of ADF, SSIS, Synapse, and pipelines to Fabric.
Architecture & Design PatternsL134-L142Patterns and architectures for ADF: efficient mapping data flows, metadata‑driven copy, SSIS IR with SQL MI/failover/VNet, Cosmos DB migration, and SAP CDC design.
Limits & QuotasL143-L150Configuring Until/Wait activity limits and timeouts, understanding data flow reservation discounts, and reviewing ADF service quotas and capacity constraints.
SecurityL151-L182Securing Data Factory with network, identity, and encryption controls: VNets, private endpoints, firewalls, managed identities, Key Vault, CMK, TLS, and secure access to SQL, Purview, and SSIS IR.
ConfigurationL183-L294Configuring ADF: integration runtimes, SSIS/SHIR, triggers, monitoring/logging, copy/data flows, formats/connectors, parameters/expressions, and pipeline/control activities.
Integrations & Coding PatternsL295-L462Connecting Azure Data Factory to diverse data sources (SaaS, databases, files, SAP), using connectors, mapping data flow functions, SSIS integration, and reusable copy/transform templates.
DeploymentL463-L476CI/CD and deployment for ADF: ARM/linked templates, Azure DevOps pipelines, hotfix flows, pre/post scripts, SSIS job migration, and integration runtime install/migration.

Troubleshooting

TopicURL
Troubleshoot Azure Data Factory change data capturehttps://learn.microsoft.com/en-us/azure/data-factory/change-data-capture-troubleshoot
Troubleshoot CI/CD, Azure DevOps, and GitHub integration for ADFhttps://learn.microsoft.com/en-us/azure/data-factory/ci-cd-github-troubleshoot-guide
Resolve common Azure Data Factory connector upgrade issueshttps://learn.microsoft.com/en-us/azure/data-factory/connector-deprecation-frequently-asked-questions
Diagnose and fix Azure Data Factory Amazon S3 connector errorshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-amazon-simple-storage-service
Fix Azure Blob Storage connector issues in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-blob-storage
Diagnose and fix Azure Cosmos DB connector issueshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-cosmos-db
Resolve Azure Data Explorer connector problems in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-data-explorer
Troubleshoot Azure Data Lake Storage connectors in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-data-lake
Resolve Azure Data Factory Azure Files connector issueshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-files
Troubleshoot Azure Data Factory Azure Table Storage connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-azure-table-storage
Resolve DB2 connector problems in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-db2
Fix delimited text connector errors in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-delimited-text
Resolve Dynamics 365 and Dataverse connector issueshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-dynamics-dataverse
Troubleshoot file system connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-file-system
Troubleshoot FTP, SFTP, and HTTP connectors in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-ftp-sftp-http
Fix common Azure Data Factory Google Ads connector problemshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-google-ads
Diagnose and fix Azure Data Factory connector issueshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-guide
Diagnose Azure Data Factory Hive connector connection and query errorshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-hive
Troubleshoot Microsoft Fabric Lakehouse connector in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-microsoft-fabric-lakehouse
Fix Microsoft Fabric Warehouse connector issues in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-microsoft-fabric-warehouse
Resolve Azure Data Factory MongoDB connector errorshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-mongodb
Resolve Oracle connector issues in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-oracle
Troubleshoot ORC format connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-orc
Fix Parquet format connector issues in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-parquet
Fix Azure Database for PostgreSQL connector issueshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-postgresql
Diagnose REST connector failures in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-rest
Resolve Salesforce and Service Cloud connector issueshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-salesforce
Resolve SAP connector issues in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-sap
Fix ServiceNow connector problems in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-servicenow
Fix SharePoint Online list connector problems in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-sharepoint-online-list
Resolve Shopify connector issues in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-shopify
Troubleshoot Snowflake connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-snowflake
Troubleshoot SQL-based connectors in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-synapse-sql
Fix Teradata connector failures in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-teradata
Troubleshoot Azure Data Factory XML format connector parsing and schema issueshttps://learn.microsoft.com/en-us/azure/data-factory/connector-troubleshoot-xml
Use Fail activity to surface custom errors in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-fail-activity
Troubleshoot Copy activity performance issueshttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-performance-troubleshooting
Troubleshoot external control activities in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/data-factory-troubleshoot-guide
Diagnose and fix Azure Data Factory Studio issueshttps://learn.microsoft.com/en-us/azure/data-factory/data-factory-ux-troubleshoot-guide
Troubleshoot mapping data flow connector and format issueshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-troubleshoot-connector-format
Resolve mapping data flow issues in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-troubleshoot-guide
Work around known Azure Data Factory issueshttps://learn.microsoft.com/en-us/azure/data-factory/known-issues-troubleshoot-guide
Troubleshoot Azure Data Factory pipeline orchestration and triggershttps://learn.microsoft.com/en-us/azure/data-factory/pipeline-trigger-troubleshoot-guide
Troubleshoot Azure Data Factory SAP CDC via SHIR logshttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-debug-shir-logs
Resolve security and access control issues in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/security-and-access-control-troubleshoot-guide
Use the self-hosted integration runtime diagnostic toolhttps://learn.microsoft.com/en-us/azure/data-factory/self-hosted-integration-runtime-diagnostic-tool
Troubleshoot self-hosted integration runtime issueshttps://learn.microsoft.com/en-us/azure/data-factory/self-hosted-integration-runtime-troubleshoot-guide
Troubleshoot SSIS IR connectivity with diagnose featurehttps://learn.microsoft.com/en-us/azure/data-factory/ssis-integration-runtime-diagnose-connectivity-faq
Diagnose and fix SSIS IR management issueshttps://learn.microsoft.com/en-us/azure/data-factory/ssis-integration-runtime-management-troubleshoot
Troubleshoot SSIS package execution on SSIS IRhttps://learn.microsoft.com/en-us/azure/data-factory/ssis-integration-runtime-ssis-activity-faq
Interpret pipeline failure status and error messages in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-pipeline-failure-error-handling

Best Practices

TopicURL
Use column patterns in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-column-pattern
Reuse logic with flowlets in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-flowlet
Tune mapping data flow performance in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance
Optimize sink performance in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance-sinks
Optimize source performance in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance-sources
Improve transformation performance in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance-transformations
Handle schema drift in Data Factory mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-schema-drift
Tune integration runtime performance for data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime-performance
Tune Azure-SSIS integration runtime for high performancehttps://learn.microsoft.com/en-us/azure/data-factory/configure-azure-ssis-integration-runtime-performance
Optimize Azure Data Factory copy activity performancehttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-performance
Optimize Azure Data Factory copy activity performancehttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-performance-features
Migrate on-premises HDFS data to Azure Storagehttps://learn.microsoft.com/en-us/azure/data-factory/data-migration-guidance-hdfs-azure-storage
Migrate Netezza data to Azure with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/data-migration-guidance-netezza-azure-sqldw
Migrate data from Amazon S3 to Azure Storage with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/data-migration-guidance-s3-azure-storage
Dedupe rows and detect nulls using ADF data flow snippetshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-data-flow-dedupe-nulls-snippets
Handle error rows and truncation in ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-data-flow-error-rows
Implement BCDR strategies for Data Factory pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/pipelines-disaster-recovery
Apply advanced SAP CDC features and best practiceshttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-advanced-topics
Apply data flow best practices for writing to data lakehttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-data-flow-write-to-lake

Decision Making

TopicURL
Use automatic connector upgrades in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/automatic-connector-upgrade
Interpret pricing examples for ADF integration runtimeshttps://learn.microsoft.com/en-us/azure/data-factory/better-understand-different-integration-runtime-charges
Choose the right integration runtime architecturehttps://learn.microsoft.com/en-us/azure/data-factory/choose-the-right-integration-runtime-configuration
Choose compute environments for Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/compute-linked-services
Use connector upgrade advisor for ADF and Synapsehttps://learn.microsoft.com/en-us/azure/data-factory/connector-upgrade-advisor
Decide how and when to upgrade ADF connectorshttps://learn.microsoft.com/en-us/azure/data-factory/connector-upgrade-guidance
Buy and use ADF data flow reserved capacity for cost savingshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-reserved-capacity-overview
Plan data lake and EDW migration to Azure with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/data-migration-guidance-overview
Assess Azure Data Factory pipelines for Fabric migrationhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-assess-your-azure-data-factory-to-fabric-data-factory-migration
Choose and provision Enterprise Edition Azure-SSIS IRhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-configure-azure-ssis-ir-enterprise-edition
Upgrade Azure Data Factory pipelines to Fabric Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-upgrade-your-azure-data-factory-pipelines-to-fabric-data-factory
Modernize Synapse pipelines with Fabric Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-upgrade-your-azure-synapse-analytics-pipelines-to-fabric-data-factory
Plan and manage Azure Data Factory costshttps://learn.microsoft.com/en-us/azure/data-factory/plan-manage-costs
Assess and plan SSIS migration to Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/scenario-ssis-migration-overview
Apply SSIS migration assessment rules for ADF/Synapsehttps://learn.microsoft.com/en-us/azure/data-factory/scenario-ssis-migration-rules

Architecture & Design Patterns

TopicURL
Design efficient pipelines using mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-performance-pipelines
Configure Azure-SSIS IR with SQL failover groupshttps://learn.microsoft.com/en-us/azure/data-factory/configure-bcdr-azure-ssis-integration-runtime
Build metadata-driven large-scale copy pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/copy-data-tool-metadata-driven
Migrate Azure SQL schemas to Azure Cosmos DB with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-sqldb-to-cosmosdb
Decide when and how to join Azure-SSIS integration runtime to a virtual networkhttps://learn.microsoft.com/en-us/azure/data-factory/join-azure-ssis-integration-runtime-virtual-network

Limits & Quotas

TopicURL
Configure Until activity loops and timeouts in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-until-activity
Configure Wait activity durations in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-wait-activity
Understand reservation discounts for ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-understand-reservation-charges
Review Azure Data Factory limits and quotas from FAQhttps://learn.microsoft.com/en-us/azure/data-factory/frequently-asked-questions

Security

TopicURL
Allow Azure Integration Runtime IP ranges through firewallshttps://learn.microsoft.com/en-us/azure/data-factory/azure-integration-runtime-ip-addresses
Configure VNet injection for Azure-SSIS IR securelyhttps://learn.microsoft.com/en-us/azure/data-factory/azure-ssis-integration-runtime-virtual-network-configuration
Configure roles and permissions for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/concepts-roles-permissions
Configure outbound FQDN allow lists with Azure Policy for ADFhttps://learn.microsoft.com/en-us/azure/data-factory/configure-outbound-allow-list-azure-policy
Use Azure credentials and managed identities in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/credentials
Plan secure data access strategies for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/data-access-strategies
Configure Azure Private Link for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/data-factory-private-link
Configure managed identities for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/data-factory-service-identity
Security infrastructure and data movement in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/data-movement-security-considerations
Enable Microsoft Entra authentication for Azure-SSIS integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/enable-aad-authentication-azure-ssis-ir
Enable customer-managed keys (BYOK) for ADF encryptionhttps://learn.microsoft.com/en-us/azure/data-factory/enable-customer-managed-key
Encrypt credentials for self-hosted integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/encrypt-credentials-self-hosted-integration-runtime
Access secured Purview from Data Factory via private endpointshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-access-secured-purview-account
Use Azure Key Vault secrets in ADF pipeline activitieshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-use-azure-key-vault-secrets-pipeline-activities
Join Azure-SSIS IR to VNet using PowerShellhttps://learn.microsoft.com/en-us/azure/data-factory/join-azure-ssis-integration-runtime-virtual-network-powershell
Join Azure-SSIS IR to VNet via portalhttps://learn.microsoft.com/en-us/azure/data-factory/join-azure-ssis-integration-runtime-virtual-network-ui
Secure Azure Data Factory with managed VNets and private endpointshttps://learn.microsoft.com/en-us/azure/data-factory/managed-virtual-network-private-endpoint
Configure modern trusted service firewall bypass in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/modern-trusted-service
Use built-in Azure Policy definitions for Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/policy-reference
Secure Azure Data Factory with network and identity controlshttps://learn.microsoft.com/en-us/azure/data-factory/secure-your-azure-data-factory
Detect and mask PII data with ADF solution templatehttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-pii-detection-and-masking
Configure Windows authentication for SSIS packages in Azurehttps://learn.microsoft.com/en-us/azure/data-factory/ssis-azure-connect-with-windows-auth
Store ADF credentials securely in Azure Key Vaulthttps://learn.microsoft.com/en-us/azure/data-factory/store-credentials-in-key-vault
Use private endpoints to securely copy data with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-copy-data-portal-private
Configure Azure-SSIS integration runtime in virtual networkhttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-deploy-ssis-virtual-network
Secure self-hosted integration runtime with TLS from intranethttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-enable-remote-access-intranet-tls-ssl-certificate
Secure on-prem SQL access via Data Factory managed VNethttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-managed-virtual-network-on-premise-sql-server
Configure private endpoint access to SQL Managed Instance from Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-managed-virtual-network-sql-managed-instance

Configuration

TopicURL
Define and use global parameters in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/author-global-parameters
Configure connections and global settings in ADF management hubhttps://learn.microsoft.com/en-us/azure/data-factory/author-management-hub
Configure express virtual network injection for Azure-SSIS IRhttps://learn.microsoft.com/en-us/azure/data-factory/azure-ssis-integration-runtime-express-virtual-network-injection
Manage SSIS packages with Azure-SSIS package storehttps://learn.microsoft.com/en-us/azure/data-factory/azure-ssis-integration-runtime-package-store
Configure standard virtual network injection for Azure-SSIS integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/azure-ssis-integration-runtime-standard-virtual-network-injection
Use built-in components on Azure-SSIS Integration Runtimehttps://learn.microsoft.com/en-us/azure/data-factory/built-in-preinstalled-components-ssis-integration-runtime
Configure integration runtimes for Azure Data Factory and Synapsehttps://learn.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime
Define and configure linked services in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/concepts-linked-services
Configure Azure Data Factory Oracle connector settingshttps://learn.microsoft.com/en-us/azure/data-factory/connector-oracle
Configure custom ARM template parameters for ADF CI/CDhttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-resource-manager-custom-parameters
Configure Data Flow activity executionhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-execute-data-flow-activity
Use Azure Data Factory expression language and functionshttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-expression-language-functions
Configure ForEach looping activity in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-for-each-activity
Configure Get Metadata activity for ADF datasetshttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-get-metadata-activity
Set up If Condition activity in ADF pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-if-condition-activity
Use Power Query activity for data wranglinghttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-power-query-activity
Configure Set Variable and pipeline return valueshttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-set-variable-activity
Configure Switch activity for conditional routinghttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-switch-activity
Use system variables in Azure Data Factory expressionshttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-system-variables
Configure Validation activity for dataset readiness in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-validation-activity
Enable data consistency verification in ADF copyhttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-data-consistency
Configure fault tolerance for Copy activityhttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-fault-tolerance
Configure session logging for Copy activityhttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-log
Configure monitoring for ADF copy activitieshttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-monitoring
Configure Copy activity in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-overview
Preserve metadata and ACLs in ADF copy activityhttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-preserve-metadata
Configure schema and data type mapping in ADF copyhttps://learn.microsoft.com/en-us/azure/data-factory/copy-activity-schema-and-type-mapping
Use the Copy Data tool in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/copy-data-tool
Create and configure Azure integration runtimeshttps://learn.microsoft.com/en-us/azure/data-factory/create-azure-integration-runtime
Provision Azure-SSIS integration runtime in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/create-azure-ssis-integration-runtime
Create Azure-SSIS integration runtime via Azure portalhttps://learn.microsoft.com/en-us/azure/data-factory/create-azure-ssis-integration-runtime-portal
Create Azure-SSIS integration runtime via PowerShellhttps://learn.microsoft.com/en-us/azure/data-factory/create-azure-ssis-integration-runtime-powershell
Deploy Azure-SSIS IR using ARM templateshttps://learn.microsoft.com/en-us/azure/data-factory/create-azure-ssis-integration-runtime-resource-manager-template
Create shared self-hosted IR with PowerShellhttps://learn.microsoft.com/en-us/azure/data-factory/create-shared-self-hosted-integration-runtime-powershell
Configure cross-tenant Azure DevOps connections for ADFhttps://learn.microsoft.com/en-us/azure/data-factory/cross-tenant-connections-to-azure-devops
Configure Aggregate transformation in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-aggregate
Configure Alter row transformation for database updateshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-alter-row
Set and use Assert transformation in data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-assert
Use Cast transformation to change column data typeshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-cast
Configure Conditional split transformation in data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-conditional-split
Configure Derived column transformation in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-derived-column
Configure Exists transformation for row matchinghttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-exists
Configure Filter transformation to remove rowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-filter
Configure Flatten transformation for hierarchical datahttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-flatten
Use Flowlet transformation to reuse data flow logichttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-flowlet
Configure Join transformation in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-join
Configure Lookup transformation for reference datahttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-lookup
Configure multiple branches in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-new-branch
Configure Parse transformation for embedded documentshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-parse
Configure Pivot transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-pivot
Configure Rank transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-rank
Author and configure mapping data flow scripthttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-script
Configure Select transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-select
Configure sink settings in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-sink
Configure Sort transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-sort
Configure source settings in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-source
Configure Stringify transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-stringify
Configure Surrogate Key transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-surrogate-key
Configure Union transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-union
Configure Unpivot transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-unpivot
Configure Window transformation in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-window
Configure Avro format options in ADF and Synapsehttps://learn.microsoft.com/en-us/azure/data-factory/format-avro
Configure binary dataset format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-binary
Configure Common Data Model format in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-common-data-model
Configure delimited text datasets in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-delimited-text
Configure Delta Lake format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-delta
Configure Excel file format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-excel
Configure Iceberg table format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-iceberg
Configure JSON file format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-json
Configure ORC format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-orc
Configure Parquet format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-parquet
Configure XML format in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/format-xml
Configure Bring Your Own Driver connectors in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/guidance-for-byod-approach
Customize Azure-SSIS integration runtime setup with additional componentshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-configure-azure-ssis-ir-custom-setup
Configure SHIR for Azure Log Analytics collectionhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-configure-shir-for-log-analytics-collection
Configure custom Event Grid triggers for Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-create-custom-event-trigger
Create storage event-based triggers in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-create-event-trigger
Configure schedule triggers in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-create-schedule-trigger
Configure tumbling window triggers in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-create-tumbling-window-trigger
Develop and install licensed SSIS IR components in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-develop-azure-ssis-ir-licensed-components
Use parameters and expression language in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-expression-language-functions
Manage Azure Data Factory studio settings and preferenceshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-manage-settings
Control Azure Data Factory studio preview experiencehttps://learn.microsoft.com/en-us/azure/data-factory/how-to-manage-studio-preview-exp
Run self-hosted IR in Windows containershttps://learn.microsoft.com/en-us/azure/data-factory/how-to-run-self-hosted-integration-runtime-in-windows-container
Schedule start and stop of Azure-SSIS integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/how-to-schedule-azure-ssis-integration-runtime
Use trigger metadata parameters in ADF pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-use-trigger-parameterization
Reconfigure Azure-SSIS integration runtime settingshttps://learn.microsoft.com/en-us/azure/data-factory/manage-azure-ssis-integration-runtime
Configure diagnostic settings and Log Analytics for ADFhttps://learn.microsoft.com/en-us/azure/data-factory/monitor-configure-diagnostics
Use monitoring reference data for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/monitor-data-factory-reference
Configure monitoring for Azure Data Factory integration runtimeshttps://learn.microsoft.com/en-us/azure/data-factory/monitor-integration-runtime
Monitor integration runtimes in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/monitor-integration-runtime
Set up ADF diagnostic logs via Azure Monitor REST APIhttps://learn.microsoft.com/en-us/azure/data-factory/monitor-logs-rest
Configure monitoring for managed VNet integration runtimeshttps://learn.microsoft.com/en-us/azure/data-factory/monitor-managed-virtual-network-integration-runtime
Monitor SHIR Azure VMs with diagnosticshttps://learn.microsoft.com/en-us/azure/data-factory/monitor-shir-in-azure
Monitor SSIS operations in ADF using Azure Monitorhttps://learn.microsoft.com/en-us/azure/data-factory/monitor-ssis
Apply naming rules for Azure Data Factory artifactshttps://learn.microsoft.com/en-us/azure/data-factory/naming-rules
Parameterize linked services in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/parameterize-linked-services
Parameterize mapping data flows from ADF pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/parameters-data-flow
Operate and configure SAP CDC processes in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-management
Set up SAP CDC linked service and datasethttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-prepare-linked-service-source-dataset
Configure prerequisites for Azure Data Factory SAP CDChttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-prerequisites-configuration
Configure self-hosted IR for SAP CDC connectorhttps://learn.microsoft.com/en-us/azure/data-factory/sap-change-data-capture-shir-preparation
Configure SHIR autoupdate and expiry notificationshttps://learn.microsoft.com/en-us/azure/data-factory/self-hosted-integration-runtime-auto-update
Configure self-hosted integration runtime as proxy for Azure-SSIS IRhttps://learn.microsoft.com/en-us/azure/data-factory/self-hosted-integration-runtime-proxy-ssis
Configure source control for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/source-control
Supported file formats and compression in ADF copyhttps://learn.microsoft.com/en-us/azure/data-factory/supported-file-formats-and-compression-codecs
Configure tumbling window trigger dependencies in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/tumbling-window-trigger-dependency
Return values from child pipelines in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-pipeline-return-value

Integrations & Coding Patterns

TopicURL
Configure SAP CDC connector to load data into Fabric OneLakehttps://learn.microsoft.com/en-us/azure/data-factory/change-data-capture-from-sap-to-onelake-with-azure-data-factory
Use expression builder for ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/concepts-data-flow-expression-builder
Connect Azure Data Factory to Microsoft Purviewhttps://learn.microsoft.com/en-us/azure/data-factory/connect-data-factory-to-azure-purview
Configure ADF connector for Amazon Marketplace Web Servicehttps://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-marketplace-web-service
Integrate Amazon RDS for Oracle with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-rds-for-oracle
Copy data from Amazon RDS for SQL Server with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-rds-for-sql-server
Integrate Azure Data Factory with Amazon Redshifthttps://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-redshift
Configure ADF Amazon S3-compatible storage connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-s3-compatible-storage
Copy and transform data in Amazon S3 with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-simple-storage-service
Transform AppFigures data with ADF Data Flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-appfigures
Transform Asana data with ADF Data Flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-asana
Copy and transform data in Azure Blob Storage with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-blob-storage
Transform data in Cosmos DB analytical store via ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-cosmos-analytical-store
Configure ADF copy activity with Azure Cosmos DB for NoSQLhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-cosmos-db
Copy data to and from Azure Cosmos DB for MongoDBhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-cosmos-db-mongodb-api
Copy and transform data in Azure Data Explorer with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-data-explorer
Copy and transform data in Azure Data Lake Storage Gen2https://learn.microsoft.com/en-us/azure/data-factory/connector-azure-data-lake-storage
Copy data to and from Data Lake Storage Gen1 using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-data-lake-store
Copy data from Azure Database for MariaDB with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-database-for-mariadb
Copy and transform data in Azure Database for MySQL using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-database-for-mysql
Copy and transform data in Azure Database for PostgreSQLhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-database-for-postgresql
Copy data to and from Azure Databricks Delta Lake with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-databricks-delta-lake
Copy data to and from Azure Files using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-file-storage
Push data to Azure Search index with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-search
Copy and transform data in Azure Synapse Analytics with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-sql-data-warehouse
Copy and transform data in Azure SQL Database with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-sql-database
Copy and transform data in Azure SQL Managed Instancehttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-sql-managed-instance
Copy data to and from Azure Table storage using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-azure-table-storage
Copy data from Cassandra using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-cassandra
Configure Azure Data Factory Concur connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-concur
Integrate Azure Data Factory with Couchbase sourcehttps://learn.microsoft.com/en-us/azure/data-factory/connector-couchbase
Transform data in data.world using Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-dataworld
Integrate Azure Data Factory with DB2https://learn.microsoft.com/en-us/azure/data-factory/connector-db2
Integrate Azure Data Factory with Apache Drillhttps://learn.microsoft.com/en-us/azure/data-factory/connector-drill
Use Dynamics AX connector in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-dynamics-ax
Copy and transform Dynamics 365/Dataverse data with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-dynamics-crm-office-365
Copy data to and from file systems with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-file-system
Configure FTP connector for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-ftp
Connect Azure Data Factory to GitHub for CDMhttps://learn.microsoft.com/en-us/azure/data-factory/connector-github
Configure Google Ads connector in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-google-adwords
Copy data from Google BigQuery V2 with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-google-bigquery
Copy data from Google BigQuery V1 with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-google-bigquery-legacy
Copy data from Google Cloud Storage using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-google-cloud-storage
Transform Google Sheets data with ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-google-sheets
Configure Greenplum connector for Azure Data Factory copyhttps://learn.microsoft.com/en-us/azure/data-factory/connector-greenplum
Integrate Azure Data Factory with HBase sourcehttps://learn.microsoft.com/en-us/azure/data-factory/connector-hbase
Use HDFS connector with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-hdfs
Copy data from Hive using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-hive
Configure HTTP source connector in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-http
Copy data from HubSpot using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-hubspot
Integrate Azure Data Factory with Impala sourcehttps://learn.microsoft.com/en-us/azure/data-factory/connector-impala
Integrate IBM Informix with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-informix
Integrate Jira as a source in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-jira
Copy data from Magento using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-magento
Copy data from MariaDB using Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-mariadb
Configure Marketo connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-marketo
Use Microsoft Access connector with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-microsoft-access
Copy and transform data in Microsoft Fabric Lakehousehttps://learn.microsoft.com/en-us/azure/data-factory/connector-microsoft-fabric-lakehouse
Copy and transform data in Microsoft Fabric Warehousehttps://learn.microsoft.com/en-us/azure/data-factory/connector-microsoft-fabric-warehouse
Integrate Azure Data Factory with MongoDB connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-mongodb
Configure Azure Data Factory MongoDB Atlas connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-mongodb-atlas
Use legacy MongoDB connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-mongodb-legacy
Use Azure Data Factory MySQL connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-mysql
Configure Azure Data Factory Netezza connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-netezza
Configure Azure Data Factory OData connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-odata
Configure Azure Data Factory ODBC connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-odbc
Copy and transform Microsoft 365 data with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-office-365
Integrate Oracle Cloud Storage with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-oracle-cloud-storage
Connect Azure Data Factory to Oracle Eloquahttps://learn.microsoft.com/en-us/azure/data-factory/connector-oracle-eloqua
Connect Azure Data Factory to Oracle Responsyshttps://learn.microsoft.com/en-us/azure/data-factory/connector-oracle-responsys
Use Oracle Service Cloud connector in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-oracle-service-cloud
Connect Azure Data Factory to PayPal datahttps://learn.microsoft.com/en-us/azure/data-factory/connector-paypal
Use Azure Data Factory Phoenix connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-phoenix
Use PostgreSQL V2 connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-postgresql
Configure PostgreSQL V1 connector in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-postgresql-legacy
Use Azure Data Factory Presto connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-presto
Transform Quickbase data with ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-quickbase
Connect Azure Data Factory to QuickBooks Onlinehttps://learn.microsoft.com/en-us/azure/data-factory/connector-quickbooks
Integrate REST endpoints with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-rest
Use Salesforce V2 connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce
Connect Salesforce V1 to Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce-legacy
Integrate Salesforce Marketing Cloud with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce-marketing-cloud
Use Salesforce Service Cloud V2 connector in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce-service-cloud
Use Salesforce Service Cloud V1 connector in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce-service-cloud-legacy
Configure SAP BW connector for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-business-warehouse
Use SAP BW Open Hub connector in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-business-warehouse-open-hub
Transform SAP ODP data with SAP CDC connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-change-data-capture
Connect SAP Cloud for Customer with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-cloud-for-customer
Copy data from SAP ECC with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-ecc
Configure SAP HANA connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-hana
Copy data from SAP tables using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sap-table
Use ServiceNow V2 connector with Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-servicenow
Configure ServiceNow V1 connector in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-servicenow-legacy
Connect SFTP servers to Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sftp
Integrate SharePoint Online lists with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sharepoint-online-list
Connect Azure Data Factory to Shopify datahttps://learn.microsoft.com/en-us/azure/data-factory/connector-shopify
Transform Smartsheet data using Data Factory data flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-smartsheet
Configure Snowflake V2 connector and data flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-snowflake
Configure Snowflake V1 connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-snowflake-legacy
Configure Spark connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-spark
Configure Azure Data Factory SQL Server connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sql-server
Set up Azure Data Factory Square connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-square
Set up Sybase connector for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-sybase
Use TeamDesk connector for ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-teamdesk
Configure Azure Data Factory Teradata Vantage connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-teradata
Use Twilio connector for ADF data flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-twilio
Configure Vertica connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-vertica
Use Web Table connector in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-web-table
Integrate Azure Data Factory with Xero connectorhttps://learn.microsoft.com/en-us/azure/data-factory/connector-xero
Transform Zendesk data with Azure Data Factory data flowshttps://learn.microsoft.com/en-us/azure/data-factory/connector-zendesk
Configure Zoho connector (End of Support) in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/connector-zoho
Configure Lookup activity to read external datahttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-lookup-activity
Invoke REST endpoints with Web activity in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-web-activity
Control pipelines using Webhook activity callbackshttps://learn.microsoft.com/en-us/azure/data-factory/control-flow-webhook-activity
Deploy and run SSIS packages on Azure-SSIS integration runtimehttps://learn.microsoft.com/en-us/azure/data-factory/create-azure-ssis-integration-runtime-deploy-packages
Apply aggregate functions in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-aggregate-functions
Use array functions in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-array-functions
Use cached lookup functions in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-cached-lookup-functions
Use conversion functions in Azure Data Factory mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-conversion-functions
Use date and time functions in ADF mapping flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-date-time-functions
Use expression functions in ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-expression-functions
Reference for all ADF mapping data flow functionshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-expressions-usage
Call external endpoints from ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-external-call
Use map functions in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-map-functions
Use metafunctions in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-metafunctions
Use window functions in mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/data-flow-window-functions
Use mapping data flow transformation functionshttps://learn.microsoft.com/en-us/azure/data-factory/data-transformation-functions
Automate SSISDB log cleanup with Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-clean-up-ssisdb-logs-with-elastic-jobs
Integrate Azure Data Factory with Microsoft Purviewhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-discover-explore-purview-data
Process fixed-width text files with ADF mapping data flowshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-fixed-width
Configure ADF Copy activity to ingest data into Fabrichttps://learn.microsoft.com/en-us/azure/data-factory/how-to-ingest-data-into-fabric-from-azure-data-factory
Execute SSIS packages with Azure-enabled dtexec utilityhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-invoke-ssis-package-azure-enabled-dtexec
Run SSIS packages via Azure SQL MI Agenthttps://learn.microsoft.com/en-us/azure/data-factory/how-to-invoke-ssis-package-managed-instance-agent
Execute SSIS packages in Azure from SSDThttps://learn.microsoft.com/en-us/azure/data-factory/how-to-invoke-ssis-package-ssdt
Run SSIS packages via Execute SSIS Package activity in portalhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-invoke-ssis-package-ssis-activity
Execute SSIS packages with ADF activity and PowerShellhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-invoke-ssis-package-ssis-activity-powershell
Invoke SSIS packages via Stored Procedure Activityhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-invoke-ssis-package-stored-procedure-activity
Send email notifications from ADF and Synapse pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/how-to-send-email
Integrate Azure SQL Managed Instance with SSIS in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-use-sql-managed-instance-with-ir
Copy data from ADLS Gen1 to Gen2 with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/load-azure-data-lake-storage-gen2-from-gen1
Programmatically monitor Azure Data Factory pipelines via SDKshttps://learn.microsoft.com/en-us/azure/data-factory/monitor-programmatically
Create Azure Data Factory via .NET SDKhttps://learn.microsoft.com/en-us/azure/data-factory/quickstart-create-data-factory-dot-net
Create Azure Data Factory with Python SDKhttps://learn.microsoft.com/en-us/azure/data-factory/quickstart-create-data-factory-python
Create Azure Data Factory via REST APIhttps://learn.microsoft.com/en-us/azure/data-factory/quickstart-create-data-factory-rest-api
Use Azure PowerShell scripts to manage Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/samples-powershell
Bulk copy from ADLS Gen2 files to Azure databases with ADFhttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-bulk-copy-from-files-to-database
Bulk copy from databases using control tables in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-bulk-copy-with-control-table
Use ADF template to copy files from multiple containershttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-copy-files-multiple-containers
Copy new and changed files by LastModifiedDate in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-copy-new-files-last-modified-date
Transform data with Azure Databricks notebooks in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-databricks-notebook
Delta copy from databases using control table templatehttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-delta-copy-with-control-table
Extract structured data from PDFs using ADF templatehttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-extract-data-from-pdf
Migrate large S3 datasets to ADLS Gen2 templatehttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-migration-s3-azure
Move files between file-based stores using ADF templatehttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-move-files
Replicate multiple SAP objects via SAP CDC using ADFhttps://learn.microsoft.com/en-us/azure/data-factory/solution-template-replicate-multiple-objects-sap-cdc
Access on-premises and Azure files from SSIS in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/ssis-azure-files-file-shares
Run Azure Machine Learning pipelines from Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-machine-learning-service
Run Synapse notebooks from Data Factory pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-synapse-notebook
Trigger Synapse Spark job definitions in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-synapse-spark-job-definition
Configure Hadoop Streaming activity in Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-hadoop-streaming
Use Script activity to transform data in ADFhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-script
Configure Spark activity in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-spark
Invoke stored procedures via Data Factory activityhttps://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-stored-procedure
Use data wrangling functions in Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/wrangling-functions

Deployment

TopicURL
Set up CI/CD for Azure Data Factory pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery
Automate ADF CI/CD with Azure Pipelineshttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-automate-azure-pipelines
Use hotfix production environments for ADF CI/CDhttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-hotfix-environment
Automate CI/CD publishing for Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-improvements
Use linked ARM templates in Azure Data Factory deploymentshttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-linked-templates
Manually promote ADF ARM templates across environmentshttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-manual-promotion
Run pre- and post-deployment scripts for ADF CI/CDhttps://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-sample-script
Deploy linked ARM templates via Azure DevOps for ADFhttps://learn.microsoft.com/en-us/azure/data-factory/deploy-linked-arm-templates-with-vsts
Migrate SSIS SQL Agent jobs to Azure Data Factoryhttps://learn.microsoft.com/en-us/azure/data-factory/how-to-migrate-ssis-job-ssms
Automate self-hosted integration runtime installation with PowerShellhttps://learn.microsoft.com/en-us/azure/data-factory/self-hosted-integration-runtime-automation-scripts
Migrate Azure integration runtime to managed virtual networkhttps://learn.microsoft.com/en-us/azure/data-factory/tutorial-managed-virtual-network-migrate

Frequently asked questions

What to verify before installation and use

What does the azure-data-factory source document cover?

This skill provides expert guidance for Azure Data Factory. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference conten…

How do I install azure-data-factory?

The source record exposes this install command: npx skills add https://github.com/MicrosoftDocs/Agent-Skills --skill "skills/azure-data-factory". Inspect the command and pinned source before running it.

Alternatives

Compare before choosing

Computed 92717

MicrosoftDocs/Agent-Skills

azure-migrate

Expert knowledge for Azure Migrate development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when configuring Azure Migrate projects/appliances, VMware/Hyper-V discovery, SQL/PostgreSQL assessments, AppCAT, or Resource Mover, and other Azure Migrate related development tasks. Not for Azure Database Migration Service (use azure-database-migration), Azure Site

2026-08-170 platforms
Computed 92717

MicrosoftDocs/Agent-Skills

azure-sentinel

Expert knowledge for Azure Sentinel development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when configuring data connectors, ASIM analytics, KQL/REST integrations, playbooks, or Sentinel deployments, and other Azure Sentinel related development tasks. Not for Azure Defender For Cloud (use azure-defender-for-cloud), Azure Security (use azure-security), Azu

2026-08-170 platforms
Computed 92717

MicrosoftDocs/Agent-Skills

azure-sql-database

Expert knowledge for Azure SQL Database development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when configuring serverless billing, Hyperscale, geo-replication/DR, Data Sync/sharding, or elastic pools, and other Azure SQL Database related development tasks. Not for Azure SQL Managed Instance (use azure-sql-managed-instance), SQL Server on Azure Virtual Ma

2026-08-170 platforms
Computed 92717

MicrosoftDocs/Agent-Skills

azure-virtual-machines

Expert knowledge for Azure Virtual Machines development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when designing Oracle/OpenShift on VMs, GPU/HPC fleets, NVMe/InfiniBand, Trusted Launch, or encrypted disks, and other Azure Virtual Machines related development tasks. Not for Azure Data Science Virtual Machines (use azure-data-science-vm), Azure Large Inst

2026-08-170 platforms