An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory : Successfactors OAuth challenge
Hi, we currently ingest data from Successfactors in Azure Data Factory using REST API and Basic Authentification. As you may know, Basic Authentification will be depreciated in November 2026, we wish to turn to OAuth. After research we figured out there…
Azure Data Factory
Azure Data Factory resources and linked service disappeared. Error code 401 Failed to load resource in console.
Hi, I have been working on my data factory for about a day now. I added a linked service and configured around 6 pipelines to feed into my PostgreSQL database. This was working successfully and I was getting ready to publish. I log in later today and…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory linked services ClientIPNotAuthorized
Nothing changed on our pipeline/resources The linked services and publishing fail with Failed to get DataPlane access, reason: {"code":"ClientIPNotAuthorized","message":"Client IP not authorized to access the API.…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
How to parametrize the referenceName for Linked Service Reference in the Datasets part for only 1 parquet dataset.
We currently have two Azure Data Factory instances: one for DEV and one for PROD. The issue is related to dataset parameterization. We have 37 Parquet datasets, but only one of them needs to reference a different linked service in the PROD environment.…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ADF pipeline getting triggered for old blob event
Hi All, I have a storage event trigger attached to a pipeline in ADF. On 4-jun-2026 between 4:00 and 4:05 PM UTC around 70k blob json files were written to the ADLS2 path monitored by storage event trigger. Due to this 10000 runs of pipeline started as…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
how to fix The template validation failed: 'The number of template actions limit exceeded: maximum '1500' and actual '1501'
Error in ADF: Operation on target For Each Tenant failed: Activity failed because an inner activity failed; Inner activity name: Execute StageTenantTablesInner, Error: ErrorCode=InvalidTemplate, ErrorMessage=The template validation failed: 'The number of…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
How to send a JSON payload to Azure SQL (via Azure Data Factory)?
I am unable successfully send a JSON payload over to an Azure DB Stored Procedure as i am getting this error: Execution fail against sql server. Please contact SQL Server team if you need further support. Sql error number: 13609. Error Message: JSON…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
how connect to a source system - SAP database?
how connect to a source SAP database?This project involves the migration of the existing data warehouse environment from Qlik to Microsoft Azure. The initiative aims to modernize the analytics platform by leveraging Azure’s scalable storage, compute, and…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Using AME unable to create Linked Service for Azure SQL in Data Factory
Using AME unable to create Linked Service for Azure SQL in Data Factory. Any help would be greatly appreciated.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
getting error while creating crm dynamics 365 dataset in ADF
I am encountering the following error while trying to create a dataset using the Dynamics 365 connector in Azure Data Factory (ADF) although Linked service connection successful: "The HTTP request was forbidden with client authentication scheme…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Our production pipelines are failing due to shared error and need your assistance further.
Error Copy User data to SQL_copy1 Troubleshoot activity failures { "errorCode": "2200", "message": "ErrorCode=SqlFailedToConnect,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Cannot…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ADF Pipeline Error: This resource references resources which could not be loaded.
I have an existing data factory. Trying to create a CICD pipeline from adf_publish branch via ADO. (Aiming for it to auto run with each successful pull request. Failing to export and publish the artifact. Error logs: BaseFileResourceProviderService:…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Join: Microsoft Azure Q&A Champions Program
The Microsoft Azure Q&A Champions Program recognizes and empowers a global community of internal and external Azure experts who help customers succeed by providing high-quality, trusted answers on Microsoft Q&A. The program scales expert led…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Fabric database is mirrored to another warehouse
I am getting an error that states a DB I'm trying to mirror is attached to another warehouse. I believe this is related to an azure fabric trial I started a few months ago. I have no access to any other workspaces to unlink the existing mirror.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
How to parametrize in the arm-template-parameters-definition.json the referenceName for Linked Service Reference in the Datasets part.
I would like to parametrize in the arm-template-parameters-definition.json the "referenceName" for linked service in the datasets part of the file. You can have a look at the below image the part I want to change in order the production…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
How to implement a dynamic trigger interval in ADF without creating infinite loops or pipeline concurrency issues?
Hello everyone, I am currently working on optimizing an existing data pipeline in Azure Data Factory (ADF) and I am facing an architectural challenge regarding dynamic scheduling. Here is my current setup: The pipeline is currently triggered by a fixed…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory Private endpoint for Portal Endpoint
Hi Team, We are looking for recommendations and best practices around configuring the portal private endpoint for Azure Data Factory in a multi-VNET environment. Current setup: We have multiple ADF instances owned by separate teams. Each ADF has its…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Does the Azure Data Factory HubSpot connector v2.0 (Preview) support incremental load?
The HubSpot connector 1.0 supported incremental loads by means of passing a query. The new 2.0 connector does not support queries. Does that mean the new connector does not support incremental loads, or is there some other option? Fetching all of the…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Data Flow source test connection to Cosmos DB fails with InvalidSubscriptionId error via Managed VNet Private Endpoint
Azure Data Factory Data Flow fails to connect to Azure Cosmos DB (SQL API) when using Managed Virtual Network with a Managed Private Endpoint. The Copy Activity works correctly with the same linked service and private endpoint configuration. Error…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ADF Trigger Schedules
Can we schedule the trigger for once in last working day of the month?
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.