12,184 questions with Azure Data Factory tags

Sort by: Updated
3 answers

Azure Data Factory : Successfactors OAuth challenge

Hi, we currently ingest data from Successfactors in Azure Data Factory using REST API and Basic Authentification. As you may know, Basic Authentification will be depreciated in November 2026, we wish to turn to OAuth. After research we figured out there…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-26T07:51:44.8166667+00:00
RENOUD Thomas 0 Reputation points
answered 2026-07-02T07:35:21.51+00:00
RENOUD Thomas 0 Reputation points
3 answers

Azure Data Factory resources and linked service disappeared. Error code 401 Failed to load resource in console.

Hi, I have been working on my data factory for about a day now. I added a linked service and configured around 6 pipelines to feed into my PostgreSQL database. This was working successfully and I was getting ready to publish. I log in later today and…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-29T20:59:30.9366667+00:00
Dylan Johns 0 Reputation points
answered 2026-07-02T06:50:27.6733333+00:00
Pilladi Padma Sai Manisha 10,770 Reputation points Microsoft External Staff Moderator
3 answers

Azure Data Factory linked services ClientIPNotAuthorized

Nothing changed on our pipeline/resources The linked services and publishing fail with Failed to get DataPlane access, reason: {"code":"ClientIPNotAuthorized","message":"Client IP not authorized to access the API.…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-29T22:38:59.2633333+00:00
Felix Fung 0 Reputation points Microsoft Employee
answered 2026-06-30T20:05:21.4366667+00:00
Felix Fung 0 Reputation points Microsoft Employee
4 answers

How to parametrize the referenceName for Linked Service Reference in the Datasets part for only 1 parquet dataset.

We currently have two Azure Data Factory instances: one for DEV and one for PROD. The issue is related to dataset parameterization. We have 37 Parquet datasets, but only one of them needs to reference a different linked service in the PROD environment.…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-23T13:58:41.3633333+00:00
Dina 0 Reputation points
commented 2026-06-27T07:09:55.3866667+00:00
Manoj Kumar Boyini 17,950 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

ADF pipeline getting triggered for old blob event

Hi All, I have a storage event trigger attached to a pipeline in ADF. On 4-jun-2026 between 4:00 and 4:05 PM UTC around 70k blob json files were written to the ADLS2 path monitored by storage event trigger. Due to this 10000 runs of pipeline started as…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-25T12:48:22.1166667+00:00
JigarkumarPatel-5373 46 Reputation points
accepted 2026-06-26T11:53:00.7533333+00:00
JigarkumarPatel-5373 46 Reputation points
2 answers

how to fix The template validation failed: 'The number of template actions limit exceeded: maximum '1500' and actual '1501'

Error in ADF: Operation on target For Each Tenant failed: Activity failed because an inner activity failed; Inner activity name: Execute StageTenantTablesInner, Error: ErrorCode=InvalidTemplate, ErrorMessage=The template validation failed: 'The number of…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-23T06:33:38.25+00:00
Goundla, Sai Karthik Goud 0 Reputation points
commented 2026-06-26T08:37:21.9633333+00:00
Manoj Kumar Boyini 17,950 Reputation points Microsoft External Staff Moderator
2 answers

How to send a JSON payload to Azure SQL (via Azure Data Factory)?

I am unable successfully send a JSON payload over to an Azure DB Stored Procedure as i am getting this error: Execution fail against sql server. Please contact SQL Server team if you need further support. Sql error number: 13609. Error Message: JSON…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2023-09-07T11:00:35.3866667+00:00
Kevin Perez 10 Reputation points
commented 2026-06-25T18:37:23.6333333+00:00
MikeBurek 0 Reputation points
3 answers

how connect to a source system - SAP database?

how connect to a source SAP database?This project involves the migration of the existing data warehouse environment from Qlik to Microsoft Azure. The initiative aims to modernize the analytics platform by leveraging Azure’s scalable storage, compute, and…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-04-15T09:42:26.0466667+00:00
Makama, ANTHEA (404) 0 Reputation points
commented 2026-06-25T09:25:19.95+00:00
sega 0 Reputation points
3 answers

Using AME unable to create Linked Service for Azure SQL in Data Factory

Using AME unable to create Linked Service for Azure SQL in Data Factory. Any help would be greatly appreciated.  

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-24T01:44:55.94+00:00
Hemant 41 Reputation points Microsoft External Staff
answered 2026-06-25T04:20:54.3666667+00:00
Pilladi Padma Sai Manisha 10,770 Reputation points Microsoft External Staff Moderator
2 answers

getting error while creating crm dynamics 365 dataset in ADF

I am encountering the following error while trying to create a dataset using the Dynamics 365 connector in Azure Data Factory (ADF) although Linked service connection successful: "The HTTP request was forbidden with client authentication scheme…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-24T10:43:20.4666667+00:00
Khurshid, Danish 0 Reputation points
answered 2026-06-24T11:30:24.88+00:00
Manoj Kumar Boyini 17,950 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Our production pipelines are failing due to shared error and need your assistance further.

Error Copy User data to SQL_copy1 Troubleshoot activity failures { "errorCode": "2200", "message": "ErrorCode=SqlFailedToConnect,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Cannot…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-23T09:22:05.1666667+00:00
Murli Kunagu (Tata Consultancy Services Limited) 20 Reputation points Microsoft External Staff
accepted 2026-06-24T02:48:52.85+00:00
Murli Kunagu (Tata Consultancy Services Limited) 20 Reputation points Microsoft External Staff
2 answers

ADF Pipeline Error: This resource references resources which could not be loaded.

I have an existing data factory. Trying to create a CICD pipeline from adf_publish branch via ADO. (Aiming for it to auto run with each successful pull request. Failing to export and publish the artifact. Error logs: BaseFileResourceProviderService:…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-23T17:43:35.6533333+00:00
Soniran, Dare 0 Reputation points
answered 2026-06-23T19:31:22.6033333+00:00
SAI JAGADEESH KUDIPUDI 3,550 Reputation points Microsoft External Staff Moderator
0 answers

Join: Microsoft Azure Q&A Champions Program

The Microsoft Azure Q&A Champions Program recognizes and empowers a global community of internal and external Azure experts who help customers succeed by providing high-quality, trusted answers on Microsoft Q&A. The program scales expert led…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-05-25T23:37:24.3633333+00:00
Ashley Swearingen 0 Reputation points Microsoft External Staff Moderator
edited the question 2026-06-23T19:16:12.25+00:00
Ashley Swearingen 0 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Fabric database is mirrored to another warehouse

I am getting an error that states a DB I'm trying to mirror is attached to another warehouse. I believe this is related to an azure fabric trial I started a few months ago. I have no access to any other workspaces to unlink the existing mirror.

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-17T13:06:58.91+00:00
Angelo Spaziani 20 Reputation points
edited the question 2026-06-23T13:27:39.75+00:00
Manoj Kumar Boyini 17,950 Reputation points Microsoft External Staff Moderator
1 answer

How to parametrize in the arm-template-parameters-definition.json the referenceName for Linked Service Reference in the Datasets part.

I would like to parametrize in the arm-template-parameters-definition.json the "referenceName" for linked service in the datasets part of the file. You can have a look at the below image the part I want to change in order the production…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2025-03-10T07:51:01.0166667+00:00
Dina 0 Reputation points
edited an answer 2026-06-22T08:45:50.92+00:00
Dina 0 Reputation points
2 answers One of the answers was accepted by the question author.

How to implement a dynamic trigger interval in ADF without creating infinite loops or pipeline concurrency issues?

Hello everyone, I am currently working on optimizing an existing data pipeline in Azure Data Factory (ADF) and I am facing an architectural challenge regarding dynamic scheduling. Here is my current setup: The pipeline is currently triggered by a fixed…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-17T13:09:37.9333333+00:00
Fasd 20 Reputation points
accepted 2026-06-22T06:54:28.9333333+00:00
Fasd 20 Reputation points
3 answers

Azure Data Factory Private endpoint for Portal Endpoint

Hi Team, We are looking for recommendations and best practices around configuring the portal private endpoint for Azure Data Factory in a multi-VNET environment. Current setup: We have multiple ADF instances owned by separate teams. Each ADF has its…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-05T12:04:07.2533333+00:00
Sumit Gaur 475 Reputation points
commented 2026-06-22T05:48:30.2033333+00:00
Smaran Thoomu 35,375 Reputation points Microsoft External Staff Moderator
2 answers

Does the Azure Data Factory HubSpot connector v2.0 (Preview) support incremental load?

The HubSpot connector 1.0 supported incremental loads by means of passing a query. The new 2.0 connector does not support queries. Does that mean the new connector does not support incremental loads, or is there some other option? Fetching all of the…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-15T07:21:26.49+00:00
Tariq Riahi 0 Reputation points
commented 2026-06-19T09:20:54.77+00:00
Pilladi Padma Sai Manisha 10,770 Reputation points Microsoft External Staff Moderator
1 answer

Data Flow source test connection to Cosmos DB fails with InvalidSubscriptionId error via Managed VNet Private Endpoint

Azure Data Factory Data Flow fails to connect to Azure Cosmos DB (SQL API) when using Managed Virtual Network with a Managed Private Endpoint. The Copy Activity works correctly with the same linked service and private endpoint configuration. Error…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-15T06:01:45.58+00:00
Yeshwanth Reddy Sangam 0 Reputation points Microsoft Employee
answered 2026-06-18T17:40:19.47+00:00
Yeshwanth Reddy Sangam 0 Reputation points Microsoft Employee
3 answers One of the answers was accepted by the question author.

ADF Trigger Schedules

Can we schedule the trigger for once in last working day of the month?

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,184 questions
asked 2026-06-17T11:27:24.01+00:00
M, Pratibha 20 Reputation points
accepted 2026-06-18T07:18:04.1933333+00:00
M, Pratibha 20 Reputation points