When using the Jira Connector in Azure ADF, how can I save the table list in the dataset?

Question

When using the Jira Connector in Azure ADF, how can I save the table list in the dataset?

Gue, David 30

Hi ... I'm using the Jira Connector linked service in a dataset. The connection is successful, and I can see a list of available tables in the "Table" dataset field.

Is there a way to extract this list of tables (to save for looping via ForEach activity)?

This is to avoid manually entering each table name in the dataset.

Thank you. Dave.

phemanth 15,485 Reputation points Microsoft External Staff Moderator

2025-05-05T04:12:51.09+00:00

@Gue, David We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Chandra Boorla 12,125 Reputation points Microsoft External Staff Moderator

2025-05-05T22:26:33.6566667+00:00

@Gue, David

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Shraddha Pore 5 Reputation points Microsoft External Staff Moderator

2025-05-06T09:20:35.21+00:00

@Gue, David

You can streamline your pipeline in Azure Data Factory (ADF) by configuring your Jira dataset to accept a dynamic table name through parameters. This makes it possible to reuse the same dataset for copying data from different Jira tables without hardcoding each table individually.

Below documentation has complete details about using JIRA connector in ADF.

Copy data from Jira using Azure Data Factory or Synapse Analytics

Create a Parameterized Dataset for Jira

In your ADF project, define a dataset that connects to Jira. Add a parameter to this dataset, for example, tableName. Use this parameter to dynamically assign the tableName property.

Fetch Table Names Using a Lookup Activity

Use a Lookup activity to pull in a list of table names that you want to extract from Jira. The source for this could be a flat file (CSV/JSON) stored in Blob Storage, or it could be retrieved dynamically through the Jira REST API using a Web activity.

Use ForEach to Loop Over the Table List**

Drag in a ForEach activity and set it to use the output from the Lookup activity as the input list. Within the loop, each table name will be processed one at a time (or in batches, depending on your configuration).

Configure the Copy Activity Inside the Loop**

Inside the ForEach activity, add a Copy activity. For the source, use the Jira dataset you created earlier and pass the current table name (from the loop) to the tableName parameter. Set up your destination dataset (e.g., Blob Storage, SQL Database) as needed.

Please check below link that helps to understand how to parameterize datasets.

Parameterize Datasets in Azure Data Factory
Gue, David 30 Reputation points

2025-05-06T20:08:54.19+00:00

Thank you, all, for your prompt insight and help.

Chandra Boorla's 1st comment (May 2, 2025, 2:38 PM) is correct:

"Unfortunately, ADF does not currently expose the list of available Jira tables (like issues, projects, etc.) as a queryable object. The dropdown in the dataset is only available through the UI and can't be extracted directly within the pipeline logic."
Smaran Thoomu 23,005 Reputation points Microsoft External Staff Moderator

2025-05-07T13:14:21.3633333+00:00

@Gue, David Following up to see if the below answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Shraddha Pore 5 Reputation points Microsoft External Staff Moderator

2025-05-08T19:12:43.2466667+00:00

Hello @Gue, David , following up to see if the below answer was helpful.

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

1 answer

Your answer

phemanth 15,485 Reputation points Microsoft External Staff Moderator

2025-05-05T04:12:51.09+00:00

@Gue, David We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Chandra Boorla 12,125 Reputation points Microsoft External Staff Moderator

2025-05-05T22:26:33.6566667+00:00

@Gue, David

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Shraddha Pore 5 Reputation points Microsoft External Staff Moderator

2025-05-06T09:20:35.21+00:00

@Gue, David

You can streamline your pipeline in Azure Data Factory (ADF) by configuring your Jira dataset to accept a dynamic table name through parameters. This makes it possible to reuse the same dataset for copying data from different Jira tables without hardcoding each table individually.

Below documentation has complete details about using JIRA connector in ADF.

Copy data from Jira using Azure Data Factory or Synapse Analytics

Create a Parameterized Dataset for Jira

In your ADF project, define a dataset that connects to Jira. Add a parameter to this dataset, for example, tableName. Use this parameter to dynamically assign the tableName property.

Fetch Table Names Using a Lookup Activity

Use a Lookup activity to pull in a list of table names that you want to extract from Jira. The source for this could be a flat file (CSV/JSON) stored in Blob Storage, or it could be retrieved dynamically through the Jira REST API using a Web activity.

Use ForEach to Loop Over the Table List**

Drag in a ForEach activity and set it to use the output from the Lookup activity as the input list. Within the loop, each table name will be processed one at a time (or in batches, depending on your configuration).

Configure the Copy Activity Inside the Loop**

Inside the ForEach activity, add a Copy activity. For the source, use the Jira dataset you created earlier and pass the current table name (from the loop) to the tableName parameter. Set up your destination dataset (e.g., Blob Storage, SQL Database) as needed.

Please check below link that helps to understand how to parameterize datasets.

Parameterize Datasets in Azure Data Factory
Gue, David 30 Reputation points

2025-05-06T20:08:54.19+00:00

Thank you, all, for your prompt insight and help.

Chandra Boorla's 1st comment (May 2, 2025, 2:38 PM) is correct:

"Unfortunately, ADF does not currently expose the list of available Jira tables (like issues, projects, etc.) as a queryable object. The dropdown in the dataset is only available through the UI and can't be extracted directly within the pipeline logic."
Smaran Thoomu 23,005 Reputation points Microsoft External Staff Moderator

2025-05-07T13:14:21.3633333+00:00

@Gue, David Following up to see if the below answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Shraddha Pore 5 Reputation points Microsoft External Staff Moderator

2025-05-08T19:12:43.2466667+00:00

Hello @Gue, David , following up to see if the below answer was helpful.

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

Answer 1

@Gue, David

It looks like you are trying to extract the list of tables available in the Jira connector within Azure Data Factory, so you can loop through them programmatically in a pipeline, rather than selecting each table manually in the dataset.

Unfortunately, ADF does not currently expose the list of available Jira tables (like issues, projects, etc.) as a queryable object. The dropdown in the dataset is only available through the UI and can't be extracted directly within the pipeline logic.

Workarounds you can consider:

Manual List + Lookup Activity:

Manually copy the list of Jira tables shown in the dataset UI.
Save them in a config file (like JSON or a SQL table).
Use a Lookup activity to retrieve the list and pass it to a ForEach activity to loop through them.

Use Jira REST API - If you need to generate the table/entity list dynamically:

Use ADF’s REST connector to call Jira’s REST API endpoints (e.g., /rest/api/3/project, /rest/api/3/field).
Parse the response to get a list of entities you want to extract (like issues, users, etc.).
Feed that result into a pipeline variable or dataset.

I hope this information helps. Please do let us know if you have any further queries.

Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.

Thank you.

Gue, David 30 Reputation points

2025-05-07T20:02:36.05+00:00

Can Power Automate's "Extract Data from Web Page" action pull the ADF Copy activity's Table source list of values? I tried to inspect the ADF page's source, but the values in the list seem to be dynamically created (pulled from the source) and not imbedded in the page.

Share via

When using the Jira Connector in Azure ADF, how can I save the table list in the dataset?

1 answer

Your answer