ADF queries_ResourceGraph_ExecuteQuery only fetches first 1000 results

[JacobStruiksma]

🐛 Problem

When fetching resource graph queries with more than 1000 results it would only fetch 1000 results. For example the src/templates/finops-hub/modules/Microsoft.FinOpsHubs/Recommendations/queries/Recommendations-Microsoft-AdvisorCost.json could return more then 1000 results.

Change should happen in src/templates/finops-hub/modules/Microsoft.FinOpsHubs/AzureResourceGraph/app.bicep

👣 Repro steps

TODO: Add repro steps below:

1. add recommandation for the finops hub
2. execute the pipeline queries_ExecuteETL in ADF
3. check how many results end up in ingestion recommendation blob storage
4. would give you 1000 rows back.

🤔 Expected

return all records back.

📷 Screenshots

TODO: If applicable, add screenshots to help explain your problem. Remove if not applicable.

🔧 Environment

• FinOps hub version: 14
• Billing account type: MCA (Microsoft Customer Agreement)
• Power BI report type: Storage-based / ADX (Azure Data Explorer)
• Cost Management export: FOCUS 1.2-preview

ℹ️ Additional context

TODO: Add any other context about the problem here. Remove if not applicable.

🙋‍♀️ Ask for the community

We could use your help:

1. Please vote this issue up (👍) to prioritize it.
2. Leave comments to help us solidify the vision.

[microsoft-github-policy-service]

Thank you for submitting this issue! We try to respond within 3 business days. In the meantime:

• 📖 Check the troubleshooting guide for common issues
• 💬 Ask questions in Discussions
• 📅 Join our biweekly office hours for live help from the team

[flanakin]

We've kicked off a PR for this, but it's a bit too risky for v15, so we'll push it to v16. For now, you should be able to update the query in the JSON file in storage to add | limit 1000 for the queries that are failing. We'll update the issue once we have a proper fix out.

[JacobStruiksma]

The problem is that it does not fail so no need to put that limit in there .