Power Platform Community Forum Thread Details

Using Power Query to dynamically process CSVs from a SharePoint document library

I have several Dataverse tables which are added to on a monthly basis (sometimes more). This is currently done by importing Excel files directly to the table in Dataverse after they're manually converted from CSV to Excel. I want to simplify this process as much as possible and have come up the follow proposal:

Add the CSV files to a SharePoint document library - the library has a column which states which Table it's relevant to
A Power Automate Flow then triggers once the item is added, and then triggers a relevant Dataflow
Dataflow then starts and queries the relevant document library for the CSVs which have not yet been imported, it will then import the CSVs to the table
Once complete, the Power Automate flow will then update a column on the SharePoint library with a value (e.g. 'Done')

For the solution I've proposed above, how can I create a dynamic query which only looks at files which match a certain criteria based on the column? (e.g. where the 'Done' column is blank). The file names will differ slightly from month to month, although the structure and layout will be the same.

In Power Query, I've managed to get as far as filtering just the relevant document library, which show me the files (currently three in there), but I want the ability to filter out based on several of the column values. How can I do this? It does give me the option to click into the files, and further query this but I don't want this to be absolutely queried (hope that makes sense!).

If anyone has any alternative proposals which they would recommend, happy to hear them. I'm still fairly new to Dataverse, Power Apps, and Power Automate.

Thanks for any help!

Quick Links

Leaderboard > Power Apps - Power Query