This article is contributed. See the original author and article here.

Azure Data Factory and Azure Synapse Analytics Mapping Data Flows provides powerful, easy-to-use, data transformation at cloud scale. We’ve recently introduced 3 new data transformation functions to our rich data flow expression language: collectUnique(), substringIndex(), and topN().


 



  • collectUnique()

    • Create a new collection of values into an array. ADF will automatically dedupe elements in the array for you.



  • substringIndex()

    • Extracts the substring before n ccurrences of the delimiter.



  • topN()

    • ADF will sort your data based on the column or expression that you provide and then return the top n results.




Find the documentation for all ADF data flow transformation functions at this link here.

Brought to you by Dr. Ware, Microsoft Office 365 Silver Partner, Charleston SC.