Just-in-Time Access to Azure Kubernetes Service

Just-in-Time Access to Azure Kubernetes Service

This article is contributed. See the original author and article here.

Historically, we could assign an employee to an administrative role through the Azure portal or through Windows PowerShell and that employee would be a permanent administrator; their elevated access would remain active in the assigned role. Azure AD PIM introduced the concept of permanent and eligible administrators in Azure AD and Azure. Permanent administrators have persistent elevated role connections; whereas, eligible administrators have privileged access only when they need it. The eligible administrator role is inactive until the employee needs access, then they complete an activation process and become an active administrator for a set amount of time. 


 


For example, leverage Just-in-Time access to “Assign” an Administrator access to the CLI to run commands against the cluster during the allotted timeframe.


 


MichaelWithrow_0-1614720909010.png


 


For more information please refer to the document below to enable Just-in-Time access for your administrators.


 


Use Azure AD in Azure Kubernetes Service – Azure Kubernetes Service | Microsoft Docs

Released: March 2021 Exchange Server Security Updates

This article is contributed. See the original author and article here.

Microsoft has released a set of out of band security updates for vulnerabilities for the following versions of Exchange Server:



  • Exchange Server 2013

  • Exchange Server 2016

  • Exchange Server 2019


Security updates are available for the following specific versions of Exchange:



  • Exchange Server 2010 (RU 31 for Service Pack 3 – this is a Defense in Depth update)

  • Exchange Server 2013 (CU 23)

  • Exchange Server 2016 (CU 19, CU 18)

  • Exchange Server 2019 (CU 8, CU 7)


Because we are aware of active exploits of related vulnerabilities in the wild (limited targeted attacks), our recommendation is to install these updates immediately to protect against these attacks.


The vulnerabilities affect Microsoft Exchange Server. Exchange Online is not affected.


For more information, please see the Microsoft Security Response Center (MSRC) blog.


For technical details of these exploits and how to help with detection, please see HAFNIUM Targeting Exchange Servers.


Additional details


Does installing the March Security Updates require my servers to be up to date?


Today we shipped Security Update (SU) fixes. These fixes can be installed only on servers that are running the specific versions listed previously, which are considered up to date. If your servers are running older Exchange Server cumulative or rollup update, you will need to install a currently supported RU/CU before you can install the security updates.


How can I get an inventory of the update-level status of my on-premises Exchange servers?


You can use the Exchange Server Health Checker script, which can be downloaded from GitHub (use the latest release). Running this script will tell you if you are behind on your on-premises Exchange Server updates (note that the script does not support Exchange Server 2010).


What is the order of installation for the Security Updates mentioned here?


Exploitation of the security vulnerabilities addressed in these fixes requires HTTPS access over the Internet. Therefore, our recommendation is to install the security updates first on Exchange servers exposed/published to the Internet (e.g., servers publishing Outlook on the web/OWA and ECP) and then update the rest of your environment.


Will the installation of the Security Updates take as long as installing an RU/CU?


Installation of Security Updates does not take as long as installing a CU or RU, but you will need to plan for some downtime.


The last Exchange 2016 and Exchange 2019 CU’s were released in December of 2020. Are new CU’s releasing in March 2021?


We are still on schedule to release Exchange Server 2016 CU 20 and Exchange Server 2019 CU 9 in March 2021 and those CUs will contain the Security Updates mentioned here (along with other fixes). Our strong recommendation is to install security updates immediately.


How can I tell if my servers have already been compromised?


Information on Indicators of Compromise (IOCs) – such as what to search for, and how to find evidence of successful exploitation (if it happened), can be found in HAFNIUM Targeting Exchange Servers.


Are there any other resources that you can recommend?


Microsoft Defender Security Research Team has published a related blog post called Defending Exchange servers under attack which can help you understand some general practices around detection of malicious activity on your Exchange servers and help improve your security posture.


The Exchange Team

Organize Business glossary terms using hierarchies.

Organize Business glossary terms using hierarchies.

This article is contributed. See the original author and article here.




At times, organizations, in the interest of consistency, may be forced to take the axe to an otherwise nuanced business glossary but for data consumers across the business to make the most of data, they need the nuance. For instance, in a healthcare organization, it makes sense to have a term, API as app programming interface as required by a technical data analyst in IT department whereas a data scientist in research department may be looking for data on active pharmaceutical ingredients and so the business glossary must be able to absorb both interpretations of the same glossary term. Currently Azure Purivew does not support having multiple instances of the same term with variations in glossary and this is where hierarchical glossary terms will help.




 


With the introduction of hierarchial glossary terms in Azure Purview you can now define parent-child relationship between terms, and this gives you the ability to define the same term name in different parents. So,  a term “customer” can be present in parent “finance” as well as “sales” with different term templates and custom attributes. This grouping of terms into hierarchies is not just for organizational purpose but will be used in future for access control i.e., providing right set of users have access to right terms using hierarchical path of the glossary.


 


Naga_Yenamandra_0-1614279704131.png


 


Figure1: Screenshot showing hierarchical glossary in Purview.


 


Naga_Yenamandra_1-1614279704139.png


 


Figure2: Screenshot showing creation of a term as a child to another parent term.


 


Naga_Yenamandra_2-1614279704147.png


 


 


Figure3: Screenshot showing complete hierarchical path for a term. 


 


To Summarize, grouping business terms in hierarchies will empower you with the following capabilities:



  • Organize glossary terms in hierarchies i.e., defining parent-child relationship between terms.

  • Same term name can be created in different parents to contextualize them as per organization needs.

  • Access control using hierarchical path will allow right set of users to manage the right glossary terms.


 


Next Steps:



  1. Get an overview of business glossary

  2. Go through how-to-guides to create, import and export glossary termsmanage term templates and bulk edit assets to tag glossary terms. 

  3. Use the tutorials document to setup glossary terms in Azure Purview 

  4. Start a conversation on the Azure Purview tech community. 

What's New in Excel for the web

What's New in Excel for the web

This article is contributed. See the original author and article here.

Delighting our customers with faster, smoother, and richer experiences in Excel for the web is an uncompromised goal across our Excel team.  Recently we shared how we’ve continued to improve performance to make opening workbooks, navigating a workbook, and other interactions faster and smoother for you.  Today we’re introducing several additional features to help you better navigate and manipulate your Excel files in a browser:



  • Easier worksheet navigation

  • Multiple range selection

  • Zoom in/out

  • Excel keyboard shortcuts by default

  • Version history

  • Regional settings


 


Easier worksheet navigation


When opening an Excel workbook with multiple worksheets, you can now jump directly to the worksheet you want. Simply click on the new All Sheets button in the lower left corner and then select your worksheet.


 


cuong_16-1614714305315.png


 


 


Multiple range selection


You can now select multiple ranges that are not adjacent to each other – and fill color or copy-and paste.  Hold the Ctrl key while selecting as many ranges as you want.  The example below shows how you can select two non-adjacent columns and apply conditional formatting.


 


discon.selection.gif


 


 


Excel keyboard shortcuts by default


Excel for the web now supports your keyboard shortcuts by default.  Keyboard shortcuts like Alt, Ctrl-1, Ctrl-Shift-A, etc., go to Excel and not your browser.  To see the list of Excel keyboard shortcuts, click on the Help tab and select Keyboard Shortcuts – Override browser shortcuts is checked by default.


 


cuong_18-1614714305516.png


 


 


Zoom in/out


Excel for the web now supports many ways to zoom in/out.  Zoom in to get a close-up view of your data or zoom out for an overview look of your worksheet:



  • Pinch/stretch to zoom on touch screen or trackpad

  • Ctrl + mouse wheel

  • Ctrl Alt +/- key

  • Click the +/- button

  • Select a predefined zoom level from 25% to 200% in the bottom right corner


 


cuong_19-1614714305517.png


 


 



  • Coming soon: Zoom button in the menu ribbon under the View tab!


 


cuong_20-1614714305523.png


 


 


Version history


You can now view and restore previous versions of your Excel file using version history.  Track activities in the workbook by others collaborating with you and revert to a previous version if needed.  Select File > Info > Version History


 


version-history.gif


 


 


Regional settings


You can now change region settings in Excel for the web to set your date/time, number, and currency formats in a couple ways:



  • Select File > Options > Regional Format Settings, or


 


regional-settings.gif


 


 



  • Select the Number Format drop down list > More Number Formats…


 


cuong_23-1614714309884.jpeg


 


 


These are just some of the latest improvements, many more are coming soon!


 


Your feedback helps shape the future of Excel for the web.  Please let us know how you like a particular feature and what we can improve upon—send us a smile or frown.


 


Want to know more about Excel for the web?  See What’s new in Excel for the web and subscribe to our Excel Blog to get the latest updates.  Stay connected with us and other Excel fans around the world – join our Excel Community and follow us on Facebook and Twitter.


 


 


 

Best practices for Microsoft Learn LMS integration with University of Oxford, 9th March Webinar

Best practices for Microsoft Learn LMS integration with University of Oxford, 9th March Webinar

This article is contributed. See the original author and article here.

Best practices for Microsoft Learn LMS integration with University of Oxford


Higher Education Future Ready Skills Webinar Series




 



When: March 09, 2021 4:00 PM (Europe/London)



Duration: 1 hour  Register Now 



The growth in recent years of Industry 4.0 technology pillars, has presented the need for students to gain experience of areas such as IoT, Machine Learning, Artificial Intelligence, Data Science and Networking.


Learn from the University of Oxford how they have been working with Microsoft in the development of series of Microsoft Learn modules based around AI Edge Engineering and 5G for the Enterprise. These courses have been designed to help ensure students have hands on labs and gain the necessary industry-transferable digital skills for the workplace. 


This session looks at how the University of Oxford Artificial Intelligence: Cloud and Edge Implementation course is utilizing the Microsoft Learn LTI Application and Microsoft Learn Modules and Units within their curriculum to support students in developing digital skills to succeed in the workplace.





 



Presented By




 

Ajit.jfif




Ajit Jaokar Course Director – Artificial Intelligence

University of Oxford



Ajit Jaokar is Course Director: Artificial Intelligence: Cloud and Edge implementations at the University of Oxford. Ajit built the course at Oxford and is a Data Scientist at his company, Feynlabs. He has also conducted AI courses in the London School of Economics (LSE), Universidad Politécnica de Madrid (UPM) and as part of the The Future Society at the Harvard Kennedy School of Government.







 

lee.jpg




Lee Stott Principal Program Manager

Microsoft



Lee Stott is Principal Program Manager at Microsoft, for the Cloud and AI Engineering team. Lee is an experienced business technology leader with extensive Data Science, Mobile and Cloud industry knowledge. He applies that experience to help Microsoft engage with developers and strategic decision makers across the world. Lee’s focus is on developing Microsoft global strategy for faculty engineering engagements and student developers.






Introducing Microsoft Power Fx: the low-code programming language

Introducing Microsoft Power Fx: the low-code programming language

This article is contributed. See the original author and article here.

Today the Power Platform introduces its open-source language for low-code, Microsoft Power Fx. This formula-based language originates from Microsoft Excel and is already the foundation of the Microsoft Power Apps canvas. You may wonder, why does the world need a low-code programming language? Point-and-click tools are great for quickly assembling experiences and workflows, but many apps need a layer of logic that goes beyond what is practical to drag and dropfor example:  


Show a list of customers who signed up in the last 7 days within 15 miles of this location.  


Highlight the newest entries in green.  


When a user clicks for more details, if the record has outstanding action items associated with it, pop those to the top of the screen. 


riduncan_0-1614383870670.png


Custom logic traditionally needed to solve such problems is where low-code platforms have “hit a cliff” requiring traditional code, where the Low-code application development on Azure solution has stepped in. Power Fx enables many millions of people globally who build with Microsoft Excel syntax to build custom logic, reducing much of the “cliff”. However, this does not reduce the integration capabilities of Azure and Power Apps but enhances them. 


 


Additionally, developers can use Power Fx with tools they are familiar with such as VS (Visual Studio) Code, GitHub, Azure DevOps, and it works with “pro-code” components created in JavaScript, C#, or other professional languages. Developers can cut development time and costs using Power Fx. The complexities of asynchronous coding are taken care of, Dataverse entities and data types are first class objects, and guardrails prevent run away code and other common pitfalls. Read the entire Power Fx announcement here. 

Introducing Microsoft Power Fx: the low-code programming language

Introducing Microsoft Power Fx: the low-code programming language

This article is contributed. See the original author and article here.

Today the Power Platform introduces its formula language for low-codeMicrosoft Power Fx. This language originates from Microsoft Excel and is already the foundation of the Microsoft Power Apps canvas. You may wonder, why does a low-code platform need a programming language? The truth is, point-and-click tools are great for quickly assembling experiences and workflows, but many apps need a layer of logic that goes beyond what is practical to drag and drop, for example:  



  • Show a list of customers who signed up in the last 7 days within 15 miles of this location.  

  • Highlight the newest entries in green.  

  • When a user clicks for more details, if the record has outstanding action items associated with it, pop those to the top of the screen. 


riduncan_0-1614365930920.png


 


 Custom logic traditionally needed to solve such problems is where low-code platforms have “hit a cliff” requiring traditional code, where the Low-code application development on Azure solution has stepped inPower Fx enables 200+ million people globally who build with Microsoft Excel syntax to build custom logic, reducing much of the “cliff. However, this does not reduce the integration capabilities of Azure and Power Apps but enhances them 


 


Developers will cut their development time and cost by using Power Fx where the complexities of async coding are taken care of, Dataverse, Power Apps’ underlying data platform, entities and data types are first class objects, and guard rails prevent run away code and other common pitfalls. Additionally, developers can use Power Fx with tools they are already familiar with such as VS (Visual Studio) Code, GitHub, Azure DevOps, and their own build scripts and tools. Power Fx works with “pro-code” components created in JavaScript, C#, or other professional languages. Read the entire Power Fx announcement here.  

Modernization lives on in PnP Framework

Modernization lives on in PnP Framework

This article is contributed. See the original author and article here.

Using the Modernization tooling, classic SharePoint pages can be converted to Modern pages residing in Microsoft 365 Team or Communication sites.


 


The overall benefit of using this tooling, is that you can scan the environment to get an inventory by using the Modernization scanner (SharePoint Online only); and then with the Page Transformation tools, you then have the option to move your classic content to the modern experience – this supports either an on-premises SharePoint system or sites in SharePoint Online. The tooling is focused on the pages in classic sites and will allow you to keep and convert that content in which you have invested in resources to produce.


 


There is currently a major multi-step project to move away from older versions of PnP Sites Core and PnP PowerShell to taking advantage of modern .NET 5 and refocus the SDK to Graph first. For details of this project check out this blog for more details about the long term plans for the project for General Availability of the new PnP Framework library for automating SharePoint Online operations


 


Diagram to show the transition of PnP Modernisation tooling in the underlying frameworkDiagram to show the transition of PnP Modernisation tooling in the underlying framework


 


The modernization tooling is dependent on the PnP Sites Core, we are pleased to announce this now has been ported and integrated into PnP Framework as part of the steppingstone of improvements – meaning you can continue to take advantage of this tooling, if you wish, via either new PnP.PowerShell library that contains the cmdlets required to perform page transformation or the PnP.Framework NuGet package to use in your .NET applications.


 


There is one caveat with the move to PnP Framework, that we have no longer support for SharePoint 2010, due to the widening gaps between Office 365 APIs and the older SharePoint 2010 APIs (which is also coming up for retirement in April 2021).


 


To resolve the issues, we would have to spend significant time engineering a fix and we feel that better value of time can be used to continue integrating into the newest frameworks. If you wish to use the tooling with SharePoint 2010 support then please download the older versions Alternatively, you can use a migration tool to copy the classic sites to SharePoint Online and then convert to modern.


 






















Old GitHub Repository Location



New GitHub Repository Location



PnP-Sites-Core repository (archived)



PnP Framework repository



PnP-PowerShell repository (archived)



PnP.PowerShell repository



SP-Dev-Modernization repository



PnP Framework repository



 


As PnP Sites Core and older PnP PowerShell GitHub repositories are now archived, this will mean these are no longer updated and there will be no further releases of PnP PowerShell (classic) and PnP Sites Core.


 


Updates to the modernization tool, specifically the page transformation tool are no longer being released as this would require a new release of the  underlying archived frameworks; updates will now be released via the PnP Framework repository and as these now have builds either nightly or monthly, you will be able to take advantage of updates the next day – to use these nightly versions, you can install the prerelease version of the PowerShell modules from the gallery or grab the latest NuGet packages.


 


The Modernization scanner is currently being maintained for the time being in the SP-Dev-Modernization repository, as this tool is , any issues found with this tool can continue to be posted to this repository.


For bugs, enhancements with the page transformation tooling, please post to the issues list on the PnP Framework page – these will then be investigated and any bug or enhancement that is written as a outcome of the issue will be included in the nightly builds of PnP Framework.


 


Currently, the PnP Core SDK that will eventually replace PnP Framework is currently in beta and is currently under active development. When this is complete, the next steps are to transition all the tooling, PnP Framework, PnP PowerShell, and Modernization tooling to utilize this library – details on timelines and what features are included will be announced on a later date.


 

Starting 2021 With the Latest and Greatest Features of Azure Video Indexer

Starting 2021 With the Latest and Greatest Features of Azure Video Indexer

This article is contributed. See the original author and article here.

In Q1, 2021 (CY) we released a significant set of for Video Indexer related to our ongoing global expansion, customer growth and additional scenarios based on our customer demand and feedback. . The mapping of the feature list into use cases with more details and examples per each feature, is described in the 2nd part of the blog.


 


Feature List


 



  • New regions availability –

    • Create paid accounts on US government cloud in Virginia and Arizona regions 

    • Create a Video Indexer paid account in the Switzerland West and Switzerland North, Central India regions




  • New and Improved Analytics capabilities – 




    •  Audio event detection (e.g. explosions, gunshots, crowd reactions as public preview explosions, gunshots, crowd reactions) as public preview. Full list of acoustic events is described in the details section and in Feb release notes. By the next two months it will also be available on paid accounts. 




    • Observed People detection* – detect standing people spotted in the video and trace their path with bounding boxes as public preview. 




    • Video indexer supports detection, grouping, and recognition of characters in animated content. Improved version of on trial and paid accounts is available as a public preview. Read more here.






  • New low-cost basic audio SKU enabling of the audio related analytics of Video Indexer. The use case and the exact list of analytics are described in “Increased accessibility to video and audio content” section. This can be achieved by having a new upload preset to enable subset of models, both in Video Indexer portal website and in the upload API.




  • New source languages* for transcription and translation: Turkish, Swedish, Finnish, Danish, Norwegian, multiple Arabic Dialects, Thai and French-Canada.




  • Extend the Widget customization* capabilities to the solution developers. Read mote in “Embed widgets into your own solution” section below. The new extension will be shipped by end of March, 2021. 





  • Account management and supportability:

    • New API portal* with support channels

    • Ability to have multiple account owners for a single VI account.



  • Improved User Experience in Video Indexer Website

    • Enable dark theme for Video Indexer Website

    • Enhance video player experience and the video player widget to support X2 playback speed for audio files



  • Ongoing accessibility improvements


*Features will be delivered by end of March, 2021. 


 


Details and Examples


 


Enabling new work safety and public safety use cases


For public safety use cases (but not only) we enabled Video Indexer running for the first time on Azure Gov cloud. Azure Government is a cloud platform built upon the foundational principles of security, privacy and control, compliance, and transparency. Public Sector entities receive a physically isolated instance of Azure. You can create paid accounts on US government cloud in Virginia and Arizona regions. Read more here.


Site operators and video investigators spend hours and event days to manually explore videos, to analyze accident in the road or at work, bank robbery or searching for court evidence post events. With the new preview features such as observed people tracing and audio event detection you can quickly analyze your video with no human intervention. Use cases such as efficient accident analysis can be achieved by automatically detect observed people and acoustic events within your video to truly understand what had happened post event. For example, site operator who would like to analyze an explosion that happened in a factory can now take the footage from the CCTV cameras, automatically get timeline when the explosion accrued, and then run backwards to track the employee’s activities around the explosion and before the event accrued. That could be extremely helpful for learning, prevent and improve processes within the industry or factory.


The observed people tracing model extracts the observed people, with bounding boxes who are displayed on the video while it plays. The user can mark a specific thumbnail (right side) and detect the corresponding bounding boxes in the video. We plan to enhance it in the future also with the person path. The first public preview is planned to be shipped by end of March, 2021.   


insagiv_0-1614705160087.png


 


Screenshot from Video Indexer website: observed people insights with bounding boxes marked as a layer in the player. The path marked for a selected person is a future enhancement.


 


Audio event detection detects and classify the following audio effects in the non-speech segments of the content. The full list of caustic events includes Gunshot, Glass shatter, Alarm, Siren, Explosion, Dog Bark, Screaming, Laughter, Crowd reactions (cheering, clapping and booing) and silence (This model is relevant also for accessibility type of use cases and described in the accessibility paragraph as well).


 


insagiv_2-1614705160134.png


 


Screenshot from Video Indexer website: introduces acoustic events as a new insight. Represented by event name and where is accrues in the timeline.


 


Deep search experience across the video library and within videos


One of the leading use cases for VI is enable discoverability across media archives and skip to specific locations within the video quickly based on multiple business insights. With this release, media companies would mainly benefit from improved algorithm version of animated characters recognition models in the video.


Those which use VI website experience will now have it available in dark mode which is usually aligned with other media and video tools within the media market. To enable the dark theme, open your user settings menu and toggle on this feature.


insagiv_1-1614705160092.png


Screenshot from Video Indexer website: enable Dark mode from the user settings menu


 


Increased accessibility to video and audio content


Another key use case for Video Indexer is enabling accessibility to people with disabilities and across languages through transcription and translation, as well as compliance with accessibility regulations. You can now trigger basic audio insight and features by selecting “basic audio only” preset when uploading a video both in the upload screen and in the upload API. Choosing this option, trigger a selected following subset of audio only capabilities that would also reduce your pricing costs. This mode performs speech-to-text transcription and generation of a VTT subtitle/caption file as well as translation. The output of this mode includes an Insights JSON file including only the keywords, transcription, and timing information. Automatic language detection, content moderation and speaker diarization are not included in this . Note that the basic audio analysis is a low-cost offering comparing to the standard audio analysis. More information is available in our pricing page.


 


 


 


insagiv_3-1614705160179.png


Screenshot from Video Indexer website: introduces acoustic events into the closed captions and ability to download the captions.


 


For both deep search and accessibility use cases, within the next couple of days we plan to enable additional languages based on our customer demand. When uploading a video/audio, the list of source languages in both API and the website includes also Turkish, Swedish, Finnish, Danish, Norwegian, multiple Arabic dialects, Thai, French-Canada. Those languages are relevant for transcription and translation.


 


Embed widgets into your own solution


If you are a solution developer, you can embed three types of widgets into your apps: Cognitive Insights, Player, and Editor. More information is available here. We enhanced the widget customization capabilities so that now you can also –



  • Load a json from external location.

  • Enable custom styling to meet your application look and feel.

  • Set a custom configuration to by our custom AI (that isn’t generated by Video Indexer) side-by-side with Video Indexer AI and with that to enrich the insight widget with more insights.

  • Enrich your insights by integrating data from other data sources (e.g., if it were a person related model, you could get additional data from Active Directory on the persons org structure)  


We invite you to explore our code sample in Video Indexer Github Repository.


insagiv_4-1614705160220.png


 


Example of the insight widget with customized styling. The web component includes Video Indexer insights side-by-side with “My custom topics” which The developers can now supplement the output from VI’s widgets with additional output from other sources.


 


Looking to get your Feedback Today! 


In closing, we’d like to call you to provide feedback for all recent enhancements, especially those which were released as public preview. We collect your feedback and adjust the design where needed before releasing those as general available capabilities. For those of you who are new to our technology, we’d encourage you to get started today with these helpful resources: 


 




 


Thanks for reading ;)


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 


 

Azure Data Factory Ignite 2021 Updates

This article is contributed. See the original author and article here.

Azure Data Factory (ADF) is a fully managed, easy-to-use, serverless data integration solution to ingest all your on-premises, hybrid, and multi-cloud data. Choose from over a rich set of connectors to ingest data, build code-free or code-centric ETL/ELT processes, and seamlessly deliver it to operational data stores and modern data warehouses like Azure Synapse. 


 


We are constantly energized and inspired by how everyone has been using Azure Data Factory for all your enterprise data integration needs. Thank you to the ADF community for sharing product feedback on User Voice and community forums!



Over the years, Azure Data Factory has been made generally available in 30+ Azure regions. Today, we are excited to share that Azure Data Factory is now available in additional Azure regions: China North, South India, Switzerland North, Japan West, Canada East , Germany West Central , UK West.  Learn more about Azure regions where Azure Data Factory is available.


 


In addition, Azure Data Factory is now HITRUST certifiedLearn more about Azure Data Factory compliance as part of Azure Compliance offerings.



We are thrilled to share with you the latest updates to Azure Data Factory that will help you do more with Azure Data Factory. 


 



  1. Azure Purview and Azure Data Factory Integration  – With the integration of Azure Data Factory and Azure Purview, data engineers can quickly & easily find relevant data using a search experience in Data Factory portal, know the data and understand its business value, and easily use them in Data Factory as linked services or datasets. Learn more on how you  can use this to deeply understand the lineage for data integration.


  2. Reserved Instance pricing for Data Flows – You can now purchase 1-year or 3-year reservations of Data Flows from the Azure Portal and receive up to 30% off the pay-as-you-go option for General Purpose and Memory Optimized compute options.  Learn more about reserved Instance pricing for data flows in Azure Data Factory and Azure Synapse Analytics.


  3. CDM Format Support with Data Flow – With data flows, you can build powerful ETL processes using CDM formats and then also generate updated manifest files that point to your new, transformed data using CDM as a sink. ADF can use your CDM entity definitions to build ETL projections for transformation and mapping.  Learn more about using the Common Data Model format using Azure Data Factory.


  4. Azure Policy Support for Azure Data Factory – Azure Data Factory now includes. built-in policies that you can assign to your data factory to ensure resource consistency, regulatory compliance, and security. Learn more on how you can use Azure Policy for Azure Data Factory.


  5. Automating Azure Data Factory Deployment – You can  now use the validate all and export Azure Resource Manager (ARM) template functionality as part of a CI/CD pipeline. Learn more about Automated publish improvement in ADF’s CI/CD flow


  6. Dual standby Azure SSIS IR pair for high availability – For business continuity and disaster recovery (BCDR), you can now configure a dual standby Azure-SSIS IR pair that works in sync with Azure SQL Database/ Managed Instance failover group.  – Learn more


  7. Azure Database for PostgreSQL in Data Flow – You can now build powerful ETL pipelines that connects to Azure Database for PostgreSQL  You can read data directly from Azure Database for PostgreSQL and apply data transformations or join with other data, or post transformation you can perform inserts, updates, deletes, and upserts to publish the analytics result set into Azure Database for PostgreSQL. Learn more about Azure Database for PostgreSQL connector.


  8. REST Connector as Sink  – Generic REST connector is one of the most commonly used connectors in ADF to integrate with various SaaS applications or your own applications.  It helps you easily extend and reach a great number of data sources than the built-in ones. Now using copy activity, not only you can use REST connector to retrieve data, ADF newly enables REST connector as sink so you can also write data via REST APIs. Learn more about REST connector.


  9. Using Worksheet Index for Excel – When parsing Excel files using copy activity or data flow, you can specify the worksheet index. Learn more about Excel format


  10. Delta Lake Format support – Delta Lake is a Spark-based data lake format that makes working with data in your lake for analytics solution super-easy.  With ADF data flows, you can read from Delta Lake folders, transform data, and even update, upsert, insert, delete, and generate new Delta Lake folders using the Delta Lake sink format.  Learn more about using the Delta format using Azure Data Factory.


 


LEARN Azure Data Factory


Together with the Azure Learn team, we have been working on creating Azure Data Factory learning path  that can help you jumpstart your Azure Data Factory learning journey. If you are new to ADF, or looking at continuously learning new ADF skills, check out the learning paths on Microsoft Learn for Azure.


 


We look forward to see what you can build with Azure Data Factory.
Read more about the latest Azure Data Factory innovation on the Azure Data Factory blog.