HowTo: Azure Data Explorer integration into Azure Purview

HowTo: Azure Data Explorer integration into Azure Purview

This article is contributed. See the original author and article here.

After the announcement of the integration of Azure Data Explorer into the recently launched Azure Purview service, this blog post shows how to use ADX as a data source in Purview and highlights the new features in a few use cases that can be helpful in the context of ADX. 


 


Read the announcement blog post about our integration with Purview here. 


 


Setup: How to connect ADX as a data source in Azure Purview


 


Azure Data Explorer is available as a data source to scan within Azure Purview Studio. Just register a new source and choose “Azure Data Explorer (Kusto)” and the according cluster connection information. 


 


Image1.JPG


 


In order to connect to an ADX cluster you need to provide a service principal with “AllDatabaseViewer” rights on the target cluster/databases to Azure Purview through an Azure KeyVault


 


After that, register ADX as a data source in Azure Purview Studio. Go through the process of  managing the credentials, registering a new data source and configuring the first scan, as described here.


 


Then select all the databases that should be included in this specific scan. For example you can set up a full scan for all databases that should be done monthly or weekly, and set up another scan on specific databases that runs daily to keep the information in the data catalog up-to-date (full and incremental scans). 


 


Next you can specify which rule set you want to apply for this scan. There is a system default for every data source, which includes all default classifications.  


 


Image3.JPG


 


The power of custom classifications and scans


 


You can create your own scan rule sets to include only the scan rules that are relevant for your data or include your own custom rules that you defined in Purview


 


In the context of Azure Data Explorer, this can be very useful for a variety of use-cases: 


Custom rules can be helpful for example if you want to identify custom part numbers that you might ingest with your IoT Telemetry or Log data, or other patterns that might help you identify certain attributes in tables specific for your business domain. These classifications will then be attributes of the tables/columns in Purview and users will be able to search for example for tables containing data about specific device families, product lines or production processes in your data catalogue.


 


Classifications can also be applied manually after a scan directly within Azure Purview on the relevant data assets, like on a table or column. For example you could highlight specific columns in a dataset that you know is used to measure customer interaction, when is a feature used and how long does it take a customer to get there. In combination with the Business Glossary in Purview these additional attributes can significantly improve the search and discovery experience for many user groups within a company. Business analysts can leverage this customer interaction data and see if there’s a correlation to any metric they might use.


 


If you give good thought about which classifications and business terms might be useful, you can make your IoT-, factory floor and device telemetry data much more accessible, democratizing access to these data that historically are often siloed within manufacturing systems.


 


You can always look at an overview of the recent scans in the run history: 


 


Image4.JPG


 


 


Browsing the data catalog: ADX data assets


 


After the scan(s) have finished, you can start browsing the newly discovered data assets. You can do that either by directly searching for a specific term (part of a table name, classification, etc.) or by clicking “Browse assets” in the main menu. 


 


In the case of ADX, an overview of the registered data assets can look something like this: 


 


Image5.JPG


 


Looking at an ADX table for example we get detailed information as to which database it belongs to and about the cluster this database is running on. We also see when it was last changed, we can add a description to the table and see/add classifications for easier discovery, as well as some ADX specific properties like a potential folder or the docstring. 


 


Also as mentioned you can add descriptions as well as classifications and associate terms from the business glossary with every ADX data asset, visible on the bottom right here:


 


Image6.JPG


 


The scans also pick up the table schema, showing all columns and their respective data type. And while giving the data consumers in your company the ability to discover data easily is very important, here you can also add a contact person, an owner, that people can talk to to learn more about the data asset, how to get access and how to use it.


 


Visualizing the data flows – data lineage information


 


A very powerful piece of information is located in the “Lineage” tab. This overview shows you the data flow between the assets in your data catalog. In the context of ADX this currently means that every data movement that you defined using Azure Data Factory involving an ADX table will be visualized in this tab. 


 


Image7.JPG


 


In addition to the automatically inferred lineage information from Azure Data Factory, we saw that many customers also use custom scripts for data ingestion, or Jupyter notebooks on a Spark cluster, or they ingest data programmatically using one of the ADX SDKs provided. In this case, to make these data flows transparent as well, you can use the well documented Apache Atlas REST API to create custom objects within Azure Purview.


 


You can find all the details about using the Azure Purview REST API here, including a sample postman collection to get you started.


 


 


An example: Visualize custom data flows within Azure Purview lineage


 


One feature within ADX that many customers use very frequently is the concept of Update Policies. When using them, you essentially chain two or more tables together and transform data between them in some form. These data transformations can be linear, e.g. from Table A -> Table B -> Table C, or they can “fan out”, like filtering data per device family, e.g. from Table A -> Table B, as well as Table A -> Table C.


 


What that means is that update policies might be a very good candidate for visualization in the lineage tab. In order to achieve that, we use the Atlas API to create a new “Process” entity in Purview called “ADX Update Policy” with all the attributes it might have within ADX.


 


 


 

REST API Call (POST) against /api/atlas/v2/types/typedefs of our Purview instance:

{
  "entityDefs" : [
    {
      "superTypes" : [ "Process" ],
      "category" : "ENTITY",
      "name" : "adx_update_policy",
      "description" : "a type definition for azure data explorer update policies",
      "typeVersion" : "1.0",
      "attributeDefs" : [
        {
          "name" : "IsEnabled",
          "typeName" : "string",
          "isOptional" : true,
          "cardinality" : "SINGLE",
          "valuesMinCount" : 1,
          "valuesMaxCount" : 1,
          "isUnique" : false,
          "isIndexable" : false
        },
	{<additional attributes..>}
      ]
    }
  ]
}

 


 


 


After the creation of this asset, all we need to do to use it in the lineage tab, is to link two tables together using our newly created “Update Policy” object. Now in order to do that, we first need to fetch the GUIDs of the according ADX tables from Azure Purview, so that the tool is actually able to uniquely identify them. For the sake of this blog post we assume that we looked them up manually, but you can of course also discover them via REST API Call (hint: /api/atlas/v2/search/advanced)


.


After we have all the information, the body of the API call could look like this:


 


 

REST API Call (POST) against /api/atlas/v2/entity/bulk of our Purview instance:

{
  "entities": [
    {
      "typeName": "adx_update_policy",
      "createdBy": "admin",
      "attributes": {
        "qualifiedName": "adx_update_policy",
		    "uri": "adx_update_policy",
        "name": "adx_update_policy",
        "description": "transforms data between source and target table",
        "IsEnabled": "true",
        "Query": "KQLTransformationQuery()",
        "IsTransactional": "false",
        "PropagateIngestionProperties": "false",
        "inputs": [
          {
            "guid": "<Purview ID of the source table>",
            "typeName": "azure_data_explorer_table"
          }
        ],
        "outputs": [
          {
            "guid": "<Purview ID of the target table>",
			"typeName": "azure_data_explorer_table"
          }
        ]
      }
    }
	]
}

 


 


The result then can look something like this:


 


Image8.JPG


 


Of course these are only basic examples and they involve some scripting as well as orchestration of API calls and other sorts of automation, but you can be sure that we are hard at work with the Purview team to extend the automated lineage information to more data ingestion and analytics scenarios relevant for ADX, stay tuned for more.

Announcing Azure Purview Integration with Azure Data Explorer

Announcing Azure Purview Integration with Azure Data Explorer

This article is contributed. See the original author and article here.

We are excited to announce the integration of Azure Data Explorer with Azure Purview today.


The new ADX capabilities will create more transparency on how data is delivered into your data lake and how this data is structured.


This data governance tool is built for data consumers, such as analysts, business users, data scientists, etc. It’s built to help you to discover your data source, data pipeline, data structure, how to access the data, and if it is classified (for example if there are special privacy regulations that need to be fulfilled in order to work with that data).


register-new-data-source.png


Here are some examples of key Azure Data Explorer scenarios leveraging the built-in custom rule functionality of Azure Purview:



  • Discover data flow for each data component

    • Leverage Azure Purview metadata, lineage and custom classifications/rules



  • Easily answer these questions about my data structure “Does our data contain PII data?” “Is my PII data processed and isolated properly?”

    • Leverage Azure Purview classifications, lineage



  • Confidently use all relevant data sources for dashboard and queries

    • Leverage Azure Purview upstream lineage, classifications/business glossary




Picture1.png


The Azure Data Explorer and Azure Purview product teams have worked together from the beginning. The first version of the connector was released in private preview and has provided valuable insights from the first set of customers. Today, based on that feedback, we are thrilled to provide a native connector for ADX that’s ready for public preview.


Read more on how to register and scan Azure Data Explorer


Read more on Azure Data Explorer integration into Azure Purview

Azure Marketplace new offers – Volume 99

Azure Marketplace new offers – Volume 99

This article is contributed. See the original author and article here.











We continue to expand the Azure Marketplace ecosystem. For this volume, 91 new offers successfully met the onboarding criteria and went live. See details of the new offers below:

























































































































































































































































































































































































Applications


Advanced Transportation Management System.png

Advanced Transportation Management System: The Advanced Transportation Management System from Trafficware, a Cubic Transportation Systems company, helps smart cities address the challenges of transportation management. Features include an alarms dashboard, a map view, and a streaming traffic information service.


AI SEE.png

AI.SEE: AI.SEE, an automated quality assurance system, uses AI-powered image recognition and deep learning algorithms to find even the smallest defects on heterogeneous or reflective surfaces, which are often overlooked by human inspectors. This app is available in German and English.


Appointment and Customer Management.png

Appointment and Customer Management: SkizzleOpus is a cloud-based appointment-scheduling solution for a wide variety of businesses. Also, as a source of centralized information on space utilization, SkizzleOpus helps track the flow of people to manage social distancing.


Augmental.png

Augmental: Making education more personalized: Augmental, an adaptive learning platform, empowers teachers by providing them with real-time insights to better support their students. Augmental, which customizes course material to each student’s needs, includes a virtual classroom tool and a reporting and analytics module.


BIA Reporting Hub.png

BIA Reporting Hub: Bridge your business intelligence platforms with BIA Reporting, which allows you to centralize reports and dashboards. BIA Reporting includes free updates and unlimited support from BI4ALL.


Bidvest ALICE- SaaS for Governance and Assurance.png

Bidvest ALICE: SaaS for Governance and Assurance: Bidvest’s ALICE platform translates business logic and rules into repeatable algorithms and augments them with cognitive services, aiding governance, risk, and compliance efforts.


BLE Authentication Module.png

BLE Authentication Module: Bluetooth Low Energy Authentication Module (BLEAM) uses Bluetooth beacons to determine the precise location of a person or object and enable touchless authentication services at various businesses, such as electric vehicle charging points.


Bottomline Healthcare eCapture and PreCapture.png

Bottomline Healthcare eCapture and PreCapture: Bottomline Technologies’ eCapture and PreCapture solutions make it easy to move away from paper forms, centrally manage patient forms, and capture signatures, photos, and data on almost any device anywhere.


BryteFlow Ingest Enterprise Edition.png

BryteFlow Ingest Enterprise Edition: BryteFlow Ingest automatically transforms source data structures and schemas to build identical data sets in Microsoft Azure SQL Database and Azure Synapse Analytics. Log-based tracking enables continuous detection and transfer of incremental changes.


Casper365 Enterprise.png

Casper365 Enterprise: Casper365 Enterprise is ideal for companies looking to allow their users to create new SharePoint sites via a governed and managed self-service portal. Casper365 automates complex SharePoint deployments quickly and easily.


Clearstep.png

Clearstep: Clearstep, a chatbot triage tool, routes patients to the right place of care depending on their symptoms. Patients can search based on their symptoms, get matched to the right in-network provider, understand the cost of care, and book care online.


CloudBrain.png

CloudBrain: Click2Cloud’s CloudBrain is a multi-cloud management platform that helps users control cloud spending by optimizing the utilization patterns of their cloud services.


Cloudbric Smart Web Application Protection.png

Cloudbric Smart Web Application Protection: Cloudbric’s fully managed Smart Web Application Protection (SWAP) offers threat monitoring, automated configuration, managed maintenance, and continual threat response. Reduce security costs and achieve peace of mind with SWAP.


CloudCADI.png

CloudCADI: CloudCADI, cloud consumption and optimization software from Amadis Technologies, utilizes machine learning models to predict expenses. This helps organizations, IT teams, and others accelerate and manage their transformation.


Commerble EC PaaS.png

Commerble EC PaaS: Commerble is a customizable e-commerce platform that can maintain a high level of performance even under the pressure of 2,000 simultaneous orders per minute. This app is available only in Japanese.


COVID-19 Scientific Data Engine (SDE).png

COVID-19 Scientific Data Engine (SDE): The Scientific Data Engine (SDE) from SciMar ONE is a drug development platform that expedites the delivery of safe and effective drugs, vaccines, and diagnostics. The SDE uses COVID-19 clinical data to streamline and de-risk drug development efforts.


cPanel & WHM for Azure.png

cPanel & WHM for Azure: cPanel & WHM is a suite of tools that gives website owners and server administrators the ability to automate web hosting tasks via a simple graphical user interface. Migrate new customers, launch databases, secure your system, and customize and brand your service.


Cubic Interactive.png

Cubic Interactive: Cubic Interactive enables transit agencies to build custom loyalty and incentive programs in their mobile transit apps. Agencies can encourage desired travel behavior by awarding travelers loyalty points to offset transportation costs.


CyberPion's Ecosystem Security.png

CyberPion’s Ecosystem Security: CyberPion enables enterprises to identify security issues throughout their ecosystem and to control and manage vulnerable connection points to prevent exploitation.


DataWeave Brand Analytics.png

DataWeave Brand Analytics: With human-aided machine intelligence, DataWeave gathers external competitive information online, organizes it, and delivers it in a structured, easily consumable form. This helps businesses protect brand equity and enhance their e-commerce catalogs.


dcirrus_b2bfileshare.png

dcirrus_b2bfileshare: This file-sharing solution from DCirrus lets business-to-business customers share confidential files using secured dynamic passwords. Customers can track their files and disconnect shared links at their convenience.


dcirrus_vdr.png

dcirrus_vdr: DCirrus VDR is a secured virtual data room solution for due diligence and audits. Features include granular controls, smart tagging, indexing of documents, and watermarking with user details to avoid data theft.


deFacto Power Planning.png

deFacto Power Planning: deFacto Power Planning, a corporate performance management solution, enables enterprise-quality budgeting, forecasting, analysis, and more. Designed for Microsoft customers, its architecture is synchronized with Azure, Dynamics 365, and data integration tools.


dh Model Lab.png

dh Model Lab: dunnhumby’s machine learning solution, Model Lab, lets data scientists in retail automate many repetitive tasks, giving them more time to model and deliver customer insights to drive profitability and customer loyalty.


Direct Routing for Teams with AT&T.png

Direct Routing for Teams with AT&T: This solution utilizes AT&T IP Flexible Reach to allow you to make and receive calls outside of your company’s Microsoft Teams service. Empower your workforce to collaborate whenever and wherever with SIP trunking, SBC-as-a-Service, and professional services from AT&T.


E-book borrowing program.png

E-book borrowing program: Offer your users e-books through this app from Jiju International Co. Ltd. Users can choose a book, download it to Microsoft OneDrive, and sync it to their personal folders. This app is available in Chinese.


ERP COLEGIOS SISGA ACADEMIC.png

ERP SCHOOLS SISGA ACADEMIC: This virtual classroom system targeting the Latin American market includes forums, calendars, an online payment gateway, integration with the Schoology learning management system, and more. This app is available only in Spanish.


Flarie Studio - Create your own branded games.png

Flarie Studio – Create your own branded games: Flarie Studio from Flarie AB allows organizations to take advantage of the fast-growing gaming market by branding games for social media campaigns and more. Users choose from premade games, upload design assets, adjust game settings, and launch a branded experience.


Footprints for Retail.png

Footprints for Retail: Footprints for Retail is an advanced AI marketing platform that anticipates shopper behavior. With its predictive models and campaign automation, marketing teams can increase their effectiveness while decreasing spending.


Fortanix Confidential Computing Manager on Azure.png

Fortanix Confidential Computing Manager on Azure: The Fortanix Confidential Computing Manager enables applications to run in confidential computing environments. It orchestrates critical security policies, verifies the integrity of environments, and manages the enclave application lifecycle.


G Suite to Office 365.png

G Suite to Office 365: Cloudiway’s platform helps organizations migrate from G Suite to Office 365. All types of migration paths are supported. For best results, Cloudiway recommends using its file migration tool alongside its site migration tool.


Geotrend Market Intelligence.png

Geotrend Market Intelligence: Geotrend aids market intelligence teams by carrying out cross-disciplinary research on all types of markets. The AI-based SaaS solution reduces research time, giving teams more time for analysis. This app is available in English and French.


Granulate Real Time Continuous Optimization.png

Granulate Real Time Continuous Optimization: Granulate provides continuous performance optimization, enabling organizations to handle compute workloads with fewer servers and allowing DevOps and infrastructure managers to optimize costs.


Haldor Planning.png Haldor Planning: Haldor Planning allows teachers to plan lessons and build a curriculum in Microsoft Teams. This gives teachers and students a clear overview of plans, assignments, and assessments, all in one tab in Teams.
Hub Cittamobi.png

Hub Cittamobi: Hub Cittamobi centralizes control of urban transportation operations, integrating cameras, turnstiles, sensors, audio and video systems, Wi-Fi, and more. This app is available in Brazilian Portuguese.


IN-D Payables - Invoice Processing.png

IN-D Payables – Invoice Processing: IN-D Payables, an AI-based engine for accounts payable operations, processes invoices and extracts the useful details, like invoice number, PO number, and vendor name. It can send the relevant fields to accounting software in a matter of seconds.


Inpowa.png

Inpowa: Inpowa is an industry-agnostic employee engagement platform that reduces staff turnover, increases productivity, improves morale, and incentivizes workers through rewards based on numerous key performance indicators. Inpowa integrates with Microsoft Teams. 


Mavenir Business Messaging Solution.png

Mavenir Business Messaging Solution: Mavenir Business Messaging Solution provides a Messaging-as-a-Platform layer and value-added tools, apps, and services to enable brands, mobile network operators, and aggregators to build conversational customer experiences for mobile consumers.


NeoStencil.png

NeoStencil – Making Institutes Live/Online: Through its secure platform hosted on cloud servers, NeoStencil brings the experience of India’s top education institutes and teachers online to help students. Institutes can host live classes and receive support from the NeoStencil team.


On Demand License Management.png

On Demand License Management: Gain complete visibility into Office 365 and Microsoft Azure Active Directory licenses and utilization with Quest On Demand License Management. Discover who is or isn’t using provided licenses and determine what’s provisioned in your tenants.


Osirium PAM.png

Osirium PAM: This privileged access and infrastructure management solution protects critical assets, ensuring every action is accountable, visible, and auditable. Osirium PAM is one component of Osirium’s Privileged Access Security solution.


PackID - Temperature and humidity monitoring.png

PackID – Temperature and humidity monitoring: PackID offers temperature and humidity monitoring to prevent loss in the distribution chain of perishable products. The solution includes radio-frequency sensors that send information to the cloud and can be accessed through any device. This app is available only in Portuguese.


pecano-erp-billing-electronic-taps.png

pecano-erp-billing-electronic-taps: PECANO’s enterprise resource planning software includes an electronic billing service provided to Peruvian companies. This app is available only in Spanish.


PIDGraph- Digitalization of brownfield documents.png

PIDGraph – Digitalization of brownfield documents: PIDGraph uses artificial intelligence to convert analogue piping and instrument diagrams into a digital format. Increase your process plant’s efficiency with the help of a digital twin of your analog system models.


Qourt from Law Qube.png

Qourt from Law Qube: Part of Law Qube’s suite of judicial and law enforcement management products, Qourt helps courts of all levels manage cases as they progress from initiation through disposition.


Rigado Cascade.png

Rigado Cascade: The Cascade IoT Gateway is an element of the Rigado Edge-as-a-Service solution, and it offers an edge network for large-scale, low-power wireless deployments. Rigado makes capturing physical and environmental data easy by combining edge hardware with a secure connectivity platform and a managed cloud service.


SaaS Offer for EO- remote Sensing Service Chain.png

SaaS Offer for EO/Remote Sensing Service Chain: This package from Kratos supports earth observation and remote sensing missions. It includes the quantumRX wideband receiver (qRX), the quantumDRA stream processor/recorder (qDRA), and a one-week implementation support service.


Sage 50 Cloud Order & Accounting.png

Sage 50 Cloud Order & Accounting: Are you looking for a reliable cloud solution for order processing, inventory management, and financial accounting? Sage 50 delivers, and it brings with it the flexibility to run on any device. This app is available only in German.


Scissors Staffing Management.png

Scissors Staffing Management: Speed up your temp staffing with Scissors, a white-label solution available as a web or mobile app. Scissors can help you manage timekeeping, hiring, incident reporting, and more. Turn on additional integrations with major invoicing and payroll software to save even more time.


SkyBase for Oracle Database on Azure.png

SkyBase for Oracle Database on Azure: SkyBase Launcher lets you create an Oracle database server in your Microsoft Azure account with just a few clicks. The deployment process is fully automated and repeatable using an infrastructure-as-code approach.


Stimulus Relationship Intelligence Platform (SRIP).png

Stimulus Relationship Intelligence Platform (SRIP): Through real-time data analysis, Stimulus Relationship Intelligence Platform (SRIP) helps companies make better purchasing decisions, identify business opportunities, and avoid disruptions across the supply chain.


SurPaaS Operato.png

SurPaaS Operato: Operato enables you to group your cloud resources by application and perform day-to-day optimization and modernization with its management tools.


SwiftGo Smart Cart and Smart Basket.png

SwiftGo Smart Cart and Smart Basket: SwiftGo allows brick-and-mortar retail stores to shrink checkout lines and supply customers with personalized marketing as they shop. SwiftGo retrofits existing carts and baskets, enabling a swift, frictionless shopping experience.


TalentTurf.png

TalentTurf: Move from traditional performance reviews to insights-led performance conversations with TalentTurf. TalentTurf features embedded analytics, an easy-to-use interface, integration with leading ERP systems, and multi-device versatility.


Transport Management Platform.png

Transport Management Platform: Cubic’s Transport Management Platform facilitates coordination between transportation networks. Agency operators can work together to manage incidents and congestion in urban, interurban, and freeway environments.


UbiOps.png

UbiOps: UbiOps is a hosting layer for data science and AI code that lets teams keep track of their algorithms, functions, and scripts in one place. UbiOps also quickly turns algorithms into scalable apps without requiring knowledge of microservices or DevOps practices.


uqudo Digital Onboarding and KYC.png

uqudo Digital Onboarding and KYC: The uqudo platform is used for onboarding, sharing, and authentication. Onboarding covers user registration, ID validation, and background screening. Sharing covers know-your-customer details. Authentication uses biometrics to verify the identity of users already onboarded.


Versa Operating System (VOS).png

Versa Operating System (VOS): Connect and secure your Microsoft Azure workloads with the Versa Operating System (VOS), which provides software-defined routing, security, and a wide-area network. VOS is managed and controlled by Versa Director.


Video Surveillance as a Service.png

Video Surveillance as a Service: Intended for small and medium-sized enterprises, Duranc’s scalable video surveillance solution brings together artificial intelligence algorithms and cameras for use in loss prevention and risk mitigation.


Wallet Station.png

Wallet Station: Wallet Station enables QR code payments and one-stop services from merchant apps to management systems. Additional functionality, such as coupons, can be added. This app is available only in Japanese.


Zultys MXVirtual Enterprise Phone System [jpeg].jpg Zultys MXVirtual Enterprise Phone System: Zultys MXvirtual is a unified communications solution and IP phone system virtual appliance. Innovative, reliable, and scalable, it integrates voice, video, data, and mobility services to optimize collaboration and communications for businesses of all sizes.

Consulting services


Analytics with Azure Synapse- 2wk Proof of Concept.png

Analytics with Azure Synapse: 2wk Proof of Concept: Insight’s team of specialists will align the power of data analytics with your business opportunities, then shape one to three use cases for a proof of concept. Stakeholders will receive code, artifacts, and one or more demo-ready AI solutions.


Application Modernization.png

Application Modernization: Future-proof your applications by moving them to Microsoft Azure. Stratum’s cloud experts will determine which apps are ready to be migrated to Azure and which will need modernization. Stratum’s goal is to modernize with few to no code changes to the apps.


Application Modernization- 4 weeks assessment.png

Application Modernization: 4 weeks assessment: In this assessment, Birlasoft will examine your enterprise IT systems and monolithic applications, then provide a strategic roadmap for the easy adoption of microservices and Microsoft Azure.


AWS to AZURE - Cloud Migration- 2-Wk Imp.png

AWS to AZURE – Cloud Migration: 2-Wk Imp: Solo Network Brasil S/A will migrate your resources from Amazon Web Services (AWS) to Microsoft Azure. A roadmap for migration will ensure the process is structured and optimized.


Azure AD Setup 10-Week Implementation.png

Azure AD Setup 10-Week Implementation: In this engagement, Wipro will provide consultation and setup for Microsoft Azure Active Directory. Wipro will start with an assessment to determine your organization’s identity posture, then develop a gap analysis and a transformation roadmap.


Azure App MVP Development- 10 Week Implementation.png

Azure App MVP Development: 10 Week Implementation: Let Ascendle Technology supply your business with a custom software development team to build a minimum viable product. This will entail four weeks of strategy and three two-week production sprints. You’ll receive a demonstration every two weeks.


Azure Arc Management Assessment- 5 Days.png

Azure Arc Management Assessment: 5 Days: Fujitsu Services United Kingdom will conduct a workshop, a proof of concept with Microsoft Azure Arc, an implementation of a dashboard and workbook in Azure, and a plan to roll out Azure Arc for your hybrid and multi-cloud estate.


Azure Cloud Migration Assessment- 3-Day Assessment.png

Azure Cloud Migration Assessment: 3-Day Assessment: After reviewing your company’s goals and analyzing its infrastructure, Chorus will create a cloud readiness report and discuss the findings and recommendations with you. Chorus assessments help companies plan an optimal migration to Microsoft Azure.


Azure DevOps for Data - 2 Day workshop.png

Azure DevOps for Data – 2 Day workshop: Are your data developers left in the dark about the power of DevOps? This workshop from Improving will demonstrate how to automate data deployments via Microsoft Azure DevOps and a CI/CD process. Improving will build a foundation for DevOps in your data world.


Azure Logic Apps COVID-19 Bot- 1 Day Workshop.png

Azure Logic Apps Bot: 1 Day Workshop: Catalyst Technology Group’s free workshop will introduce companies to Microsoft Azure Logic Apps and Microsoft Power Automate, then set up a configuration to return results to the Otto.bot chatbot.


Azure Networking Workshop (2 days KickOff).png

Azure Networking Workshop (2 day KickOff): Available only in German, this workshop from braincon GmbH will go over the basics of Microsoft Azure network infrastructure, security concepts, landing zones, and resource locations. The workshop is limited to four customer participants.


Azure Security-Compliance Audit (3-Day Assessment).png

Azure Security/Compliance Audit (3-Day Assessment): This free assessment from Hanu will examine your Microsoft Azure security posture. Hanu will perform a compliance audit, conduct an application vulnerabilities check, and look for infrastructure configuration gaps.


Azure Sentinel SIEM Managed Service.png Azure Sentinel SIEM Managed Service: ITC Secure’s managed service provides a cost-effective approach to event collection and collation, threat detection, incident investigation, and rapid response using Microsoft Azure Sentinel.
Blockchain Engineer Course and Lab.png Blockchain Engineer Course and Lab: Get three months of instruction and hands-on lab assignments in this blockchain fundamentals course from Trak Labs. The course will include 11 modules and 20 practical projects on Ethereum, Hyperledger, and Tezos.
Citizen Services Conversational AI- 4-Hr Workshop.png

Citizen Services Conversational AI: 4-Hr Workshop: Discover how conversational AI powered by Microsoft can alleviate demand on call centers. VERSA’s workshop will examine this and how conversational AI can create more meaningful interactions between citizens and government entities.


Custom software development- 1-day Assessment.png

Custom software development: 1-day Assessment: In this assessment, Comminus will determine your project goals, estimate a budget, and provide a technical proposal that reflects the associated costs of running your solution on Microsoft Azure.


Cyber Defense Analysis.png Cyber Defense Analysis: CUATROi’s Cyber Defense Analysis service, available in English and Spanish, assesses organizations’ cybersecurity status. CUATROi analyzes Microsoft 365 solutions, IaaS and PaaS services, spear phishing risks, and more.
Data Analytics on Azure- 2-h Briefing.png

Data Analytics on Azure: 2-h Briefing: This briefing from SDX is aimed at customers interested in using Microsoft Azure for data analytics in hybrid or cloud-only settings. SDX will cover selected use cases and conclude with recommendations and best practices.


Explore Innovation Workshop- 10 day engagement.png

Explore Innovation Workshop: 10 day engagement: Prodware’s workshop will focus on your organization’s strategic needs and how technology and Microsoft Azure can bring about transformation in an agile manner. This offer includes an innovation gap analysis and an action plan.


Go to Cloud - 5 Day Workshop.png

Go to Cloud – 5 Day Workshop: Intended for technical and business stakeholders, this workshop from GFI will allow your organization to understand the possibilities of cloud migration. With GFI’s assistance, you’ll be able to create a roadmap for migrating to Microsoft Azure.


HPC Consulting- Implementation- 3 Weeks.png

HPC Consulting- Implementation: 3 Weeks: CrunchYard will assess your high-performance computing (HPC) needs and propose an architecture to implement on Microsoft Azure. Examples of solutions: parallel file systems for financial services or HPC clusters for exploration geophysics.


Insight Discovery and Accelerator- 1 Hr Assessment.png

Insight Discovery and Accelerator: 1 Hr Assessment: Enlighten Designs will address how to implement the Insights and Discovery Accelerator in your Microsoft Azure tenancy. The Insights and Discovery Accelerator uses Azure Cognitive Search and more to analyze page layouts and to extract text, images, and key entities for indexing.


IoT with Azure- 1-day workshop.png

IoT with Azure: 1-day workshop: Available only in German, this workshop from SDG Group will discuss implementing IoT scenarios with Microsoft Azure IoT services, then help you develop a complete use case, from data acquisition and processing to infrastructure-as-code deployment.


Modern Data Warehouse- 10-Day Assessment.png

Modern Data Warehouse: 10-Day Assessment: Predica will analyze your on-premises or hybrid cloud architecture, then collaborate with you on a plan that will allow you to implement a modern data warehouse and take advantage of the possibilities of Microsoft Azure.


One Day Azure Kubernetes Consulting Workshop.png

One Day Azure Kubernetes Consulting Workshop: In this workshop, COMLiNE SE will provide an overview of container technologies and how to manage and orchestrate your containers with Microsoft Azure Kubernetes Service and other Azure services. 


Road to Success Teams.png

Road to Success Teams: Together with employees from your organization, experts from Ask Roger! will strategize the migration of your traditional phone system or Skype system to Microsoft Teams. This offer is available only in Dutch.


SAP on Azure- 8-Wk Proof of Concept.png

SAP on Azure: 8-Wk Proof of Concept: SE16N’s proof-of-concept offer lets customers choose a pilot project from among several scenarios, such as migrating to Microsoft Azure, building an SAP system landscape on Azure, or building an SAP disaster recovery solution on Azure.


SEGA Cloud.png

SEGA Cloud: SEGA Cloud, a managed service from SEGA S.A., is designed to optimize your cloud costs and identify possible security risks by monitoring your Microsoft Azure services.


VDICE-Virtual Desktop Intertec Cloud Experience.png

VDICE-Virtual Desktop Intertec Cloud Experience: Intertec Systems LLC’s pay-as-you-go managed desktop service, built on Windows Virtual Desktop and third-party add-ons, reduces the hassle of managing end-user computing to just hardware support and access to the internet.


Windows Virtual Desktop- 2 weeks Implementation.png

Windows Virtual Desktop: 2 weeks Implementation: In this offer, QDS will implement Windows Virtual Desktop so you can easily transition to a virtual work experience. Customers can save money and improve flexibility with Windows Virtual Desktop.



Troubleshooting log on errors to an Azure AD DS domain joined Windows Server VM

Troubleshooting log on errors to an Azure AD DS domain joined Windows Server VM

This article is contributed. See the original author and article here.

If you’ve created a Windows Server virtual machine in Azure and are joining it to an Azure AD Domain Services managed domain or logging onto it via RDP, there are a couple of errors you can hit. Let’s look at the error messages and possible causes.



Problem: You’re trying to add your Windows Server VM to your Azure AD DS domain (by changing it from the current Workgroup). This prompts you for user credentials for the domain, requiring a user account that exists in Azure AD (which syncs to your AADDS domain). When you provide the credentials of a new “native” Azure AD user (not synced from an existing Active Directory environment), you get the error “The referenced account is currently locked and may not be logged on to.”


 


You’ve checked the user account in Azure Active Directory and it is not locked out.


 


Possible causes: Azure Active Directory doesn’t generate the required password hashes needed by AAD DS for Kerberos and NTLM authentication until AAD DS has been enabled in your tenant. Up until that point, those hash types aren’t ever needed. Once AAD DS has been enabled, the password hashes are created the next time your AAD native users change their password. This then needs approximately 20 minutes to sync from AAD to AAD DS.


 


Note: This doesn’t impact users synced from existing on-premises Active Directory domains, as they already use those authentication methods and Azure AD Connect synchronizes those hashes from the on-prem domain into AAD DS.


 


The solution is to get the user to log in to their Azure AD account, change their password, and wait for the sync to complete. The “account lock out” error can make you scratch your head, but give it a password reset and a little time, then try again later.


 


For more information, see Enable user accounts for Azure AD DS 



Problem: A user that exists in Azure AD is trying to log on to an Azure AD DS domain joined Windows Server VM in Azure via a Remote Desktop Session, and they’re getting the error “the connection was denied because the user account is not authorized for remote login.”


 


Cause: A Windows Server VM on Azure is still a Windows Server, and it can be easy to get tied up among all the different places that you manage security and permissions. If you’ve checked the Azure VM’s Identity and Access Management pane for a relevant virtual machine login role assignment (administrator or user) and you are still getting this error, the words “remote login” are your hint here. Inside the server operating system, the local server system properties has a section called Remote, which controls if connections via RDP are allowed and who is allowed to initiate them. If ‘Allow remote connections to this computer’ is selected, by default members of the Administrators group can connect, but nobody else.


 


This screenshot shows I’ve added an individual user from my AAD DS domain, and they can now log in, but a better solution is to add an AAD DS Group, and manage the membership of that group in Azure Active Directory.


The Remote Desktop Users control on Windows Server 2019The Remote Desktop Users control on Windows Server 2019


 


Note: When you join an Azure Windows Server VM to an AAD DS domain, two domain groups are automatically added to the local Administrators group on the server – AAD DC Administrators and Domain Admins. The AAD DC Administrators group is visible to you inside Azure Active Directory. People that you add to this group will have access to both administer the server and to log on to it via Remote Desktop. Also, these RDP login rights are separate from any network level configuration that may restrict access between the user’s device and the server’s RDP port, including their local network and the server’s Azure network security group.


 


Learn more about Azure AD Domain Services:


Management concepts for user accounts, passwords, and administration in Azure Active Directory Domain Services 


Frequently asked questions about Azure Active Directory Domain Services


 

Experiencing Data Access Issue in Azure portal for Log Analytics – 12/07 – Resolved

This article is contributed. See the original author and article here.

Final Update: Monday, 07 December 2020 00:49 UTC

We’ve confirmed that all systems are back to normal with no customer impact as of 12/7, 00:32 UTC. Our logs show the incident started on 12/6, 23:46 UTC and that during the 46 minutes that it took to resolve the issue customers may have experienced data access issues as well as failed or misfired alerts for Azure Log Analytics in North Europe.
  • Root Cause: The failure was due to an upgrade of one of our back end systems.
  • Incident Timeline: 46 minutes – 12/6, 23:46 UTC through 12/7, 00:32 UTC
We understand that customers rely on Azure Log Analytics as a critical service and apologize for any impact this incident caused.

-Ian

Update: Monday, 07 December 2020 00:17 UTC

We continue to investigate issues within Log Analytics. Root cause is not fully understood at this time. Some customers may experience experience data access issues as well as failed or misfired alerts for Azure Log Analytics in North Europe. We are working to establish the start time for the issue, initial findings indicate that the problem began at 12/06 23:46 UTC. We currently have no estimate for resolution.
  • Work Around: none
  • Next Update: Before 12/07 03:30 UTC
-Ian

Import database when policy “Azure SQL DB should avoid using GRS backup” is enforced

This article is contributed. See the original author and article here.

Symptoms:


Creating or importing database failed due to violation of policy “Azure SQL DB should avoid using GRS backup”


When creating database, you should specify the backup storage to be used, while the default is GRS (Globally redundant storage) and it violates the policy.


While importing database either using Azure Portal, RestAPI, SSMS or SQLPackage you cannot specify the backup storage as it’s not implemented yet.


This cause the import operation to fail with the following exception:


Configuring backup storage account type to ‘Standard_RAGRS’ failed during Database create or update.


 


Solution:


You can either



  • create the database with local backup storage and then import to existing database.

  • Use ARM Template to do both create the database with local backup storage and import the bacpac file.


 


Examples:


Option (A)



  1. Create the database with Azure Portal or by using T-SQL


CREATE DATABASE ImportedDB WITH BACKUP_STORAGE_REDUNDANCY = ‘ZONE’;



  1. Import the database using SSMS or SQLPackage


Option (B)


 


You may use ARM template to create database with specific backup storage and import the database at the same time.


This can be done with ARM template by using the extension named “import”


Add the following Json to your ARM template to your database resource section and make sure you provide the values for the parameters or set the values hardcoded in the template


The needed information is:


Storage Account key to access the bacpac file


Bacpac file URL


Azure SQL Server Admin Username


Azure SQL Server Admin Password


 


 


 


 


 

"resources": [
                {
                    "type": "extensions",
                    "apiVersion": "2014-04-01",
                    "name": "Import",
                    "dependsOn": [
                        "[resourceId('Microsoft.Sql/servers/databases', parameters('ServerName'), parameters('databaseName'))]"
                    ],
                    "properties": {
                        "storageKeyType": "StorageAccessKey",
                        "storageKey": "[parameters('storageAccountKey')]",
                        "storageUri": "[parameters('bacpacUrl')]",
                        "administratorLogin": "[parameters('adminUser')]",
                        "administratorLoginPassword": "[parameters('adminPassword')]",
                        "operationMode": "Import"
                    }
                }
            ]