This article is contributed. See the original author and article here.
This article is contributed. See the original author and article here.
The Data Security 6-week digital campaign and the Data Security campaign-in-a-box are available to enable Microsoft partners to drive top and mid funnel leads for the Data Security solutions and your services.
Data security has become one of the most critical security issues companies face, exacerbated by outdated approaches to data security and a fragmented solution landscape that can be expensive, hard to manage—and often ineffective. Microsoft Purview provides a comprehensive and holistic data security solution that helps customers secure their data, across clouds, apps and devices, by focusing on three key areas: discovering and protecting data, managing insider risk, and preventing data loss. When used together, customers can benefit from a cloud-based solution that helps secure all their data, on-premises or in the cloud, in emails, and in apps. These campaigns provide engaging content and insights to customers on achieving integrated data security that helps them protect data, manage insider risk, and prevent data loss, all while improving efficiency and saving costs.
Launch either of these partner-ready campaigns and go to market quicker to drive customer engagement and leads for Microsoft Data Security solutions and your services.
This article is contributed. See the original author and article here.
We continue to expand the Azure Marketplace ecosystem. For this volume, 168 new offers successfully met the onboarding criteria and went live. See details of the new offers below:
Get it now in our marketplace | |
|---|---|
| Aribot: AI-Based Automated Threat Modeling: Automated Threat Modeling from Aristiun B.V. employs AI to expose security threats in application environments. Developers can use it to automatically create traceable security requirements across the lifecycle and auto-map the requirements to compliance frameworks. |
 | CIS Oracle Linux 9 Benchmark L1: This offer from the Center for Internet Security (CIS) provides an image of Oracle Linux 9 that’s hardened according to a CIS Benchmark. CIS Benchmarks are vendor-agnostic consensus-based security configuration guides. |
 | CKAN Secured and Supported by HOSSTED: This offer from HOSSTED provides CKAN on a Microsoft Azure virtual machine. CKAN is an open-source data management system that powers hundreds of data portals worldwide. This installation includes a support package from HOSSTED. |
 | Connected Care – Healthcare Workflow Automation Platform: Delivered through Microsoft Azure, Konica Minolta Connected Care securely processes protected health information from diverse input sources (such as faxes, emails, and scans) and converts it into structured data. |
 | Credivera Exchange: Credivera Exchange is a workforce management and digital identity platform that optimizes personal privacy and trust through verifiable credentials secured in a digital wallet. Reduce risk, liability, and uncertainty with Credivera. |
 | Databook Strategic Relationship Management Platform: Databook gives sales professionals access to data-driven insights, helping enterprise go-to-market teams develop strategic relationships with customers. Databook reveals why companies are ready to buy, which business outcomes they’re seeking, and when deals are most likely to close. |
 | Delinea Secret Server (Privileged Access Management): Secret Server, part of Delinea’s privileged access management and endpoint security offerings, integrates with Microsoft Sentinel to give organizations deep insight into privileged account usage so they can meet compliance mandates and detect internal network threats. |
 | DNS Fetcher: DNS Fetcher is an online tool that enables system administrators, network engineers, and others to quickly and easily check the DNS information and records for a given domain name. |
 | Docker on Ubuntu 23.04: This offer from Ntegral provides Docker on Ubuntu 23.04. Docker is a platform that developers and system administrators use to build, run, and share applications with containers. |
 | Encrypted Conversational Portals: DropVault’s encrypted conversational portals let you securely share conversations and documents with customers or employees. Use DropVault with Azure storage options or with your existing business storage. |
 | Hazelcast Secured and Supported by HOSSTED: This offer from HOSSTED provides Hazelcast on a Microsoft Azure virtual machine. Hazelcast is a distributed computation and storage platform for low-latency querying and aggregation. This installation includes a support package from HOSSTED. |
 | Intelligent Assistant: ChatBot for Microsoft Teams: Top365’s Smart Assistant chatbot for Microsoft Teams uses AI to answer the day-to-day questions at your company, building a knowledge base from employees’ most common queries. This offer is available only in Brazilian Portuguese. |
 | iPerf3 Server on Ubuntu 20.04 LTS: This offer from Virtual Pulse S. R. O. provides IPerf3 on Ubuntu 20.04 LTS. IPerf3 is a tool for network performance measurement and tuning. For each test, it reports the measured throughput, loss, and other parameters. |
 | mirro.ai – Mood Analyzer: Mood Analyzer from mirro.ai mines your sales calls or support calls in order to assess a speaker’s emotions, energy level, engagement, stress, and fatigue. Mood Analyzer can quickly process all your recordings and extract audio snippets to save you time and assess staff performance. |
 | MySQL on Ubuntu 23.04: This offer from Ntegral provides MySQL on Ubuntu 23.04. MySQL is an open-source relational database designed for application development. Ntegral’s images are up-to-date, secure, and built to work right away. |
 | NATS Secured and Supported by HOSSTED: This offer from HOSSTED provides NATS on a Microsoft Azure virtual machine. NATS is an open-source messaging system that lets applications securely communicate across cloud, edge, or on-premises locations. This installation includes a support package from HOSSTED. |
 | NiCE Active 365 Management Pack: This offer from NiCE IT Management Solutions provides a pack for Microsoft System Center Operations Manager that maps out your hybrid or cloud-only deployment of Microsoft 365. Get quick insights into licensing, users, health states, and more. |
 | NiCE AIX Management Pack for Microsoft SCOM: This offer from NiCE IT Management Solutions provides a pack for Microsoft System Center Operations Manager that delivers monitoring of AIX systems in your IBM Power environment. Track availability, performance, security, and more. |
 | NiCE Db2 Management Pack for Microsoft SCOM: This offer from NiCE IT Management Solutions provides a pack for Microsoft System Center Operations Manager that collects detailed data from Db2 instances without impacting performance. Monitor processes, files, databases, and more. |
 | NiCE Domino Management Pack for Microsoft SCOM: This offer from NiCE IT Management Solutions provides a pack for Microsoft System Center Operations Manager that monitors your HCL Domino infrastructure and the state and performance of its components. Track server response time, availability, and bottlenecks. |
 | NiCE Linux Power Management Pack for Microsoft SCOM: This offer from NiCE IT Management Solutions provides a pack for Microsoft System Center Operations Manager that enables centralized performance monitoring for Linux assets in your IBM Power environment. Ensure availability and enhance efficiency in your IT infrastructure. |
 | NiCE MongoDB Management Pack for Microsoft SCOM: This offer from NiCE IT Management Solutions provides a pack for Microsoft System Center Operations Manager that enables centralized health and performance monitoring for your MongoDB environment. Spot anomalies and fix them before they escalate. |
 | NiCE Oracle Management Pack for Microsoft SCOM: This offer from NiCE IT Management Solutions provides a pack for Microsoft System Center Operations Manager that monitors your Oracle database and storage infrastructure and reports server problems before they affect applications and end users. |
 | NiCE PowerHA Management Pack for Microsoft SCOM: This offer from NiCE IT Management Solutions provides a pack for Microsoft System Center Operations Manager that facilitates the monitoring of IBM PowerHA technology. Get detailed data from your PowerHA environment using predefined event conditions and threshold monitors. |
 | NiCE Veritas Management Pack for Microsoft SCOM: This offer from NiCE IT Management Solutions provides a pack for Microsoft System Center Operations Manager that facilitates the monitoring of Veritas Cluster Server objects. It delivers alerts, failover detection, and service group monitoring. |
 | NiCE zLinux Management Pack for Microsoft SCOM: This offer from NiCE IT Management Solutions provides a pack for Microsoft System Center Operations Manager that will automatically discover all Linux computers on your IBM Z mainframe system. It will also monitor the health of disks, processors, and adapters. |
 | Packer 1.3.4 with Support on Ubuntu 20.04 LTS: Packer users can define and enforce infrastructure configurations using HashiCorp Configuration Language (HCL). Its simple syntax lets DevOps teams easily provision and re-provision infrastructure across multiple cloud and on-premises data centers. |
 | Red Hat JBoss Enterprise Application Platform: No matter the type of environment, Red Hat JBoss EAP can help deliver apps faster. It provides simplified deployment and full Jakarta EE performance and features a modular architecture that starts services only as they’re required. |
 | RISKGRID: RISKGRID is a cloud-based platform that enhances the risk assessment process through visual grids. Inherent risks, controls, and residual risks are clearly represented, and all changes have a full audit history. Track and measure progress with built-in analytics and build actionable plans. |
 | Safe365 – Intelligent Health and Safety: Get an instant snapshot of how your business ranks in its health and safety maturity with this suite of tools from Safe365. You can then plot a roadmap to health and safety excellence with clear, actionable steps centered around the Safe365 Safety Index. |
 | SFTP – OpenSSH FTP Server on Ubuntu 18.04 LTS: Secure File Transfer Protocol (SFTP) transfers encrypted files using the main control connection. This provides a single, efficient, secure connection passing data through the firewall, resulting in faster data transfer speeds. |
 | SFTP – OpenSSH FTP Server on Ubuntu 20.04 LTS: This offer from Virtual Pulse S.R.O. uses SSH2 protocol encryption standards to provide a single, efficient, and secure connection. It thwarts any hacking attempts while files are being transferred and significantly boosts data transfer speeds. |
 | Smartstore Commerce Cloud: Extend your ecommerce business model with this open-source solution that can create multilingual, multicurrency shops, enable SEO-optimized, comprehensive product catalogues, and support fast and precise searches of products and categories. |
 | Squid Proxy Server with Authentication on Ubuntu 18.04 LTS: This offer from Virtual Pulse S. R. O. provides Squid with Ubuntu 18.04 LTS. It contains built-in variable environments with back-end authentication functions so you can regulate employees from accessing prohibited entertainment sites during working hours. |
 | Squid Proxy Server with Authentication on Ubuntu 20.04 LTS: This offer from Virtual Pulse S. R. O. provides Squid with Ubuntu 20.04 LTS. Squid routes content requests in ways that build cache server hierarchies and optimize network throughput. |
 | Squid Easy on Ubuntu 22.04 Minimal: This offer from Virtual Pulse S. R. O. provides Squid with Ubuntu 20.04 LTS. Squid lets you cache your web content and improves response times while reducing network bandwidth usage. |
 | Swoop Broker Portal: This finance matching and deal flow management portal gives brokers whole-of-market access to funders as well as grants and equity investors which allows them to close more deals in less time. Cut your business costs in one fell swoop. |
 | Terraform 1.4.5 on Ubuntu 20.04 LTS: Terraform is a free, downloadable command line tool for providing infrastructure on any cloud provider and handling configuration, plugins, and state. Use it to specify on-premises and cloud resources in human-readable configuration files to use, version, and share. |
 | Tyk API Gateway: Tyk API Gateway is a secure, open-source gateway for APIs and microservices. It supports REST, SOAP, GraphQL, and Kubernetes to make it easy to migrate to the cloud, adopt microservices, create new products, and grow your customer base. |
 | Ubuntu 23.04 Minimal: This minimal Ubuntu server maintained by Cloud Infrastructure Services is designed for automated deployment at scale. It has a greatly reduced default package set so it’s smaller, boots faster, and requires fewer security updates over time. |
 | VUSION Cloud: VUSION Cloud is a retail platform merchants and brands can use for electronic shelf label management and monitoring to increase in-store efficiency. Its resilient, elastic architecture provides high availability and on-demand capacity for provable management and updates, no matter the amount. |
 | Zetaris – Fluid Data Vault: Through the Zetaris platform, the Fluid Data Vault toolkit enables integration of big data and data streaming sources. Use it to go directly from source systems to the data vault without having to replicate raw data across multiple storage layers. |
Go further with workshops, proofs of concept, and implementations | |
 | ACP Azure Landing Zone Deployment: ACP IT Solutions will prepare a Microsoft Azure landing zone to act as the foundation of your Azure environment, managing the applications and services that are migrated. This offer is only available in Austria, Germany, and Switzerland. |
 | AFRY Operational Data Layer: AFRY Operational Data Layer provides a solution to help retailers increase sales and free time for IT resources while providing real-time access to crucial business data through Microsoft Azure. It creates a single source of truth for price, inventory, and product data. |
 | AI Discovery: 3-Hour Virtual Workshop: TEKenable’s artificial intelligence accelerator helps organizations solve business challenges using Microsoft Azure AI services. This discovery workshop includes an overview of AI capabilities and real-life examples of how AI can be used. |
 | Audax Labs Product Engineering Services: Audax Labs provides innovative product engineering services for businesses, creating cutting-edge products using Microsoft Azure services like AI, IoT, Data Analytics, and Mixed Reality. |
 | Azure Active Directory for B2C: 3-Day Workshop: Direct Experts will provide a thorough introduction to the capabilities of Microsoft Azure Active Directory for B2C, provide hands-on training, and deploy and configure it in your environment according to best practices. |
 | Azure Active Directory: 3-Day Workshop: Direct Experts will provide a thorough introduction to the capabilities of Microsoft Azure Active Directory, provide hands-on training, and deploy and configure it in your environment according to best practices. |
 | Azure Arc: 3-Day Workshop: Direct Experts will provide a thorough introduction to the capabilities of Microsoft Azure Arc, provide hands-on training, and deploy and configure it in your environment according to best practices. |
 | Azure Automation and Infrastructure as Code: 3-Day Workshop: Direct Experts will provide a thorough introduction to the infrastructure as code capabilities of Microsoft Azure Automation, provide hands-on training, and deploy and configure it in your environment according to best practices. |
 | Azure Back Up: 3-Day Workshop: Direct Experts will provide a thorough introduction to the capabilities of Microsoft Azure Backup, provide hands-on training, and deploy and configure it in your environment according to best practices. |
 | Azure Migration with Pegasus One: Pegasus One provides end-to-end migration services of entire workloads from on-premises and other platforms to Microsoft Azure, conducting IT portfolio diagnostics to identify applications to be migrated and providing the overall total cost of ownership of migration. |
 | Azure DevOps: 3-Day Workshop: Direct Experts will introduce you to the capabilities of Azure DevOps and then provide hands-on training to initiate your DevOps journey. Participants will also learn how to implement and manage advanced domains like Azure Active Directory and Azure Networking. |
 | Azure File Sync Services: 3-Day Workshop: Azure File Sync is a service that allows you to cache several Azure file shares on an on-premises Windows Server or cloud VM. Direct Experts will help you explore the capabilities of Azure Files and Files Sync Services and show you how to configure them to your environment. |
 | Azure Firewall: 3-Day Workshop: Azure Firewall is a managed, cloud-based network security service that protects your Azure Virtual Network resources. Direct Experts will help you explore the capabilities of Azure Firewall and show you how to configure it to your environment. |
 | Azure IaaS Migration: 5-Day Proof of Concept: The experts from Elite Technology Solutions will review your current environment and create a roadmap to ensure a smooth transition of your IaaS services to Microsoft Azure. Full documentation and guided knowledge transfer will also be provided. |
 | Azure Innovation Jumpstart – 6-Week Engagement: Neudesic will identify and accelerate digital innovation opportunities using Microsoft Azure, Microsoft Power Platform, and Azure data services. You’ll receive a transformation blueprint for Azure services directly supporting your stated business goals. |
 | Azure Key Vault: 3-Day Workshop: In this hands-on workshop, Direct Experts will show you how to use Azure Key Vault so you can create and maintain keys that access and encrypt your cloud resources, apps, and solutions. Learn how you can enhance data protection and compliance. |
 | Azure Kubernetes Service (AKS): 3-Day Workshop: Direct Experts will guide you to develop and deploy cloud-native apps in Microsoft Azure, datacenters, or at the edge with built-in code-to-cloud pipelines and guardrails. Get unified management and governance for on-premises, edge, and multi-cloud Kubernetes clusters. |
 | Azure Landing Zone Foundation: 4-Week Deployment: Converge will map its processes to the Microsoft Cloud Adoption Framework and help design and create a customized landing zone environment on Microsoft Azure that aligns with your organization’s goals, compliance requirements, and scalability needs.
|
 | Azure Network Virtual Appliance (NVA): 3-Day Workshop: Direct Experts will provide an overview of how Azure Network Virtual Appliance (NVA) is used in Azure applications to enhance high availability. Participants will also learn how to implement, manage, and create a secure network boundary. |
 | Azure OpenAI Services – Envisioning Workshop: Accelerate your generative AI knowledge with WinWire’s team of AI experts. This workshop introduces Microsoft Azure OpenAI Services and best practices to identify use cases that can help your business deliver maximum impact and ROI. |
 | Azure OpenAI: Hands-on Training Sessions: MaibornWolff will offer a series of workshops to help you explore and leverage the power of Microsoft Azure OpenAI and its technologies like ChatGPT. You will learn how to develop generative AI applications, drive growth, improve efficiency, and gain a competitive edge. |
 | Azure Sentinel: 3-Day Workshop: Direct Experts will introduce the core services offered by Microsoft Sentinel and will deploy it using best practices suited to your environment and business needs. Uncover sophisticated threats and respond decisively with this intelligent security information and event management solution. |
 | Azure Virtual Desktop: 3-Day Workshop: Receive hands-on guidance from Direct Experts as you deepen your understanding of Azure Virtual Desktop and how it can be securely scaled and adapted to suit your remote work environment, budget, and business needs. |
 | Azure VMware: 3-Node AV36 Cluster / 100 VMs – Implementation Services: Performance Technologies S.A. will implement Microsoft Azure VMware Solution so can you seamlessly migrate, extend, and run VMware workloads on Azure. This brings scalability and facilitates hybrid-cloud strategies. |
 | Coforge FinOps – Cloud Financial Management: Focusing on cost visibility, cost control, and cost governance, Coforge will implement its FinOps service to enhance visibility and intelligence in your cloud platform. You’ll be able to lower costs and optimize resources with the right governance in place. |
 | Coforge’s Customer 360 Solution: 6-Week Implementation: Using Microsoft Power BI and Azure services, Coforge will implement an accelerator for its Customer 360 Solution, which derives insights from multiple customer channels. Track customer satisfaction, predict churn, and manage client expectations with the help of Coforge. |
 | Datacenter Migration to Azure: Agic Cloud will utilize Microsoft Azure and Microsoft 365 to guide and empower your IT department to manage and govern your datacenter migration process based on a defined and planned strategy. Reduce costs while increasing the performance, availability, and security of your workloads. |
 | Disaster Recovery on Azure: 3-Day Workshop: Direct Experts will provide hands-on training and help you configure disaster recovery solutions on Azure tailored to your specific environment. Workshop participants will come away with enhanced knowledge and troubleshooting skills based on best practices. |
 | Enterprise Integration Accelerator: 7-Week Implementation: Insight will extend your Azure landing zone and address key security, governance, cost control, and operational requirements through workshops, a knowledge transfer, infrastructure as code, and a DevOps-ready implementation framework. |
 | ExSight: Advanced Data Analytics for Real-time Monitoring on Azure: Exist Software will implement its ExSight data analytics tool, which provides real-time monitoring of Azure systems and gives you instant visibility into any issues or anomalies. Dashboards can be customized so that they display the metrics that matter most to you. |
 | Generative AI Adoption Framework: 4-Week Implementation: Through a workshop and a proof of concept, ENCAMINA will enable you to unleash the potential of generative AI. The framework will be aligned with your company’s business objectives and strategies. This service is available only in Spanish. |
 | Generative AI eXplore: 2-Month Proof of Concept: In this proof of concept, iCubed will show your organization how generative AI works, explore its potential applications, and create a prototype with Microsoft Azure OpenAI Service to solve your business challenges. |
 | Marketing Strategy and Campaign Data Analysis: 8-Week Implementation: Are you looking to boost your online presence and attract more customers? 54cuatro’s service, available only in Spanish, will create a custom analytics platform using Microsoft Azure Synapse that concentrates information in a data lake. This will improve audience targeting. |
| Microsoft Azure OpenAI Service: 1-Day Workshop: Discover the opportunities of generative AI, Azure OpenAI Service, Microsoft 365 Copilot, and GitHub’s Codex in this workshop from onepoint. You’ll explore use cases and leave with an accelerator kit. This offer is available only in French. |
 | Oracle to Azure SQL: Database Migration: Mazzy Technologies will migrate your Oracle schema to PostgreSQL or Microsoft Azure SQL Database. Mazzy Technologies specializes in Azure migrations and application modernization for large enterprises and government agencies around the world. |
| SalzPoint Supply Chain Framework on Azure: 2-Week Implementation: SAVIC Technologies will implement SalzPoint, a supply chain management and sales team management software framework that sits on Microsoft Azure and provides real-time data for your business. The front-end interface can be customized using Microsoft Power Automate and Microsoft Power BI. |
Contact our partners | |
Application Modernization Assessment Service | |
Azure Active Directory for B2C: 2-Day Assessment | |
Azure Active Directory for B2C: 2-Hour Briefing | |
Azure Active Directory: 2-Day Assessment | |
Azure Active Directory: 2-Hour Briefing | |
Azure Automation and Infrastructure as Code: 2-Day Assessment | |
Azure Automation and Infrastructure as Code: 2-Hour Briefing | |
Azure Back Up: 2-Day Assessment | |
Azure Back Up: 2-Hour Briefing | |
Azure Backup and Disaster Recovery: 2-Day Assessment | |
Azure Backup and Disaster Recovery: 2-Hour Briefing | |
Azure Cost Management and Analysis: 2-Day Assessment | |
Azure Cost Management and Analysis: 2-Hour Briefing | |
Azure Data Platform Architecture: 2-Week Assessment | |
Azure DevOps: 2-Day Assessment | |
Azure Files and Files Sync Services: 2-Day Assessment | |
Azure Files and Files Sync Services: 2-Hour Briefing | |
Azure Firewall: 2-Day Assessment | |
Azure Firewall: 2-Hour Briefing | |
Azure Key Vault: 2-Day Assessment | |
Azure Key Vault: 2-Hour Briefing | |
Azure Kubernetes Service (AKS): 2-Day Assessment | |
Azure Managed Databases: 2-Day Assessment | |
Azure Managed Databases: 2-Hour Briefing | |
Azure Monitor: 2-Day Assessment | |
Azure Monitor: 2-Hour Briefing | |
Azure Network Virtual Appliance: 2-Day Assessment | |
Azure Network Virtual Appliance: 2-Hour Briefing | |
Azure Networking: 2-Day Assessment | |
Azure Networking: 2-Hour Briefing | |
Azure OpenAI Enablement: 1-Hour Briefing | |
Azure Security: 2-Day Assessment | |
Azure Security: 2-Hour Briefing | |
Azure Sentinel: 2-Day Assessment | |
Azure Sentinel: 2-Hour Briefing | |
Azure Virtual Desktop (Managed Service): 1-Hour Briefing | |
Azure Virtual Desktop: 2-Day Assessment | |
Azure Virtual Desktop: 2-Hour Briefing | |
Azure VMware Solution (Managed Service): 1-Hour Briefing | |
Citrix Application Delivery Controller: VPX FIPS 13.1 | |
Citrix Cloud on Azure Readiness: 2-Week Assessment | |
Cloud Security Assessment: 4-Week Assessment | |
Cloud-Native Azure Application Development: 1-Hour Briefing | |
CloudON for Azure Virtual Desktop Infrastructure: 2-Week Assessment | |
CloudON for SQL Migration: 2-Week Assessment | |
Coforge Quasar – Loss Run Document Analysis | |
ContraForce Hyperautomation Security Platform | |
Cue: Gamification for Microsoft 365 | |
Enterprise Integration: 6-Week Assessment | |
epicCare: Home Care Management Software | |
EverestDX BotX Intelligent Automation Platform | |
Honeywell Forge Performance+ for Distribution Centers | |
Identity Orchestration Fabric with Microsoft Entra Verified ID | |
Microsoft Intune Managed Service for Enterprises | |
Poly CloudConnect for Teams by Pexip | |
Poly FedConnect Powered by Pexip | |
Poly PrivateConnect Powered by Pexip | |
POSSE PLS Permitting and Licensing Software | |
Quartz Smart Solutions – Contract Performance Monitoring | |
Quartz Smart Solutions – Digital Bank Guarantee | |
Quartz Smart Solutions – Quartz for Markets | |
Recuro Digital Medical Home – White Label Custom Solution | |
Recuro Virtual Primary Healthcare (Core) | |
Recuro Virtual Primary Healthcare (Enhanced) | |
Recuro Virtual Urgent Healthcare | |
Revelstoke Security Orchestration Automation and Response Platform | |
Ripik Vision: Fuel Rate Improvement Tool for Cement Kilns | |
Ripik Vision: Woodchip Size Detection for Pulp/Paper Industry | |
SQUEAKS Next-Gen Communication Platform | |
Syvir Remote Hyper-V Diagnostics | |
Tagit Mobeix Retail Banking on Azure | |
Threat Protection with Managed SIEM and XDR Service for Microsoft Azure Government | |
Well-Architected Review of Your Azure Infrastructure | |
ZendPHP with Apache on Debian 11 | |
This article is contributed. See the original author and article here.
Today there is a lot of interest around generative AI, specifically training and inferencing large language models (OpenAI GPT4, DALL.E2), Git copilot, Azure OpenAI service). Training these large language models requires lots of float-point performance and high interconnect network bandwidth. The Azure NDm_v4 virtual machine is an ideal choice for these types of demanding jobs (because it has 8 A100 GPU and each GPU has 200 Gbps of HDR InfiniBand). Kubernetes is a popular choice to deploy and manage containerized workloads on compute/gpu resources. The Azure Kubernetes service (AKS) simplifies Kubernetes cluster deployments. We show how to deploy an optimal NDm_v4 (A100) AKS cluster, making sure that all 8 GPU and 8 InfiniBand devices on each virtual machine come up correctly and are available to deliver optimal performance. A multi-node NCCL allreduce benchmark job is executed on the NDm_v4 AKS cluster to verify its deployed/configured correctly.
We will deploy AKS cluster from the Azure cloud shell using Azure command line interface (azcli). The Azure cloud shell has azcli preinstalled, but if you prefer to install from your local workstation, instructions to install azcli are here.
Note: There are many other ways to deplot an AKS cluster (e.g. Azure Portal, ARM template, Bicep and terraform are also popular choices)
First we need to install the aks-preview azcli extension, to be able to deploy AKS and control AKS via azcli.
az extension add –name aks-preview
It is also necessary to register infiniBand support, to make sure all nodes in your pool can communicate over the same InfiniBand network.
az feature register –name AKSInfinibandSupport –namespace Microsoft.ContainerService
Create a resource group for the AKS cluster.
az group create –resource-group –location
For simplicity we will use the default kubenet networking (you could also deploy AKS using CNI and choose your own VNET), in the kubenet case AKS will deploy the VNET and subnet. System managed identity will be used for authentication. Ubuntu is chosen for the HostOS (The default AKS version deployed was 1.25.6 and the default Ubuntu HostOS is Ubuntu 22.04).
az aks create -g –node-resource-group -n –enable-managed-identity –node-count 2 –generate-ssh-keys -l –node-vm-size Standard_D2s_v3 –nodepool-name –os-sku Ubuntu –attach-acr
Then deploy the NDmv4 AKS pool. (Initially only one NDmv4 VM, later we will scale up the AKS cluster).
Note: Make sure you have sufficient NDmv4 quota in your subscription/location.
A specific tag (SkipGPUDriverInstall=true) needs to be set to prevent the GPU driver from being installed automatically (we will use the Nvidia GPU operator to install the InfiniBand driver instead). Some container images can be quite large and so we use a larger OS disk size (128 GB)
az aks nodepool add –resource-group –cluster-name –name –node-count 1 –node-vm-size Standard_ND96amsr_A100_v4 –node-osdisk-size 128 –os-sku Ubuntu –tags SkipGPUDriverInstall=true
Get credentials to connect and interact with the AKS Cluster.
az aks get-credentials –overwrite-existing –resource-group –name
Check that the AKS pools are ready.
kubectl get nodes
kubectl get nodes
Install NVIDIA network and gpu operators (they will be used to install specific GPU and InfiniBand drivers (in this case OFED 5.8-1.0.1.1.2 and GPU driver 525.60.13)
#! /bin/bash
# Apply required manifests
kubectl get namespace nvidia-operator 2>/dev/null || kubectl create namespace nvidia-operator
# Install node feature discovery
helm upgrade -i --wait
-n nvidia-operator node-feature-discovery node-feature-discovery
--repo https://kubernetes-sigs.github.io/node-feature-discovery/charts
--set-json master.nodeSelector='{"kubernetes.azure.com/mode": "system"}'
--set-json worker.nodeSelector='{"kubernetes.azure.com/accelerator": "nvidia"}'
--set-json worker.config.sources.pci.deviceClassWhitelist='["02","03","0200","0207"]'
--set-json worker.config.sources.pci.deviceLabelFields='["vendor"]'
# Install the network-operator
helm upgrade -i --wait
-n nvidia-operator network-operator network-operator
--repo https://mellanox.github.io/network-operator
--set deployCR=true
--set nfd.enabled=false
--set ofedDriver.deploy=true
--set ofedDriver.version="5.8-1.0.1.1.2"
--set secondaryNetwork.deploy=false
--set sriovDevicePlugin.deploy=true
--set-json sriovDevicePlugin.resources='[{"name": "infiniband", "vendors": ["15b3"], "devices": ["101c"]}]'
--set sriovNetworkOperator.enabled=false
# If you want to enable IPoIB, change secondaryNetwork.deploy to true and add the following flags:
# --set secondaryNetwork.multus.deploy=true
# --set secondaryNetwork.cniPlugins.deploy=true
# --set secondaryNetwork.ipamPlugin.deploy=true
# Install the gpu-operator
helm upgrade -i --wait
-n nvidia-operator gpu-operator gpu-operator
--repo https://helm.ngc.nvidia.com/nvidia
--set nfd.enabled=false
--set driver.enabled=true
--set driver.version="525.60.13"
--set driver.rdma.enabled=true
--set toolkit.enabled=true
Verify that InfiniBand and GPU drivers have been installed. You should see 8 infiniband devices and 8 gpu’s per NDm_v4 VM.
kubectl describe node | grep =e “nvidia.com/infiniband” -e “nvidia.com/gpu”
Install Volcano Kubernetes scheduler to make it easier to submit HPC/AI tightly-coupled jobs.
kubectl apply -f https://raw.githubusercontent.com/volcano-sh/volcano/release-1.7/installer/volcano-development.yaml
Check that the Volcano kubernetes scheduler was installed correctly.
kubectl get all -n volcano-system
Here is the Dockerfile that was used to create the NCCL collective test container, the NVIDIA NGC pytorch (23.03) was used as a base container.
nccl-tests.sh script to build the NCCL collective tests.
#!/bin/bash
git clone https://github.com/NVIDIA/nccl-tests.git
cd nccl-tests
make MPI=1 MPI_HOME=/usr/local/mpi
Dockerfile
ARG FROM_IMAGE_NAME=nvcr.io/nvidia/pytorch:23.03-py3
FROM ${FROM_IMAGE_NAME}
RUN apt update
RUN apt-get -y install build-essential
RUN apt-get -y install infiniband-diags
RUN apt-get -y install openssh-server
RUN apt-get -y install kmod
COPY nccl-tests.sh .
RUN ./nccl-tests.sh
COPY ndv4-topo.xml .
Login to your Azure container registry, where your custom container will be stored.
az acr login -n
Build your container locally on a Ndmv4 VM. First change to the directory containing your Dockerfile.
docker build -t .azurecr.io/ .
Push your local container to your Azure container registry.
docker push .azurecr.io/
The NVIDIA NCCL collective communication tests are ideal to verify that the NDv4 AKS cluster is set-up correctly for optimal performance. On 2 NDmv4 nodes (16 A100), NCCL allreduce should be ~186 GB/s.
We will use the docker container we created in the previous section and submit the NCCL allreduce benchmark using the Volcano scheduler.
Scale-up the NDmv4 AKS cluster to 2 NDmv4 VM’s (16 A100).
az aks nodepool scale –resource-group –cluster-name –name –node-count 2
Here is the NCCL allreduce benchmark yaml script.
apiVersion: batch.volcano.sh/v1alpha1
kind: Job
metadata:
name: nccl-allreduce-job1
spec:
minAvailable: 3
schedulerName: volcano
plugins:
ssh: []
svc: []
tasks:
- replicas: 1
name: mpimaster
policies:
- event: TaskCompleted
action: CompleteJob
template:
spec:
containers:
- command:
- /bin/bash
- -c
- |
MPI_HOST=$(cat /etc/volcano/mpiworker.host | tr "n" ",")
mkdir -p /var/run/sshd; /usr/sbin/sshd
echo "HOSTS: $MPI_HOST"
mpirun --allow-run-as-root -np 16 -npernode 8 --bind-to numa --map-by ppr:8:node -hostfile /etc/volcano/mpiworker.host -x NCCL_DEBUG=info -x UCX_TLS=tcp -x NCCL_TOPO_FILE=/workspace/ndv4-topo.xml -x UCX_NET_DEVICES=eth0 -x CUDA_DEVICE_ORDER=PCI_BUS_ID -x NCCL_SOCKET_IFNAME=eth0 -mca coll_hcoll_enable 0 /workspace/nccl-tests/build/all_reduce_perf -b 8 -f 2 -g 1 -e 8G -c 1 | tee /home/re
image: cgacr2.azurecr.io/pytorch_nccl_tests_2303:latest
securityContext:
capabilities:
add: ["IPC_LOCK"]
privileged: true
name: mpimaster
ports:
- containerPort: 22
name: mpijob-port
workingDir: /workspace
resources:
requests:
cpu: 1
restartPolicy: OnFailure
- replicas: 2
name: mpiworker
template:
spec:
containers:
- command:
- /bin/bash
- -c
- |
mkdir -p /var/run/sshd; /usr/sbin/sshd -D;
image: cgacr2.azurecr.io/pytorch_nccl_tests_2303:latest
securityContext:
capabilities:
add: ["IPC_LOCK"]
privileged: true
name: mpiworker
ports:
- containerPort: 22
name: mpijob-port
workingDir: /workspace
resources:
requests:
nvidia.com/gpu: 8
nvidia.com/infiniband: 8
limits:
nvidia.com/gpu: 8
nvidia.com/infiniband: 8
volumeMounts:
- mountPath: /dev/shm
name: shm
restartPolicy: OnFailure
terminationGracePeriodSeconds: 0
volumes:
- name: shm
emptyDir:
medium: Memory
sizeLimit: 8Gi
---
Note: Modify the ACR (cgacr2) and the container name (pytorch_nccl_tests_2303:latest) in the above script.
Check the output
kubectl logs
You should see ~186 GB/s for large messages sizes.
8 2 float sum -1 38.15 0.00 0.00 0 31.44 0.00 0.00 0
16 4 float sum -1 33.06 0.00 0.00 0 31.67 0.00 0.00 0
32 8 float sum -1 31.27 0.00 0.00 0 31.14 0.00 0.00 0
64 16 float sum -1 31.91 0.00 0.00 0 31.42 0.00 0.00 0
128 32 float sum -1 32.12 0.00 0.01 0 31.64 0.00 0.01 0
256 64 float sum -1 33.79 0.01 0.01 0 33.14 0.01 0.01 0
512 128 float sum -1 35.12 0.01 0.03 0 34.55 0.01 0.03 0
1024 256 float sum -1 35.38 0.03 0.05 0 34.99 0.03 0.05 0
2048 512 float sum -1 38.72 0.05 0.10 0 37.35 0.05 0.10 0
4096 1024 float sum -1 39.20 0.10 0.20 0 38.94 0.11 0.20 0
8192 2048 float sum -1 46.89 0.17 0.33 0 43.53 0.19 0.35 0
16384 4096 float sum -1 50.02 0.33 0.61 0 49.28 0.33 0.62 0
32768 8192 float sum -1 59.52 0.55 1.03 0 54.29 0.60 1.13 0
65536 16384 float sum -1 71.60 0.92 1.72 0 68.39 0.96 1.80 0
131072 32768 float sum -1 79.46 1.65 3.09 0 76.06 1.72 3.23 0
262144 65536 float sum -1 80.70 3.25 6.09 0 79.49 3.30 6.18 0
524288 131072 float sum -1 89.90 5.83 10.94 0 90.97 5.76 10.81 0
1048576 262144 float sum -1 104.8 10.00 18.75 0 105.6 9.93 18.62 0
2097152 524288 float sum -1 140.0 14.98 28.08 0 133.6 15.70 29.44 0
4194304 1048576 float sum -1 150.6 27.84 52.21 0 151.4 27.70 51.93 0
8388608 2097152 float sum -1 206.6 40.61 76.14 0 204.0 41.11 77.09 0
16777216 4194304 float sum -1 389.0 43.13 80.86 0 386.2 43.45 81.46 0
33554432 8388608 float sum -1 617.4 54.35 101.90 0 608.5 55.14 103.39 0
67108864 16777216 float sum -1 949.0 70.71 132.59 0 939.4 71.44 133.95 0
134217728 33554432 float sum -1 1687.9 79.52 149.09 0 1647.8 81.45 152.72 0
268435456 67108864 float sum -1 3019.6 88.90 166.68 0 3026.4 88.70 166.31 0
536870912 134217728 float sum -1 5701.8 94.16 176.55 0 5745.8 93.44 175.20 0
1073741824 268435456 float sum -1 11029 97.36 182.54 0 11006 97.56 182.92 0
2147483648 536870912 float sum -1 21588 99.48 186.52 0 21668 99.11 185.83 0
4294967296 1073741824 float sum -1 42935 100.03 187.56 0 42949 100.00 187.50 0
8589934592 2147483648 float sum -1 85442 100.54 188.50 0 85507 100.46 188.36 0
# Out of bounds values : 0 OK
# Avg bus bandwidth : 56.6365
Correct deployment of NDmv4 kubernetes pools using Azure Kubernetes service is critical to get the expected performance. NCCL collectives tests (e.g allreduce) are excellent benchmarks to verify the cluster is set-up correctly and achieving the expected high performance of NDmv4 VM’s.
This article is contributed. See the original author and article here.
MariaDB is the open-source relational database management system created by MySQL’s original developers. MariaDB is designed to be highly compatible with MySQL. It supports the same SQL syntax, data types, and connectors as MySQL, allowing for a seamless transition for applications or databases that previously used MySQL.
Recently we’ve had many customers asking for guidance on moving from MariaDB to MySQL. To address this request, this blog post focuses on moving from Azure Database for MariaDB version 10.3 to Azure Database for MySQL version 5.7 using the MySQL Shell (MySQLSh) client. However, the same process, with minor changes, can help migrate other compatible MariaDB-MySQL version pairs.
Before beginning, it’s important to assess any application changes or workarounds that are required to ensure a smoother migration. In real-world scenarios there are often challenges, so testing an application with the target MySQL 5.7 becomes crucial before starting the migration. To understand the potential incompatibilities between MariaDB and MySQL, refer to the following documents.
Before starting this process, ensure that that the following prerequisites are in place:
The process of migrating from Azure Database for MariaDB to Azure Database for MySQL involves:
Note: For reference, the name and size of the initial database is shown in the following graphic.
To back up your Azure Database for MariaDB instance using MySQLSh, perform the following steps.
util.dumpInstance(“/backup/mysqlsh/mariadb_backup”, {threads: 16, showProgress: true, users:false})
Example output
Next, I need to set up replication from Azure Database for MariaDB to Azure Database for MySQL. However, before setting up replication, it’s important to ensure that the firewall of both Azure Database for MariaDB and Azure Database for MySQL servers are configured such that they are allowed to communicate with each other.
CALL mysql.az_replication_change_master(‘rahulsaha-mariadb.mariadb.database.azure.com’, ‘replica_user@rahulsaha-mariadb’, ‘StrongPass’, 3306, ‘mysql-bin.000003’, 385, ”);
Example output
Example output
Migrating from Azure Database for MariaDB to Azure Database for MySQL using dump and restore tools, together with replication to minimize the downtime needed for cutover, is not a difficult process. However, be sure to thoroughly test and benchmark things to help minimize the potential for encountering issues during and post migration, as every database, application architecture can be incredibly unique.
If you have any feedback or questions about the information supplied above, please leave a comment below or email us at AskAzureDBforMariaDB@service.microsoft.com. Thank you!
Recent Comments