Introducing the New Azure HPC Cache Namespace Page

Introducing the New Azure HPC Cache Namespace Page

This article is contributed. See the original author and article here.

Microsoft Azure HPC Cache services include our unique aggregated namespace that simplifies the management of Azure Blob and/or on-premises storage . The aggregated namespace lets you present your backend storage as a single directory structure. Consolidating under a single virtual namespace helps reduce complexity for clients—they see all storage resources as a single file system.

 

Just as the virtual namespace simplifies data access, our new HPC Cache namespace page makes it easier than ever to add and manage the client-facing file paths. From a single page, you can now set the client-facing paths for all storage targets, visualize the entire aggregated namespace, and administer changes. By consolidating namespace processes and details, this new page provides a seamless experience without any confusing or time-consuming page toggling.

 

The screenshots below show the functions and information directly accessible from the new namespace page. (From the Azure.com portal, access the HPC Cache page, then click on the Namespace tab.)

 

NamespaceOverview.png

Figure 1. Create, view, and manage an aggregated namespace for multiple backend storage systems—quickly and easily from a single page.

 

 

CreateNamespace.png

Figure 2. Use the same page to add new client-facing namespace and backend storage details.

 

 

NamespaceCreated.png

Figure 3. View all the namespace paths and storage-target details without toggling between pages.

 

 

If you’d like to see how the layout of the new page works, check out our documentation page to learn how administrators can easily create storage targets, set namespace paths, and manage the virtual namespace.

 

As always, we appreciate your comments. If you need additional information about Azure HPC Cache services, you can visit our github page or message our team through the tech community. Your feedback helps our team continually enhance HPC Cache services to provide the best-possible user experience and functionality.

Resources

Follow the links below for additional information about Azure HPC Cache and the aggregated namespace functionality.

 

https://azure.microsoft.com/en-us/services/hpc-cache/

 

https://docs.microsoft.com/en-us/azure/hpc-cache/hpc-cache-namespace

 

 

 

 

Making sense of Azure and Azure Arc deployment options for SQL Server

Making sense of Azure and Azure Arc deployment options for SQL Server

This article is contributed. See the original author and article here.

For some years Microsoft Azure has been offering several different deployment and management choices for the SQL Server engine hosted on Azure. With the release of the Azure Arc support for SQL Server, the range of different options has grown even further. This article should help you make sense of the different choices and assist in your decision-making process.

 

The following diagram shows a high level map of the options available on Azure or via Azure Arc.  

 

Making sense of Azure and Azure Arc options for SQL Server.png

 

As you can see, both on-Azure and off-Azure options offer you a choice between IaaS and PaaS. The IaaS category targets the applications that cannot be changed because of the SQL version dependency, ISV certification or simply because the lack of in-house expertise to modernize. The PaaS category targets the applications that will benefit from modernization by leveraging the latest SQL features, gaining a better SLA and reducing the management complexity.

 

SQL Server on Azure VM

SQL Server on Azure VM  allows you to run SQL Server inside a fully managed virtual machine (VM) in Azure. It is best for lift-and-shift ready applications that would benefit from re-hosting to the cloud without any changes. You will maintain the full administrative control over the application’s lifecycle, the database engine and the underlying OS. You can choose when to start maintenance/patching, change the recovery model to simple or bulk-logged, pause or start the service when needed, and you can fully customize the SQL Server database engine. This additional control involves the added responsibility to manage the virtual machine.

 

Azure Arc enabled SQL Server

Azure Arc enabled SQL Server (preview)  is designed for the SQL Servers running in your own infrastructure or hosted on another public cloud. It allows you to connect the SQL Servers to Azure and leverage the Azure services for the benefit of these applications. The connection and registration with Azure does not impact the SQL Server itself, does not require any data migration and causes no downtime. At present, it offers the following benefits:

  • You can manage your entire global inventory of the SQL Servers using Azure Portal as a central management dashboard.
  • You can better protect the applications using the advanced security services from Azure Security Center and Azure Sentinel.
  • You can regularly validate the health of your SQL Server environment using the On-demand SQL Assessment service, remediate risks and improve performance.

 

Azure SQL Database

Azure SQL Database is a relational database-as-a-service (DBaaS) hosted in Azure. It is optimized for building modern cloud applications using a fully managed SQL Server database engine, based on the same relational database engine found in the latest stable Enterprise Edition of SQL Server. SQL Database has two deployment options built on standardized hardware and software that is owned, hosted, and maintained by Microsoft.

Unlike SQL Server, it offers limited control over the database engine and the underlying OS, and is optimized for automatic management of the scale up or out operations based on the current demand and bills for the resource consumption on a pay-as-you-go basis. SQL Database has some additional features that are not available in SQL Server, such as built-in high availability, intelligence, and management.

Azure SQL Database offers the following deployment options:

  • As a single database with its own set of resources managed via a logical SQL server. A single database is similar to a contained database in SQL Server. This option is optimized for modern cloud-born applications that require a fixed set of compute and storage resources. Hyperscale and serverless options are available.
  • An elastic pool, which is a collection of databases with a shared set of resources managed via a logical SQL server. Single databases can be moved into and out of an elastic pool. This option is optimized for modern cloud-born applications using the multi-tenant SaaS application pattern. Elastic pools provide a cost-effective solution for managing the performance of multiple databases that have variable usage patterns.

 

Azure SQL Managed Instance

Azure SQL Managed Instance  is designed for new applications or existing on-premises applications that want migrate to the cloud with minimal changes to use the latest stable SQL Server features. This option provides all of the PaaS benefits of Azure SQL Database but adds capabilities such as native virtual network and near 100% compatibility with on-premises SQL Server. Instances of SQL Managed Instance provide full access to the database engine and feature compatibility for migrating SQL Servers but do not offer admin access to the underlying OS. Azure SQL Managed Instance offers a 99.99% availability SLA.

 

Azure Arc enabled SQL Managed Instance

Azure Arc enabled SQL Managed Instance is designed to provide the existing SQL server applications an option to migrate to the latest version of the SQL Server engine and gain the PaaS style built in management capabilities without moving outside of the existing infrastructure. The latter allows the customers to maintain the data sovereignty and meet other compliance criteria. This is achieved by leveraging the Kubernetes platform with Azure data services, which can be deployed on any infrastructure.

At present, it offers the following benefits:

  • You can easily create, remove, scale up or scale down a SQL Managed Instance within minutes.
  • You can setup periodic usage data uploads to ensure that Azure bills you monthly for the SQL Server license based on the actual usage of the managed instances (pay-as-you-go). You can do it even you are running the applications in an air-gapped environment.
  • You can leverage the capabilities of latest version of SQL Server that is automatically kept up to date by the platform. No need to manage upgrades, updates or patches.
  • Built-in management services for monitoring, backup/restore, and high availability.

 

Next steps

For related material, see the following articles:

 

 

 

Imagine Cup Junior 2021 AI for Good Challenge

This article is contributed. See the original author and article here.

By Anthony Salcito, Vice President, Education

 

During Microsoft’s recent global skills announcements, it was shared that over 149M new jobs will be created in technology over the next 5 years. While this shows the immediate need to upskill and reskill on technology to fuel economic growth and talent pipeline, the question remains – how we can ensure a more sustainable solution for many years to come?

 

At Microsoft, our mission is to empower every student on the planet to achieve more. Connected to this mission, Microsoft continues to work hard to spark student interest in STEM and Computer Science and prepare them for a path where technology is a core subject area connected to success in every role in the future.  That’s why I’m excited to share today’s launch of Imagine Cup Junior AI for Good Challenge 2021. This is the second year we’ve run this challenge for secondary students, inviting young and talented minds to come up with ideas to make their world a better place with the power of Artificial Intelligence (AI). In our inaugural year we celebrated 9 winning teams from the hundreds of students across 23 countries who took part, and I was amazed by the imagination of students, the quality of their ideas and submissions.

 

Imagine Cup Junior AI for Good Challenge brings new skills to students across all subject areas regardless of their experience in technology. No longer is technology a separate discipline but rather a foundational capability that will enhance every students’ future opportunities, no matter what job role they pursue in their future.  Students aged 13 to 18 can take part, individually or in teams up to 6, by developing an AI concept based on Microsoft’s AI for Good initiatives. These include AI for Humanitarian Action, AI for Earth, AI for Cultural Heritage, AI for Accessibility and new to our 2021 challenge, AI for Health.

 

While it’s been a challenging year with remote and blended learning becoming a part of many school days for students, we have introduced a number of new elements to Imagine Cup Junior AI for Good Challenge to increase the opportunity for all students to participate including webinars, hackathons and a beginners kit. To get started, educators need to register at https://.imaginecup.com/junior which will provide access to the Imagine Cup Junior resource kit which includes:

 

  • Imagine Cup Junior for Beginners Kit – five 45-minute lessons that will prepare students for their challenge submission
  • Educator guides, student guides, and slides for the following modules for those who would like to take learning further:
    • Imagine Cup Junior for Beginners
    • Fundamentals of AI
    • Machine Learning
    • Applications of AI in real life
    • Deep learning and neural networks
    • AI for Good
  • Build your Project in a Day hackathon kit with videos from members of Microsoft’s Education, Artificial Intelligence and Cloud teams. This can be used in class to inspire students and coach them on how to get started, and perhaps even spark excitement to one day work in the field of AI
  • Engagement plans for educators on how they can embed the learning within their curriculum
  • Access to a series of AI webinars throughout the challenge and regional virtual hackathons for students to build out their projects live

 

Plus lots more, including challenges using Azure, Minecraft: Education Edition, and social kits and templates to celebrate taking part.

 

We are also empowering parents and guardians to register and submit on behalf of students in the event that learning from home continues, and the webinar and hackathon series will provide inspirational and exciting learning opportunities for students both at home or in school. 

 

Registration opens today and will close May 21 2021. To ensure the privacy of students, all submissions must be made by educators/instructors/parents/guardians on behalf of their students. While we can’t wait to see ALL the amazing ideas of students around the world, Microsoft will be proud to recognize the top ten ideas globally and recognize their achievement with an Imagine Cup Junior trophy.

 

Challenge rules and regulations can be found here.

 

It is never too early to get started, and we hope by cultivating student creativity and passion for technology it will spark interest in and support the development of careers at the cutting edge of technology.

 

Register today at https://imaginecup.com/junior and empower students to truly change the world. I can’t wait to see their innovation and ideas to help positively change the world!

 

Microsoft Azure and PyTorch help AstraZeneca apply advanced machine learning to drug discovery

This article is contributed. See the original author and article here.

AstraZeneca, which is headquartered in Cambridge, UK, has a broad portfolio of prescription medicines, primarily for the treatment of diseases in Oncology; Cardiovascular, Renal & Metabolism; and Respiratory & Immunology.

 

“…The vast amount of data our research scientists have access to is exponentially growing each year and maintaining a comprehensive knowledge of all this information is increasingly challenging, ” Gavin Edwards, a Machine Learning Engineer at AstraZeneca wrote.

 

Edwards is part of AstraZeneca’s Biological Insights Knowledge Graph (BIKG) team. He explains that knowledge graphs are networks of contextualized scientific data such as genes, proteins, diseases, and compounds—and the relationship between them. 

 

As these knowledge graphs grow and become more complex, machine learning gives AstraZeneca’s BIKG team a way to analyze the data within them and find relevant connections more quickly and efficiently.

 

 “We can use this approach to identify, say, the top 10 drug targets our scientists should pursue for a given disease,” Edwards wrote.

 

Since a great deal of the data used to form knowledge graphs comes in the form of unstructured text, AstraZeneca uses PyTorch’s library of natural language processing (NLP) to define and train models. They use Microsoft’s Azure Machine Learning platform in conjunction with PyTorch to create machine learning models for recommending drug targets.

 

Learn more about how AstraZeneca is using Microsoft Azure and PyTorch in an effort to accelerate drug discovery.

Confidential Containers Nodes Now Supported on Azure Kubernetes Service (AKS) – Public Preview

Confidential Containers Nodes Now Supported on Azure Kubernetes Service (AKS) – Public Preview

This article is contributed. See the original author and article here.

Microsoft is committed to enabling the industry to move from ‘computing in the clear’ to ‘computing confidentially’. Why? Common scenarios confidential computing have enabled include:

  • Multi-party rich and secure data analytics
  • Confidential blockchain with secure key management
  • Confidential inferencing with client and server measurements & verifications
  • Microservices and secure data processing jobs

The public preview of confidential computing nodes powered by the Intel SGX DCsv2 SKU with Azure Kubernetes Service brings us one step closer by securing data of cloud native and container workloads. This release extends the data integrity, data confidentiality and code integrity protection of hardware-based isolated Trusted Execution Environments (TEE) to container applications.

 

Azure confidential computing, based on Intel SGX-enabled virtual machines, continues encrypting data while the CPU is processing it—that’s the “in use” part. This is achieved with a hardware-based TEE that provides a protected portion of the hardware’s processor and memory. Users can run software on top of the protected environment to shield portions of code and data from view or modification outside of the TEE.

 

Expanding Azure confidential computing deployments

Developers can choose different application architectures based on whether they prefer a model with a faster path to confidentiality or a model with more control. The confidential nodes on AKS support both architecture models and will orchestrate confidential application and standard container applications within the same AKS deployment. Also, developers can continue to leverage existing tooling and dev ops practices when designing highly secure end-to-end applications.

AKS confidential computing node.jpg

During our preview period, we have seen our customers choose different paths towards confidential computing:

  • Most developers choose confidential containers by taking an existing unmodified docker container application written in a higher programming language like Python, Java etc. and chose a partner like Scone, Fortanix and Anjuna or Open Source Software (OSS) like Graphene or Occlum in order to “lift and shift” their existing application into a container backed by confidential computing infrastructure. Customers chose this option either because it provides a quicker path to confidentiality or because it provides the ability to achieve container IP protection through encryption and verification of identity in the enclave and client verification of the server thumbprint.
  • Other developers choose the path that puts them in full control of the code in the enclave design by developing enclave aware containers with the Open Enclave SDK, Intel SGX SDK or chose a framework such as the Confidential Consortium Framework (CCF). AI/ML developers can also leverage Confidential Inferencing with ONNX to bring a pre-trained ML model and run it confidentially in a hardware isolated trusted execution environment on AKS.

One customer, Magnit, chose the first path.  Magnit is one of the largest retail chains in the world and is using confidential containers to pilot a multi-party confidential data analysis solution through Aggregion’s digital marketing platform.  The solution focuses on creating insights captured and computed through secured confidential computing to protect customer and partner data within their loyalty program.

 

We have aggregated more samples of real use cases and continue to expand this sample list here: https://aka.ms/accsamples.

 

How to get going

Confidential computing, through its isolated execution environment, has broad potential across use cases and industries; and with the added improvements to the overall security posture of containers with its integration to AKS, we are excited and eager to learn more about what business problems you can solve.

 

Get started today by learning how to deploy confidential computing nodes via AKS