by Contributed | May 25, 2021 | Technology
This article is contributed. See the original author and article here.
Microsoft is a security and compliance leader. We are constantly humbled that the market keeps validating our goal on delivering Security for All in a Zero Trust World. We are not only best in suite we are also best in breed. Just in the month of May alone Microsoft has added these accolades to it list.
And while we could just rest on our laurels our team is determined to continue to improve and create intelligent security and compliance solutions for the world.
Join us at Microsoft Virtual Security & Compliance Summit on Thursday, June 3, 2021 between 9:00 AM–12:00 PM Pacific Time (12:00 PM–3:00 PM Eastern Time).
The realities of widespread remote and hybrid work scenarios pose new challenges for organizations. Security, compliance, and identity are more complex—and more critical—than ever. Join us to hear some of the industry’s leading voices speak on mitigating risks and strengthening your security posture.
At this event, you’ll gain fresh insights on:
- What’s top of mind for CISOs—like cloud-first security, training, and resiliency.
- How we secure Microsoft today—an insider look.
- Securing the remote and hybrid workplace.
- Trends and best practices from Microsoft defenders, detection, and response teams.
- Strategies for protecting against insider risk.
- Tactics to protect and govern data across your digital estate.
Don’t miss this interactive, high-profile event with Microsoft experts—and the opportunity to connect with your peers on the cybersecurity techniques you need to help safeguard your organization in 2021 and beyond.
To learn more about Microsoft Security solutions, visit our website. Bookmark the Security blog to keep up with our expert coverage on security matters. Also, follow us at @MSFTSecurity for the latest news and updates on cybersecurity.
Follow Christopher on Twitter and LinkedIn
by Contributed | May 25, 2021 | Technology
This article is contributed. See the original author and article here.
Claire Bonaci
You’re watching the Microsoft US health and life sciences, confessions of health geeks podcast, a show that offers Industry Insight from the health geeks and data freaks of the US health and life sciences industry team. I’m your host, Claire Bonaci. As we close out our 2021 nurses week series today guest host Kelly rocky interviews Dr. Tim Raderstorf, Chief Innovation Officer at Ohio State University School of Nursing.
Kelly Robke
Welcome to the podcast everyone. I’m very excited to have Dr. Tim Raderstorf here with us today from the Ohio State University School of Nursing, speaking about an issue near and dear to his heart. Tim is such an incredible nurse leader, as an innovator. He’s one of my heroes, and one of my mentors on my dissertation project for my DNP. Thank you, Tim, for making the time for us today. And I would just like for you to share your nursing journey with our listeners. It’s a very incredible, very unique and compelling path. Would you mind sharing some of the highlights from your nursing career?
Tim Raderstorf
Sure, I’d be happy to. But then thank you for the very kind introduction. I look to you as a mentor and for inspiration as well. So it’s an honor to be here with you today. Yeah, I’m, I’m what I call a little bit of a bent arrow. So I grew up from a place of immense privilege. I went to a Catholic prep school. And when you were good at math and science, they told you to be a physician. So I went to college, no enrolled in pre med, and kind of ignored all the flags that were telling me that clinical care was really where I wanted to be as a nurse, not as a physician. So I ended up working my first summers out of college at a summer camp for kids with the hematology oncology disorders, mostly HIV, sickle cell and cancer, and saw what the nurses did there and was just, you know, one of those lightbulb moments of Oh, this is this is where I need to be. So I went and got a direct entry program. I used that pre med degree to get into nursing school and went and got my master’s in nursing from Xavier University in Cincinnati, started out as a floor nurse at Nationwide Children’s Hospital, and then quickly transitioned into leadership roles. that eventually led to me having the chief innovation officer and faculty role at Ohio State’s College of Nursing.
Kelly Robke
Wow, thank you for that. And I learned something new about you every time I too, began my career working in blood disorders, but on the pregnancy side in hemoglobinopathies, sickle cell trait and disease and also HIV. That was just some incredible work back then. But thank you for reviewing that. The first thing I wanted to ask you about today is if you could tell us a little bit about the Genesis and the necessity in the call to action around nurses everywhere.
Tim Raderstorf
Yeah. Nurses everywhere is a nonprofit that I was fortunate to be a founding member of and continue to be the chief operating officer for that was called together by one of the best entrepreneurs in healthcare, nursing. And BK reached out to 18 of her friends in health care. And somehow me as well, I’m very fortunate to have been included in this group. But said, you know, this is an April of 2020. And it was very clear that the writing was on the wall that things weren’t going to get better soon, and that our nurse colleagues, and more importantly, the public were really going to suffer as part of this pandemic. So she called us all together and said, Hey, we need to find a way to elevate the profession of nursing, while improving health outcomes. And you know, by being nurses, we do that anyways. So let’s find a way that we can partner with the public, not create another nursing organization, but create a public health organizations that’s run by nurses to help the public achieve their their health goals. So it’s been a phenomenal journey. I’d encourage anyone who’s listening to to check out our website at nurses everywhere.com. But led by four past American Nurses Association presidents, the current president of the AMA, a lot of wonderful leaders, intrapreneurs, and entrepreneurs in healthcare, the past American Hospital Association president. So that’s all these amazing leaders who are totally selfless, and, you know, are just really committed to making their communities thrive. So we started nurses everywhere to give the public a voice and to be partners with nursing in that in that venture. And we’ve done it a lot of fun and interesting ways. First, we wanted to know what the public thought about nurses during the pandemic. So we collaborated with the Harris Poll and sent out a survey to over 2000 individuals in the US to ask them how they felt about nurses. And, you know, we knew that we were a trusted profession, and then people loved us from that round, but we weren’t sure as you know, are they enjoying this additional access to nurses that was occurring as part of the the policies are surrounding the pandemic. So we found that 89% of Americans want the same access to nurses after the pandemic as the receiving during the pandemic. And 91%. Want safe us in standard staffing ratios within health systems, and 90% want those same safe staffing ratios within nursing homes. So not only does the public trust us, but we were found new information or, or information that validated that they value us and they see the role that we have in their health care. So together, we wanted to figure out what the next steps would be to continue this partnership and really improve community health in United States. Because if you look at our outcomes, they’re nowhere where they need to be right now. Now, so that’s a tricky scenario, right? How do you have a public health organization that’s run by nurses that that’s for the public? And we’ve we first wanted to see all right, what can we do to raise awareness and change that narrative of what people think of nurses. So for example, I gave an innovation talk in Australia this fall. And one of the CO presenters behind the scenes and zoom, sent me a picture of Greg focker, from Meet the Parents after I presented and said was this inspiration for you. And it was, I’m sure light hearted and you meant to be kind. But it really tells you how the public worldwide views nurses, in my case, male nurse. So we wanted to change the narrative and focus on gratitude, focus on the work that they’re doing, and really capitalize on how the public wanted to help nurses. So we’ve done two things. Since then, one, we launched the thinking nurse wear mask campaign, we created a PSA, and really focused on asking the public if they wanted to be to impact their own health outcomes. And if they wanted to do that in a way that showed gratitude to frontline conditions, the best way they could do it would be the fall COVID protocol and wear their masks in public. And then from there, we were approached by a country music duo who had just created a song called You didn’t have to as really written as as what we’re going to call the nurses week anthem, cheer. But the the husband wife duo, the husband’s mother was a nurse for 35 years in the UK. And we decided that together, nurses everywhere would direct and produce the music video for this. So we were able to pull pictures from from nurses from around around the world, and showcase them in this video. And that got 100,000 views on YouTube in the first two weeks, something that was really elevating the way that the public was interacting with nurses. And now as we move into nurses week, we’re continuing to capitalize on that momentum by using what’s called the think of nurse contest. And this is our call to action for the public. and other health systems are anyone who really wants to get involved, to show gratitude for us, hopefully reaching the next phase of whatever the pandemic may be, by creating their own video to that song and submitting it on social media and our website at nurses everywhere.com. Winners, the winning submission is going to get a private conference or private concert from brown and gray. And there’s a bunch of other great swag and prizes to people who participate in it. So it’s a really fun way for the public to get engaged. But more importantly, in the contest, but more important, it’s a really great way for the public to engage with nurses everywhere so that we can continue to bridge that gap between nurses in public health and really improve health outcomes for into the future.
Kelly Robke
Well, you’ve hit on so many incredible and important value statements related to nursing our role in the community, our role in public health as well. First, I think it is nurses are natural collaborators. And we’ve always been looked upon as the role models in healthcare to demonstrate cross clinical collaboration, cross professional collaboration, but knowing you as an innovator, I think you’re already talking about a very innovative approach to the role of nursing in our community in our society, where we’re redefining what it means to be involved in health care. And and that has to involve maintaining health as well as addressing challenges in health too. We we go beyond the hospital, a traditional hospital system. And as healthcare transforms, we’re going to be right there at the tip of the spear because I think we both regard nurses as natural leaders as well as conveners, if you will. And I think being able to show leadership in this incredible time of unprecedented challenge to health care is just an example of our role within society within our communities. And within the changing paradigm of health. I think it’s really great what you’re doing with nurses everywhere, and really appreciate hearing how that came to be. And in the good work that you’ve been doing. I know my boss, Molly was one of the nurse nurses featured in in the video. So we love that connection as well. And I do hope our listeners will check out the thinking nurse contest that you mentioned, because that’s really cool stuff. I’m gonna throw a wild card question at you because one of the ways you’ve been inspiring and supportive to me personally is the book that you’ve recently published with Dr. Bernadine Melnick, another great nurse innovator. Can you tell us a little bit about your book and how it came about? But it’s one of my favorite reads? So thank you.
Tim Raderstorf
I can, like any good author. I love it. Right here. But yeah, this is a very interesting opportunity to meet, you know, being an innovation and being a fan of the TV show the office. Yeah, because it’s been very clear the direction that paper publication has been going for quite some time. Now. When speaking, when Springer reached out to write this book, we said, well, if we’re going to write a book on innovation, then we have to take an innovative approach to that book. Yes, it can’t be a textbook, like you’ve seen before. So you know, we have a couple concessions, one, we have to be able to write in first person be able to use narrative throughout and implement storytelling to, we want to make sure that there are alternative modalities to engage with this. So there are podcasts that go along with the book, though, when you purchase it, you can listen to podcasts with some of the chapter authors. In three, we wanted them to bring in a concept that hadn’t been in, in healthcare in general on which, which is entrepreneurship and entrepreneurial mindset. So there’s some things on innovation, there are plenty of things on leadership, but the entrepreneurial mindset hadn’t been bad at it. And so we said, you know, this is this is the gap that exists right now, we want to fill that through this book. So it was a long arduous journey, but a great opportunity to showcase the work of many of our peers who have been doing this for a long time, they just may not have had something to point to and say, you know, here it is. So we wrote the book, and really won the American Journal, nurse, American Journal, nurses book the year and the management and leadership section. And it’s just been a very exciting time to see that our peers are recognizing that this needs to be the path that we move forward when it comes to education. And the beauty about education is that that leads to practice. So very excited to see how this book transforms the nursing profession.
Kelly Robke
And what’s the title again, do you mind showing it to our smart listeners,
Tim Raderstorf
but it’s evidence based leadership, innovation and entrepreneurship in nursing and healthcare, a practical guide for success.
Kelly Robke
And you actually assembled quite the dream team of Nursing Practice nursing leadership, nursing innovation, and then like we’ve been talking about the cross collaborative view because it takes a village to get accomplished the bold and transformative changes that nurses are aware of as leaders in healthcare delivery. So I just wanted to make sure we we gave a shout out to that because it’s such an important work to thanks so much for your time and happy nurses week t happy nurses week to you. Thanks so much for having me.
Claire Bonaci
Thank you all for watching. Please feel free to leave us questions or comments below. And check back soon for more content from the HLS industry team.
by Contributed | May 25, 2021 | Technology
This article is contributed. See the original author and article here.
The 19th annual Imagine Cup brought together thousands of students from 163 countries across the globe reimagining tech solutions to impact their communities. With projects submitted in four social good categories – Earth, Education, Healthcare, and Lifestyle – the competition advanced through Online Semifinals and World Finals rounds. As winners of each category, the top four teams were selected to pitch their projects at the World Championship during Microsoft Build for the chance to take home the 2021 trophy.
Congratulations to Team REWEBA from Kenya, who won the grand prize for their IoT-based infant monitoring solution, which remotely analyzes infant parameters during post-natal screening and serves as an early warning intervention system. The team won USD75,000, a mentoring session with Microsoft CEO Satya Nadella, and a USD50,000 Microsoft Azure Grant.
The 2021 World Championship was judged by Jocelyn Jackson, Enhao Li, and Toni Townes-Whitley – innovation and industry experts spanning a variety of technology, diversity, start-up, and social impact backgrounds that align to the core of Imagine Cup’s mission. Hosts Tiernan Madorno, Microsoft Business Program Manager, and Donovan Brown, Microsoft Partner Program Manager, kicked off the show, introducing each of the judges tasked with selecting the World Champion. The top four teams then gave an in-depth presentation on their solutions, which were assessed for their technology, diversity, originality, and innovative design. Watch the show to experience the moment when Team REWEBA is crowned champion!
Meet the 2021 World Champion
From left to right, team members Dharmik Karania, Jeet Gohil, Khushi Gupta, and Abdihamid Ali
Team REWEBA, Kenya – Healthcare category
After meeting at the United States International University in Kenya, the team started working together on a graduate project aimed at solving a major problem within their community. Members of the team had interned at a local hospital, learning first-hand the challenges that mothers can face traveling long distances for infant screenings. Lack of healthcare access in marginalized communities, compounded by the effects of COVID-19, contributes to a high infant mortality rate. Team member Khushi Gupta says, “Sub-Saharan Africa remains the region with the highest under-5 mortality rate in the world. We can solve this problem using REWEBA, a remote infant monitoring system that can be used in marginalized areas thus giving everyone equal access to healthcare.” They realized how beneficial it could be to apply IoT to create a remote monitoring solution, and their project was born.
REWEBA (Remote Well Baby) is an early warning system that digitally monitors babies’ growth and health parameters and sends them to doctors for timely intervention. It combines Machine Learning, IoT, Analytics, and more to provide innovative functionalities for infant screening, mimicking the process of post-natal screening in a hospital. Team member Jeet Gohil shared that “There’s a lot of technologies that we came to discover {through building our project}, for example Azure DevOps, IoT, and Functions. We learned a lot about how to build IoT systems.”
Kushi Gupta stated the driving factor for the team’s solution was enabling equal access to healthcare services and saving infants from fatal diseases: “Africa has the highest number of {infant mortalities}, highlighting the gap in healthcare services. REWEBA is the only remote healthcare solution that provides regular growth monitoring for infants from the comfort of the home, while also giving direct access to doctors for immediate intervention.”
Looking to the future, Team REWEBA hope to enhance and scale their project to include additional infant screening factors and a postnatal screening device for mothers. The team would like to launch a start-up in Kenya to enable even better access to healthcare services in marginalized areas. When asked how winning the 2021 Imagine Cup will impact their project, the team responded, “The winning prize and the Azure grants will take our project up a notch, and we envision saving millions of babies’ lives all around Kenya. We plan to extend throughout Africa and India as well, as these are the countries where infant mortality is really high.”
Team REWEBA’s winning moment.
————–
Registration for the 2022 competition is now open. Join over two million student competitors worldwide in making an impact in what you’re most passionate about and sign up for Imagine Cup today!
by Contributed | May 25, 2021 | Technology
This article is contributed. See the original author and article here.
While trying to upload files that are bigger than 64 KB, we came across this error: 413 Request Entity Too Large.
The maximum message size quota for incoming messages (65536) has been exceeded. To increase the quota, use the MaxReceivedMessageSize property on the appropriate binding element.
The maximum message size quota for incoming messages (65536) has been exceeded. To increase the quota, use the MaxReceivedMessageSize property on the appropriate binding element.
As the error above mentions, this issue occurs because the request size is bigger than the MaxReceivedMessageSize for WCF.
Solution
Increase MaxReceivedMessageSize value for your web service to solve this issue. However, this may get tricky because there are two different MaxReceivedMessageSize parameters:
- MaxReceivedMessageSize in System.ServiceModel.Configuration.BasicHttpBindingElement
- MaxReceivedMessageSize in System.ServiceModel.Channels.HttpTransportBindingElement
This configuration below will increase the MaxReceivedMessageSize in System.ServiceModel.Configuration.BasicHttpBindingElement
<basicHttpBinding>
<binding name="basicHttpBinding_Portal" maxReceivedMessageSize="2147483647" maxBufferSize="2147483647" maxBufferPoolSize="2147483647">
<readerQuotas maxBytesPerRead="2147483647" maxArrayLength="2147483647" maxStringContentLength="2147483647" maxDepth="2147483647" maxNameTableCharCount="2147483647"/>
</binding>
</basicHttpBinding>
You should increase the MaxReceivedMessageSize in System.ServiceModel.Channels.HttpTransportBindingElement as well:
<customBinding>
<binding closeTimeout="00:10:00" openTimeout="00:10:00" sendTimeout="00:10:00">
<httpTransport maxReceivedMessageSize="2147483647" maxBufferSize="2147483647" useDefaultWebProxy="true" transferMode="Buffered" />
</binding>
</customBinding>
You can also do it in the code as explained in this document.
by Contributed | May 25, 2021 | Technology
This article is contributed. See the original author and article here.
For an issue I worked on, the application pool kept stopping with Event ID 2269, 5139, and 5002. The errors and warnings I saw in Event Viewer are below.
Event 2269
The worker process for app pool 'DefaultAppPool' failed to initialize the http.sys communication when asked to start processing http requests
Event 5139
A listener channel for protocol 'http' in worker process serving application pool 'DefaultAppPool' reported a listener channel failure.
Event 5002
Application pool 'DefaultAppPool' is being automatically disabled due to a series of failures
Solution
Check if the application pool identity has “Bypass traverse checking” permission. This is group-policy permission to determine which users can traverse folders even if they don’t have permission on folders.
To give “Bypass traverse checking” permission:
- Go to “Start > Run”, type “gpedit.msc”
- Follow “Computer Configuration > Windows Settings > Security Settings > Local Policies > User Rights Assignment”
- Right click “Bypass traverse checking” and click “Properties”
- Click “Add User or Group”. Add these users and groups: Everyone, Users, IIS_IUSRS, IIS AppPoolDefaultAppPool
- Restart the server
- Open the same window and make sure the users/groups you added are still there
- Test the application
If this doesn’t work, use “netstat” and see if there are port conflicts. There might be network and file structure related issues as well
Note: With the steps above, we added more users than we should. This is for testing only. You can later harden this configuration.
by Contributed | May 25, 2021 | Technology
This article is contributed. See the original author and article here.
When you run a penetration test on your web application, the report may point out BREACH as a high-risk vulnerability. BREACH attack works by trying to guess the secret keys in a compressed and encrypted response. Attacker makes many requests and try to figure out the encrypted information byte-by-byte using the pattern in responses.
Here is an example vulnerability test report that mentions the BREACH:
'id' : 'BREACH',
'port' : '443',
'severity' : 'HIGH',
'finding' : 'potentially VULNERABLE, uses gzip HTTP compression - only supplied '/' tested'
Mitigations
Common recommendations:
- Disabling HTTP compression
- Separating secrets from user input
- Randomizing secrets per request
- Masking secrets (effectively randomizing by XORing with a random secret per request)
- Protecting vulnerable pages with CSRF
- Length hiding (by adding a random number of bytes to the responses)
- Rate-limiting the requests
My comments about these mitigations:
- The first option (disabling HTTP compression) will mitigate this vulnerability. However, this may have a performance effect
- Recommendations #2 to #5 are related to the coding of the application. They can help preventing this attack. They are also best practices for development
- Recommendations #6 and #7 are hosting-related. You may need to talk to your hosting company to make these changes
The question is how the scan tool is determining to raise this vulnerability? Is it just checking if the compression is enabled? If that’s the only check it does, then recommended mitigations from #2 to #7 won’t make this vulnerability disappear from the report.
My recommendation would be to keep the compression enabled but implementing the other recommendations (from #2 to #7).
by Contributed | May 25, 2021 | Technology
This article is contributed. See the original author and article here.
You may come across this error message when you access your website: “Can’t reach this page. There was a temporary DNS error. Error code: INET_E_RESOURCE_NOT_FOUND”
Solution
As the error mentions, there might be a problem with the DNS record of your application. However, for the issue I worked on, the root cause was the corruption in the IE registry setting.
We renamed the Connections container in the registry key below. After a server restart, a new Connections container was created and the application started working.
HKEY_LOCAL_MACHINE > Software > Microsoft > Windows > CurrentVersion > Internet Settings > Connections
My guess is that an Windows update or another system-level change can cause this issue.
by Contributed | May 25, 2021 | Technology
This article is contributed. See the original author and article here.
We recently announced the general availability of Azure Defender for SQL to protect SQL Servers in Azure, on premises, and in multi-cloud deployments on Amazon Web Services (AWS) and Google Cloud Platform (GCP). Today we are happy to announce we are expanding Azure Defender’s SQL protection to open-source relational databases. Azure Defender for open-source relational databases is now generally available for use with Azure Databases for MySQL, PostgreSQL, and MariaDB single servers.
Attackers often laterally traverse within organizations to discover and exfiltrate data, wherever it is stored, making open-source databases and SQL Server common targets. With Azure Defender, you can now protect your SQL Servers, as well as your open-source databases, expanding and strengthening your protection across your entire SQL estate. We recommend you protect your production instances of SQL and open-source databases with Azure Defender as part of your overall security strategy.
Protect your SQL estate with Azure Defender today
Azure Defender for open-source relational databases constantly monitors your servers for security threats and detects anomalous database activities indicating potential threats to Azure Database for MySQL, PostgreSQL and MariaDB. Some examples are:
- Granular detection of brute force attacks
- Azure Defender for open-source relational databases provides detailed information on attempted and successful brute force attacks. This lets you investigate and respond with a more complete understanding of the nature and status of the attack on your environment.
- Behavioral alerts detection
- Azure Defender for open-source relational databases alerts you to suspicious and unexpected behaviors on your servers, such as changes in the access pattern to your database.
- Threat intelligence-based detection
- Azure Defender leverages Microsoft’s threat intelligence and vast knowledge base to surface threat alerts so you can act against them.
Azure Defender for Open-Source Databases is just one component of the Azure Defender stack, which also protects SQL Servers, virtual machines, storage, and containers. In addition, you will benefit from centralized management for security, integration with Azure Secure Score, and native integration with Azure Sentinel.
Get started today!
Protect your Azure open-source databases today and expand your organization’s protection. To learn more, visit our documentation page. To learn more about Azure Defender visit our website. Follow us at @MSFTSecurity for the latest news and updates on cybersecurity.
by Contributed | May 25, 2021 | Technology
This article is contributed. See the original author and article here.
An indexer in Azure Cognitive Search is a crawler that extracts searchable text and metadata from a data source and populates a search index using field-to-field mappings between source data and your index. This approach is sometimes referred to as a ‘pull model’ because the service pulls data in without you having to write any code that adds data to an index. Indexers also drive the AI enrichment capabilities of Cognitive Search, integrating external processing of content en route to an index. Previously, indexers mostly just supported Azure data sources like Azure blobs and Azure SQL.
Today we’re excited to announce the following updates related to data source support!
New preview indexers
- Amazon Redshift (Powered by Power Query)
- Cosmos DB Gremlin API
- Elasticsearch (Powered by Power Query)
- MySQL
- PostgreSQL (Powered by Power Query)
- Salesforce Objects (Powered by Power Query)
- Salesforce Reports (Powered by Power Query)
- SharePoint Online
- Smartsheet (Powered by Power Query)
- Snowflake (Powered by Power Query)
GA indexers
- Azure Data Lake Storage Gen2
Power Query Connectors
Power Query is a data transformation and data preparation engine with the ability to pull data from many different data sources. Power Query connectors are used in products like Power BI and Excel. Azure Cognitive Search has added support for select Power Query data connectors so that you can pull data from more data sources using the familiar indexer pipeline.
You can use the select Power Query connectors just like you would use any other indexer. The Power Query connectors integrated into Azure Cognitive Search support change tracking, skillsets, field mappings, and many of the other features that indexers provide. They also support transformations.
These optional transformations can be used to manipulate your data before pulling it into an Azure Cognitive Search index. They can be as simple as removing a column or filtering rows or as advanced as adding your own M script.
To learn more about how to pull data from your data source using one of the new Power Query indexers, view the following tutorial:
SharePoint Online Indexer
The SharePoint Online indexer allows you to pull content from one or more SharePoint Online document libraries and index that content into an Azure Cognitive Search index. It supports many different file formats including the Office file formats. It also supports change detection that will by default identify which documents in your document library have been updated, added, or deleted. This means that after the initial ingestion of content from your document library, the indexer will only process content that has been updated, added, or deleted from your document library.
To learn more about how to pull data from your SharePoint Online document library, view the following tutorial:
Getting started
To get started with the new preview indexers, sign up using the below form:
https://aka.ms/azure-cognitive-search/indexer-preview
For more information, see our documentation at:
by Contributed | May 25, 2021 | Technology
This article is contributed. See the original author and article here.
We are excited to announce that Azure Spot VMs are now supported in Azure Databricks. Together, Spot VMs and Azure Databricks help innovative customers like aluminium and energy producer Hydro to accelerate data + AI workloads while optimizing costs. This will allow you to access unused Azure compute capacity at deep discounts—up to 90 percent compared to pay-as-you-go prices.* This feature is GA in all regions where Azure Databricks is available today.
How can you use and save cost using this feature? With Azure Spot VMs, you can access unused Azure compute capacity at deep discounts. Discounts vary based on region, VM type, and availability of compute capacity when your workload is deployed. You pay up to the maximum price that you optionally agree to in advance. You can specify the use of Spot VMs for your clusters and pools via the Databricks UI or Rest API.
Create an Azure Databricks cluster with Spot VMs using the UI
When you create an Azure Databricks cluster, select your desired instance type, Databricks Runtime version and then select the “Spot Instances” checkbox as highlighted below.
Spot VMs are ideal for workloads that can be interrupted, providing scalability while reducing costs. Azure Databricks automatically handles the termination of Spot VMs by starting new pay-as-you-go worker nodes to guarantee your jobs will eventually complete. This provides predictability, while helping to lower costs.
When a cluster is created with Spot instances, Databricks will allocate Spot VMs for all worker nodes, if available. The driver node is always an On-Demand VM. During your workload runs, Spot VMs can be evicted when Azure no longer has available compute capacity and must reallocate its resources. Spot VMs will also be evicted when the current price exceeds the maximum price that you optionally agreed to pay before the VMs were allocated. In either case, pay-as-you-go instances will automatically replace any evicted Spot VMs.
Create an Azure Databricks cluster with Spot VMs using the REST API
With the Azure Databricks Clusters REST API, you have the ability to choose your maximum Spot price and fallback option if Spot instances are not available or are above your maximum price. Create a bearer token in the Databricks UI. This will be used to authenticate when making your API call.
Create an Azure Databricks warm pool with Spot VMs using the UI
You can use Azure Spot VMs to configure warm pools. Clusters in the pool will launch with spot instances for all nodes, driver and worker nodes. When creating a pool, select the desired instance size and Databricks Runtime version, then choose “All Spot” from the On-demand/Spot option.
At any point in time when Azure needs the capacity back, the Azure infrastructure will evict Azure Spot Virtual Machines with 30 seconds notice. Databricks will attempt to replace the evicted Spot Virtual Machines, if unsuccessful, on-demand VMs are deployed to replace evicted Spot VMs.
Create a warm pool with Spot VMs using the Instance Pools API
The Instance Pools API can be used to create warm Azure Databricks pools with Spot VMs. In addition to the options available in the Azure Databricks UI, the Instance Pools API enables you to specify a maximum Spot VM price and fallback behavior if Spot VM capacity is unavailable.
Spot Pricing, Trends and Eviction Rates
Spot VM pricing can be viewed for all series on the Linux VM pricing page. The last column in the tables under each series type shows the savings based on region.
On the Databricks pricing page, you can view the ‘Pay As You Go Total Price’ (PAYG) and ‘Spot (%Savings) Total Price’. Note that the DBU price does not change with the use of Spot VMs. Savings are from discounts on Spot VMs only. Please note that Spot VMs pricing does not include network, storage or other resources, which are billed separately.
- Pay As You Go Total Price = Pay As You Go Price + DBU Price
- Spot Total Price = Spot VM Price (% Savings of PAYG) + DBU Price
Customers can also look at Spot VM pricing trends for the last 3 months and eviction rate. To see this, navigate to the Create a virtual machine page within the Azure Portal and click the “View pricing history and compare pricing in nearby regions” link. This will show you historical pricing and eviction rate for the regions and instances you select.
Learn more about using Azure Spot VMs with Azure Databricks by viewing the documentation: Azure Spot VMs, Azure Databricks Clusters, Azure Databricks Clusters API, Azure Databricks pools and Instance Pools API . To get started with Azure Databricks, visit the Azure Databricks page and attend up-coming Azure Databricks events.
*Actual discounts may vary based on region, VM type, and Azure compute capacity available when the workload is deployed. Please note that Spot VMs pricing does not include network, storage or other resources, which are billed separately.
Recent Comments