Time Weighted Average and Value in Azure Data Explorer

Time Weighted Average and Value in Azure Data Explorer

This article is contributed. See the original author and article here.

Azure Data Explorer (ADX) supports time series aggregation at scale, either by the summarize operator that keeps the aggregated data in tabular format or by the make-series operator that transforms it to a set of dynamic arrays. There are multiple aggregation functions, out of them avg() is one of the most popular. ADX calculates it by grouping the samples into fixed time bins and applying simple average of all samples inside each time bin, regardless of their specific location inside the bin. This is the standard time bin aggregation as done by SQL and other databases. However, there are scenarios where simple average doesn’t accurately represent the time bin value. For example, IoT devices sending data commonly emits metric values in an asynchronous way, only upon change, to conserve bandwidth. In that case we need to calculate Time Weighted Average (TWA), taking into consideration the exact timestamp and duration of each value inside the time bin. ADX doesn’t have native aggregation functions to calculate time weighted average, still we have just added few User Defined Functions, part of the Functions Library, supporting it:



Here is a query comparing the original & interpolated values, standard average by the summarize operator, twa using fill forward and twa using linear interpolation:

let tbl = datatable(ts:datetime,  val:real, key:string) [
    datetime(2021-04-26 00:00), 100, 'D1',
    datetime(2021-04-26 00:45), 300, 'D1',
    datetime(2021-04-26 01:15), 200, 'D1',
];
let stime=datetime(2021-04-26 00:00);
let etime=datetime(2021-04-26 01:15);
let dt = 1h;
//
tbl
| where ts between (stime..etime)
| summarize val=avg(val) by bin(ts, dt), key
| project-rename _ts=ts, _key=key
| extend orig_val=0
| extend _key = strcat(_key, '-SUMMARIZE'), orig_val=0
| union (tbl
| invoke time_weighted_val_fl('ts', 'val', 'key', stime, etime, dt)
| project-rename val = _twa_val
| extend _key = strcat(_key, '-SAMPLES'))
| union (tbl
| invoke time_weighted_avg_fl('ts', 'val', 'key', stime, etime, dt)
| project-rename val = tw_avg
| extend _key = strcat(_key, '-TWA-FF'), orig_val=0)
| union (tbl
| invoke time_weighted_avg2_fl('ts', 'val', 'key', stime, etime, dt)
| project-rename val = tw_avg
| extend _key = strcat(_key, '-TWA-LI'), orig_val=0)
| order by _key asc, _ts asc
// use anomalychart just to show original data points as bold dots
| render anomalychart with (anomalycolumns=orig_val, title='Time Wighted Average, Fill Forward & Linear interpolation')

 


adieldar_0-1727624993177.png


 


Explaining the results:































 



2021-04-26 00:00



2021-04-26 00:00



Interpolated value



100



(300+200)/2=250



Average by summarize



(100+300)/2=200



200



Fill forward TWA



(45m*100 + 15m*300)/60m = 150



(15m*300 + 45m*200)/60m = 225



Linear interpolation TWA



45m*(100+300)/2 + 15m*(300+250)/2)/60m = 218.75



15m*(250+200)/2 + 45m*200)/60m = 206.25



 


Note that all functions work on multiple time series, partitioned by supplied key.


You are welcome to try these functions and share your feedback!

[Azure AI Search] Internal Server Error when creating CMK encrypted objects

This article is contributed. See the original author and article here.

Scenario


Customers follow the Microsoft doc to create CMK encrypted objects (data source, index etc.), but get the 500 Internal Server Error:


{‘error’:{‘code’:”,’message’:’Could not use key vault key to wrap/unwrap the encryption key. {‘Message’:’An error has occurred.’}’}



Possible Causes



  • The key vault host is incorrect, e.g. incorrect key vault domain.

    • Action: check the keyVaultUri in the Json payload.



  • The key vault host is inaccessible to search. For example, the key vault has public network access disabled but does not have a shared private link (SPL) configured from search. 

    • Action: check the SPL configurations or create a SPL. 




Note that if the key vault Uri is correct or accessible, the error message due to a wrong key vault key name or version in the JSON payload is slightly different. The error message has the complete key vault key path.


{
“error”: {
“code”: “”,
“message”: “Could not use key vault key https://keyvaultname.vault.azure.net:443/keys/wrongkeyname to wrap/unwrap the encryption key. The key vault key cannot be found.”
}
}

Introducing Copilot in OneDrive: Now Generally Available

Introducing Copilot in OneDrive: Now Generally Available

This article is contributed. See the original author and article here.

We’re thrilled to announce that Copilot is now available1 on OneDrive for the web to all our Copilot licensed commercial users2, marking a significant milestone in the way you work with files in OneDrive. Copilot brings the power of AI right into OneDrive to help you work more efficiently and effectively. Let’s take a look at how Copilot can transform the way you work with your files. 


 


What Can You Do with Copilot in OneDrive? 


Copilot isn’t just a tool; it’s a productivity companion that works alongside you, making everyday tasks easier and empowering you to achieve more. Here are some of the exciting ways you can take advantage of Copilot’s capabilities: 


 


Generate Summaries for Large Documents 
No more scanning through long documents to find the key points. With Copilot, you can quickly generate a concise summary of a single document or up to 5 files3 at a time, allowing you to easily get insights and focus on what matters most.  


arjuntomar_0-1727124636815.png


 


 


Compare Differences Between Multiple Documents 
Whether you’re working with contracts, financial reports, or job applications, sometimes all you’re looking for are meaningful differences between files. With Copilot you can now save time by quickly comparing up to 5 files, highlighting the key differences between them in an easy-to-read table view, without even opening these files. 


arjuntomar_1-1727124636816.png


 


 


Answer Complex Questions Using Files 
Need insights from multiple documents? Copilot can analyze the content of your OneDrive files and answer complex questions by pulling the right information from across your stored data -turning your file storage into a valuable source of knowledge and insight. 


 


Generate Ideas for New Documents 
If you’re stuck and need inspiration, Copilot can help you get started by suggesting outlines, ideas, or even a draft based on the files stored in OneDrive. For example, you can select relevant docs in your OneDrive and ask Copilot to generate drafts of a sales proposal, marketing strategy, or a project plan. 


 


How to Get Started with Copilot in OneDrive 


Getting started with Copilot in OneDrive is easy. Simply hover over a supported file in your OneDrive and click on the Copilot button to choose from a menu of suggested actions or ask your own question. You can also select up to 5 files and click the Copilot button in the command bar to get started. Whether you’re summarizing a report or need an insight from a file, Copilot is just a click away. 


 


If you’re new to Copilot or want to learn more, check out our getting started guide for detailed instructions and tips on how to make the most of this powerful new tool. If you need more answers, visit our FAQs. 


 


A Smarter, More Efficient Future with OneDrive 


With the full availability of Copilot in OneDrive, we’re excited to see how you leverage this AI-powered assistant to transform the way you work. And we have a lot more exciting Copilot features coming your way soon. Start exploring Copilot in OneDrive today and discover how it can help you achieve more! 


 


Join us on October 8th for our exciting OneDrive digital event: AI Innovations for the New Era of Work and Home


 


Please give us your feedback 


We’d love to hear your thoughts—don’t forget to provide feedback directly in Copilot by using thumbs up or thumbs down feature. Your input helps us improve our experience! 



  1. Copilot in OneDrive requires a Microsoft Copilot for Microsoft 365 license. 

  2. Copilot in OneDrive is currently available on OneDrive for web and for our commercial users only. 

  3. For a list of currently supported file formats, please visit our FAQs. 


 


About the author 


Arjun is a Principal Product Manager on the OneDrive web team. His main focus is to bring the power of AI to files experiences in OneDrive and across other M365 apps. Outside work, he enjoys dining out, traveling, and playing cricket whenever possible. 

Microsoft’s Perspective on the Ecosystem: Join the Ultimate Partner Executive Summit

Microsoft’s Perspective on the Ecosystem: Join the Ultimate Partner Executive Summit

This article is contributed. See the original author and article here.

Sandy Gupta.jpg


As a Microsoft Partner, are you still determining what events to attend this fall?


Ultimate Partner LIVE – Executive Summit ’24, is your chance to elevate your Microsoft partnership and take your business to the next level. It’s about exclusive insights, personal connections, and real strategies for success. If you’re serious about growth in this ecosystem, you don’t want to miss this executive summit October 22-23, 2024, in Dallas, TX.


 


A key focus of the Summit will be understanding how an ecosystem approach enables partners to align with Microsoft, reach more customers and accelerate growth.   


 


Sandy Gupta, Global VP for ISV at Microsoft will join Vince Menzione, Ultimate Partner CEO, for an exclusive strategic conversation to discuss Microsoft’s perspective on the ecosystem. 


 


During this fireside chat you will learn:



  • Where cloud, AI, and digital transformation are headed, and what that means for your business.  Jay McBain, Chief Analyst at Canalys, has predicted that GenAI will be a US$158 billion opportunity for the channel ecosystem by 2028.  Sandy will discuss how the Microsoft partner ecosystem is aligning for this opportunity.

  • Real-world, actionable insights to position your software company to win in this ecosystem and unlock new growth opportunities.  Microsoft recently commissioned a global study through IDC, “Microsoft Partners: Driving Economic Value and AI Maturity”.  Key findings from the study show for every $1 of Microsoft revenue, partners who develop software generate $11.

  • About Sandy’s career path at Microsoft and how his unique viewpoint will shape Microsoft’s ISV strategy in FY25


 


Meet and ask questions to leaders like Sandy and his team during this event!  Build deep, meaningful connections with other senior executives from leading Microsoft Partners and VP/GM Microsoft leaders from ISV, GSI, and CSP.


 


At Ultimate Partner, we bring the most important leaders, industry experts, and the Ultimate Partner Workshops to provide you a masterclass in two solid days.


 


Secure your ticket today, as they’re selling fast. Don’t miss out on driving your business forward with Microsoft’s latest innovations!


I can’t wait to host you in Dallas, where we will spark the ecosystem together.


Register now.

News to Know: Volume 1, Edition 10

News to Know: Volume 1, Edition 10

This article is contributed. See the original author and article here.

Welcome to the Viva Glint newsletter. These recurring communications coincide with platform releases and enhancements to help you get the most out of the Viva Glint product. You can access the current newsletter and past editions on the Viva Glint blog.


 


Glint released its latest new features and enhancements on September 21, 2024. Scheduled monthly releases and regular maintenance are how we best serve our customers. Your dashboard provides date and timing details two or three days before releases. See our future release and downtime dates. Follow along with what features are ahead: Viva Glint product roadmap.



Microsoft 365 Copilot in Viva Glint


Copilot in Viva Glint summarizes non-English survey comments. As a Copilot user, you’ll still interact with Copilot in English, but Copilot now summarizes non-English comments left by survey respondents. To gather the best feedback, encourage your employees to leave comments in their native language. Microsoft 365 Copilot currently supports 27 languages.


 


Learn how Microsoft HR uses Viva and Microsoft 365 Copilot to empower employees. Using a human-centric approach, Microsoft HR rolled out Microsoft 365 Copilot to their global HR organization. Read the blog about how Microsoft uses Viva to communicate, encourage skilling and development, and measure success.


 


New on your Viva Glint platform


360 feedback programs are included with all Viva Glint purchases! 360 feedback programs provide multiple perspectives for gathering insights into an employee’s strengths and opportunities, with a long-term focus on improvement.


 



 


Export reports to PDFs easily and quickly. Now the Export feature in all Glint reports includes a full PDF experience with quick generation time and capabilities such as search, markup, highlight, and preview. You can also select which report sections to export – an enhancement our customers have been requesting! Read about PDF enhancements.


 


Navigate between Viva apps with ease. The Viva App Bar is a shared Microsoft component that enables Viva suite users to seamlessly discover and navigate between Viva apps they have purchased on the web. Viva Glint is integrating with these shared navigation elements to allow our users to have consistent experiences across Viva apps.


image (3).png


 


Enhanced data controller experience. Microsoft Viva Glint Administrators can decide how survey responses are handled for deleted users and how Glint reuses employee IDs over time. Learn about new user data options in the General Settings feature and its impact on user deletion.


 


Collaborate in Viva Glint across multiple tenants. Use Microsoft 365’s multitenant organization (MTO) feature to let survey takers and dashboard users from multiple tenants access Glint on a home tenant. Get a holistic view of your organization’s employee sentiment, no matter how complex your tenant configuration.



 


Upcoming events


Ask the Experts | October 15 


Our next session in this popular series focuses on maximizing survey participation. Bring your questions! Register


 


AI Empowerment: How HR uses AI | October 22


Join us to hear how HR professionals use AI to work more effectively. This session covers key features, capabilities, and use cases for AI within the HR function, and recommendations on how it can help you be more effective in your role. Register


 


 


Events you may have missed


Catch up with recordings and recaps released since our last newsletter:



 


For your managers


Do your managers feel equipped to understand and act on feedback? Viva People Science conducted a study with 700+ US-based managers across a variety of industries to gain a deeper understanding of their experience, from common practices to barriers when it comes to acting on employee feedback. Learn more about the critical findings


 


Help managers build psychological safety within their teams. Share this new learning path with your managers to help them identify and cultivate psychological safety within their teams. Managers can earn their Microsoft Viva badge in psychological safety with Credly. 


 


 


Exciting new resources for all stakeholders


Accelerate AI transformation with our new eBook. The state of AI change readiness, from the Viva People Science team, outlines findings on AI readiness, discusses implications, and provides practical guidance for leaders and HR on best to support people through change related to AI at work.


 


Build a holistic employee listening strategy. Take time to align with your internal stakeholders and complete our Holistic Listening Vision and Strategy Discovery Workbook from the Viva People Science team. This workbook helps you consider information important to your listening strategy and for tracking progress.


 


Coming soon: learn about the combined powers of Viva Glint, Viva Insights, and Viva Pulse. Together these apps measure employee engagement and productivity while giving you actionable insights. Keep your eyes out for a new communication where we will be highlighting features, customer success stories, and events featuring these products.