Time Weighted Average and Value in Azure Data Explorer

by Contributed | Sep 29, 2024 | Technology

This article is contributed. See the original author and article here.

Azure Data Explorer (ADX) supports time series aggregation at scale, either by the summarize operator that keeps the aggregated data in tabular format or by the make-series operator that transforms it to a set of dynamic arrays. There are multiple aggregation functions, out of them avg() is one of the most popular. ADX calculates it by grouping the samples into fixed time bins and applying simple average of all samples inside each time bin, regardless of their specific location inside the bin. This is the standard time bin aggregation as done by SQL and other databases. However, there are scenarios where simple average doesn’t accurately represent the time bin value. For example, IoT devices sending data commonly emits metric values in an asynchronous way, only upon change, to conserve bandwidth. In that case we need to calculate Time Weighted Average (TWA), taking into consideration the exact timestamp and duration of each value inside the time bin. ADX doesn’t have native aggregation functions to calculate time weighted average, still we have just added few User Defined Functions, part of the Functions Library, supporting it:

• time_weighted_val_fl() – Calculates the time weighted value of a metric using linear interpolation.


• time_weighted_avg_fl() – Calculates the time weighted average of a metric using fill forward interpolation.


• time_weighted_avg2_fl() – Calculates the time weighted average of a metric using linear interpolation.

Here is a query comparing the original & interpolated values, standard average by the summarize operator, twa using fill forward and twa using linear interpolation:

let tbl = datatable(ts:datetime,  val:real, key:string) [
    datetime(2021-04-26 00:00), 100, 'D1',
    datetime(2021-04-26 00:45), 300, 'D1',
    datetime(2021-04-26 01:15), 200, 'D1',
];
let stime=datetime(2021-04-26 00:00);
let etime=datetime(2021-04-26 01:15);
let dt = 1h;
//
tbl
| where ts between (stime..etime)
| summarize val=avg(val) by bin(ts, dt), key
| project-rename _ts=ts, _key=key
| extend orig_val=0
| extend _key = strcat(_key, '-SUMMARIZE'), orig_val=0
| union (tbl
| invoke time_weighted_val_fl('ts', 'val', 'key', stime, etime, dt)
| project-rename val = _twa_val
| extend _key = strcat(_key, '-SAMPLES'))
| union (tbl
| invoke time_weighted_avg_fl('ts', 'val', 'key', stime, etime, dt)
| project-rename val = tw_avg
| extend _key = strcat(_key, '-TWA-FF'), orig_val=0)
| union (tbl
| invoke time_weighted_avg2_fl('ts', 'val', 'key', stime, etime, dt)
| project-rename val = tw_avg
| extend _key = strcat(_key, '-TWA-LI'), orig_val=0)
| order by _key asc, _ts asc
// use anomalychart just to show original data points as bold dots
| render anomalychart with (anomalycolumns=orig_val, title='Time Wighted Average, Fill Forward & Linear interpolation')

Explaining the results:

Note that all functions work on multiple time series, partitioned by supplied key.

You are welcome to try these functions and share your feedback!

Introducing Copilot in OneDrive: Now Generally Available

by Contributed | Sep 27, 2024 | Technology

This article is contributed. See the original author and article here.

We’re thrilled to announce that Copilot is now available1 on OneDrive for the web to all our Copilot licensed commercial users2, marking a significant milestone in the way you work with files in OneDrive. Copilot brings the power of AI right into OneDrive to help you work more efficiently and effectively. Let’s take a look at how Copilot can transform the way you work with your files. 

What Can You Do with Copilot in OneDrive? 

Copilot isn’t just a tool; it’s a productivity companion that works alongside you, making everyday tasks easier and empowering you to achieve more. Here are some of the exciting ways you can take advantage of Copilot’s capabilities: 

Generate Summaries for Large Documents 
No more scanning through long documents to find the key points. With Copilot, you can quickly generate a concise summary of a single document or up to 5 files3 at a time, allowing you to easily get insights and focus on what matters most.  

Compare Differences Between Multiple Documents 
Whether you’re working with contracts, financial reports, or job applications, sometimes all you’re looking for are meaningful differences between files. With Copilot you can now save time by quickly comparing up to 5 files, highlighting the key differences between them in an easy-to-read table view, without even opening these files. 

Answer Complex Questions Using Files 
Need insights from multiple documents? Copilot can analyze the content of your OneDrive files and answer complex questions by pulling the right information from across your stored data -turning your file storage into a valuable source of knowledge and insight. 

Generate Ideas for New Documents 
If you’re stuck and need inspiration, Copilot can help you get started by suggesting outlines, ideas, or even a draft based on the files stored in OneDrive. For example, you can select relevant docs in your OneDrive and ask Copilot to generate drafts of a sales proposal, marketing strategy, or a project plan. 

How to Get Started with Copilot in OneDrive 

Getting started with Copilot in OneDrive is easy. Simply hover over a supported file in your OneDrive and click on the Copilot button to choose from a menu of suggested actions or ask your own question. You can also select up to 5 files and click the Copilot button in the command bar to get started. Whether you’re summarizing a report or need an insight from a file, Copilot is just a click away. 

If you’re new to Copilot or want to learn more, check out our getting started guide for detailed instructions and tips on how to make the most of this powerful new tool. If you need more answers, visit our FAQs. 

A Smarter, More Efficient Future with OneDrive 

With the full availability of Copilot in OneDrive, we’re excited to see how you leverage this AI-powered assistant to transform the way you work. And we have a lot more exciting Copilot features coming your way soon. Start exploring Copilot in OneDrive today and discover how it can help you achieve more! 

Join us on October 8th for our exciting OneDrive digital event: AI Innovations for the New Era of Work and Home

Please give us your feedback 

We’d love to hear your thoughts—don’t forget to provide feedback directly in Copilot by using thumbs up or thumbs down feature. Your input helps us improve our experience! 

1. Copilot in OneDrive requires a Microsoft Copilot for Microsoft 365 license. 


2. Copilot in OneDrive is currently available on OneDrive for web and for our commercial users only. 


3. For a list of currently supported file formats, please visit our FAQs. 

About the author 

Arjun is a Principal Product Manager on the OneDrive web team. His main focus is to bring the power of AI to files experiences in OneDrive and across other M365 apps. Outside work, he enjoys dining out, traveling, and playing cricket whenever possible. 

Microsoft’s Perspective on the Ecosystem: Join the Ultimate Partner Executive Summit

by Contributed | Sep 26, 2024 | Technology

This article is contributed. See the original author and article here.

As a Microsoft Partner, are you still determining what events to attend this fall?

Ultimate Partner LIVE – Executive Summit ’24, is your chance to elevate your Microsoft partnership and take your business to the next level. It’s about exclusive insights, personal connections, and real strategies for success. If you’re serious about growth in this ecosystem, you don’t want to miss this executive summit October 22-23, 2024, in Dallas, TX.

A key focus of the Summit will be understanding how an ecosystem approach enables partners to align with Microsoft, reach more customers and accelerate growth.   

Sandy Gupta, Global VP for ISV at Microsoft will join Vince Menzione, Ultimate Partner CEO, for an exclusive strategic conversation to discuss Microsoft’s perspective on the ecosystem. 

During this fireside chat you will learn:

• Where cloud, AI, and digital transformation are headed, and what that means for your business.  Jay McBain, Chief Analyst at Canalys, has predicted that GenAI will be a US$158 billion opportunity for the channel ecosystem by 2028.  Sandy will discuss how the Microsoft partner ecosystem is aligning for this opportunity.


• Real-world, actionable insights to position your software company to win in this ecosystem and unlock new growth opportunities.  Microsoft recently commissioned a global study through IDC, “Microsoft Partners: Driving Economic Value and AI Maturity”.  Key findings from the study show for every $1 of Microsoft revenue, partners who develop software generate $11.


• About Sandy’s career path at Microsoft and how his unique viewpoint will shape Microsoft’s ISV strategy in FY25

Meet and ask questions to leaders like Sandy and his team during this event!  Build deep, meaningful connections with other senior executives from leading Microsoft Partners and VP/GM Microsoft leaders from ISV, GSI, and CSP.

At Ultimate Partner, we bring the most important leaders, industry experts, and the Ultimate Partner Workshops to provide you a masterclass in two solid days.

Secure your ticket today, as they’re selling fast. Don’t miss out on driving your business forward with Microsoft’s latest innovations!

I can’t wait to host you in Dallas, where we will spark the ecosystem together.

Register now.