Integrating Microsoft Fabric with Azure Databricks Delta Tables

Integrating Microsoft Fabric with Azure Databricks Delta Tables

This article is contributed. See the original author and article here.

Introduction


Microsoft Fabric is a powerful unified analytics solution that allows users to seamlessly connect to various data sources, including Azure Databricks, and create insightful reports and visualizations without the need to move the data.


 


In this tutorial, we’ll show you step-by-step how to connect to Azure Databricks generated Delta Tables and create a report in Microsoft Fabric.


By the end of this tutorial, you’ll have the knowledge needed to read Azure Databricks generated Delta Tables from a Microsoft Fabric using Notebook and SQL query. You will also learn how to create a Power BI report that can help drive business decisions. So, let’s get started!


 


Anu_Singh_6-1693676822491.png


 


Prerequisites


Before you connect, complete these steps:



  • An Azure Databricks workspace

  • An ADLS Gen2 account to store delta table and a parquet file

  • A Fabric workspace. For more information, see Fabric trial docs.

  • A lakehouse in Fabric workspace. For more information, see Create a lakehouse with OneLake.


 


Create Delta Table in Databricks



  1. Create a delta table from Databricks Notebook.


   In this case, I am using parquet files stored in ADLS Gen2 account to create a delta table.


 

%SQL

--create external table from parquet files stored in ADLS Gen2
CREATE TABLE fact_internet_sales
LOCATION 'abfss://demo@[yourdatalake].dfs.core.windows.net/fact_internet_sales'
AS
SELECT * FROM PARQUET.`abfss://data@[yourdatalake].dfs.core.windows.net/fact_internet_sales`;

 


Anu_Singh_1-1693605529594.png


 


 

%Python

#Read parquet files stored in ADLS Gen2
df = spark.read.format('parquet')
    .load("abfss://data@[yourdatalake].dfs.core.windows.net/fact_internet_sales")

#Write to an external delta table
df.write 
    .format("delta") 
    .option("path", "abfss://demo@[yourdatalake].dfs.core.windows.net/fact_internet_sales") 
    .saveAsTable("fact_internet_sales")

 


Anu_Singh_2-1693605761876.png


 


 


Read the Delta Table in Fabric


Open the Fabric workspace to read, analyse and visualise the data.


 


Create shortcut to delta table


 



  1. In the lakehouse, click on ellipses (…) next to the Tables and select New Shortcut.

     Anu_Singh_1-1693606671369.png


     



  2. In the New shortcut wizard, select Azure Data Lake Storage Gen2 tile. For more information, see Create an Azure Data Lake Storage Gen2 shortcut                                                                                                                Anu_Singh_2-1693606905366.png

     



  3. Enter the storage account URL in Connection settings.












    Field



    Details



    URL



    https://StorageAccountName.dfs.core.windows.net



     Anu_Singh_3-1693607504533.png                                               



  4. Enter the connection details (sign in if required) and select Next

    In this case, I am using ‘Organization Account’ Authentication kind and hence need to sign in.






















    Field



    Details



    Connection



    Existing connections for the specified storage location will appear in the drop-down. If none exist, create a new connection.



    Connection name



    The Azure Data Lake Storage Gen2 connection name.



    Authentication kind



    The supported models are: Organizational account, Account Key, Shared Access Signature (SAS), and Service principal. For more information, see ADLS shortcuts.



     Anu_Singh_4-1693607697749.png                                                                                   



  5. Enter the Shortcut Name and Sub path details and then click Create




















    Field



    Details



    Shortcut Name



    Name of your shortcut



    URL



    The Azure Data Lake Storage Gen2 URL from the last page.



    Sub Path



    The directory where the delta table resides.



    Anu_Singh_5-1693607870447.png



  6. The shortcut pointing to the delta table (fact_internet_sales) created in the last section will now appear as a delta table under Tables in the Explorer pane.                                                                                                        


  7. Click on the table (fact_internet_sales) and the data in the table will show up.


     

    Anu_Singh_2-1693671634119.png

     




 


Read the data from Notebook – Lakehouse mode


The data in the table can now be queried directly from the notebook in Fabric.


 



  1. Right-click on the table or click on ellipses (…) next to the table, click Open in notebook and then New notebook.
     

     



     

    Anu_Singh_2-1693839332613.png
     

     



  2. New notebook will appear with the query automatically generated to read the data in the table.


  Select the Run Cell button or press Ctrl+Enter to execute the query and view the data.


Anu_Singh_8-1693673096446.png


 


 


Read the data using SQL – SQL Endpoint mode


The data in the table can also be queried directly using T-SQL query in Fabric.


 



  1. Browse to the SQL Endpoint created as part of Lakehouse provisioning from your workspace.


  2. After opening SQL Endpoint from the workspace, expand the database, schema and tables folder in the object Explorer to see all tables listed.




  3. Right-click on the table (fact_internet_sales) or click on ellipses (…) next to the table, click New SQL Query and then Select TOP 100 rows


     

    Anu_Singh_2-1693674552264.png

      



  4.  The script will be automatically generated and executed to show the data in the table or click on Run to execute the query.


    Anu_Singh_4-1693675947483.png


 


 


Visualise the data in Fabric using Power BI


The data in delta table can now be accessed and analysed in Power BI. You can either create a new dataset or use the default dataset created as part of lakehouse provisioning for a new report. For more information, see Direct Lake in Power BI and Microsoft Fabric


 


Using new dataset



  1. If you are in the Lakehouse mode, click on New Power BI dataset


      Anu_Singh_9-1693677766359.png


 


If you are in the SQL endpoint mode, click on New Power BI dataset from Reporting tab.


Anu_Singh_8-1693677639859.png


 



  1. In the New Dataset dialog, select the table to be included in the dataset and click Confirm.


Anu_Singh_12-1693599480206.png


 



  1. The dataset is automatically saved in the workspace, and then opens the dataset. In the web modelling experience page, click on New Report


Anu_Singh_5-1693839480214.png


 



  1. In the report authoring page, drag or select the attributes from Data pane to the left-hand side pane to be included in the visualization.


Anu_Singh_3-1693839409972.png


 


 


 


Using default dataset



  1. Select your workspace and open the default dataset.


Anu_Singh_10-1693677984415.png


 



  1. On the dataset page, click on Start from scratch to create a new report.


Anu_Singh_11-1693678126559.png


 



  1. In the report authoring page, drag or select the attributes from Data pane to the left-hand side pane to be included in the visualization.


Anu_Singh_4-1693839429999.png


 


 


 


 


Summary


In conclusion, this guide provides a seamless solution for accessing Azure Databricks generated delta tables from Microsoft Fabric and visualizing the data in Power BI without the need to move the data. By following the steps outlined in this guide, you can easily connect to your delta tables and extract valuable insights from your data. With the power of Azure Databricks and Microsoft Fabric combined, you can take your data analysis to the next level and make informed decisions that drive business success.


 


Give it a try and let me know if this was helpful.


 

MVP Rudy Ooms’s Dedication Solved Real-World Problem

MVP Rudy Ooms’s Dedication Solved Real-World Problem

This article is contributed. See the original author and article here.

Microsoft MVPs continue to help the community by sharing their profound technical knowledge and demonstrating leadership. In this article, we spotlight Rudy Ooms, an Enterprise Mobility MVP from the Netherlands, and explore his insightful troubleshooting story that made a significant impact in addressing a real-world challenge.


MVP Rudy Ooms.jpg


 


Rudy found a question in the Microsoft Management Customer Connection Program (MM CCP) regarding the 0x800705B4 error. The individual posting the question referenced a previous blog post by Rudy where he shared the same error, however, it was not exactly the same case. Therefore, he quickly decided to step in to help the person who posted this question.


 


“The moment I noticed the question popping up in the MM CCP, I became aware of the fact that the problem he was experiencing wasn’t a simple one and was giving him and his company a lot of issues and headaches. So, at that point in time, I really needed to help him out. When taking a closer look at the issue, I quickly understood that the Microsoft support desk could find it difficult to solve this case. Why? If you can’t reproduce it yourself it can become difficult to solve it and that’s where I come in”.


 


The issue was the device sync issue that impacted on new Autopilot enrollments due to error 0x800705b4. Rudy promptly set up his test device, started troubleshooting with his familiar tool Fiddler, went through a lot of trial and error such as using the SyncML tool, and he discovered that an illegal XML character was the culprit. By removing the assignment of the policy and the autopilot settings within the registry, he successfully mitigated the issue and made devices sync and new enrollments worked smoothly. For a comprehensive insight into his challenges and the adjustments he undertook, we highly recommend delving into the detailed narrative on his blog post. Rudy mentions that he helped another individual on the WinAdmins Discord channel facing the exact same issue.


https://call4cloud.nl/2023/06/the-0x800705b4-error-in-our-stars/


 


“After digging into the issue and finding the culprit within 24 hours yeah that felt pretty good,” Rudy is looking back on his contribution. Despite the lack of access to the questioner’s company’s tenants, the reason behind the early resolution of the situation was his desire to help, as well as his ability to improve his own troubleshooting skills by identifying the cause of the problem. This experience taught him a couple of things, ”It reminds me that you can learn new stuff every day… even when you thought you knew everything about SYNCML. And the MS community is strong and always willing to help – and so am I!”


 


The Product Group at Microsoft recognizes this wonderful troubleshooting story. Juanita Baptiste, Senior Program Manager, said of Rudy’s and the rest of the MVP community’s contributions, “The MVP community is more than just customers to bounce ideas off of. They are experts in their areas and cover more scenarios than we think. I have changed the design specs and features based on feedback from this community and it’s helped us build a better product. We can’t help everyone at the level of detail that MVPs (like Rudy) does, but the fact that they have each other for support and is an immense help to us!”


 


This story is the best practice of helping each other as a community. Whether you are an MVP or not, everyone has the ability to help others by sharing unique expertise and experience. Next, it is your turn. For example, the following sites (not limited to just the following, of course) can help you make a difference right away, starting today!


Microsoft Tech Community


Microsoft Q&A


GitHub


Feedback Hub

Pair programming a game with GitHub Copilot and a human

Pair programming a game with GitHub Copilot and a human

This article is contributed. See the original author and article here.

 


Chris_Noring_1-1693589156528.jpg



We’ve heard a lot about GitHub Copilot, but maybe more specifically about LLMs, large language models and how they can be used to generate code. You might even have used ChatGPT.



GitHub Copilot chat, is a product built by GitHub, it relies on a specific type of LLm a so called codex model and integrates with your IDE. It’s a bit like a pair programmer, but one that has seen a lot of code and can help you write it.



So what will we do today? We’ll use GitHub Copilot chat to solve a problem. The problem we have is Rock Paper Scissors. It’s a small game that most people knows the rules to. It’s also an interesting problem as it’s small and contained, but still has some complexity to it.



Where do we start? The interesting part here is that there are many ways to start which I discovered speaking to my colleague Cynthia. What we’re doing today is based on the excellent challenge module by Cynthia.

 


 


References







 



Approaches

So what approach do we choose?



Domain description. In this version, we write a domain descriptions with all rules and concepts in it and feed that to our AI pair programmer.

One comment at a time. Here, we write a comment and gradually work our towards a solution. In this approach we tackle one concept and rule at a time.



For the sake of this article, we’ll use the domain description approach.



Solving the problem: use domain description



Luckily for us, the training module already have a domain description, here it is:



Game rules:

Rock beats scissors (breaking it).
Scissors beat paper (cutting it).
Paper beat rock (wrapping it).
The minigame is multiplayer and the computer plays the role of your opponent and chooses a random element from the list of elements

Interaction with the player:

The console is used to interact with the player.
The player can choose one of the three options: rock, paper, or scissors.
The player can choose whether to play again.
The player should be warned if they enter an invalid option.
The player is shown their score at the end of the game.
Validation of user input:

At each round, the player must enter one of the options in the list and be informed if they won, lost, or tied with the opponent.
The minigame must handle user inputs, putting them in lowercase and informing the user if the option is invalid.
By the end of each round, the player must answer whether they want to play again or not.




> You can find this description in the




Ok, now what? Now we do the following:



1. Create a new file called rockpaperscissor.py and paste the domain description at the top like so:


 

   

# rockpaperscissor.py
   # Game rules:

    # Rock beats scissors (breaking it).
    # Scissors beat paper (cutting it).
    # Paper beat rock (wrapping it).
    # The minigame is multiplayer and the computer plays the role of your opponent and chooses a random element from the list of elements
    # Interaction with the player:
   
    # The console is used to interact with the player.
    # The player can choose one of the three options: rock, paper, or scissors.
    # The player can choose whether to play again.
    # The player should be warned if they enter an invalid option.
    # The player is shown their score at the end of the game.
    # Validation of user input:
   
    # At each round, the player must enter one of the options in the list and be informed if they won, lost, or tied with the opponent.
    # The minigame must handle user inputs, putting them in lowercase and informing the user if the option is invalid.
    # By the end of each round, the player must answer whether they want to play again or not.
   
    # game loop where the player and computer selects rock, paper, or scissors, round is repeated until player quits by typing "quit"
​

 



   Now we’ve provided context to Copilot in two ways, both by providing a domain description and by providing a file name *rockpaperscissor.py*. In the next step, let’s see what Copilot can do for us.



1. Type the following code:



   

quit = False
while

 




    Here’s where I stopped typing code because Copilot suggested the following:


 


   

not quit:




    and for every Enter I pressed, Copilot suggested code. So after having typed Enter a number of times and accepting all completions I arrived at this code:



   

quit = False
    while not quit:
        # player input
        player = input("rock, paper, or scissors? ")
        # computer input
        import random
        computer = random.choice(["rock", "paper", "scissors"])
        # game logic
        if player == computer:
            print("tie")
        elif player == "rock":
            if computer == "paper":
                print("computer wins")
            else:
                print("player wins")
        elif player == "paper":
            if computer == "scissors":
                print("computer wins")
            else:
                print("player wins")
        elif player == "scissors":
            if computer == "rock":
                print("computer wins")
            else:
                print("player wins")
        else:
            print("invalid input")
        # ask player if they want to play again
        play_again = input("play again? (y/n) ")
        if play_again == "n":
            quit = True
        elif play_again == "y":
            quit = False
        else:
            print("invalid input")
            quit = True


 

Improve the code, step 1



This code works, but it’s not the greatest code to look at. It doesn’t keep track of scores and it’s not very readable. So let’s see if we can improve it.



Open the the Chat component by selecting it at the bottom left of your left side menu (looks like a chat window). In it, type the prompt “improve code”. It should generate a response like so:



One improvement you could make is to add a score counter for the player and computer, so that the player can see their score at the end of the game. Here's an updated version of the code with a score counter:




followed by the code:

 

# Game rules:

# Rock beats scissors (breaking it).
# Scissors beat paper (cutting it).
# Paper beat rock (wrapping it).
# The minigame is multiplayer and the computer plays the role of your opponent and chooses a random element from the list of elements
# Interaction with the player:

# The console is used to interact with the player.
# The player can choose one of the three options: rock, paper, or scissors.
# The player can choose whether to play again.
# The player should be warned if they enter an invalid option.
# The player is shown their score at the end of the game.
# Validation of user input:

# At each round, the player must enter one of the options in the list and be informed if they won, lost, or tied with the opponent.
# The minigame must handle user inputs, putting them in lowercase and informing the user if the option is invalid.
# By the end of each round, the player must answer whether they want to play again or not.

# initialize score counters
player_score = 0
computer_score = 0

# game loop where the player and computer selects rock, paper, or scissors, round is repeated until player quits by typing "quit"
quit = False
while not quit:
    # player input
    player = input("rock, paper, or scissors? ")
    # computer input
    import random
    computer = random.choice(["rock", "paper", "scissors"])
    # game logic
    if player == computer:
        print("tie")
    elif player == "rock":
        if computer == "paper":
            print("computer wins")
            computer_score += 1
        else:
            print("player wins")
            player_score += 1
    elif player == "paper":
        if computer == "scissors":
            print("computer wins")
            computer_score += 1
        else:
            print("player wins")
            player_score += 1
    elif player == "scissors":
        if computer == "rock":
            print("computer wins")
            computer_score += 1
        else:
            print("player wins")
            player_score += 1
    else:
        print("invalid input")
    # ask player if they want to play again
    play_again = input("play again? (y/n) ")
    if play_again == "n":
        quit = True
    elif play_again == "y":
        quit = False
    else:
        print("invalid input")
        quit = True

# print final scores
print("player score:", player_score)
print("computer score:", computer_score)




In the above code, we’ve added a score counter for the player and computer, so that the player can see their score at the end of the game. We’ve also added a print statement to print the final scores.



Improve the code, step 2, use your know-how as a developer



What else can we do? At this point, we can start to refactor the code. An improvement we can do is to add a so called rule matrix. A rule matrix is a matrix that contains all the rules of the game. It’s a bit like a lookup table. Let’s provide that as a prompt to Copilot.



Here’s what we’re typing in Copilot chat:

 

improve code by adding a rule matrix to compare player and computer choices





which results in the following output from Copilot:

 

    # Game rules:

# Rock beats scissors (breaking it).
# Scissors beat paper (cutting it).
# Paper beat rock (wrapping it).
# The minigame is multiplayer and the computer plays the role of your opponent and chooses a random element from the list of elements
# Interaction with the player:

# The console is used to interact with the player.
# The player can choose one of the three options: rock, paper, or scissors.
# The player can choose whether to play again.
# The player should be warned if they enter an invalid option.
# The player is shown their score at the end of the game.
# Validation of user input:

# At each round, the player must enter one of the options in the list and be informed if they won, lost, or tied with the opponent.
# The minigame must handle user inputs, putting them in lowercase and informing the user if the option is invalid.
# By the end of each round, the player must answer whether they want to play again or not.

# initialize score counters
player_score = 0
computer_score = 0

# rule matrix
rules = {
    "rock": {"rock": "tie", "paper": "lose", "scissors": "win"},
    "paper": {"rock": "win", "paper": "tie", "scissors": "lose"},
    "scissors": {"rock": "lose", "paper": "win", "scissors": "tie"}
}

# game loop where the player and computer selects rock, paper, or scissors, round is repeated until player quits by typing "quit"
quit = False
while not quit:
    # player input
    player = input("rock, paper, or scissors? ")
    # computer input
    import random
    computer = random.choice(["rock", "paper", "scissors"])
    # game logic
    if player not in rules:
        print("invalid input")
    else:
        result = rules[player][computer]
        if result == "win":
            print("player wins")
            player_score += 1
        elif result == "lose":
            print("computer wins")
            computer_score += 1
        else:
            print("tie")
    # ask player if they want to play again
    play_again = input("play again? (y/n) ")
    if play_again == "n":
        quit = True
    elif play_again == "y":
        quit = False
    else:
        print("invalid input")
        quit = True

# print final scores
print("player score:", player_score)
print("computer score:", computer_score)


 

Now, you see how the code looks a lot better, no more nested if statements. We’ve also added a rule matrix (technically it added a dictionary not a matrix, but it’s still a big improvement over the code that was there before) to compare player and computer choices. Of course, we can still improve the code. For example, we can add a function to print the final scores. We should also add tests and documentation before we call it a day.



Conclusion



Sometimes using an AI assistant may look like magic, we could give it a full domain description. That could be a valid approach if the problem is small enough. Even then you need to improve the code in stages.



Another learning is that the more knowledge you have of code in general and the problem domain, the better you can guide the AI assistant to arrive at the solution you want.



Compare the difference between the first and last attempt, the last attempt is much better, don’t you think?



AI assistants aren’t here to replace us YET, but to help us solve problems, we still need to guide, we still need to know what we’re doing. But they can help us solve problems faster and better.




Protecting and Watermarking CAD files in Microsoft 365

Protecting and Watermarking CAD files in Microsoft 365

This article is contributed. See the original author and article here.

SarahGilbert_0-1693585027595.png


 


 


Intellectual property (IP) theft can wreak havoc on the supply chain and defense, stripping away an organization’s, or nation’s, competitive advantage. Hackers don’t necessarily pose the biggest threat to IP. Insider threats from employees, contractors and partners pose just as big a threat (some might argue bigger) from both accidental and deliberate data loss. While IP comes in many common forms, such as documents and spreadsheets, but images and CAD files pose just as big a risk and are more difficult to protect with traditional security tools. It is possible to protect and watermark CAD files stored and shared in Microsoft 365 applications to help prevent data loss and IP theft and meet Defense compliance requirements such as CMMC. Read on to learn more. 


 


WHAT ARE CAD FILES? 


If you’re not familiar with them, computer-aided design (CAD) files are used for designing models or architecture plans in a 2D or 3D rendering. CAD files are used for creating architectural designs, building plans, floor plans, electrical schematics, mechanical drawings, technical drawings, blueprints, or for special effects in movies. They are used by every organization related to any type of manufacturing or construction, including those who manufacture tools and equipment for other manufacturers. 


 


2D CAD files are drawings that mimic ‘old school’ drafting work. Most often these still exist as blueprints for structures where the height isn’t as critical for the design or is a standard dimension, however the layout within that 2-dimensional space is critical. For example, how do we fit our desks, chairs, tables, etc., into that space? The problem with portraying complicated 3-dimensional objects like machine parts in only 2 dimensions is that they need to be rendered from multiple angles so that all critical dimensions are portrayed properly. This used to result in a lot of drawings of the same part, but from different angles. 


 


3D files on the other hand can be portrayed in 3 dimensions and can be rotated in space and even ‘assembled’ with other parts. This can help Engineers discover issues (such as a pipe or shaft that has been accidentally routed through another part) much more quickly so they can be resolved long before production begins. 


 


Much like image files, there are several types of CAD file extensions (.DWG, .DXF, .DGN, .STL) and the file type is dependent on the brand of software used to create them. 


 


CHALLENGES TO CAD FILE PROTECTION  


Since most CAD files contain intellectual property or IP, protecting them is critical to protect competitive advantage, avoid malicious theft/corporate espionage and stop sharing with unauthorized audiences. Depending on the industry, different regulations and protection policies may also need to be applied to protect CAD files. For example, in the defense industry, file that contain controlled unclassified information (CUI) must be classified and labelled as CUI under CMMC 2.0, NIST 800-17, and NIST 800-53 regulations. 


 


Out of the box tools are often limited in their ability to classify and tag CAD files to meet the stringent requirements. Additionally, CAD files are often shared and collaborated on using file shares or even file sharing and collaboration tools like SharePoint, and Teams. Without the ability to properly classify and tag information Defense suppliers are at risk of losing valuable Government and Defense contracts to accidental sharing or malicious users. 


 


5 TIPS TO PROTECT CAD FILES IN M365 


Protecting CAD files is no different to protecting any other sensitive documents in your care. We recommend you: 



  1. Identify Sensitive CAD Files – The first step to any data protection strategy is knowing where your sensitive CAD files exist. If you don’t, you should consider using a scanning tool to find any files and apply appropriate protections. 

  2. Restrict Access – Ensure only users and partners who require access sensitive CAD are authorized to do so. Then follow tip #3. 

  3. Restrict Actions Authorized Users Can Take – Just because a user should be able to access a document, should they have carte blanche? For example, should they be able to edit it, download it or share it? Should they be able to access it on a public Wi-Fi or at an airport? You need to be able to apply fine grain access and usage controls to prevent data misuse and loss. 

  4. Digitally Watermark files to provide a visual reminder of the sensitivity level of files and add information about the user for tracking purposes in the event of a leak. For Defense applications you’ll want to add CUI markings to your watermark such as a CUI Designation Indicator. 

  5. Track Access – Keep an audit log of access and actions authorized users have taken with sensitive CAD files (print, save, download, email, etc.) and have a process in place to identify any suspicious activity (multiple downloads, access in the middle of the night, from a suspicious IP address, etc.). 


 


DYNAMICALLY CLASSIFY, PROTECT AND WATERMARK CAD FILES WITH NC PROTECT 


NC Protect from Microsoft Partner and MISA member, archTIS, provides advanced data-centric security across Microsoft applications to enhance information protection for cloud, on-premises and hybrid environments. The platform empowers enterprises to automatically find, classify and secure sensitive data, and determine how it can be accessed, used and shared with granular control using attribute-based access control (ABAC) and security policies. 


 


NC Protect offers a range of unique capabilities to restrict access to, protect and watermark CAD files, as well as other documents, in Microsoft’s document management and collaboration application. Capabilities include: 


 



  • Classification 

    • NC Protect automatically applies Microsoft Information Protection (MIP) sensitivity labels based on the contents of the file. 

    • Apply additional meta data or classification as required. For example, tag files as CUI. 



  • Encryption 

    • NC Protect leverages Microsoft Information Protection (MIP) sensitivity labels and Rights Management System (RMS) to encrypt CAD and other files. 

    • Encrypt files at rest or in motion (e.g., email attachments) 



  • Watermarking 

    • Watermark CAD files with any attributes such as user name, date, time, etc. to deter photographing and remind users of the sensitivity of the file. 

    • Automatically embed CUI Designator data into a 2D or 3 D CAD file as a secure digital watermark including: Name, Controlled BY, Category, Distribution/Limited Dissemination Control, and POC. 

    • Add CUI designator markings. 



  • Restrict Access & Actions 

    • Protected CAD files can only be opened and modified by authorized users based on predefined policies. 

    • Force read-only access for internal and guest users with a built-in Secure Viewer to prevent Copy, Paste, Print, Save As and Download capabilities. 

    • Policies can also control if and who protected CAD files can be shared with. 

    • Hide sensitive CAD files from the document view of unauthorized users in file sharing applications. 



  • Tracking 

    • Track access to all protected files as well as actions users have taken with the file. 

    • Export user actions and logs to Microsoft Sentinel, Splunk or a CSV file for further analysis and upstream actions. 



  • Supported Platforms & File types: 

    • Protects CAD file across all Microsoft 365 applications: SharePoint, Teams, OneDrive, Exchange email, Office 365, as well as SharePoint Server and Windows file shares. 

    • NC Protect supports multiple CAD file formats including: .dgn, .dwf, .dwfx, .dwg, .dwt, .dxf, .ifc, .iges, .plt, .stl, and .cff2. 

    • EASY TO CONFIGURE ACCESS, PROTECTION AND WATERMARK POLICES 

    • Applying these policies and controls with NC Protect from archTIS is easy to do using the product’s built-in policy builder. 




 


EASY TO CONFIGURE ACCESS, PROTECTION AND WATERMARK POLICES 


For example, the policy below allows NC Protect to deny any guests users the ability to see that CAD files even exist within the network. With this policy activated, a guest will not see a dwg file – even if it resides in a container or Team that they have full access to. Consider how easy it is to share access to SharePoint, OneDrive and Teams with external users and how critical collaboration with external vendors can be for the business.  


 


Users often place sensitive data into places that they don’t realize are accessible by people outside of the organization.  This policy allows NC Protect to apply a blanket restriction on guests and mitigate the potential loss of sensitive intellectual property. 


 


IrenaMroz_1-1693584224655.png


 


 


For more granular protection, the policy below forces any users who are not part of the Engineering Department to be limited to read only access to CAD files.  Even if someone from the Engineering group gives them access to these files, if their department is not Engineering NC Protect will automatically invoke the Secure Reader when they try to open them. In this case the department attribute is being used, but NC Protect can use any attribute such as existing group memberships, title or any other custom attribute to determine how users can interact with these files. 


IrenaMroz_2-1693584224656.png


 


 


NC Protect’s built-in Secure Reader enforces ‘true read only’ access.  Users can’t download, copy or even print a protected file.  NC Protect can also watermark the CAD file (or any other type of file) so if a user screenshots the drawing, the photo will contain their name, date and ‘CONFIDENTIAL’ as seen in the image below. 


 


IrenaMroz_3-1693584224657.png


 


 


 


About the author


Irena Mroz, Chief Marketing Officer, archTIS


As CMO, Irena Mroz is responsible for leading archTIS’ product marketing, branding, demand generation and public relations programs. A technical cybersecurity marketer, Mroz has spent her 25+ year career empowering start-ups and public software companies to exceed growth objectives through successful product positioning, demand generation, high profile events and product evangelism. Mroz holds a Bachelor of Science in Mass Communications from Boston University’s College of Communication.


 


About archTIS


archTIS is a global provider of innovative software solutions for the secure collaboration of sensitive information. The company’s award-winning data-centric information security solutions protect the world’s most sensitive content in government, defense, supply chain, enterprises and regulated industries through attribute-based access and control (ABAC) policies. archTIS’ complementary NC Protect software enhances Microsoft security capabilities with fine-grain, dynamic ABAC policies to control access to and add unique data protection capabilities to secure sensitive data across Microsoft 365 apps, SharePoint on-premises and Windows file shares. The company is a Microsoft Partner and a member of the Microsoft Intelligent Security Association. For more information, visit archtis.com or follow @arch_tis.


 


Learn more: https://www.archtis.com/microsoft-365-sharepoint-information-security-solutions-for-public-sector/


 


 

Now generally available: The new Microsoft Dynamics 365 Customer Insights

Now generally available: The new Microsoft Dynamics 365 Customer Insights

This article is contributed. See the original author and article here.

At Microsoft Inspire 2023, we announced that we are bringing together Microsoft Dynamics 365 Marketing and Microsoft Dynamics 365 Customer Insights into one offer, enabling organizations to unify and enrich their customer data to deliver personalized, connected, end-to-end customer journeys across sales, marketing, and service. We are retaining the existing “Dynamics 365 Customer Insights” name to encompass this new offer of both applications. Today, we’re excited to share that the new Dynamics 365 Customer Insights is now generally available for purchase.

For our existing Dynamics 365 Marketing and Dynamics 365 Customer Insights customers, this change signals an acceleration into our “better together” story, where we’ll continue to invest in new capabilities that will enable stronger, insights-based marketing, making it easier for marketers and data analysts to glean insights from customer data. Beginning September 1, 2023, customers who had the previous license for Marketing and/or Customer Insights will only see a product name change in the product; there will be no changes to the core product functionality due to the consolidation of the two products.

The new Customer Insights offers your organization flexibility to meet your business needs, with access to both the customer data platform (Customer Insights—Data) and real-time marketing with customer journey orchestration (Customer Insights—Journeys). The new pricing enables customers to unlock access to both applications and then buy the capacity they need. This gives you, our customers, the power of choice—where you can start with one or both applications and further invest in the capabilities that you’d like to scale. If you’re an existing customer of Microsoft Dynamics 365 Sales or Microsoft Dynamics 365 Customer Service, you can use Customer Insights as the foundation of your customer experience (CX) stack by achieving greater customer understanding and orchestrating contextual customer journeys across every touchpoint of the business.

Watch this video to see the new Dynamics 365 Customer Insights.

Achieve greater personalization with Copilot in Dynamics 365 Customer Insights

With the Customer Insights customer data platform, you can gain a holistic view of your customers, anticipate needs, and discover growth opportunities. And with real-time marketing and journey orchestration, you can deliver personalized, in-the-moment customer-triggered engagements that are relevant and contextual. With Copilot in Customer Insights, you can save time by using natural language to create or enhance target segments. You can also nurture creativity by turning topics into suggested copy, helping marketers move from concept to completion faster.

With the power of Copilot in Dynamics 365 Customer Insights, included at no additional cost, your data analysts and marketers can be more productive and increase their focus on personalizing the customer journey.

Our latest investments in copilot capabilities include the ability to:

Customer success with Dynamics 365 Customer Insights: Lynk & Co

Let’s take a look at an organization that is using Dynamics 365 Customer Insights today.

Lynk & Co is a Sweden-based company that is transforming the way people use cars by offering a simple and flexible experience where customers can choose to buy, borrow, or subscribe to a vehicle. With ambitions to disrupt the automobile industry and launch its business in seven markets in less than two years, Lynk & Co needed to quickly build an infrastructure that could support multi-channel customer engagement and drive highly personalized experiences. The company chose Microsoft Dynamics 365 for its out-of-the-box and customizable tools and the ability it provided to build in modules to create unique processes and prioritize specific customer experiences. Within 18 months, Lynk & Co was able to ramp up a significant digital presence in Belgium, France, Germany, Italy, Netherlands, Spain, and Sweden, as well as open social clubs designed to bring the company’s online brand to life through community-focused events.

The company uses Dynamics 365 Customer Insights to capture actionable customer data and link it with operational data within its cars. This is helping the company create seamless, highly personalized experiences for every customer from their first engagement to every time they use the app, drive a car, have service, or visit a club. It also makes it easy to support customers if they want to move from simply borrowing a car, to a monthly subscription, or to a car purchase. 

With the customer journey orchestration features in Dynamics 365 Customer Insights, customers get personalized messaging and image content. Beyond that, the system sends right-timed information on specific-to-the-customer club event invitations. These events vary from country to country but have included everything from unplugged live music nights and art openings to meet-ups for running and cycling groups, community talks on social issues, or workshops on how to upcycle old sneakers.

Engagement data from these events feeds back into the platform to further personalize member experiences across all lines of business, across all communication channels—and helps Lynk & Co learn and iterate.

Watch this video to see how Lynk & Co is using Dynamics 365 Customer Insights.

Learn more and get started today with Dynamics 365 Customer Insights

To learn more about Dynamics 365 Customer Insights, take the guided tour or start a free 30-day trial. If you have questions about the merging of Dynamics 365 Marketing and the previous Dynamics 365 Customer Insights, including pricing, please reference the FAQ on Microsoft Learn. If you missed Inspire 2023, you can watch the session by Emily He (Corporate Vice President, Business Applications Marketing), on demand, to see the announcements for Business Applications, including the latest innovations in Dynamics 365 Customer Insights.

The new Dynamics 365 Customer Insights

We’re bringing together Marketing and Customer Insights into one offer.


The post Now generally available: The new Microsoft Dynamics 365 Customer Insights appeared first on Microsoft Dynamics 365 Blog.

Brought to you by Dr. Ware, Microsoft Office 365 Silver Partner, Charleston SC.

Keep track of your trade policies with advanced export control

Keep track of your trade policies with advanced export control

This article is contributed. See the original author and article here.

Introduction

Supply Chain Management lets you manage, track, and verify compliance with export control restrictions prior to confirming, picking, packing, shipping, and invoicing sales orders. The new advanced export control functionality allows you to manage your export control policies using a native Microsoft Dataverse solution that interfaces directly with your Supply Chain Management instance. Supply Chain Management then enforces compliance with international trade regulations by consulting your export-control policies in real time.

The export control dataverse solution allows you to keep track of the many different rules and policies, expressing these rules, including complex ones, using formulas similar to those in Microsoft excel. The fact that it is a dataverse-based solution also allows your other systems to access your export control rules thanks to the hundreds of connectors available for Dataverse.

The solution implements five primary concepts:
Jurisdictions

A jurisdiction is a set of codes, categories, restrictions, exceptions and licenses. It represents a set of configurations that apply to incoming requests. Like the US International Traffic in Arms Regulation (ITAR), US Export Administration Regulations (EAR) or EU Dual Use.

You can create as well your own jurisdiction for your companies internal policies.

Codes and categories

The codes that make up a jurisdiction are often referred to as Export Control Classification Numbers (ECCNs).

An example of an export control classification number is 7A994, which is defined by the United States Export Administration Regulations (US EAR) export control jurisdiction. This classification number applied to “Other navigation direction finding equipment, airborne communication equipment, all aircraft inertial navigation systems not controlled under 7A003 or 7A103, and other avionic equipment, including parts and components.” According to the US EAR, ECCN 7A994 is a part of the *Anti Terrorism (AT)* control category.

Restrictions

Each export control jurisdiction defined a set of restrictions under which export control actions should be disallowed unless an exception exists.

Exceptions

Exceptions allow an action even though a restriction would otherwise block it. Common types of exceptions include licenses, blanket exemptions, and corporate policies.

Exceptions are defined the same way as restrictions, but also provide extra requirements that apply when the exception is used, such as the need to display a message to the user o to print text and licenses on documents.

Licenses

Licenses are the specific permissions to be able to trade an item or set of items in a given context. It is common that the authorities are the ones providing the licenses.


For more information see the documentation:

Advanced export control overview – Supply Chain Management | Dynamics 365 | Microsoft Learn

Supply Chain at Microsoft

Take a tour – Supply Chain Management | Microsoft Dynamics 365

Learn more about the latest AI breakthroughs with Microsoft Dynamics 365 Copilot:

Dynamics 365 AI webpage

The post Keep track of your trade policies with advanced export control appeared first on Microsoft Dynamics 365 Blog.

Brought to you by Dr. Ware, Microsoft Office 365 Silver Partner, Charleston SC.