tag:blogger.com,1999:blog-37390732325022605202024-03-23T03:14:35.947-07:00Dinesh's Blog :::: Being Compiled ::::Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.comBlogger750125tag:blogger.com,1999:blog-3739073232502260520.post-30820678988139763802023-06-19T18:39:00.007-07:002023-06-19T18:41:14.015-07:00Microsoft Fabric creates a Warehouse automatically - Microsoft Fabric - III<p style="text-align: justify;">Discover the power of Microsoft Fabric in automating data warehousing with our latest video, “Microsoft Fabric creates a Warehouse Automatically”. This informative video demonstrates how you can effortlessly create a data warehouse without the need for complex and time-consuming traditional warehousing processes.</p><p style="text-align: justify;">Join us as we explore how Microsoft Fabric automatically generates a default data warehouse, showcasing the transformation of Delta tables into accessible tables within the warehouse. Learn step-by-step how to create Delta tables in the lakehouse, enabling their visibility as fully functional tables in the data warehouse.</p><p style="text-align: justify;">Furthermore, we explore the flexibility of the data warehouse, demonstrating how you can enhance it by creating custom views and stored procedures. Additionally, we demonstrate the way of opening the warehouse as the default Power BI dataset for creating reports and dashboard.</p><p style="text-align: justify;">Don't miss out on this informative video that provides valuable insights into Microsoft Fabric's data warehousing capabilities. Subscribe to our channel for more in-depth tutorials and stay up to date with the latest advancements in data management and analytics.</p><p style="text-align: justify;"><br /></p><div class="separator" style="clear: both; text-align: center;"><iframe allowfullscreen="" class="BLOG_video_class" height="347" src="https://www.youtube.com/embed/kxgpFIqjDlA" width="570" youtube-src-id="kxgpFIqjDlA"></iframe></div><br /><p style="text-align: justify;"><br /></p>Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-8811302993892435622023-05-30T09:13:00.001-07:002023-05-30T09:13:34.340-07:00Understanding and enabling Microsoft Fabric - [Video]<p> Want to know about <b>Microsoft Fabric</b>? Here is a video that speaks about Microsoft Fabric, what it offers and how you can start with a trial.</p><div class="separator" style="clear: both; text-align: center;"><iframe allowfullscreen="" class="BLOG_video_class" height="365" src="https://www.youtube.com/embed/-pv5nDYyUWw" width="627" youtube-src-id="-pv5nDYyUWw"></iframe></div><br /><p><br /></p><p><br /></p>Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-33860339636587216762023-05-14T08:53:00.003-07:002023-05-14T08:53:56.740-07:00Unleashing Power BI in Jupyter Notebook - Embed and Create reports<p><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;">This video discusses two things: </span></p><p></p><ul style="text-align: left;"><li><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;">Embedding Power BI report in Jupytor Notebook </span></li><li><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;">Creating Power BI report directly in Jupytor Notebook. </span></li></ul><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;">Embedding Power BI is not something new, it was announced in May 2021. Creating Power BI report in Jupytor Notebook was announced in last month, April 2023. Both topics are discussed in detail with demonstrations. Following are discussed:</span><div><ul style="text-align: left;"><li><span style="color: #0d0d0d; font-family: Roboto, Noto, sans-serif;"><span style="background-color: white; font-size: 15px; white-space: pre-wrap;">Powerbiclient Python package</span></span></li><li><span style="color: #0d0d0d; font-family: Roboto, Noto, sans-serif;"><span style="background-color: white; font-size: 15px; white-space: pre-wrap;">Two Authentication method</span></span></li><li><span style="color: #0d0d0d; font-family: Roboto, Noto, sans-serif;"><span style="background-color: white; font-size: 15px; white-space: pre-wrap;">Install powerbiclient in Jupytor notebook</span></span></li><li><span style="color: #0d0d0d; font-family: Roboto, Noto, sans-serif;"><span style="background-color: white; font-size: 15px; white-space: pre-wrap;">Embed Power BI report in Jupytor Notebook</span></span></li><li><span style="color: #0d0d0d; font-family: Roboto, Noto, sans-serif;"><span style="background-color: white; font-size: 15px; white-space: pre-wrap;">Add custom Notebook filter for filtering reports</span></span></li><li><span style="color: #0d0d0d; font-family: Roboto, Noto, sans-serif;"><span style="background-color: white; font-size: 15px; white-space: pre-wrap;">Loading visual data into Pandas dataframe</span></span></li><li><span style="color: #0d0d0d; font-family: Roboto, Noto, sans-serif;"><span style="background-color: white; font-size: 15px; white-space: pre-wrap;">Create Power BI report in Jupytor Notebook</span></span></li><li><span style="color: #0d0d0d; font-family: Roboto, Noto, sans-serif;"><span style="background-color: white; font-size: 15px; white-space: pre-wrap;">Quick report feature and personalizing visuals</span></span></li><li><span style="color: #0d0d0d; font-family: Roboto, Noto, sans-serif;"><span style="background-color: white; font-size: 15px; white-space: pre-wrap;">Publishing to Power BI service for sharing the dataset and report</span></span></li></ul><br /></div><div class="separator" style="clear: both; text-align: center;"><a href="https://youtu.be/NxvwRuHNWhQ" imageanchor="1" style="margin-left: 1em; margin-right: 1em;" target="_blank"><img border="0" data-original-height="720" data-original-width="1280" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgnxa2hk8ftqQjEwQrYOMj50khzulyR2Ytfl2ER4vQ0V7ATzdwFqQas6EPcqsRl4H2v2dKbwEmQQ0F3AnDZr7StBfQCzLrAQOuAoDel9pDQv8_j5CdOKLT896vSR0Z5qXFFOiMl0kwrnn6l6cVmZEHLG9xv_8ssmtHc_06xROxD-6mCGfFq_lXQHuWgAw/w570-h320/Unleashing%20Power%20BI%20in%20Jupyter%20Notebook.png" width="570" /></a></div><br /><div style="text-align: center;"><br /></div>Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-69277300948913400952023-05-14T08:42:00.001-07:002023-05-14T08:42:29.116-07:00Real-time Streaming in Power BI - Push DatasetThis video discusses the way of showing stream data with Power BI visuals, specifically with Push Datasets. Here is the content: <div><ul style="text-align: left;"><li>Types of streaming datasets supported by Power BI</li><li>The way of creating the Push dataset</li><li>Sending values using a .Net application</li><li>Creating reports and dashboards visuals using streaming dataset.
</li></ul><div><br /></div><div class="separator" style="clear: both; text-align: center;"><a href="https://youtu.be/WVscgsJGINI" imageanchor="1" style="margin-left: 1em; margin-right: 1em;" target="_blank"><img border="0" data-original-height="1512" data-original-width="2672" height="311" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjurKvnFAJLAWeF5zN-8rIv4Xejor7LLQPZv32DyGQdhSloXugD2BxclkHlub6h6yTQ-1qFhPdkQk_4T-X8vplcFdTnRD5JWgOqgrPMz_hE2N4gHxrJpmPibZrQYkfNCNIWdfjShGlzqmJ-dXX7X4b8tfgGYxtEE3VTzO6OzaHsK50tvzrySuKQaNLUjA/w550-h311/Real-time%20streaming%20in%20Power%20BI.png" width="550" /></a></div><br /><div style="text-align: center;"><br /></div></div>Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-64099784034487605192022-04-02T07:51:00.005-07:002022-04-02T07:52:11.198-07:00Azure Synapse Analytics - Part III - Serverless SQL Pool<p></p><div class="separator" style="clear: both; text-align: center;"><iframe allowfullscreen="" class="BLOG_video_class" height="411" src="https://www.youtube.com/embed/2xndDUXMnlc" width="495" youtube-src-id="2xndDUXMnlc"></iframe></div><br /><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;"><br /></span><p></p><p><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;">Azure Synapse Serverless SQL Pool facilitates data exploration, transformations and data warehousing with multiple functionalities, allowing us to work with it using SQL. This video discusses how it works, what we can do and demos on use cases. This is the content:</span></p><span style="background-color: white;">
<ul style="color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; text-align: left; white-space: pre-wrap;"><li><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;">Introduction to Serverless SQL Pool</span></li><li><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;">How useful it is</span></li><li><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;">Is it same as Dedicated SQL Pool?</span></li><li><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;">Demo</span></li><ul><li><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;">Data exploration</span></li><li>Data transformation</li><li>Making a logical data warehouse and accessing it using Power BI</li></ul></ul><span style="color: #0d0d0d; font-family: Roboto, Noto, sans-serif;"><span style="font-size: 15px; white-space: pre-wrap;"><br /></span></span></span><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;">Read more at:</span><span style="background-color: white;"><br /></span><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;"><a href="https://docs.microsoft.com/en-us/azure/synapse-analytics/sql/overview-architecture/?WT.mc_id=DP-MVP-33296">Serverless SQL Pool Architecture</a></span><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;">
</span><span style="background-color: white; color: #0d0d0d; font-family: Roboto, Noto, sans-serif; font-size: 15px; white-space: pre-wrap;"><a href="https://docs.microsoft.com/en-us/learn/paths/build-data-analytics-solutions-using-azure-synapse-serverless-sql-pools/?WT.mc_id=DP-MVP-33296">Serverless SQL Pool - Microsoft Learn</a></span>Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-85710620798291002112022-04-02T07:46:00.006-07:002022-04-02T07:47:30.140-07:00Azure Synapse Analytics - Part II - Hypersapce<p> <span face="Roboto, Arial, sans-serif" style="background-color: #f9f9f9; color: #030303; font-size: 14px; white-space: pre-wrap;">*** This is the session I have done for Sri Lanka Data Community – Feb 2022 episode. This does not contain the entire event.</span></p><span class="style-scope yt-formatted-string" dir="auto" face="Roboto, Arial, sans-serif" style="background: rgb(249, 249, 249); border: 0px; color: #030303; font-size: 14px; margin: 0px; padding: 0px; white-space: pre-wrap;"><div><div class="separator" style="clear: both; text-align: center;"><iframe allowfullscreen="" class="BLOG_video_class" height="400" src="https://www.youtube.com/embed/UrDdYkNIepQ" width="481" youtube-src-id="UrDdYkNIepQ"></iframe></div><br /><span class="style-scope yt-formatted-string" dir="auto" face="Roboto, Arial, sans-serif" style="background: rgb(249, 249, 249); border: 0px; color: #030303; font-size: 14px; margin: 0px; padding: 0px; white-space: pre-wrap;"><br /></span></div>
With modern data solutions, where we see data warehousing and big data, analytics are not limited to columnar based queries, highly selective queries are part of the trend now. Here is the way of optimizing such queries with Hyperspace: An indexing subsystem for Apache Spark.
Read more at:
</span><span class="style-scope yt-formatted-string" dir="auto" face="Roboto, Arial, sans-serif" style="background: rgb(249, 249, 249); border: 0px; color: #030303; font-size: 14px; margin: 0px; padding: 0px; white-space: pre-wrap;">
</span><span class="style-scope yt-formatted-string" dir="auto" face="Roboto, Arial, sans-serif" style="background: rgb(249, 249, 249); border: 0px; color: #030303; font-size: 14px; margin: 0px; padding: 0px; white-space: pre-wrap;">
<a href="https://docs.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-performance-hyperspace?pivots=programming-language-csharp/?WT.mc_id=DP-MVP-33296">https://docs.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-performance-hyperspace?pivots=programming-language-csharp/?WT.mc_id=DP-MVP-33296</a></span><div><span class="style-scope yt-formatted-string" dir="auto" face="Roboto, Arial, sans-serif" style="background: rgb(249, 249, 249); border: 0px; color: #030303; font-size: 14px; margin: 0px; padding: 0px; white-space: pre-wrap;"><br /></span></div><div><span class="style-scope yt-formatted-string" dir="auto" face="Roboto, Arial, sans-serif" style="background: rgb(249, 249, 249); border: 0px; color: #030303; font-size: 14px; margin: 0px; padding: 0px; white-space: pre-wrap;"><a href="https://github.com/microsoft/hyperspace/?WT.mc_id=DP-MVP-33296">https://github.com/microsoft/hyperspace/?WT.mc_id=DP-MVP-33296</a></span></div><div><span class="style-scope yt-formatted-string" dir="auto" face="Roboto, Arial, sans-serif" style="background: rgb(249, 249, 249); border: 0px; color: #030303; font-size: 14px; margin: 0px; padding: 0px; white-space: pre-wrap;">
This talks about
- What is Hyperspace and how it helps us to add indexes
- How to see indexes, what changes it makes to the data lake
- How to check whether indexes are used for queries
- How to compare indexed query and non-indexed query with given APIs
If you have any questions, please add to the comment section.</span></div>Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-59805146540550540462020-10-04T07:11:00.004-07:002020-10-04T07:12:38.192-07:00Azure Synapse Analytics - Part I<p> <span style="background-color: white; color: #050505; font-family: "Segoe UI Historic", "Segoe UI", Helvetica, Arial, sans-serif; font-size: 15px; white-space: pre-wrap;">This video speaks about the latest in data warehousing and big data analytics: Azure Synapse Analytics. This is the first part of it and it explains; </span></p><div dir="auto" style="background-color: white; color: #050505; font-family: "Segoe UI Historic", "Segoe UI", Helvetica, Arial, sans-serif; font-size: 15px; white-space: pre-wrap;">- The way we have been creating on-premise data solutions </div><div dir="auto" style="background-color: white; color: #050505; font-family: "Segoe UI Historic", "Segoe UI", Helvetica, Arial, sans-serif; font-size: 15px; white-space: pre-wrap;">- The way we have been creating data solutions in Azure before Azure Synapse Analytics </div><div dir="auto" style="background-color: white; color: #050505; font-family: "Segoe UI Historic", "Segoe UI", Helvetica, Arial, sans-serif; font-size: 15px; white-space: pre-wrap;">- How we can create data solutions in Azure using Azure Synapse Analytics </div><div dir="auto" style="background-color: white; color: #050505; font-family: "Segoe UI Historic", "Segoe UI", Helvetica, Arial, sans-serif; font-size: 15px; white-space: pre-wrap;">- Quick demo on creating the workspace, SQL Pool, Spark cluster and accessing and processing data</div><div dir="auto" style="background-color: white; color: #050505; font-family: "Segoe UI Historic", "Segoe UI", Helvetica, Arial, sans-serif; font-size: 15px; white-space: pre-wrap;"><br /></div><div class="separator" style="clear: both; text-align: center;"><iframe allowfullscreen="" class="BLOG_video_class" height="415" src="https://www.youtube.com/embed/NR2cX_HFvEw" width="498" youtube-src-id="NR2cX_HFvEw"></iframe></div><br /><div dir="auto" style="background-color: white; color: #050505; font-family: "Segoe UI Historic", "Segoe UI", Helvetica, Arial, sans-serif; font-size: 15px; white-space: pre-wrap;"><br /></div>Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-43667208878399551792020-06-05T13:23:00.000-07:002020-06-05T13:23:27.862-07:00Power BI Desktop Model – Connect from SSMS and Export more than 30,000 rows<div dir="ltr" style="text-align: left;" trbidi="on">
This video shows the way of connecting to Power BI Desktop Model from SQL Server Management Studio and using it for various operations. Additionally this shows how to get data saved into csv files using SSMS when number of records exceeds 30,000.<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/5vV9iMpuePg/0.jpg" frameborder="0" height="466" src="https://www.youtube.com/embed/5vV9iMpuePg?feature=player_embedded" width="520"></iframe></div>
<br /></div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-78090644862958655472020-06-05T13:20:00.001-07:002020-06-05T13:20:48.863-07:00Azure Databricks – Enabling Databricks CLI for Azure Portal and Windows<div dir="ltr" style="text-align: left;" trbidi="on">
This video shows the way of installing and configuring Azure Databricks CLI for Azure Portal (Cloud Shell) and Windows.<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/2xaGOqr_LPo/0.jpg" frameborder="0" height="466" src="https://www.youtube.com/embed/2xaGOqr_LPo?feature=player_embedded" width="520"></iframe></div>
<br /></div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-59051729956753667552020-06-05T13:18:00.000-07:002020-06-05T13:18:40.110-07:00Azure Data Factory - Accessing a Databricks Notebook with Input and Output Parameters<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">This video shows the way of accessing Azure Databricks Notebooks through Azure Data Factory. Additionally, it explains how to pass values to the Notebook as parameters and how to get the returned value from Notebook to Data Factory Pipeline.</span><br />
<span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;"><br /></span>
<br />
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/njUiDmUyN6c/0.jpg" frameborder="0" height="466" src="https://www.youtube.com/embed/njUiDmUyN6c?feature=player_embedded" width="520"></iframe></div>
<span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;"><br /></span></div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-48819523421791454702020-05-11T06:05:00.000-07:002020-05-11T06:05:20.863-07:00Coronavirus (Covid-19) Dashboard solution with Power BI<div dir="ltr" style="text-align: left;" trbidi="on">
If you are interested in #covid-19 statistics, check this #dashboard out. This has been developed using #powerbi, #azuresqldatabase and #azuredatafactory.<br />
<br />
http://coronavirusexplorer.com/<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEifQLq_8T7i6CW5Sp32kR7xfBsKroZN5CuAYbsfISA8KxeeYuW5MOnOptiTokjXcfY3AwuaLC254RSekqCPJWDI1CzthJrOw2YUCNBJMn8OkLeSZsePRdABt_PgUUVkSxl8CnnxPHhtNtdx/s1600/Coronavirus-Explorer-Dashboard.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="1258" data-original-width="1600" height="500" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEifQLq_8T7i6CW5Sp32kR7xfBsKroZN5CuAYbsfISA8KxeeYuW5MOnOptiTokjXcfY3AwuaLC254RSekqCPJWDI1CzthJrOw2YUCNBJMn8OkLeSZsePRdABt_PgUUVkSxl8CnnxPHhtNtdx/s640/Coronavirus-Explorer-Dashboard.png" width="640" /></a></div>
<br />
<br /></div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-22887951565496674242020-04-19T04:36:00.000-07:002020-04-19T04:36:18.201-07:00Azure Databricks - Accessing Data Lake using Azure Active Directory Credentials<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">This video discusses the way of accessing Azure Data Lake Gen 2 through Azure Databricks, using Azure Active Directory Credentials. Following are discussed;
</span><br />
<ul style="text-align: left;">
<li><span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">Ways of Accessing ADLS Gen 2</span></li>
<li><span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">Enabling Azure Data Lake Credential Passthrough</span></li>
<li><span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">Demo: Accessing ADLS Gen 2 in Azure Databricks</span></li>
<ul>
<li><span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">Creating an Azure Databricks workspace</span></li>
<li><span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">Configuring Standard Cluster for AAD Credentials</span></li>
<li><span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">Configuring High Concurrency Cluster for AAD Credentials</span></li>
</ul>
</ul>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/VOqwjRdfGvQ/0.jpg" frameborder="0" height="360" src="https://www.youtube.com/embed/VOqwjRdfGvQ?feature=player_embedded" width="480"></iframe></div>
<div>
<br /></div>
</div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-6260869324623081482020-04-19T04:32:00.000-07:002020-04-19T04:32:42.155-07:00Azure Databricks - Accessing Data Lake - Using a Service Principal<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">This video discusses the ways of accessing Azure Data Lake Gen 2 in Azure Databricks, specifically using a Service Principal. Following are discussed in detail;
</span><br />
<ul style="text-align: left;">
<li><span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">Ways of accessing Azure Data Lake Gen 2</span></li>
<li><span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">Creating a Service Principal for accessing Azure Data Lake</span></li>
<li><span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">Access using Role-based access control</span></li>
<li><span style="background-color: #f9f9f9; color: #030303; font-family: "roboto" , "arial" , sans-serif; font-size: 14px; white-space: pre-wrap;">Access using ACL-based access control</span></li>
</ul>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/odlf3wXBSpY/0.jpg" frameborder="0" height="360" src="https://www.youtube.com/embed/odlf3wXBSpY?feature=player_embedded" width="480"></iframe></div>
<div>
<br /></div>
</div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-35976586115893323142020-04-08T21:19:00.000-07:002020-04-08T21:19:20.620-07:00Sending Emails from Azure SQL Database - YouTube Video<div dir="ltr" style="text-align: left;" trbidi="on">
This video focuses on sending emails for operations related to Azure SQL databases. Following are discussed and demonstrated;<br />
<br />
<ul style="text-align: left;">
<li>Possibilities of tracking changes in Azure SQL Database for sending emails</li>
<li>Setting up an Azure SendGrid account</li>
<li>Setting up an Azure Logi Apps for sending emails</li>
</ul>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/JVfPq5GJKqI/0.jpg" frameborder="0" height="366" src="https://www.youtube.com/embed/JVfPq5GJKqI?feature=player_embedded" width="470"></iframe></div>
<div>
<br /></div>
</div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-4559566599301767502020-04-08T21:14:00.000-07:002020-04-08T21:14:43.717-07:00Data Science with SQL Server Machine Learning Services - YouTube Video<div dir="ltr" style="text-align: left;" trbidi="on">
This video discusses performing data science experiments in SQL Server using Python. Setting up the environment, training, storing models and consuming trained models stored in the database are discussed with a demonstration.<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/47uceTJkLPk/0.jpg" frameborder="0" height="366" src="https://www.youtube.com/embed/47uceTJkLPk?feature=player_embedded" width="470"></iframe></div>
<br /></div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-63511940188054925012020-04-08T21:11:00.000-07:002020-04-08T21:11:05.017-07:00Automating Resume and Pause of Azure Analysis Services - YouTube Video<div dir="ltr" style="text-align: left;" trbidi="on">
This video discusses how to automate starting and stopping Azure Analysis Services using Azure Automation Account. Following are demonstrated;<br />
<div>
<ul style="text-align: left;">
<li>Create Azure Automation Account</li>
<li>Import libraries required</li>
<li>Create a PowerShell Runbook</li>
<li>Schedule the Runbook</li>
</ul>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/PZ7io8ck2b4/0.jpg" frameborder="0" height="366" src="https://www.youtube.com/embed/PZ7io8ck2b4?feature=player_embedded" width="470"></iframe></div>
<div>
<br /></div>
</div>
</div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-68459719014673350352020-03-21T13:01:00.000-07:002020-03-21T13:01:12.323-07:00Power BI App for seeing Coronavirus - COVID-19 updates in Sri Lanka<div dir="ltr" style="text-align: left;" trbidi="on">
<div style="text-align: justify;">
Here is an Azure site built for showing updates related to Coronavirus - COVID-19, specifically for Sri Lanka.</div>
<div style="text-align: justify;">
<br /></div>
<div style="text-align: justify;">
This has been designed using Azure Data Factory, Azure SQL Database, Power BI and Azure App Services.</div>
<div style="text-align: justify;">
<br /></div>
<div style="text-align: justify;">
<div class="separator" style="clear: both; text-align: center;">
<a href="http://coronasl.azurewebsites.net/" target="_blank"><img alt=" Coronavirus COVID-19 - Sri Lanka - Update" border="0" data-original-height="1060" data-original-width="1600" height="422" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj6qHfAJ-wx9bSRaBhuMs9G8_8GQ4aiP45I-jf4NmJgLqAWVCFpc9mEvCi4DxBqdqewhIxGMl6q-UiJNr7VpFDDuH7SNrv8mnhNRlRLNzx17FFQgdHOohohm0P8ZuLA85Bh2EhrIDHy165I/s640/Coronavirus-Dashboard-SriLanka.jpg" width="640" /></a></div>
<br /></div>
</div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-35150564755335752032019-04-02T21:10:00.000-07:002019-04-02T21:10:19.300-07:00Azure Databricks - What, Why & How - YouTube Video<div dir="ltr" style="text-align: left;" trbidi="on">
Here is the first video on Azure Databricks. This talks about;<br />
<br />
<ul style="text-align: left;">
<li>Why we need to Azure Databricks for processing data</li>
<li>What is Azure Databricks</li>
<li>Demo: How to provision an Azure Databricks workspace, a cluster, a database and a table.</li>
</ul>
<div>
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/oLGRsuxpVMs/0.jpg" frameborder="0" height="366" src="https://www.youtube.com/embed/oLGRsuxpVMs?feature=player_embedded" width="470"></iframe>
</div>
<div>
<br /></div>
<div>
<br /></div>
</div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-15146117765934222372019-02-18T09:28:00.003-08:002019-02-18T09:28:52.432-08:00Creating Paginated Reports with Power BI<div dir="ltr" style="text-align: left;" trbidi="on">
Here is a video on Power BI Paginated reports. This videos discusses/demonstrates;<br />
<br />
<ul style="text-align: left;">
<li>What is a paginated report?</li>
<li>Power BI support on paginated reports</li>
<li>Power BI configuration for paginated reports</li>
<li>Creating a paginated report using Report Builder</li>
<li>Publishing a paginated report sourced to local database, to Power BI portal.</li>
</ul>
<div>
Here is the video:</div>
<div>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/hnA-X-4JL4Y/0.jpg" frameborder="0" height="366" src="https://www.youtube.com/embed/hnA-X-4JL4Y?feature=player_embedded" width="470"></iframe></div>
<br /></div>
</div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-13657872360335874322018-07-03T10:13:00.001-07:002018-07-03T10:13:54.579-07:00Azure Data Lake Analytics - Accessing External Data Sources with USQL<div dir="ltr" style="text-align: left;" trbidi="on">
This video discusses the way of accessing external data sources such as Azure SQL Database with USQL as external data sets. It explains why we need it, what objects should be created for accessing external sources and how external data can be accessed in USQL codes.<br />
<br />
Watch and see!<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/Deie9tZtqUI/0.jpg" frameborder="0" height="366" src="https://www.youtube.com/embed/Deie9tZtqUI?feature=player_embedded" width="470"></iframe></div>
<br /></div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-55017031965768084832018-06-24T18:46:00.000-07:002018-06-24T18:46:06.236-07:00Azure Data Factory V2 - Lookup and ForEach Activities<div dir="ltr" style="text-align: left;" trbidi="on">
Here is my third video on Azure Data Factory. This video discusses and demonstrates;<br />
<br />
<ul style="text-align: left;">
<li>Why we need iteration in ETLs</li>
<li>Lookup Activity</li>
<li>ForEach Activity</li>
<li>Demo: Iterating over a data collection using ForEach Activity, with data loaded from Lookup Activity</li>
</ul>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/ROq5mVrZPY0/0.jpg" frameborder="0" height="366" src="https://www.youtube.com/embed/ROq5mVrZPY0?feature=player_embedded" width="470"></iframe></div>
<div>
<br /></div>
</div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-30403732790871875372018-02-01T20:56:00.000-08:002018-02-01T20:56:01.909-08:00Azure Data Factory V2 - Creating a Pipeline using Author-Tab<div dir="ltr" style="text-align: left;" trbidi="on">
<div style="text-align: justify;">
Here is another video on Azure Data Factory V2. This video explains how to create a Pipeline manually, using Author-Tab. This video discusses and demonstrates;</div>
<div style="text-align: justify;">
</div>
<ul>
<li>How to create Linked Services manually</li>
<li>How to create Datasets manually</li>
<li>How to create a Pipeline and add Activities</li>
<li>And how to schedule the Pipeline</li>
</ul>
<div>
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/IAqJ6nCDtGc/0.jpg" frameborder="0" height="366" src="https://www.youtube.com/embed/IAqJ6nCDtGc?feature=player_embedded" width="470"></iframe></div>
<div>
<br /></div>
<div>
<br /></div>
<div>
<br /></div>
<br />
<div style="text-align: justify;">
<br /></div>
</div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-73992241119665821102018-01-25T10:43:00.000-08:002018-01-25T10:43:24.337-08:00Azure Data Factory V2 - Copying On-Premise SQL Server data to Azure Data Lake Store<div dir="ltr" style="text-align: left;" trbidi="on">
<div style="text-align: justify;">
Azure Data Factory has been enhanced significantly with V2 and its support on Cloud-ETL-and-ELT is excellent now. First version of it was not much user-friendly but now it is not that difficult to implement ETL solutions with V2.</div>
<div style="text-align: justify;">
<br /></div>
<div style="text-align: justify;">
This video discusses;</div>
<div style="text-align: justify;">
</div>
<ul>
<li>Why we need Azure Data Factory</li>
<li>What is Azure Data Factory</li>
<li>How it works and how it should be used</li>
<li>Integration Runtime - installing for connecting with sources</li>
<li>Copying On-Premise SQL Server Data to Azure Data Lake using Data Factory</li>
</ul>
<br />
<div style="text-align: justify;">
Here is the video;</div>
<div style="text-align: justify;">
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/KrB2JcTu21w/0.jpg" frameborder="0" height="366" src="https://www.youtube.com/embed/KrB2JcTu21w?feature=player_embedded" width="470"></iframe></div>
<div style="text-align: justify;">
<br /></div>
<div style="text-align: justify;">
Here are some sample screens;</div>
<div style="text-align: justify;">
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhnmCfbCrjRLje4_fArq5lJY1b_aZLqVhOgdUe5vKUYTYn9rYHmDEYpRvB_ORCrudMU5gXp9m3pwD24JEVJ1chcdc8RLITXz885skAegKi2kb6fXxtbb3tZpTGAz4GpGiWysTmoSdqjdLLl/s1600/How+it+works.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="900" data-original-width="1600" height="360" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhnmCfbCrjRLje4_fArq5lJY1b_aZLqVhOgdUe5vKUYTYn9rYHmDEYpRvB_ORCrudMU5gXp9m3pwD24JEVJ1chcdc8RLITXz885skAegKi2kb6fXxtbb3tZpTGAz4GpGiWysTmoSdqjdLLl/s640/How+it+works.png" width="640" /></a></div>
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjnfZbDkEktwMFRt2V2U3DFt06mVcn2vTwGfa3Qlo-4ygT9m9kxM5NpkufOqkAjifeItigvbfICd8WD1lXrbTfK1fFPP6v_kpOLmIzZ5nWsY3Amgvf0hY_Rd4Z2XiVN-PnPxIlB1pLgfiNW/s1600/Azure+Integration+Runtime.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="900" data-original-width="1600" height="360" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjnfZbDkEktwMFRt2V2U3DFt06mVcn2vTwGfa3Qlo-4ygT9m9kxM5NpkufOqkAjifeItigvbfICd8WD1lXrbTfK1fFPP6v_kpOLmIzZ5nWsY3Amgvf0hY_Rd4Z2XiVN-PnPxIlB1pLgfiNW/s640/Azure+Integration+Runtime.png" width="640" /></a></div>
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi2lhfAOsZ44FpX3KNlFW0XbZ7-j6WAH_IGbjb1Q5k0obFYZOMaMwoDTS3mV-p1YDcfKTwWd4_8ND2b2QKaIAHjooqjOcRvXvGdhrp0L4-qux-W0cI5kzoA2TFswjUrIcAK0AvlByWCxMDu/s1600/Azure+Data+Factory+V2.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="856" data-original-width="1600" height="342" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi2lhfAOsZ44FpX3KNlFW0XbZ7-j6WAH_IGbjb1Q5k0obFYZOMaMwoDTS3mV-p1YDcfKTwWd4_8ND2b2QKaIAHjooqjOcRvXvGdhrp0L4-qux-W0cI5kzoA2TFswjUrIcAK0AvlByWCxMDu/s640/Azure+Data+Factory+V2.png" width="640" /></a></div>
<div style="text-align: justify;">
<br /></div>
<div style="text-align: justify;">
<br /></div>
</div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-1295960536212573802018-01-15T18:39:00.000-08:002018-01-15T18:39:22.395-08:00Introduction to Azure Data Lake Analytics - and basics of U-SQL<div dir="ltr" style="text-align: left;" trbidi="on">
I made another video on Azure Data Lake, specifically on Azure Data Lake Analytics. This is a 40-minutes video and it discusses following items along with demonstrations;<br />
<br />
<ul style="text-align: left;">
<li>What is Azure Data Lake Analytics</li>
<li>Data Lake Architecture and how it works</li>
<li>Comparison between Azure Data Lake Analytics, HDInsight and Hadoop for processing Big Data.</li>
<li>What is U-SQL and basics of it.</li>
<li>Demo on <i>How to create an Azure Data Lake Analytics account</i></li>
<li>Demo on <i>How to execute a simple U-SQL using Azure Portal</i></li>
<li>Demo on <i>How to extract multiple files, transform using C# methods and referenced assembly, making multiple results with bit complex transformations using Visual Studio</i>.</li>
</ul>
<div>
Here is the video.</div>
<div>
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/T0ZB1_oQ2MU/0.jpg" frameborder="0" height="366" src="https://www.youtube.com/embed/T0ZB1_oQ2MU?feature=player_embedded" width="470"></iframe></div>
<div>
<br />
<br /></div>
</div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0tag:blogger.com,1999:blog-3739073232502260520.post-81932711340901327152018-01-04T20:58:00.000-08:002018-01-04T20:58:27.220-08:00Introduction to Azure Data Lake Store - Does it replace the Data Warehouse?<div dir="ltr" style="text-align: left;" trbidi="on">
<div style="text-align: justify;">
I have made a video on Azure Data Lake and Azure Data Lake Store and published in YouTube. This video explains <i>What is Azure Data Lake, Its Characteristics, Components of it, How it works, Usage, Comparison between Data Lake Store and Blob Storage, </i><b style="font-style: italic;">Modern Data Warehousing and How can we use Azure Data Lake with modern data warehousing</b>.</div>
<div style="text-align: justify;">
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/pjHcGanZpDw/0.jpg" frameborder="0" height="366" src="https://www.youtube.com/embed/pjHcGanZpDw?feature=player_embedded" width="420"></iframe></div>
<div style="text-align: justify;">
<br /></div>
<div style="text-align: justify;">
<br /></div>
<div style="text-align: justify;">
Have a look on it and let me know you thoughts or questions you have.</div>
<div style="text-align: justify;">
<br /></div>
</div>
Dinesh Priyankarahttp://www.blogger.com/profile/03528311189201964690noreply@blogger.com0