Sunday, October 4, 2020

Azure Synapse Analytics - Part I

 This video speaks about the latest in data warehousing and big data analytics: Azure Synapse Analytics. This is the first part of it and it explains;

- The way we have been creating on-premise data solutions
- The way we have been creating data solutions in Azure before Azure Synapse Analytics
- How we can create data solutions in Azure using Azure Synapse Analytics
- Quick demo on creating the workspace, SQL Pool, Spark cluster and accessing and processing data



Friday, June 5, 2020

Power BI Desktop Model – Connect from SSMS and Export more than 30,000 rows

This video shows the way of connecting to Power BI Desktop Model from SQL Server Management Studio and using it for various operations. Additionally this shows how to get data saved into csv files using SSMS when number of records exceeds 30,000.


Azure Databricks – Enabling Databricks CLI for Azure Portal and Windows

This video shows the way of installing and configuring Azure Databricks CLI for Azure Portal (Cloud Shell) and Windows.


Azure Data Factory - Accessing a Databricks Notebook with Input and Output Parameters

This video shows the way of accessing Azure Databricks Notebooks through Azure Data Factory. Additionally, it explains how to pass values to the Notebook as parameters and how to get the returned value from Notebook to Data Factory Pipeline.



Monday, May 11, 2020

Coronavirus (Covid-19) Dashboard solution with Power BI

If you are interested in #covid-19 statistics, check this #dashboard out. This has been developed using #powerbi, #azuresqldatabase and #azuredatafactory.

http://coronavirusexplorer.com/



Sunday, April 19, 2020

Azure Databricks - Accessing Data Lake using Azure Active Directory Credentials

This video discusses the way of accessing Azure Data Lake Gen 2 through Azure Databricks, using Azure Active Directory Credentials. Following are discussed;
  • Ways of Accessing ADLS Gen 2
  • Enabling Azure Data Lake Credential Passthrough
  • Demo: Accessing ADLS Gen 2 in Azure Databricks
    • Creating an Azure Databricks workspace
    • Configuring Standard Cluster for AAD Credentials
    • Configuring High Concurrency Cluster for AAD Credentials

Azure Databricks - Accessing Data Lake - Using a Service Principal

This video discusses the ways of accessing Azure Data Lake Gen 2 in Azure Databricks, specifically using a Service Principal. Following are discussed in detail;
  • Ways of accessing Azure Data Lake Gen 2
  • Creating a Service Principal for accessing Azure Data Lake
  • Access using Role-based access control
  • Access using ACL-based access control

Wednesday, April 8, 2020

Sending Emails from Azure SQL Database - YouTube Video

This video focuses on sending emails for operations related to Azure SQL databases. Following are discussed and demonstrated;

  • Possibilities of tracking changes in Azure SQL Database for sending emails
  • Setting up an Azure SendGrid account
  • Setting up an Azure Logi Apps for sending emails

Data Science with SQL Server Machine Learning Services - YouTube Video

This video discusses performing data science experiments in SQL Server using Python. Setting up the environment, training, storing models and consuming trained models stored in the database are discussed with a demonstration.


Automating Resume and Pause of Azure Analysis Services - YouTube Video

This video discusses how to automate starting and stopping Azure Analysis Services using Azure Automation Account. Following are demonstrated;
  • Create Azure Automation Account
  • Import libraries required
  • Create a PowerShell Runbook
  • Schedule the Runbook

Saturday, March 21, 2020

Power BI App for seeing Coronavirus - COVID-19 updates in Sri Lanka

Here is an Azure site built for showing updates related to Coronavirus - COVID-19, specifically for Sri Lanka.

This has been designed using Azure Data Factory, Azure SQL Database, Power BI and Azure App Services.

 Coronavirus COVID-19 - Sri Lanka - Update