Posted on

Big Data Clusters for the Absolute Beginner

I finally presented my first tech at SQL Saturday Sioux Falls and Baton Rouge. I decided to name my session, “Big Data Clusters for the Absolute Beginner” because beginning of 2019 I *was* the absolute beginner (and I’m learning every day!) So in a way, my session is “based on a true story” :) I’m super-excited because I think it’s the future of SQL Server. Big Data Clusters are new and cutting-edge technology.

Continue reading “Big Data Clusters for the Absolute Beginner”

Posted on

Deploy SQL Server Big Data Cluster Using Azure Data Studio Notebook

Yesterday was the release of SQL Server 2019 CTP 3.2. The biggest change in CTP 3.2 is that Big Data Clusters is now in public preview. That means anyone can go download and deploy it. Prior to CTP 3.2, you had to sign up for the “Early Adoption Program”, wait until you received an email with your Docker credentials, etc. With CTP 3.2, Microsoft has actually done away with Docker credentials. You no longer need that to create your Big Data Cluster as the images needed are on Microsoft’s public repo.

Continue reading “Deploy SQL Server Big Data Cluster Using Azure Data Studio Notebook”

Posted on

How to Setup SQL Server Big Data Cluster in Azure (AKS) – Part 4

This is part 4 of the “BDC series.” You can read part 1 here, part 2 here, and part 3 here. This blog post will go into the available monitoring tools available to monitor the health of your Big Data Cluster. If you’d like to stay updated, without doing the heavy work, feel free to register for my newsletter. I will email out blog posts of my journey down the wonderful road of BDCs.

[Updated for CTP 3.2] – There are kubectl commands and azdata commands to check the health of your cluster but I will focus on the Kubernetes Dashboard for this series. I will blog about some of the useful kubectl and mssqlctl commands in later posts.

Continue reading “How to Setup SQL Server Big Data Cluster in Azure (AKS) – Part 4”

Posted on

How to Setup SQL Server Big Data Cluster in Azure (AKS) – Part 3

This is part 3 of the “BDC series.” You can read part 1 here and part 2 here. This blog post will go into creating the Big Data Cluster on top of the Azure Kubernetes Service (AKS) cluster we created in Part 2. If you’d like to stay updated, without doing the heavy work, feel free to register for my newsletter. I will email out blog posts of my journey down the wonderful road of BDCs.

Before I get started I want to say that there are many ways to deploy a Big Data Cluster. There is a “Default configuration” way and a “Custom configuration” way. You can read more about the custom config way here. I will be posting blogs on the other ways to deploy a BDC but for the sake of this series I will be deploying the BDC via the default way. The BDC team at Microsoft is constantly revamping and tweaking the BDC deployment process in order to make it more streamline and easier.

Continue reading “How to Setup SQL Server Big Data Cluster in Azure (AKS) – Part 3”

Posted on

How to Setup SQL Server Big Data Cluster in Azure (AKS) – Part 2

This is part 2 of the “BDC series.” You can read part 1 here. This blog post will go into creating the Azure Kubernetes Service (AKS) cluster. If you’d like to stay updated, without doing the heavy work, feel free to register for my newsletter. I will email out blog posts of my journey down the wonderful road of BDCs.

Continue reading “How to Setup SQL Server Big Data Cluster in Azure (AKS) – Part 2”

Posted on

How to Setup SQL Server Big Data Cluster in Azure (AKS) – Part 1

If you’d like to stay updated, without doing the heavy work, feel free to register for my newsletter. I will email out blog posts of my journey down the wonderful road of BDCs.

So far, Microsoft does not have a simple way to create a Big Data Cluster. It’s a bit cumbersome of a process and the learning curve is a bit steep. However, Microsoft is currently working on making it easier to deploy a Big Data Cluster via Notebook in Azure Data Studio and eventually some type of “deployment wizard.” But for now, the only option is to do it the long way.

Continue reading “How to Setup SQL Server Big Data Cluster in Azure (AKS) – Part 1”

Posted on

How To Request vCPU Core Quota Increase in Azure

Recently I was in the process of creating a AKS cluster and encountered an error:

Operation failed with status: ‘Bad Request’. Details: Provisioning of resource(s) for container service myfirstcluster in resource group sqlresourcegroup failed.
Message: Operation results in exceeding quota limits of standardDSv2Family Cores. Maximum allowed: 20, Current in use: 0, Additional requested: 32.
Please read more about quota increase at https://aka.ms/ProdportalCRP/?#create/Microsoft.Support/Parameters/

Continue reading “How To Request vCPU Core Quota Increase in Azure”

Posted on

What Are SQL Server Big Data Clusters?

If you’d like to stay updated, without doing the heavy work, feel free to register for my newsletter. I will email out blog posts of my journey down the wonderful road of BDCs.

When I think of SQL Server 2019, I think of BIG DATA CLUSTERS. I remember first hearing the term and immediately thinking, “eh, what does that have to do with a Windows SQL DBA?” But the more I thought about it, the more I fell in love with it. And here’s why:

First: the entire market is shifting more and more towards the cloud. Whether you personally believe it or not, or like it or not, it is happening. In 3-5 years from now, majority of jobs on the market will require some level of cloud knowledge (Azure, AWS, etc.)

Second: over the past few version of SQL Server (2016+) it’s apparent that Microsoft is pushing SQL Server down the path of becoming “OS agnostic.” By that I mean it will no longer matter what the underlying OS is. Windows? Linux? Who cares? SQL Server will run on it all!

Third: Microsoft has a game plan and I want to play a part!

Continue reading “What Are SQL Server Big Data Clusters?”

Posted on

T-SQL Tuesday #115 – Dear 20 Year Old Self – Round Up

It was an absolute honor to host this month’s TSQL Tuesday. I decided on doing the “Dear 20 year old self” as a way for us to reflect on life. It seemed like this topic hit home with a lot of people. I enjoyed reading each one of the posts.

If you don’t find your post in this Round Up, please email me your link and I will update this post!

Continue reading “T-SQL Tuesday #115 – Dear 20 Year Old Self – Round Up”

Posted on

T-SQL Tuesday #115 – Dear 20 Year Old Self

Yesterday was my 41st birthday. Twenty years ago, I remember my best friend asking me, “Where do you see yourself when you’re 40?” My reply was something like, “I can’t see myself as a 40 year old.” For some weird reason my mind went blank at 40. It wasn’t like I thought I’d be dead by 40, but I remember thinking of 30 or 35, but not 40. Maybe because 40 was twice my age and just too “far into the future” to think about?! But in a “blink of an eye” here I am twenty-one years later. Funny enough, now I can see myself as an 80 year old. Weird.

Continue reading “T-SQL Tuesday #115 – Dear 20 Year Old Self”

Posted on

What is Azure Kubernetes Service (AKS)

Installing and deploying a Kubernetes cluster on-prem can be a pain in the arse. Especially if you are new to Kubernetes. That’s where a cloud provider like Microsoft’s Azure comes in handy. Instead of having to go through the arduous task of installing, setting up, configuring and deploying Kubernetes clusters, you can just use Microsoft’s AKS, or Azure Kubernetes Service, to quickly deploy clusters. That way you can focus on your organization’s mission critical issues, rather than worring about ongoing operations and maintenance of your Kubernetes cluster.

Continue reading “What is Azure Kubernetes Service (AKS)”

Posted on

Book Review – “The Kubernetes Book” by Nigel Poulton

As a SQL Server professional, I find it extremely exciting when new features come out. For example, when Microsoft launched SQL Server 2017, you could install it on Linux. SQL Server 2019 supports availability groups on containers in a Kubernetes cluster. Also in SQL Server 2019, there is the new Big Data Clusters feature, and guess what it uses for container orchestration? You guessed it, Kubernetes.

The average SQL Server DBA might not have much experience with setting up HA/DR solution utilizing Availability Groups, let alone installing it on Linux or figuring out the ins and outs of containers and Kubernetes. But for those who like to push themselves by learning new things and securing their future, this blog post is a review of a book by my friend Nigel Poulton (b | t), titled, “The Kubernetes Book.” Continue reading “Book Review – “The Kubernetes Book” by Nigel Poulton”