Data Warehousing

Why Data Warehouse Projects Fail

Why Data Warehouse Projects Fail

Data warehouse projects are among the most visible and expensive initiatives an organization can undertake. Sadly, they are also among the most likely to fail. At one time, Gartner reported that more than 50% of data warehouses would fail to make it to user acceptance. Because of the size of investment (both time and money) required, the success of such…


SQL Server 2016 Service Pack 1 Changes Everything

Earlier today, Microsoft announced the release of Service Pack 1 (SP1) for SQL Server 2016. Pay close attention to this announcement, because this is not a typical update. Service Pack 1 unlocks most all of the programmability features found in Enterprise Edition, making them available in lower-cost (and even free) editions of SQL Server. Folks, this is a huge change…


Data Warehouse

Webinar on Change Tracking for Data Warehouse Loads

Join me online on Tuesday, November 15th at 1:00PM as I host a webinar entitled “Managing Data Warehouse Incremental Loads with SQL Server Change Tracking”. In this webinar, I’ll discuss the essentials of incremental loads, and will introduce SQL Server change tracking. I’ll talk about how change tracking can be used in data warehouse load scenarios, and will show several…


Podcast Interview: Is the On-Premises Data Warehouse Dead?

Recently I’ve been talking a lot with clients and others about the involvement of cloud architecture in a data warehouse design. In fact, this topic was the focus of my most recent Data Geek newsletter publication. A few weeks ago, I had the pleasure of being interviewed by my friend Carlos Chacon for the SQL Data Partners podcast, during which…


Change Tracking for Data Warehouse Loads (Webinar)

For data warehouse professionals, data change detection is is a central part of what we do. Accurately detecting new, changed, and deleted records means the difference between doing an expensive truncate-and-reload operation versus a smaller, faster incremental load. SQL Server change tracking, a feature first introduced in SQL Server 2008, allows detection of changed data – including inserts, updates, and…


Webinar: Change Tracking for Data Warehouse Loads

For data warehouse professionals, change detection is critical. Accurately detecting new, changed, and deleted records means the difference between doing an expensive truncate-and-reload operation versus a smaller, faster incremental load. This is especially important as the volume of information stored in data warehouses continues to grow. SQL Server change tracking, a feature first introduced in SQL Server 2008, allows detection…


We don't trust this data

We Don’t Trust This Data

“Learning to trust is one of life’s most difficult tasks.” –  Isaac Watts As data professionals, there are times when our jobs are relatively easy. Back up the databases. Create the dashboard report. Move the data from flat files to the database. Create documentation. There are lots of cogs in those machines, but an experienced technologist will have little trouble…


The Key to Successful Analysis

The Key to Successful Analysis

The key to successful analysis is to ask enough good questions. How do you know that you’ve asked enough questions? When you think you have all the information you need to get started, ask 10 more good questions. Those ten questions will lead to five more, which will lead to 3 more, and so on. After you get started, if…


Null, empty string, or zero?

The answer: It Depends. One of the more common problems I encounter when managing data quality, especially in an ETL process, is the proper handling of null, empty string, or zero values. When I put on my preaching shoes to talk about bad data, this is one the areas I have to spend a lot of time covering because it…


Best of PASS Summit 2014: Building Bullet-Resistant SSIS Packages

This week, PASS announced the Best of PASS Summit 2014, a collection of the 10 highest-rated sessions from last fall’s PASS Summit in Seattle. I was pleasantly surprised to learn that my session, “Building Bullet-Resistant SSIS Packages”, was among these. All of these sessions (including lots of other content) are available for viewing on the PASS TV channel on YouTube….