Artifact Statement Date String – YYYYMMDD (DT_WSTR, 4)(DATEPART(“YEAR”, GETDATE())) + RIGHT(“00” + (DT_WSTR, 4)(DATEPART(“MONTH”, GETDATE())), 2) + RIGHT(“00” + (DT_WSTR, 4)(DATEPART(“DAY”, GETDATE())), 2) Time String – HHMMSS RIGHT(“00” + (DT_WSTR, 4)(DATEPART(“HOUR”, GETDATE())), 2) + RIGHT(“00” + (DT_WSTR, 4)(DATEPART(“MINUTE”, GETDATE())), 2) + RIGHT(“00” + (DT_WSTR, 4)(DATEPART(“SECOND”, GETDATE())), 2)
SharePoint lists are popular and simple tools for storing modestly-sized discrete sets of data. SQL Server Integration Services (SSIS) includes a source component to allow reading data from SharePoint lists. In this post, I’ll demonstrate how to use SSIS to read from a SharePoint list using the OData source. SharePoint lists A SharePoint list is a simple collection of related…
A few years back, I wrote a blog post about using an SSIS object variable as a data flow source. In that post, I described how you could load a set of query results into an object-typed variable in SQL Server Integration Services and then use that in-memory data as a source within a data flow. In the comments and…
For the better part of 15 years, SQL Server Integration Services (SSIS) has been the go-to enterprise extract-transform-load (ETL) tool for shops running on Microsoft SQL Server. More recently, Microsoft added Azure Data Factory (ADF) to its stable of enterprise ETL tools. In this post, I’ll be comparing SSIS and Azure Data Factory to share how they are alike and…
I’m happy to announce the publication of my latest book. The SSIS Catalog: Install, Manage, Secure, and Monitor your Enterprise ETL Infrastructure is now available on Amazon in both paperback and Kindle formats. In this book, I introduce the reader to the SSIS catalog and describe how it fits into an enterprise ETL architecture. This book is, by design, narrowly…
SSIS parameters help to ease the process of passing runtime values to SSIS packages. For values that can change over time, using parameters in SSIS is an ideal means of externalizing those runtime values. In this post, I’ll demonstrate how to get started using SSIS parameters. What Problem Are We Solving? To understand the need for ETL parameters, let’s first…
The SSIS catalog is a system through which SQL Server Integration Services (SSIS) packages are stored, executed, and logged. Introduced with the release of SQL Server 2016, the SSIS catalog helps to better adapt Integration Services as an enterprise-ready ETL system. In this post, I’ll share a brief introduction to the SSIS catalog, as well as links to content on…
As anyone who reads my blog on a regular basis knows, I’m a big fan of using dynamic configurations, including SSIS parameters variables, to make my ETL architectures as flexible as possible. However, along with those dynamic behaviors comes the challenge of troubleshooting and debugging. Because variables and parameters do not have static values (by design), working your way through…
Visual Studio and its business intelligence variant SQL Server Data Tools share a very powerful but extremely busy interface. If you happen to close out of one of the tool windows by mistake, finding the right menu option to re-enable that window can take some practice. In this post, I’ll show you to to restore your missing SSIS toolbox. Restore…
This quick tip is likely to be the most brief of the entire collection, but is also one of the most practical. When testing SSIS packages during development in SQL Server Data Tools, it’s very common to run and re-run the same package numerous times. It’s fairly easy to stop and restart the package each time using the Stop and…