“Andy made my job easy with his refreshing balance of effective communications, solid technical skills, sound judgment, gentle humor, and good people practices. It was a pleasure working for Andy Leonard.”
About
I write books about data technology, SSIS, and Azure Data Factory. I deliver data…
Services
Activity
-
Check out on the HLS Blog “Technical Walkthrough: Deploying a SQL DB like it's Terraform”
Check out on the HLS Blog “Technical Walkthrough: Deploying a SQL DB like it's Terraform”
Liked by Andy Leonard
-
What tools do you use to review error logs? How often are you reviewing them? #sqlserver #seroshield #dba #remotedba #sqltips
What tools do you use to review error logs? How often are you reviewing them? #sqlserver #seroshield #dba #remotedba #sqltips
Liked by Andy Leonard
-
I’ve had to do this a few times in the past. Some companies don’t deserve me. Not saying I was all that and a bag of chips, but some interviews were…
I’ve had to do this a few times in the past. Some companies don’t deserve me. Not saying I was all that and a bag of chips, but some interviews were…
Liked by Andy Leonard
Experience
-
-
-
-
-
-
-
-
-
-
-
-
-
Licenses & Certifications
Volunteer Experience
-
Volunteer
Torch Missions
- Present 12 years 10 months
Poverty Alleviation
Worked with a team of volunteers at Hope for Honduras to serve families by helping to construct homes and deliver food.
-
Volunteer
Torch Missions
- Present 10 years 10 months
Poverty Alleviation
Worked with a team of volunteers at Hope for Honduras to serve families by helping to construct homes and deliver food.
-
Volunteer
Torch Missions
- Present 9 years 10 months
Poverty Alleviation
Worked with a team of volunteers at Hope for Honduras to serve families by helping to construct homes and deliver food.
Publications
-
Data Integration Life Cycle Management with SSIS
Apress
See publicationBuild a custom BimlExpress framework that generates dozens of SQL Server Integration Services (SSIS) packages in minutes. Use this framework to execute related SSIS packages in a single command. You will learn to configure SSIS catalog projects, manage catalog deployments, and monitor SSIS catalog execution and history.
-
The Biml Book
Apress
Learn Business Intelligence Markup Language (Biml) for automating much of the repetitive, manual labor involved in data integration. We teach you how to build frameworks and use advanced Biml features to get more out of SQL Server Integration Services (SSIS), Transact-SQL (T-SQL), and SQL Server Analysis Services (SSAS) than you ever thought possible.
The first part of the book starts with the basics―getting your development environment configured, Biml syntax, and scripting…Learn Business Intelligence Markup Language (Biml) for automating much of the repetitive, manual labor involved in data integration. We teach you how to build frameworks and use advanced Biml features to get more out of SQL Server Integration Services (SSIS), Transact-SQL (T-SQL), and SQL Server Analysis Services (SSAS) than you ever thought possible.
The first part of the book starts with the basics―getting your development environment configured, Biml syntax, and scripting essentials.
Whether a beginner or a seasoned Biml expert, the next part of the book guides you through the process of using Biml to build a framework that captures both your design patterns and execution management. Design patterns are reusable code blocks that standardize the approach you use to perform certain types of data integration, logging, and other key data functions. Design patterns solve common problems encountered when developing data integration solutions. Because you do not have to build the code from scratch each time, design patterns improve your efficiency as a Biml developer.
In addition to leveraging design patterns in your framework, you will learn how to build a robust metadata store and how to package your framework into Biml bundles for deployment within your enterprise.
In the last part of the book, we teach you more advanced Biml features and capabilities, such as SSAS development, T-SQL recipes, documentation autogeneration, and Biml troubleshooting.
The Biml Book:
Provides practical and applicable examples
Teaches you how to use Biml to reduce development time while improving quality
Takes you through solutions to common data integration and BI challenges
What You'll Learn
Master the basics of Business Intelligence Markup Language (Biml)
Study patterns for automating SSIS package generation
Build a Biml Framework
Import and transform database schemas
Automate generation of scripts and projects
Other authors -
-
Building Custom Tasks for SQL Server Integration Services
Apress
See publicationLearn to build custom SSIS tasks using Visual Studio Community Edition and Visual Basic. Bring all the power of Microsoft .NET to bear on your data integration and ETL processes, and for no added cost over what you’ve already spent on licensing SQL Server. If you already have a license for SQL Server, then you do not need to spend more money to extend SSIS with custom tasks and components.
Why are custom components necessary? Because even though the SSIS catalog of built-in tasks…Learn to build custom SSIS tasks using Visual Studio Community Edition and Visual Basic. Bring all the power of Microsoft .NET to bear on your data integration and ETL processes, and for no added cost over what you’ve already spent on licensing SQL Server. If you already have a license for SQL Server, then you do not need to spend more money to extend SSIS with custom tasks and components.
Why are custom components necessary? Because even though the SSIS catalog of built-in tasks and components is a marvel of engineering, there do remain gaps in the functionality that is provided. These gaps are especially relevant to enterprises practicing Data Integration Lifecycle Management (DILMS) and/or DevOps.
One of the gaps is a limitation of the SSIS Execute Package task. Developers using the stock version of that task are unable to select SSIS packages from other projects. Yet it’s useful to be able to select and execute tasks across projects, and the example used throughout this book will help you to create an Execute Catalog Package task that does in fact allow you to execute a task from another project. Building on the example’s pattern, you can create any task that you like, custom tailored to your specific, data integration and ETL needs.
What You Will Learn:
Configure and execute Visual Studio in the way that best supports SSIS task development
Create a class library as the basis for an SSIS task, and reference the needed SSIS assemblies
Properly sign assemblies that you create in order to invoke them from your task
Implement source code control via Visual Studio Team Services, or your own favorite tool set
Code not only your tasks themselves, but also the associated task editors
Troubleshoot and then execute your custom tasks as part of your own project -
SQL Server 2012 Integration Services Design Patterns
Apress
SQL Server 2012 Integration Services Design Patterns is a book of recipes for SQL Server Integration Services (SSIS). Design patterns in the book show how to solve common problems encountered when developing data integration solutions. Because you do not have to build the code from scratch each time, using design patterns improves your efficiency as an SSIS developer. In SSIS Design Patterns, we take you through several of these snippets in detail, providing the technical details of the…
SQL Server 2012 Integration Services Design Patterns is a book of recipes for SQL Server Integration Services (SSIS). Design patterns in the book show how to solve common problems encountered when developing data integration solutions. Because you do not have to build the code from scratch each time, using design patterns improves your efficiency as an SSIS developer. In SSIS Design Patterns, we take you through several of these snippets in detail, providing the technical details of the resolution.
Other authors -
-
SQL Server MVP Deep Dives, Volume 2
Manning
SQL Server MVP Deep Dives, Volume 2 is a unique book that lets you learn from the best in the business - 64 SQL Server MVPs offer completely new content in this second volume on topics ranging from testing and policy management to integration services, reporting, and performance optimization techniques...and more.
Other authors -
-
SQL Server MVP Deep Dive Volume 2
Manning Publications
This book is all about SQL Server, but not an ordinal book about SQL Server from begin to end or on special aspect of SQL Server. This book covers 5 major topics of SQL Server ( Architecture and Design, Administration, Database Development, Performance Tuning and Optimization, and Business Intelligence ). Over 50 SQL Server MVPs contributed in writing this book.
I also wrote a chapter in the BI section of this book on SSIS with this title:
Exploring Different Types of Enumerators in…This book is all about SQL Server, but not an ordinal book about SQL Server from begin to end or on special aspect of SQL Server. This book covers 5 major topics of SQL Server ( Architecture and Design, Administration, Database Development, Performance Tuning and Optimization, and Business Intelligence ). Over 50 SQL Server MVPs contributed in writing this book.
I also wrote a chapter in the BI section of this book on SSIS with this title:
Exploring Different Types of Enumerators in the SSIS Foreach Loop ContainerOther authors -
-
SQL Server MVP Deep Dives
Manning
This is not an ordinary SQL Server Book. SQL Server MVP Deep Dives brings together the world's most highly-regarded SQL Server experts to create a masterful collection of tips, techniques, and experience-driven best practices for SQL Server development and administration.
Other authors -
-
Professional Software Testing with Visual Studio 2005 Team System
Wrox
Covering all phases of the development lifecycle, this book shows readers how to implement best practices for software testing using the appropriate components of VSTS.
Other authors -
-
Professional SQL Server 2005 Integration Services
2006
This book will help you get past the initial learning curve quickly so that you can get started using SSIS to transform data, create a workflow, or maintain your SQL Server.
Other authors -
Honors & Awards
-
Microsoft Data Platform MVP 2020-2021
Microsoft
Honored and humbled to be re-awarded Data Platform Most Valued Professional (MVP) by Microsoft for 2020-2021. MVP Profile: https://mvp.microsoft.com/en-us/PublicProfile/5003377
-
Microsoft MVP
Microsoft
2007 - 2012: SQL Server MVP
2019 - 2020: Data Platform MVP -
BimlHero
Varigence
from https://varigence.com/Blog/Post/65...
The program has been designed to ensure that Biml Heroes can effectively use Biml to create real-world, production quality business intelligence and data warehousing solutions. Unlike some certification programs, you won't earn a certification by just sitting in a class for a few hours. In order to become a Biml Hero, you'll need to attend eight hours of advanced training. Then you'll then have to pass a comprehensive test on Biml as well as submit…from https://varigence.com/Blog/Post/65...
The program has been designed to ensure that Biml Heroes can effectively use Biml to create real-world, production quality business intelligence and data warehousing solutions. Unlike some certification programs, you won't earn a certification by just sitting in a class for a few hours. In order to become a Biml Hero, you'll need to attend eight hours of advanced training. Then you'll then have to pass a comprehensive test on Biml as well as submit a production quality code sample and case study detailing how you implemented a data solution with Biml.
Organizations
-
Professional Association for SQL Server (PASS)
-
- Present
Recommendations received
-
LinkedIn User
13 people have recommended Andy
Join now to viewMore activity by Andy
-
Today is Data Engineering Friday! Join me right here on LinkedIn at 12:00 PM ET as I add even more instrumentation to application and application…
Today is Data Engineering Friday! Join me right here on LinkedIn at 12:00 PM ET as I add even more instrumentation to application and application…
Shared by Andy Leonard
-
Felt cute. Might eat trash later. Oh, and you can hire me for writing developer tutorials, videos, software projects, graphic design, and even silly…
Felt cute. Might eat trash later. Oh, and you can hire me for writing developer tutorials, videos, software projects, graphic design, and even silly…
Liked by Andy Leonard
-
Quantum Software: As Important As The Hardware Explore Quantinium's groundbreaking work in quantum computing, focusing on both hardware and software.…
Quantum Software: As Important As The Hardware Explore Quantinium's groundbreaking work in quantum computing, focusing on both hardware and software.…
Liked by Andy Leonard
-
🐰✨ Easter Bunny has come early! Looks like repositories are coming to BigQuery 🚀🎉 #bigquery #gcp #sql
🐰✨ Easter Bunny has come early! Looks like repositories are coming to BigQuery 🚀🎉 #bigquery #gcp #sql
Liked by Andy Leonard
Other similar profiles
Explore more posts
-
Adilson Lopes
Are you running SQL Server 2014? SQL Server 2014 will reach end of support (EOS) July 9, 2024. The EOS event presents an opportunity to evaluate migrating and modernizing SQL Server workloads to Amazon Web Services (AWS) for enhanced operational excellence and innovation velocity. Join this webinar, tomorrow April 30th at 1pm EDT, to learn more. Yogi Barot Frank Wang
2 Comments -
Rich King
For all my Snowflake using connections out there: what's your CI/CD setup like? We're considering a number of options for deploying code to our data lake (Snowflake) and I'd like to understand what other folks out there are doing. We'd be managing more than just tables and views, but also tasks, stored procedures, stages, pipes, streams, etc. - What's your setup? - What are the pros and cons? If you've used Snowflake in the past, what have you seen work well? Thanks in advance! #snowflake #data #datalake #healthcare #versioncontrol #cicd #deployment #release
7 Comments -
5minsnowflake Newsletter
Converting JSON data to actionable insights is a common challenge for many working with large datasets. This article provides a valuable framework for effectively utilizing Snowflake’s capabilities to transform raw data into meaningful analytics. The author lays out practical steps for enhancing data processing, including leveraging SQL queries and integrating powerful data visualization tools. Utilizing these resources can significantly streamline your analysis, making sense of complex data much easier. By adopting these strategies, teams can not only save time but also uncover deeper insights that drive data-informed decision-making. It’s a great reminder of how mastering tools like Snowflake can elevate your data capabilities. What are your own strategies for working with JSON data? Share your experiences in the comments. #Snowflake #DataScience #JSON #DataAnalytics #CloudComputing https://lnkd.in/gbvRW4xJ
-
Ayan Chakraborty
AWS and Databricks??!! I think the below diagram explains it simply: But we need to understand one thing, even al these diagram looks pretty simple, they are high-level. Once you start working on it hands-on, you will feel the challenges and that's the fun working as a data guy.. Isn't it?
-
Dustin Dorsey
The Nashville Data Engineering Group is hosting a special meetup with Fivetran and dbt Labs next week on Thursday, June 27th! This event is totally free and will be in-person at the Vaco offices in Brentwood from 5:30 to 7:30pm. This is an exciting opportunity to meet other local data professionals and learn more about a couple of the most popular tools in data engineering right now and the problems they are solving. For more info and to register please check out the comments! #NashDataEng #DataEngineering #NashvilleTech
3 Comments -
MotherDuck
🚨 Is your data engineering workflow holding you back? 🚨 MotherDuck and Dagster Labs are teaming up to discuss the secrets of modern data engineering. We'll cover: - Crafting an end-to-end data platform with Bluesky data, MotherDuck, and Dagster - Proactively solving problems with "shift-left" testing to catch issues early - Practical automation strategies to streamline your workflow and boost productivity 📅 January 14th ⏰ 9:00 AM PT ☑️ Registration link in the comments
1 Comment -
InterWorks
In today’s #TechnicalTuesday article, Chris Hastie walks you through how to establish your own connections from Snowflake to the Matillion ETL API to trigger jobs. To be more specific, Chris shows you: ❄️ How external access in Snowflake works 🌐 How to configure an outbound network rule 🔗 How to set up an external access integration 🔒 How to attach optional security components: secrets for a Matillion ETL API ⚙️ How to trigger Matillion ETL jobs in a stored procedure Why is this important? This stored procedure could be beneficial in various scenarios, such as: ⏰ Triggering a job as part of a scheduled task 🔄 Triggering a job as part of a wider set of stored procedures 📥 Triggering a job when a stream detects new data from a snowpipe Read the full step-by-step guide below. https://lnkd.in/ggnvQBXu
1 Comment -
Viaduct
Analytics teams face real technical challenges when building predictive models on #connectedvehicle data. But often the biggest hurdle isn't technical – it's an unclear definition of success. When business and analytics teams don’t speak the same language, they waste time and resources trying to solve poorly-defined problems with arbitrary success metrics. Our latest blog post offers a helpful framework (with concrete examples) to crisply define your business challenge and link it to an analytical approach. Link in the comments. ⬇
1 Comment -
Andy Leonard
My course deliveries change each time I present the course. Monday's delivery of A Day of Fabric Data Factory will include a demo on Trigger functionality for data pipelines, which is in preview. If you're reading this before 24 Jun 2024, there's still time to register for this delivery. If not, I'm delivering A Day of Fabric Data Factory in July and again in August. Learn more at the link in the comments. #fabric #training #datafactory
3 Comments -
CloudyData
Decoding Data Integration: ETL vs. ELT Dive into the nuances of data integration as we unravel the distinctions between ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) methodologies. This article explores the benefits, use cases, and considerations for each approach, empowering readers to make informed decisions when designing their data workflows. Whether you're a seasoned data architect or just starting your journey in data management, this comparative analysis sheds light on the optimal strategies for processing and leveraging your organization's valuable data assets. Pdf credit goes to respective owner Follow for more resources #ETL #ELT #Data #Analytics
-
Kyla Faust
Are you looking to streamline your data management processes and tackle technical debt head-on? Check out the latest blog from our Perficient Databricks Champion, David Callaghan where we delve into the powerful capabilities of Databricks system tables. Don’t let technical debt hold back your innovation! Dive into the blog and unlock the full potential of your data infrastructure. 📊 https://lnkd.in/eQpxuV-B #DataManagement #Databricks #BigData #Innovation #Perficient
-
5minsnowflake Newsletter
What factors should you consider when choosing between Snowflake and BigQuery for your data warehousing needs? The decision isn't just about performance; it involves understanding your team's expertise, the types of data workflows you manage, and how these platforms align with your organization's goals. This article provides a detailed comparison of both technologies, highlighting their unique features and capabilities. It’s essential to recognize the strengths and weaknesses of each platform, as this could significantly impact your data strategies and outcomes. Whether you're a data scientist, developer, or business leader, having the right tools can make all the difference in extracting value from your data. I encourage everyone to reflect on their experiences with these platforms. Which one fits better for your projects, and why? #Snowflake #BigQuery #DataWarehousing #DataScience #CloudComputing #TechCommunity https://lnkd.in/gTzh8QCF
-
Sync Computing
New feature alert! Users can now enable "Worker instance recommendations" to start optimizing both the # of workers and now the worker size (e.g. .2xlarge --> .4xlarge) for Databricks jobs clusters 🎯 In tandem with "auto-apply," all users have to do is enable and walk away. Gradient will do all the heavy lifting. 🔥 This addition to our search space provides even more optimization opportunities for our users 🌈 This is for both Amazon Web Services (#AWS) and Microsoft #Azure We've already gotten great feedback from our users, and this is just the beginning. Learn more in our recent release notes: https://hubs.ly/Q02wyqH80
-
Dalton Ruer
I love the fact that I get to share super technical information in incredibly fun ways. How do I do it? I'm glad you asked ... in this post I used an analogy of a very old childhood game, Hungry Hungry Hippos, to illustrate how end-users can be "information hungry" and how Qlik can be used to satisfy those needs. If you take the time, here is what you will get out of it: ● Learn about the IntervalMatch function in Qlik 💡. This function can be used to solve various use cases, including staffing and financial accounting. ● Discover how to create a master calendar in Qlik 📅. This can be a valuable tool for analyzing time and attendance data. ● See how to join data from different tables in Qlik 🔗. This is a key skill for any Qlik developer. ● Learn how to avoid Cartesian joins 🚫. These can be a performance killer in Qlik. https://lnkd.in/gnpbrH88
2 Comments -
5minsnowflake Newsletter
Exploring the fundamentals of dbt with Snowflake can open new doors for enhancing your data transformation processes. Did you know that incorporating dbt can streamline your workflows and improve your team's productivity? In this article, we cover key concepts and practical applications, equipping you with the knowledge to implement dbt efficiently. The integration of these technologies not only enhances your data management strategies but also fosters a collaborative environment within your team. What implications do you see for your own projects by leveraging dbt with Snowflake? We’d love to hear your thoughts and insights on the subject. #DataScience #MachineLearning #CloudTechnology #Snowflake #dbt #DataAnalytics https://lnkd.in/gb5RuN5y
-
Reid Havens 🧙🏻♂️
📢 IN A FEW MINUTES - Join Alex Barbeau and I next TODAY Friday May 17th @ 9:30 AM (PT)! 🧱 Are you working with Power BI, and your organization is using Azure Databricks, but you don't know where or how to start using an Open Data Lakehouse? 🔎 In this demo focused presentation, Alex Barbeau will show practical tips and tricks for Power BI admins and developers to get started and succeed in using Databricks. ℹ️ From how to login to Databricks, the differences in Warehouse types, how to interact with the Hive Catalog and Unity Catalog, you'll leave this presentation with the information you need to get started on Databricks from Power BI. #PowerBI #Microsoft #Fabric #Azure #Databricks
1 Comment -
Tom Coffing
A cumulative sum is a running total of values progressively increasing or accumulating over time or across a dataset. This blog teaches you how to get subtotals and grand totals. https://lnkd.in/egMNvmZ6 #ibm #netezza #ibmcloud #aws #awscloud #azurecloud #googlecloud #oraclecloud #db2 #ibmdb2
Explore collaborative articles
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
Explore MoreOthers named Andy Leonard in United States
-
Andy Leonard
Getting more done before 5:00am than most people do all day!
-
Andy Leonard
Senior Contracts Manager at Amazon
-
Andy L.
-
Andy Leonard
An honest meal makes its own friends.
298 others named Andy Leonard in United States are on LinkedIn
See others named Andy Leonard