Watching Yellow Boxes Sucks

Here’s a chance for the world to learn from my stupidity. Like that will be the first [1] time, eh?

Here I am, 9:35 PM, 2 hours past my regular bedtime. [2] 582,000 records processed so far. it’s been 3 hours, probably more. [3] And here I sit, watching yellow boxes, and waiting for an SSIS package to finish running.

Pretty, eh?

I’m testing some updates done by myself and some team members, and need to verify that the package can successfully complete. When it’s done, I need to test the next batch. And I need to have them all done tonight, because I’m taking off tomorrow.

But I don’t know how many rows are coming out of the data source!

And therein lies the problem. I forgot to check before I ran the package to see how many rows the source query will return with the new set of test data. It might be just a few more rows. It might be a few million.

So here is a tip from me to you: always test your source query before running your packages.

Because watching yellow boxes sucks.

Here I am, 9:50 PM. 621,000 records processed so far…

[1] Or last.

[2] I have small kids, what can I say?

[3] I’m pulling the data from a remote Oracle database on the other side of a VPN – LAN-local performance had better be a lot better than this, eh?

Advertisements

About ssimagine

My name is Matthew Roche, and I am a Senior Program Manager with the SQL Server product group at Microsoft. I work on Master Data Services and Data Quality Services, and have previously worked on SQL Server Integration Services. Although I work for Microsoft and will be posting on technical topics, I want to stress that this is a personal blog, and any opinions posted here are mine and mine alone. I built my career around SQL Server and Microsoft technologies for well over a decade before I joined Microsoft as an employee, and I plan on using this blog to share my personal experience and opinions. They may well be shaped by my experience on the SQL Server team, but they’re still mine, and not that of Microsoft, disclaimer, disclaimer, etc., etc..
This entry was posted in Uncategorized. Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s