?

Log in

Previous Entry | Next Entry

File Under "Self-Inflicted Wounds"

Yesterday at work, we received an email from a former employee who left the firm about three months ago. Apparently, he was getting deluged with automated alert txt messages from our systems and wanted them to stop.

Digging into it, we were at first mystified: he's not in any of the recipient lists in our monitoring packages or even email distribution lists. He's not in the corporate directories or any other sources of record. Then we also realized that the messages were for systems we had decommissioned and removed from our monitoring tools. So where were these being generated?

After some considerable effort, we discovered that the bozo had:
1. created a monitoring script for his production environment which he didn't document;
2. the monitoring script wasn't folded into our suite of monitoring tools so it wasn't using our alert management & scheduling systems;
3. he was running this monitoring script for the prod env from a dev workstation, not the proper prod services;
4. he hard-coded his personal contact info into the script so that he alone would get the alerts.

In short, he created the very mess he was now complaining to us to have fixed for him, and he did it in the most incredibly unprofessional means possible.

While I'm sympathetic that his mobile is getting flooded with txt messages and costing him a bundle if he doesn't have unlimited messaging, my sympathy ends there. He built this mess for himself and I was sorely tempted to let him wallow in it a while longer as a lesson in how not to do things.

Tags:

Comments

( 3 comments — Leave a comment )
chrishansenhome
Dec. 10th, 2016 10:41 pm (UTC)
What an idiot.

The Register would probably love to write this one up. If you're not familiar with The Register, go have a look. I don't think there are any details that would tip people off as to where you work.

Edited at 2016-12-10 10:42 pm (UTC)
excessor
Dec. 11th, 2016 07:49 pm (UTC)
Do you ever write this stuff up and send it to your leadership team, contrasting how professional vs unprofessional IT people do things?
theoctothorpe
Dec. 12th, 2016 06:28 am (UTC)
oops… we can't seem to figure out how the messages are being sent ::shrug:: Oh well.

( 3 comments — Leave a comment )