Print Story A Day in the Life
Working life
By ReallyEvilCanine (Wed May 09, 2007 at 02:49:22 AM EST) A Day in the Life, Charlie Root, WTF (all tags)

I got into the office to see $BigFoods had filed a Prio-1 ticket. One of their idiot users managed to delete the root admin. Now while you can't delete Charlie Root in UNIX & Linux, we're dealing with a database. An administrator with write privileges can delete any damned thing he wants. Restoring this isn't easy but can be done. I know it can be done because at least once a month some company sends in a Prio-1 ticket because this has happened.

Who the fuck gives root database and application admin access to goddamned call center monkeys? $BigFoods does. And why? I almost fell out of my chair when I read the response.

x-posted to da brog, sans another cartoon babes poll.

I sent the guy my standard response about how to fix the problem. There is one way which doesn't work:
      1) Recreate the administrator user

This can't work for much the same reason that you don't rename root in operating systems from California and Finland so that you can have a normal user named root.

There are two ways which do work:
      1) Restore from back-up.
      2) Follow complicated process dependent on ensuring that our rules about base tables data weren't broken

The second option is the better of the two. Unfortunately few ever follow our demands to leave the fucking base tables and data the fuck alone. They'll add extension columns, new rows, triggers, whatever they can think of. They'll base intersection tables on certain variable positions of those base tables. They're idiots. I can't make up the shit they do because no one in his right mind would ever think to do such a thing. Who the hell puts an index on the primary key column, stores that to a M:M table, then uses that table for keyed searches? (Answer: Roberto from $CarCorp.)

So the first one is usually the better choice. In order to prevent the loss of work since the last back-up (circa 1998), we also tell them they can edit redo logs to remove the deletions and then apply.

Nope. "Our DBA is away and our back-up DBA isn't sure about working with redo logs. We need you to assist us."

The database is sitting on AIX. I can't connect to do any sort of teleconferencing so that I can actually see what's going on and I'd have to talk my way through this with a DBA who can probably find his ass with both hands in a best of three. It woulda been a case of the blind leading the fuckwitted. As I was trying to figure out how to say this in reply which wouldn't get my manager's attention I got a follow-up response.


we restored successfully the DB until the Time point before the users deletion. now the environment is up running. We had to full restore because user deleted many more peoples.

I just stared at the screen. There are about 12,000 seats at this place and one of those fuckwit ell-users deleted the admin and then a load of other users? I couldn't let it go. I had to ask.
Joe, I'm glad the system is back up and running. I strongly advise you find out why this user had admin rights and remove them. Your administrator should also evaluate the security permissions and settings for all users, both within the application and at the database level. Love, REC
Ask a stupid question...

"All users have administrative access. After an employee survey and discussion groups, the consultants explained that employee morale was being hampered by the previous heavy lock-down on the system. We agreed to conditionally lift the lock-down conditional on employee productivity remaining at or above the previous level. Productivity has in fact increased some 10% over the past six months."

Uh-huh... right up until one of those monkeys deleted the fucking administrator and half his cow-orkers, costing you a few hours' data across the entire center.

I'll bet those lost 10,000 man-hours or so still didn't cost you as much as what those "consultants" reamed you for. Root access for phone operator and data-entry monkeys so that they feel empowered? Root Cause: 17-Fuckwit.

I wonder if I could get them to pay me to come in and feng shui their server room.

< Things to note | BBC White season: 'Rivers of Blood' >
A Day in the Life | 9 comments (9 topical, 0 hidden) | Trackback
HAHAHAAAAA!!! AAAHAHAHAHAHAHAHAHAAAAA!!! by greyrat (4.00 / 2) #1 Wed May 09, 2007 at 03:04:27 AM EST

OK. You win. Your (work) life sucks more than mine. HAHAHAHAHAHAHAHAHAAAAAA!!

Do, do, do do-do do do by Cloaked User (2.00 / 0) #2 Wed May 09, 2007 at 03:08:02 AM EST
If you've seen the episode where Bubbles gets pissed off at the Professor and the other two girls for treating her like a wimp, then there can be only one answer.

This is not a psychotic episode. It is a cleansing moment of clarity.
Rights by Herring (2.00 / 0) #3 Wed May 09, 2007 at 03:46:24 AM EST
Back when Crap Corp were fairly new to Notes, we had a couple of instances where Important People would take a replica of a database onto their laptop to do some work off line. "This is a bit slow" they though "Ah, that'll be because of the 12,000 documents I'm not interested in. I'll delete them." Of course, when they replicated back to the server, they had Important People's Access Rights.

And, also predictably, IT got blamed for "allowing this to happen".

A mate of mine worked on Notes stuff there. He hard coded one user's name into a DB once. The guy was head of training but he kept deleting training courses so he was left with super-user access, but explicitly blocked from deleting anything.

You can't inspire people with facts
- Small Gods

DENY is probably my all-time favourite permission by ReallyEvilCanine (2.00 / 0) #5 Wed May 09, 2007 at 04:11:29 AM EST
Unless, you know, some fucker applies it to my account.

the internet: amplifier of stupidity -- discordia

[ Parent ]
(Comment Deleted) by yicky yacky (4.00 / 8) #4 Wed May 09, 2007 at 03:56:04 AM EST

This comment has been deleted by yicky yacky

I like the way deleted comments by greyrat (4.00 / 2) #6 Wed May 09, 2007 at 05:12:27 AM EST
keep accumulating 4's.

[ Parent ]
Sounds like a job for my new book by joh3n (2.00 / 0) #7 Wed May 09, 2007 at 09:55:10 AM EST
'Feng Shui:  On the Attack'

I am a crime against humanity

I bet by Herring (4.00 / 1) #8 Wed May 09, 2007 at 11:49:48 AM EST
if you did a book on feng shui for datacentres, fools would buy it. You could include bollocks about which operating systems/processor architectures were harmonious together and ...

back later.

You can't inspire people with facts
- Small Gods

[ Parent ]
I GET 10 PERCENT! by joh3n (2.00 / 0) #9 Wed May 09, 2007 at 02:38:17 PM EST

I am a crime against humanity

[ Parent ]
A Day in the Life | 9 comments (9 topical, 0 hidden) | Trackback