Hulver's site || Beware the Admins

Diaries
Everything
Who's Online?
FAQ / Help

A Day in the Life

Working life

By ReallyEvilCanine (Fri Jan 12, 2007 at 04:48:15 AM EST) A Day in the Life, database, make room, transaction logs, pie (all tags)

It's Friday. It's almost time for me to go home. There wasn't going to be an entry today but then...

Ticket# 20070112-ACC22:
YOU GUYS SUCK! OUR SYSTEM IS DOWN!!! PRIO-1! PRIO-1!!! FIX IT NOW!!!

Nothing's being written. All transactions are failing. But they can read everything...

x-posted to da brog.



SQLError         Statement       0        2007-01-12 04:16:51       UPDATE dbo.APP_REQUEST

    SET

    STATUS = ?,

    ACTL_START_DT = ?,

    LAST_UPD_BY = ?,

    LAST_UPD = ?

    WHERE ROW_ID = ? AND STATUS = 'QUEUED'
GenericLog    GenericError    1    2007-01-12 04:16:51    [Microsoft][ODBC SQL Server Driver][SQL Server]The log file for database 'ixsblpr' is full. Back up the transaction log for the database to free up some log space.

GenericLog    GenericError    1    2007-01-12 04:16:51    Message: Error: An ODBC error occurred,

Additional Message: pfNativeError: 9002; szSQLState: 37000;

szErrorMsg: [Microsoft][ODBC SQL Server Driver][SQL Server]The log file for database 'ixsblpr' is full. Back up the transaction log for the database to free up some log space.

Over and over and over. A few hundred megs of our server logs filled with the same message.

They have no more space on their database hard drives (or at least in the transaction logs), but we're the suck-meisters.

A Prio-1 has been resolved and closed inside 15 minutes.
Root Cause 17:Fuckwit.

< American Beauty moment | BBC White season: 'Rivers of Blood' >

Login

Related Links

- da brog
- ReallyEvilCanine's Diary

Comment Controls

A Day in the Life | 12 comments (12 topical, 0 hidden) | Trackback

WTF? by TurboThy (2.00 / 0) #1 Fri Jan 12, 2007 at 04:56:17 AM EST

Do people actually write "YOU PEOPLE SUCK" in an honest-to-ISG paid support ticket?
__
Sommerhus til salg, første række til Kattegat.

And if so... by ayrlander (2.00 / 0) #2 Fri Jan 12, 2007 at 05:12:41 AM EST

Do users actually expect support people to want to respond to this type of request properly, as opposed to going all BOFH on them? "Okay, I fixed your disk space problem, you should be good to go." "Aaaaargh, my hard drive's empty!" "Have a nice day <click>."

[ Parent ]

Not as such by ReallyEvilCanine (4.00 / 1) #3 Fri Jan 12, 2007 at 05:20:31 AM EST

They write much more tediously.

"This is the second time we've experienced a major loss of our entire production system this week. Such losses cost us over $150,000 per hour which we expect your sales people to contact us about in regards to remuneration for the continued failure of your software to deliver as promised. The incompetence of your support is resulting in our need to keep our administrators here longer hours and we see no end to this. We have grave concerns about this software and the competency of those servicing it."

Not cut and pasted, but not too far off the mark. Fuckwits. Like software support gives a shit. Just the details, ma'am. That's why we limit the description field on all tickets. Unfortunately some decide to post updates and really let loose with a good rant. Too bad they're so identifiable that I can't possibly use those for entries.

the internet: amplifier of stupidity -- discordia

[ Parent ]

Write a tedious reply by anonimouse (2.00 / 0) #6 Fri Jan 12, 2007 at 07:00:43 AM EST

Disk space costs much less than $150k. Go and buy some.

Girls come and go but a mortgage is for 25 years -- JtL

[ Parent ]

That's what we said by ReallyEvilCanine (4.00 / 1) #8 Fri Jan 12, 2007 at 07:34:19 AM EST

Amongst ourselves.

the internet: amplifier of stupidity -- discordia

[ Parent ]

Not disk space by R Mutt (2.00 / 0) #10 Fri Jan 12, 2007 at 08:00:20 AM EST

The SQL server transaction log is limited by default to a certain maximum size.

There's an "automatically grow file" checkbox, though I've not been able to get it to work myself.

[ Parent ]

How-to by ReallyEvilCanine (2.00 / 0) #11 Fri Jan 12, 2007 at 09:24:25 AM EST

In Enterprise Manager, right-click the database.
Go to the Transaction Log tab.
Halfway down is the Automatically grow file" checkbox.
Under that is the option to grow based on size or percent.

They ran out of space on the drive.

the internet: amplifier of stupidity -- discordia

[ Parent ]

: Yes, I know how to click the box by R Mutt (2.00 / 0) #12 Fri Jan 12, 2007 at 09:40:44 AM EST

But it still seems to just run out of space again a couple of days later.
It probably works normally and is something to do with the setup... not really bothered since it's just a test server.

[ Parent ]

To be fair by R Mutt (2.00 / 0) #4 Fri Jan 12, 2007 at 05:21:53 AM EST

That is a nasty error message if you're not a DBA and don't know SQL server.

Obviously the first thing that you do is go to the transaction log in Enterprise Manager, and try to back it up and delete it.

Which of course you can't do, because the transaction log is full.

You have to run:
BACKUP LOG database_name WITH TRUNCATE_ONLY
...from a SQL window, since it's one of those bits of functionality that they've never bothered to put in the GUI.

thats what happens when you by ReallyEvilCanine (2.00 / 0) #5 Fri Jan 12, 2007 at 05:59:26 AM EST

only hire point-and-click "DBAs". Anyone with basic DBA training should be able to work that one out, especially when 100M of logs have the same message over and over. You can even look up the solution at MS.

the internet: amplifier of stupidity -- discordia

[ Parent ]

Or by R Mutt (4.00 / 1) #7 Fri Jan 12, 2007 at 07:21:13 AM EST

Lay off all the DBAs entirely, since they don't produce anything and are hence of no benefit to the company.

/me crosses fingers and hopes nothing goes wrong with the databases that googling with site:microsoft.com can't diagnose...

[ Parent ]

: Getting an error mesg by cam (4.00 / 4) #9 Fri Jan 12, 2007 at 07:43:40 AM EST

that isn't well addressed in a google search is like death now. "Surely I cant be the first to get this error?"
cam
Freedom, liberty, equity and an Australian Republic
[ Parent ]

A Day in the Life | 12 comments (12 topical, 0 hidden) | Trackback