I Think Our 2 a.m. Problem is Fixed!

JennaGlatzer · Sep 7, 2006

We'll see tonight. A tech support person told me that it's not our nightly backups causing the bad glitches that have been happening every night (er, morning) at 2 a.m. ET, but rather, our log files, which are also processed at that time and are huge. She set it up to delete the log files nightly, and thinks that this will fix our glitchiness. Let me know over the next couple of days how it runs for you at that time!

poetinahat · Sep 7, 2006

Thanks, Jenna -- that fixes my 4PM problem!

JennaGlatzer · Sep 7, 2006

I sure hope so. Report back and let me know.

A. Hamilton · Sep 7, 2006

Ohh yay! 11 p.m (pst) is about my most active time here.

Deleted member 42 · Sep 7, 2006

But umm . . . don't you want the logs?

These are the Web logs, you realize, about the visitors to the site.

MacAllister · Sep 7, 2006

Uh huh. And information like when the server was down, and for how long...I'm also a bit perplexed that processing the log files should gobble available resources that way. That seems a bit off.

JennaGlatzer · Sep 7, 2006

Well, first, I've... um... never looked at the logs. Ever. Don't even know how. But this was the second note from the tech person:

"Once the logs are ran and it gathers up the # of visitors and other stats, there's nothing left to look at, but what's been happening is the log file has just been growing and it still has days and weeks of stats that have already been processed in your stats program.

I think that might have been a cause."

So I think what she's saying is that it's saving all this raw data, but we have the logs in the stats files, so we don't need all the raw data (more than 2 gigs of it in the past couple of weeks).

MacAllister · Sep 7, 2006

Good lord--two gigs is rather a LOT of raw data.

Deleted member 42 · Sep 7, 2006

Every time a visitor arrives at the site their data (where from, when, what they clicked on, what they looked at, how long, what hardware and software they're using) is added to the end of a file.

A new file is started every day.

No one, I mean no one, has a single continuous log file.

Normally, a cron job compresses the previous day's logs into a Unix version of a compressed file, called a tar file.

And umm . . . the fact that the host hadn't noticed this doesn't reflect well.

Perks · Sep 7, 2006

Hey, will this effect the CP loading problem some of us are having? I'm thinking 'no' but hope springs eternal.

Dawno · Sep 7, 2006

I will probably be on around 11 pacific time, which is when all the glitchiepoo stuff happens to me, and I'll letcha know how it goes.

Dawno · Sep 7, 2006

So far so good - by now I'm usually giving up and going to bed.

poetinahat · Sep 7, 2006

Good here too so far.

Patricia · Sep 7, 2006

Good here. But mine doesn't usually start until later. I'm not getting the usual before the glitch boots. I've been able to stay on longer tonight. I had a real problem with the old sight but this one has been better.

I've thought for a long time it was my PC's or server, but apparently not, according to my tech.

A. Hamilton · Sep 7, 2006

Oh it's much better for me tonight.

JennaGlatzer · Sep 7, 2006

Me too! Hooray!

And Perks, nope, if it had fixed the User CP problem, it would have been immediate.

L M Ashton · Sep 8, 2006

I had problems at 4pm my time, but to convert that to EST... Um, 5:30 am EST. So, it's not a you problem but more than likely a lousy Sri Lankan internet connection problem.

KTC · Sep 8, 2006

I had problems at 630am...but I can't convert time. I have a hard enough problem keeping my own zone in context.

Jo · Sep 8, 2006

I had the usual 4pm (AU) problems about three hours ago (around 6pm local time--4am ET?). Pages were loading slowly (and not at all), although refreshing brought them up.

ChunkyC · Sep 8, 2006

We're still bound to experience slowdowns during the backup, but it does appear that this tweak has eliminated a significant part of the problem.

Deleted member 42 · Sep 8, 2006

Sound's like it mostly improved.

Patricia · Sep 8, 2006

Yes, things were much, much better. I didn't get locked out at all.

JennaGlatzer · Sep 10, 2006

WHAT THE... ?!

Ugh. Tell me now we have a 6 a.m. problem instead.

I've been trying and trying to post for the past 26 minutes, and it's been error filled and slow, just like it usually is at 2.

Deleted member 42 · Sep 10, 2006

Chunky do you know how to log in via the Shell and get a list of currently running processes?

ChunkyC · Sep 10, 2006

I have shell access, no problem. But as for processes ... um ... *thumbs through UNIX for Dummies for arcane command & syntax*...found it. Currently showing bash and the ps command.

This was happening around 6 a.m. eastern, right Jenna? I'm gonna hafta get up at 4 in the morning my time, aren't I?

I Think Our 2 a.m. Problem is Fixed!

wishes you happiness

say it loud

wishes you happiness

here for a minute...catch me?

Deleted member 42

'Twas but a dream of thee

wishes you happiness

'Twas but a dream of thee

Deleted member 42

delicate #!&@*#! flower

Shiny!

Shiny!

say it loud

California Dreaming

here for a minute...catch me?

wishes you happiness

crazy spec fic writer

Stand in the Place Where You Live

Travelling the re-write road

It's hard being green

Deleted member 42

California Dreaming

wishes you happiness

Deleted member 42

It's hard being green