PDA

View Full Version : MJ12 stats frozen


ToshPower
11-02-2006, 05:12 AM
Sorry if I'm bringing up something already known to you guys, but my dearly beloved MJ12 stats are not updating :cry:

And this while we are seriously slapping ass :spank:

:rock:
Bok
11-02-2006, 06:50 AM
There seems to be some problem getting the data from the mj12 site. I'll get in touch with them and see what is going on...

Bok
ToshPower
11-02-2006, 06:53 AM
There seems to be some problem getting the data from the mj12 site. I'll get in touch with them and see what is going on...

Bok

Perhaps it has something to do with this?

http://www.majestic12.co.uk/forum/viewtopic.php?t=2258
Bok
11-02-2006, 07:39 AM
Quite possibly..

I've emailed Alex about it. The csv files he produces for me are not there.

Phil
ToshPower
11-02-2006, 07:53 AM
Quite possibly..

I've emailed Alex about it. The csv files he produces for me are not there.

Phil

Allrightie, thanks for the efford!
Bok
11-02-2006, 12:05 PM
I'm in contact with Alex over at MJ12, it's very odd as I can do a wget on the files ok, but when getting them via LWP in perl it gets a not-found. I suspect the webserver has been altered to block this type of request. Alex is working on it...

Bok
ToshPower
11-02-2006, 12:35 PM
We'll wait and see.

Another strange thing is the difference in the stats on the MJ12 page and those of FDC.

On MJ12 page I got around 9 mil. urls more than on FDC stats. No biggie, just strange. Was planning to scream I reached top 100, but with your stats that's gonna take another 3 days or so. If you are bored maybe you can look into it ;)
Ken_g6[TA]
11-02-2006, 12:42 PM
I'm in contact with Alex over at MJ12, it's very odd as I can do a wget on the files ok, but when getting them via LWP in perl it gets a not-found. I suspect the webserver has been altered to block this type of request. Alex is working on it...

BokWell, in that case, you could do:
my $/;
undef $/;
open IN, "wget -O- $addr |" or die "WGet failed.";
$html = <IN>;
close IN;Right?:D
CaptainMooseInc
11-02-2006, 12:50 PM
Tosh,

The reason for it being about 9mil behind is because the stats have been frozen for days. Alex has them working on his end again but he outputs special files for Bok which Bok uses to generate his stats. Once Bok can get his stats server to pull the files successfully again (not his fault, but rather Alex's hosting provider's fault) then all should be back to normal. You'll probably just see a HUGE spike in your URLs that you've done for 1 day as it's Bok's server playing catchup.

Alex said it may be up to a week before he can switch hosting providers so we'll just have to sit and wait.

-Jeff
Bok
11-02-2006, 01:16 PM
They are fixed...

Alex counldn't retrieve them either with the LWP code I was using, but we tried some slightly different LWP using a different user agent and it works. /shrug, no idea why..

Ken,
yes that would most likely work also. Normally I find it's the other way around and wget commands are blocked rather than LWP :) Which is why the scripts are coded with LWP

Bok :cheers:
ToshPower
11-02-2006, 01:19 PM
A great! Thought stats where just frozen one day. Good job Bok!
ToshPower
11-13-2006, 05:53 AM
MJ12 stats are a little bit broken.

Seems everyone has been kicked from their team :o
Bok
11-13-2006, 06:42 AM
I'm guessing they have changed the HTML I parse. I'll take a look at it later today.

Bok
Bok
11-13-2006, 08:51 AM
Well, I have no idea what went wrong. At a guess, the stats I parse from screwed up over night. But this did highlight a bug in my script where I wasn't updating the team except on change of date. Corrected that, reverted to a backup and reran and they are ok now.

Bok