Sorry if I'm bringing up something already known to you guys, but my dearly beloved MJ12 stats are not updating :cry:
And this while we are seriously slapping ass :spank:
:rock:
Printable View
Sorry if I'm bringing up something already known to you guys, but my dearly beloved MJ12 stats are not updating :cry:
And this while we are seriously slapping ass :spank:
:rock:
There seems to be some problem getting the data from the mj12 site. I'll get in touch with them and see what is going on...
Bok
Perhaps it has something to do with this?Quote:
Originally Posted by Bok
http://www.majestic12.co.uk/forum/viewtopic.php?t=2258
Quite possibly..
I've emailed Alex about it. The csv files he produces for me are not there.
Phil
Allrightie, thanks for the efford!Quote:
Originally Posted by Bok
I'm in contact with Alex over at MJ12, it's very odd as I can do a wget on the files ok, but when getting them via LWP in perl it gets a not-found. I suspect the webserver has been altered to block this type of request. Alex is working on it...
Bok
We'll wait and see.
Another strange thing is the difference in the stats on the MJ12 page and those of FDC.
On MJ12 page I got around 9 mil. urls more than on FDC stats. No biggie, just strange. Was planning to scream I reached top 100, but with your stats that's gonna take another 3 days or so. If you are bored maybe you can look into it ;)
Well, in that case, you could do:Quote:
Originally Posted by Bok
Right?:DCode:my $/;
undef $/;
open IN, "wget -O- $addr |" or die "WGet failed.";
$html = <IN>;
close IN;
Tosh,
The reason for it being about 9mil behind is because the stats have been frozen for days. Alex has them working on his end again but he outputs special files for Bok which Bok uses to generate his stats. Once Bok can get his stats server to pull the files successfully again (not his fault, but rather Alex's hosting provider's fault) then all should be back to normal. You'll probably just see a HUGE spike in your URLs that you've done for 1 day as it's Bok's server playing catchup.
Alex said it may be up to a week before he can switch hosting providers so we'll just have to sit and wait.
-Jeff
They are fixed...
Alex counldn't retrieve them either with the LWP code I was using, but we tried some slightly different LWP using a different user agent and it works. /shrug, no idea why..
Ken,
yes that would most likely work also. Normally I find it's the other way around and wget commands are blocked rather than LWP :) Which is why the scripts are coded with LWP
Bok :cheers:
A great! Thought stats where just frozen one day. Good job Bok!
MJ12 stats are a little bit broken.
Seems everyone has been kicked from their team :o
I'm guessing they have changed the HTML I parse. I'll take a look at it later today.
Bok
Well, I have no idea what went wrong. At a guess, the stats I parse from screwed up over night. But this did highlight a bug in my script where I wasn't updating the team except on change of date. Corrected that, reverted to a backup and reran and they are ok now.
Bok