Results 1 to 14 of 14

Thread: MJ12 stats frozen

  1. #1

    MJ12 stats frozen

    Sorry if I'm bringing up something already known to you guys, but my dearly beloved MJ12 stats are not updating

    And this while we are seriously slapping ass

    Last edited by ToshPower; 11-02-2006 at 05:24 AM.
    Member of the DPC
    [DPC]Fokschaap that is !


  2. #2
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,452
    Blog Entries
    13
    There seems to be some problem getting the data from the mj12 site. I'll get in touch with them and see what is going on...

    Bok

  3. #3
    Quote Originally Posted by Bok
    There seems to be some problem getting the data from the mj12 site. I'll get in touch with them and see what is going on...

    Bok
    Perhaps it has something to do with this?

    http://www.majestic12.co.uk/forum/viewtopic.php?t=2258
    Member of the DPC
    [DPC]Fokschaap that is !


  4. #4
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,452
    Blog Entries
    13
    Quite possibly..

    I've emailed Alex about it. The csv files he produces for me are not there.

    Phil

  5. #5
    Quote Originally Posted by Bok
    Quite possibly..

    I've emailed Alex about it. The csv files he produces for me are not there.

    Phil
    Allrightie, thanks for the efford!
    Member of the DPC
    [DPC]Fokschaap that is !


  6. #6
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,452
    Blog Entries
    13
    I'm in contact with Alex over at MJ12, it's very odd as I can do a wget on the files ok, but when getting them via LWP in perl it gets a not-found. I suspect the webserver has been altered to block this type of request. Alex is working on it...

    Bok

  7. #7
    We'll wait and see.

    Another strange thing is the difference in the stats on the MJ12 page and those of FDC.

    On MJ12 page I got around 9 mil. urls more than on FDC stats. No biggie, just strange. Was planning to scream I reached top 100, but with your stats that's gonna take another 3 days or so. If you are bored maybe you can look into it
    Member of the DPC
    [DPC]Fokschaap that is !


  8. #8
    Former QueueMaster Ken_g6[TA]'s Avatar
    Join Date
    Nov 2002
    Location
    Colorado
    Posts
    184
    Quote Originally Posted by Bok
    I'm in contact with Alex over at MJ12, it's very odd as I can do a wget on the files ok, but when getting them via LWP in perl it gets a not-found. I suspect the webserver has been altered to block this type of request. Alex is working on it...

    Bok
    Well, in that case, you could do:
    Code:
    my $/;
    undef $/;
    open IN, "wget -O- $addr |" or die "WGet failed.";
    $html = <IN>;
    close IN;
    Right?
    Proud member of the friendliest team around, Team Anandtech!
    The Queue is dead! (Or not needed.) Long Live George Woltman!

  9. #9
    Tosh,

    The reason for it being about 9mil behind is because the stats have been frozen for days. Alex has them working on his end again but he outputs special files for Bok which Bok uses to generate his stats. Once Bok can get his stats server to pull the files successfully again (not his fault, but rather Alex's hosting provider's fault) then all should be back to normal. You'll probably just see a HUGE spike in your URLs that you've done for 1 day as it's Bok's server playing catchup.

    Alex said it may be up to a week before he can switch hosting providers so we'll just have to sit and wait.

    -Jeff
    Distributed Hold'em


  10. #10
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,452
    Blog Entries
    13
    They are fixed...

    Alex counldn't retrieve them either with the LWP code I was using, but we tried some slightly different LWP using a different user agent and it works. /shrug, no idea why..

    Ken,
    yes that would most likely work also. Normally I find it's the other way around and wget commands are blocked rather than LWP Which is why the scripts are coded with LWP

    Bok

  11. #11
    A great! Thought stats where just frozen one day. Good job Bok!
    Member of the DPC
    [DPC]Fokschaap that is !


  12. #12
    MJ12 stats are a little bit broken.

    Seems everyone has been kicked from their team
    Member of the DPC
    [DPC]Fokschaap that is !


  13. #13
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,452
    Blog Entries
    13
    I'm guessing they have changed the HTML I parse. I'll take a look at it later today.

    Bok

  14. #14
    Administrator Bok's Avatar
    Join Date
    Oct 2003
    Location
    Wake Forest, North Carolina, United States
    Posts
    24,452
    Blog Entries
    13
    Well, I have no idea what went wrong. At a guess, the stats I parse from screwed up over night. But this did highlight a bug in my script where I wasn't updating the team except on change of date. Corrected that, reverted to a backup and reran and they are ok now.

    Bok

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •