team add request

hi bok...

please add "The Pirate Fleet" team to your OGR-27 project stats

http://stats.distributed.net/team/tm...=27&team=31857

thanks :thumbs:

Done.

And run manually, so they should propagate to live within the next 1/2 hour or so..

Bok :cheers:

maybe that's a time to add all teams to ogr27? what's the issue?

Some use password protection to prevent you from seeing the member list for that team.

Correct.

Plus it's a screen scraping exercise as no files are produced by dnet unfortunately.

Bok

well if can parse one page you can parse them all. it's just a matter of server load.

maybe top 50 teams??

No way would I crawl the whole lot. Dnet have already said NOT to. With top 50, again I'd hit password protected pages.

I should certainly rewrite the parser to drive from the team list rather than having it based on individual team-id's, it's not just not high on my 'intersting to do' list right now.

Bok

http://lists.distributed.net/piperma...il/041674.html

maybe changes on their side, like xml exporting will be better?

I don't really care what format it is in, as long as it was in single files. Parsing html is not fun and prone to errors anyway.

I've asked a few times for the same thing you are and been knocked back though :(

No reason not to keep trying mind :)

Bok

Yes pity some people don't realize the amount of trouble that others go to in order to update and keep stats running...

Well discussion clarify something

Nuno Rodrigues to D.net
show details Apr 24 (3 days ago)

Reply

I searched the .plans and found this:

http://n0cgi.distributed.net/cgi/dne...gi?user=thejet


Thanks to Simon T. we've got another XML export in our stable.
The Participant Summary page is now available as an XML export.
The new page can be reached at:

http://stats.distributed.net/partici...ummary_xml.php

The page takes the following arguments [as query string parameters]:
id = The participant ID
project_id = The project ID [25 == OGR-25, 8 == RC5-72]
show_friends = Include friend statistics in a <friends> element
show_neighbors = Include neighbor statistics in a <neighbors> element

An example can be seen here:
http://stats.distributed.net/partici...ow_neighbors=1

Hopefully over the next few weeks/months we'll get a more robust implementation to allow all of our statistics pages to be viewed in XML form, making life much easier for those 3rd party statistics web sites to grab their core data.

and another

The distributed.net stats used to have a "raw output" option that was
designed to make it simpler for web scrapers to pull their stats out
and work with them locally, but most of the raw pages were lost when
we migrated to the "next gen" stats system and have never been
replicated in the "new" codebase (now over five years old, I think).

That said...

http://cvs.distributed.net/viewvc.cgi/stats-html/

...the stats code is open source and if anyone wants to put the time
in to produce xml format output the contribution would be happily
accepted and put into production.

view-source:http://stats.distributed.net/partici...&project_id=27

Code:

---

<!-- WARNING: This code is experimental and the schema is subject to change at any time -->
<!--
API Documentation:
// Variables Passed in url:
// id == Participant ID
// project_id == Project ID
// show_friends == Show Friend Data
// show_neighbors == Show Neighbor Data
-->
<participant-summary id="469686" project="OGR-27" project-id="27" last-update="26-Apr-2009" >
    <name><![CDATA[Alain Kaeslin .COM]]></name>
    <motto><![CDATA[]]></motto>
    <stats>
        <stat name="rank-project" unit="" value="221" change="322"/>
        <stat name="rank-project-day" unit="" value="1" change="7" />
        <stat name="work-overall" unit="Gnodes" value="670825"/>
        <stat name="work-day" unit="Gnodes" value="446509"/>
        <stat name="work-first" unit="" value="2009-04-24"/>
        <stat name="work-last" unit="" value="2009-04-26"/>
        <stat name="days-working" unit="" value="3"/>
    </stats>
</participant-summary>

---

from html stats

Code:

---

Rank        Participant        First Unit        Last Unit        Days        Gnodes
1(7)        Alain Kaeslin .COM        24-Apr-2009        26-Apr-2009        3        446,509

---

That's been there for some time. It's only per user though (there is or was a team one too), so does not really help in getting full stats.

It would need to be expanded to do all users and have a teamid on too :)

Bok

http://stats.distributed.net/team/tm...php?team=26268

WHOOOP!

also if you wish you can make some changes in cvs

http://cvs.distributed.net/viewvc.cgi/stats-html/team/

http://stats.distributed.net/team/tm...php?team=26268

EVEN BETTER!

You can run grabber once for team = 1; i++; i < 100000
and then remove from final list all 404 errors or access denied responces.

There is no way on earth I would run something to do 100,000 page retrievals from dnet. They would (and rightly so) ban the ip address.

Until they provide a single file for stats, this is just not going to happen.

Bok

okay

There are 338 registered teams.
204 of them submitted work units yesterday.
(2 of them are brand new!)

you can retrieve only 338 xml pages. )))

hi bok... one more request to add our RC5-72 team...


http://stats.distributed.net/team/tm...d=8&team=31857

thanks...

Done and run,

should show up fairly soon...

Bok :cheers:

thanks, much appreciated... :thumbs:

Please add [H]ard|OCP

http://stats.distributed.net/team/tm...=27&team=24958

edit: and add to RC5-72 as well (same number)

They will show up on tonight's run...

Bok