Results 1 to 17 of 17

Thread: Build your own custom map....

  1. #1

    Build your own custom map....

    Hey guys, I was playing around at Ivy Tech with the new version of DIMES. Now I know you have been able to enter your own websites to TRACERT since .4 was released initially, but I have found that it will let you enter as many URLs as you'd like and ignore mapping out the IPs that it gets from the server.

    Soooo....where did this little experiment take me???

    First I started out by loading up Google.com and typing in some random search and looking at results. I then copied the URLs from the results and pasted it into the top right hand corner box of DIMES.

    I started noticing that a lot of the stuff I was looking at would bring up more ISPs than I have ever seen DIMES list at one time....so I got to thinking...

    What if I narrowed it down to a specific set of web addresses???...

    Once again I turned to Google.com. Now my search phrase turned into *.edu. I wanted to have as many .EDU URLs as possible. Since most of these are hosted from a backbone at the universities they are at, I figured I would get TONS of ISPs...and I was RIGHT!

    I copied every link from the first 10 pages of results (the only reason I stopped was because I had to leave) and put it into DIMES one by one. I backed up like 50 links into DIMES. I started noticing that each college had a different ISP...

    Then the TOTALLY UNEXPECTED happened....

    The ISPs I was seeing started LINKING. Harvard's .EDU was before Yale's .EDU...Harvard came up with its limb of the map...then Yale was up next and instead of branching off by itself...3 little boxes popped up after Harvard. So I reentered Yale's .EDU and it made its own branch this time but still connected to the Yale that first showed up! I had made a full circle.

    What I want people to use this new thread for is to list any URL extensions they know of! I am going to do the first 10 pages of Google.com results for any .WHATEVER extension. If there is a webpage out there (haven't found it yet) that has a massive list of them then don't list ones you know in here. PLEASE DON'T POST .COMs, .ORGs, or .NETs! I know these already. I also know a few more that are listed below.

    If anyone else is interested in taking a half an hour out of their time every once and awhile to do 10 pages of Google search results then go for it! Keep us updated!

    I know of and refuse to do (since I think DIMES does these the most):
    .COM
    .NET
    .ORG

    Ones I know of and want to do/am doing:
    .COM.UK
    .COM.AU
    .CA
    .EDU
    .GOV
    .TV
    .INFO
    .TK

    Now I know there are HUNDREDS more (because each country has its own country code so there are lots of domains) and I want them ALL.

    -Jeff


    P.S. Yes...I know Google's listings change all the time so not everyone is going to get the same 10 pages all the time...but hey...WHO CARES?!?!?!
    Distributed Hold'em


  2. #2
    Stats Developer magnav0x's Avatar
    Join Date
    Mar 2002
    Location
    Dallas, TX
    Posts
    1,747
    This list contains all the two letter TLD's for countries and a few generic TLD's. Should keep you busy for a while, there are more where that came from.

    .aero Aviation
    .biz Business Organizations
    .com Commercial
    .coop Co-Operative Organizations
    .edu Educational
    .gov US Government
    .info Open TLD
    .int International Organizations
    .mil US Dept of Defense
    .museum Museums
    .name Personal
    .net Networks
    .org Organizations


    .ac Ascension Island
    .ad Andorra
    .ae United Arab Emirates
    .af Afghanistan
    .ag Antigua and Barbuda
    .ai Anguilla
    .al Albania
    .am Armenia
    .an Netherlands Antilles
    .ao Angola
    .aq Antarctica
    .ar Argentina
    .as American Samoa
    .at Austria
    .au Australia
    .aw Aruba
    .az Azerbaijan
    .ba Bosnia and Herzegovina
    .bb Barbados
    .bd Bangladesh
    .be Belgium
    .bf Burkina Faso
    .bg Bulgaria
    .bh Bahrain
    .bi Burundi
    .bj Benin
    .bm Bermuda
    .bn Brunei Darussalam
    .bo Bolivia
    .br Brazil
    .bs Bahamas
    .bt Bhutan
    .bv Bouvet Island
    .bw Botswana
    .by Belarus
    .bz Belize
    .ca Canada
    .cc Cocos (Keeling) Islands
    .cd Congo, Democratic republic of the (former Zaire)
    .cf Central African Republic
    .cg Congo, Republic of
    .ch Switzerland
    .ci Côte d'Ivoire
    .ck Cook Islands
    .cl Chile
    .cm Cameroon
    .cn China
    .co Colombia
    .cr Costa Rica
    .cs Czechoslovakia (former - non-existing)
    .cu Cuba
    .cv Cape Verde
    .cx Christmas Island
    .cy Cyprus
    .cz Czech Republic
    .de Germany
    .dj Djibouti
    .dk Denmark
    .dm Dominica
    .do Dominican Republic
    .dz Algeria
    .ec Ecuador
    .ee Estonia
    .eg Egypt
    .eh Western Sahara
    .er Eritrea
    .es Spain
    .et Ethiopia
    .eu European Union
    .fi Finland
    .fj Fiji
    .fk Falkland Islands
    .fm Micronesia
    .fo Faroe Islands
    .fr France
    .ga Gabon
    .gb United Kingdom
    .gd Grenada
    .ge Georgia
    .gf French Guiana
    .gg Guernsey
    .gh Ghana
    .gi Gibraltar
    .gl Greenland
    .gm Gambia
    .gn Guinea
    .gp Guadeloupe
    .gq Equatorial Guinea
    .gr Greece
    .gs South Georgia and the South Sandwich Islands
    .gt Guatemala
    .gu Guam
    .gw Guinea-Bissau
    .gy Guyana
    .hk Hong Kong
    .hm Heard and McDonald Islands
    .hn Honduras
    .hr Croatia
    .ht Haiti
    .hu Hungary
    .id Indonesia
    .ie Ireland
    .il Israel
    .im Isle of Man
    .in India
    .io British Indian Ocean Territory
    .iq Iraq
    .ir Iran
    .is Iceland
    .it Italy
    .je Jersey
    .jm Jamaica
    .jo Jordan
    .jp Japan
    .ke Kenya
    .kg Kyrgyzstan
    .kh Cambodia
    .ki Kiribati
    .km Comoros
    .kn Saint Kitts and Nevis
    .kp Korea, Democratic People's Republic of
    .kr Korea, Republic of
    .kw Kuwait
    .ky Cayman Islands
    .kz Kazakhstan
    .la Lao People's Democratic Republic
    .lb Lebanon
    .lc Saint Lucia
    .li Liechtenstein
    .lk Sri Lanka
    .lr Liberia
    .ls Lesotho
    .lt Lithuania
    .lu Luxembourg
    .lv Latvia
    .ly Libyan Arab Jamahiriya
    .ma Morocco
    .mc Monaco
    .md Moldova
    .mg Madagascar
    .mh Marshall Islands
    .mk Macedonia
    .ml Mali
    .mm Myanmar
    .mn Mongolia
    .mo Macau
    .mp Northern Mariana Islands
    .mq Martinique
    .mr Mauritania
    .ms Montserrat
    .mt Malta
    .mu Mauritius
    .mv Maldives
    .mw Malawi
    .mx Mexico
    .my Malaysia
    .mz Mozambique
    .na Namibia
    .nc New Caledonia
    .ne Niger
    .nf Norfolk Island
    .ng Nigeria
    .ni Nicaragua
    .nl The Netherlands
    .no Norway
    .np Nepal
    .nr Nauru
    .nu Niue
    .nz New Zealand
    .om Oman
    .pa Panama
    .pe Peru
    .pf French Polynesia
    .pg Papua New Guinea
    .ph Philippines
    .pk Pakistan
    .pl Poland
    .pm St. Pierre and Miquelon
    .pn Pitcairn
    .pr Puerto Rico
    .ps Palestine
    .pt Portugal
    .pw Palau
    .py Paraguay
    .qa Qatar
    .re Reunion
    .ro Romania
    .ru Russia
    .rw Rwanda
    .sa Saudi Arabia
    .sb Solomon Islands
    .sc Seychelles
    .sd Sudan
    .se Sweden
    .sg Singapore
    .sh St. Helena
    .si Slovenia
    .sj Svalbard and Jan Mayen Islands
    .sk Slovakia
    .sl Sierra Leone
    .sm San Marino
    .sn Senegal
    .so Somalia
    .sr Surinam
    .st Sao Tome and Principe
    .su USSR (former)
    .sv El Salvador
    .sy Syrian Arab Republic
    .sz Swaziland
    .tc The Turks & Caicos Islands
    .td Chad
    .tf French Southern Territories
    .tg Togo
    .th Thailand
    .tj Tajikistan
    .tk Tokelau
    .tm Turkmenistan
    .tn Tunisia
    .to Tonga
    .tp East Timor
    .tr Turkey
    .tt Trinidad and Tobago
    .tv Tuvalu
    .tw Taiwan
    .tz Tanzania
    .ua Ukraine
    .ug Uganda
    .uk United Kingdom
    .um United States Minor Outlying Islands
    .us United States
    .uy Uruguay
    .uz Uzbekistan
    .va Holy See (Vatican City State)
    .vc Saint Vincent and the Grenadines
    .ve Venezuela
    .vg Virgin Islands British
    .vi Virgin Islands U.S
    .vn Vietnam
    .vu Vanuatu
    .wf Wallis and Futuna Islands
    .ws Samoa
    .ye Yemen
    .yt Mayotte
    .yu Yugoslavia
    .za South Africa
    .zm Zambia
    .zr Zaire (non-existent, see Congo)
    .zw Zimbabwe
    Warning this Post is Rated "M" for Mature

    -Contains Harsh Language
    -L337 HaX0r W3RD2!
    -Partial Nudity

    I haven't lost my mind; it's backed up on tape drive somewhere.

  3. #3
    I reserve the first set before the double space. This is gonna take a long time so.....

    If anyone is interested in helping me do this, this is what is going to need to be done:

    1.) Pick a letter of the Alphabet (go in order unless you dont' wanna do a bunch).
    2.) Copy all the listed domain extensions for that letter.
    3.) Search Google.com by using the format: *.domainname (i.e. *.ac and so forth).
    4.) First the first 10 pages copy each URL (don't use the clickable link, highlight and copy the grey URL under it) and paste it into DIMES then hit ENTER.
    5.) After 10 pages for a domain extension just simply move to the next one.
    6.) When you're done with all extensions listed simply reply to this thread with something like "Letter A extensions completed".

    As more and more letters are eliminated then I can get an updated list of more extensions and remove those which have already been done.

    The goal is to force DIMES to get measurements from every part of the world. Right now the client seems very biased to US based IP addresses and this thing is supposed to map the whole internet so I'm forcing it to.

    In less than 45 mins of doing this I managed to make my graph more diverse than ever before (instead of 300 little floating boxes that say Level 3 Comm or ATT WorldNet Services).

    If no one wants to help I'll single handedly rip through these.

    -Jeff
    Distributed Hold'em


  4. #4
    Hahahah! It works!!! I boosted my ASes and AS nodes by a lot in just 1018 measurements! I went through and did the .EDUs from Ivy Tech and look what the stats report back:

    Agent Name: CaptainMooseInc_IVYTECH
    Registered: 22 April 2005
    Number of Measurement Units: 1018
    ASes and AS Links: 12

    Hahaha! YES! I've found my new addiction....

    I am going to dig through all the .govs and .edus I can find, domestic and foreign, and build and ASes and ASnodes EMPIRE!!!

    -Jeff
    Distributed Hold'em


  5. #5
    STATUS UPDATE:

    Client name used: CaptainMooseInc_TECH

    Google Search:
    *.edu
    Pages Completed: 26 (restarted at page 11 after already doing pages 1-10)

    Google Search:
    *.gov
    Pages Completed: 11

    Google Search:
    *.tk
    Pages completed: 10
    **//REMOVE FROM FUTURE SEARCH QUERIES, GOOGLE PROVIDES TOO MANY NON .TK LINKS SUCH AS .COMs and .DE\\**

    Google Search:
    *.info
    Pages Completed: 0
    **//REMOVE FROM FUTURE SEARCH QUERIES, GOOGLE PROVIDES TOO MANY NON .INFO LINKS SUCH AS .COMs\\**

    Google Search:
    *.tv
    Pages Completed: 0
    **//REMOVE FROM FUTURE SEARCH QUERIES, GOOGLE PROVIDES TOO MANY NON .TV LINKS SUCH AS .COMs\\**

    Total ASes and ASlinks found: -Updated Later, no stats available at this time-

    -Jeff
    Last edited by CaptainMooseInc; 04-27-2005 at 07:51 PM.
    Distributed Hold'em


  6. #6
    Senior Member
    Join Date
    Apr 2005
    Location
    Delaware, USA
    Posts
    102
    Great Idea, Put me down for :


    .cn china
    .jp japoan
    .sg singapore
    .tw taiwan
    .th thailand
    .vn vietnam

  7. #7
    Number os ASes and ASLinks found: 11

    Ha! Tell me this doesn't work!

    -Jeff
    Distributed Hold'em


  8. #8
    Senior Member
    Join Date
    Apr 2005
    Location
    Delaware, USA
    Posts
    102
    I have done Japan, China, Taiwan, and Vietnam, and only found 4 links. So much for not much penetration in Asia. I thought that would be ASes and ASLinks heaven. I figured china wouldn't yield much as everything seems to go through a *.gov.cn domain.

  9. #9
    Keeper of the Fridge PY 222's Avatar
    Join Date
    Jul 2002
    Location
    San Jose, CA
    Posts
    2,706
    Originally posted by LichtJF
    I have done Japan, China, Taiwan, and Vietnam, and only found 4 links. So much for not much penetration in Asia. I thought that would be ASes and ASLinks heaven. I figured china wouldn't yield much as everything seems to go through a *.gov.cn domain.
    That would most likely be the Great Firewall of China.

  10. #10
    Senior Member
    Join Date
    Apr 2005
    Location
    Delaware, USA
    Posts
    102
    And that really isn't too far from the truth.

  11. #11
    i did first 10 for
    .nz (new zealand)


    with the links. i take it they are when servers join up from different routes taken. So where every so often it clears the screen on my it only removes certain dots and tends to keep the "good" ones i have found with 5 or more lines coming from them. Does anyone know how it works ???

  12. #12
    Don't worry, if New Zealand returned any ASes and ASLinks it won't matter about it being cleared.

    I still manage to find ASes and ASLinks using the .EDUs....college networks are incredible....

    Are there any foreign .EDUs out there? Kinda like *.EDU.UK or *.EDU.AU or anything like that? I'd really like to focus in on colleges. I've networked all the colleges in America (the big decent ones that is) and now I want to work on cross the ocean and getting those colleges too.



    -Jeff
    Distributed Hold'em


  13. #13
    just wondering why certain dots stay yet others go.

    i am on demon internet and now have a few large icons nearby my machine (dimes logo in the graph) with 8+ links. these always stay as the graph clears and just the outside ones are lost. is their a known process to this or is it just the furthest ones are lost ??

    also to gain links do they both need to be open in DIMES on my machine at the same time, so it keeps the best servers with most links as it is more likely to gain them from these ????

  14. #14
    Look for the thing that says "Pruning Level". You prolly have that set in the middle or something. Drag it all the way to the left (0). It'll show you more links. DIMES seems to hold around 100 IPs before it "gets too cluttered" and "has to clear it". Don't worry, DIMES is still working right.

    -Jeff
    Distributed Hold'em


  15. #15
    Google Search: *.mil
    Pages Completed: 16
    ASes and ASLinks found: -will edit in later-
    Node name used: CaptainMooseInc_TECH1

    -Jeff
    Last edited by CaptainMooseInc; 05-04-2005 at 08:15 PM.
    Distributed Hold'em


  16. #16
    THIS IS DIRECTLY FROM THE NETDIMES.ORG STATS PAGE!!! AWESOME PAYLOAD WITH .MIL ADDRESSES!!!

    Agent Name: CaptainMooseInc_TECH1
    Registered: 4 May 2005
    Number of Measurement Units: 613
    ASes and AS Links: 21

    21 ASes and AS Links for 613 measurements!!! That means I was getting an AS or an ASLink every 30 measurements! Ha!

    I am banging out those ASes and ASLinks...man

    -Jeff
    Distributed Hold'em


  17. #17
    Old Timer jasong's Avatar
    Join Date
    Oct 2004
    Location
    Arkansas(US)
    Posts
    1,778
    Man, I wish I'd noticed this topic before. Now I want to get DIMES up and running again. I'm going to attempt a reinstall RIGHT-FRICKIN-NOW!!!

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •