PDA

View Full Version : Build your own custom map....



CaptainMooseInc
04-22-2005, 06:41 PM
Hey guys, I was playing around at Ivy Tech with the new version of DIMES. Now I know you have been able to enter your own websites to TRACERT since .4 was released initially, but I have found that it will let you enter as many URLs as you'd like and ignore mapping out the IPs that it gets from the server.

Soooo....where did this little experiment take me???

First I started out by loading up Google.com and typing in some random search and looking at results. I then copied the URLs from the results and pasted it into the top right hand corner box of DIMES.

I started noticing that a lot of the stuff I was looking at would bring up more ISPs than I have ever seen DIMES list at one time....so I got to thinking...

What if I narrowed it down to a specific set of web addresses???...

Once again I turned to Google.com. Now my search phrase turned into *.edu. I wanted to have as many .EDU URLs as possible. Since most of these are hosted from a backbone at the universities they are at, I figured I would get TONS of ISPs...and I was RIGHT!

I copied every link from the first 10 pages of results (the only reason I stopped was because I had to leave) and put it into DIMES one by one. I backed up like 50 links into DIMES. I started noticing that each college had a different ISP...

Then the TOTALLY UNEXPECTED happened....

The ISPs I was seeing started LINKING. Harvard's .EDU was before Yale's .EDU...Harvard came up with its limb of the map...then Yale was up next and instead of branching off by itself...3 little boxes popped up after Harvard. So I reentered Yale's .EDU and it made its own branch this time but still connected to the Yale that first showed up! I had made a full circle. :)

What I want people to use this new thread for is to list any URL extensions they know of! I am going to do the first 10 pages of Google.com results for any .WHATEVER extension. If there is a webpage out there (haven't found it yet) that has a massive list of them then don't list ones you know in here. PLEASE DON'T POST .COMs, .ORGs, or .NETs! I know these already. I also know a few more that are listed below.

If anyone else is interested in taking a half an hour out of their time every once and awhile to do 10 pages of Google search results then go for it! Keep us updated!

I know of and refuse to do (since I think DIMES does these the most):
.COM
.NET
.ORG

Ones I know of and want to do/am doing:
.COM.UK
.COM.AU
.CA
.EDU
.GOV
.TV
.INFO
.TK

Now I know there are HUNDREDS more (because each country has its own country code so there are lots of domains) and I want them ALL.

-Jeff


P.S. Yes...I know Google's listings change all the time so not everyone is going to get the same 10 pages all the time...but hey...WHO CARES?!?!?!

magnav0x
04-22-2005, 06:57 PM
This list contains all the two letter TLD's for countries and a few generic TLD's. Should keep you busy for a while, there are more where that came from.

.aero Aviation
.biz Business Organizations
.com Commercial
.coop Co-Operative Organizations
.edu Educational
.gov US Government
.info Open TLD
.int International Organizations
.mil US Dept of Defense
.museum Museums
.name Personal
.net Networks
.org Organizations


.ac Ascension Island
.ad Andorra
.ae United Arab Emirates
.af Afghanistan
.ag Antigua and Barbuda
.ai Anguilla
.al Albania
.am Armenia
.an Netherlands Antilles
.ao Angola
.aq Antarctica
.ar Argentina
.as American Samoa
.at Austria
.au Australia
.aw Aruba
.az Azerbaijan
.ba Bosnia and Herzegovina
.bb Barbados
.bd Bangladesh
.be Belgium
.bf Burkina Faso
.bg Bulgaria
.bh Bahrain
.bi Burundi
.bj Benin
.bm Bermuda
.bn Brunei Darussalam
.bo Bolivia
.br Brazil
.bs Bahamas
.bt Bhutan
.bv Bouvet Island
.bw Botswana
.by Belarus
.bz Belize
.ca Canada
.cc Cocos (Keeling) Islands
.cd Congo, Democratic republic of the (former Zaire)
.cf Central African Republic
.cg Congo, Republic of
.ch Switzerland
.ci Côte d'Ivoire
.ck Cook Islands
.cl Chile
.cm Cameroon
.cn China
.co Colombia
.cr Costa Rica
.cs Czechoslovakia (former - non-existing)
.cu Cuba
.cv Cape Verde
.cx Christmas Island
.cy Cyprus
.cz Czech Republic
.de Germany
.dj Djibouti
.dk Denmark
.dm Dominica
.do Dominican Republic
.dz Algeria
.ec Ecuador
.ee Estonia
.eg Egypt
.eh Western Sahara
.er Eritrea
.es Spain
.et Ethiopia
.eu European Union
.fi Finland
.fj Fiji
.fk Falkland Islands
.fm Micronesia
.fo Faroe Islands
.fr France
.ga Gabon
.gb United Kingdom
.gd Grenada
.ge Georgia
.gf French Guiana
.gg Guernsey
.gh Ghana
.gi Gibraltar
.gl Greenland
.gm Gambia
.gn Guinea
.gp Guadeloupe
.gq Equatorial Guinea
.gr Greece
.gs South Georgia and the South Sandwich Islands
.gt Guatemala
.gu Guam
.gw Guinea-Bissau
.gy Guyana
.hk Hong Kong
.hm Heard and McDonald Islands
.hn Honduras
.hr Croatia
.ht Haiti
.hu Hungary
.id Indonesia
.ie Ireland
.il Israel
.im Isle of Man
.in India
.io British Indian Ocean Territory
.iq Iraq
.ir Iran
.is Iceland
.it Italy
.je Jersey
.jm Jamaica
.jo Jordan
.jp Japan
.ke Kenya
.kg Kyrgyzstan
.kh Cambodia
.ki Kiribati
.km Comoros
.kn Saint Kitts and Nevis
.kp Korea, Democratic People's Republic of
.kr Korea, Republic of
.kw Kuwait
.ky Cayman Islands
.kz Kazakhstan
.la Lao People's Democratic Republic
.lb Lebanon
.lc Saint Lucia
.li Liechtenstein
.lk Sri Lanka
.lr Liberia
.ls Lesotho
.lt Lithuania
.lu Luxembourg
.lv Latvia
.ly Libyan Arab Jamahiriya
.ma Morocco
.mc Monaco
.md Moldova
.mg Madagascar
.mh Marshall Islands
.mk Macedonia
.ml Mali
.mm Myanmar
.mn Mongolia
.mo Macau
.mp Northern Mariana Islands
.mq Martinique
.mr Mauritania
.ms Montserrat
.mt Malta
.mu Mauritius
.mv Maldives
.mw Malawi
.mx Mexico
.my Malaysia
.mz Mozambique
.na Namibia
.nc New Caledonia
.ne Niger
.nf Norfolk Island
.ng Nigeria
.ni Nicaragua
.nl The Netherlands
.no Norway
.np Nepal
.nr Nauru
.nu Niue
.nz New Zealand
.om Oman
.pa Panama
.pe Peru
.pf French Polynesia
.pg Papua New Guinea
.ph Philippines
.pk Pakistan
.pl Poland
.pm St. Pierre and Miquelon
.pn Pitcairn
.pr Puerto Rico
.ps Palestine
.pt Portugal
.pw Palau
.py Paraguay
.qa Qatar
.re Reunion
.ro Romania
.ru Russia
.rw Rwanda
.sa Saudi Arabia
.sb Solomon Islands
.sc Seychelles
.sd Sudan
.se Sweden
.sg Singapore
.sh St. Helena
.si Slovenia
.sj Svalbard and Jan Mayen Islands
.sk Slovakia
.sl Sierra Leone
.sm San Marino
.sn Senegal
.so Somalia
.sr Surinam
.st Sao Tome and Principe
.su USSR (former)
.sv El Salvador
.sy Syrian Arab Republic
.sz Swaziland
.tc The Turks & Caicos Islands
.td Chad
.tf French Southern Territories
.tg Togo
.th Thailand
.tj Tajikistan
.tk Tokelau
.tm Turkmenistan
.tn Tunisia
.to Tonga
.tp East Timor
.tr Turkey
.tt Trinidad and Tobago
.tv Tuvalu
.tw Taiwan
.tz Tanzania
.ua Ukraine
.ug Uganda
.uk United Kingdom
.um United States Minor Outlying Islands
.us United States
.uy Uruguay
.uz Uzbekistan
.va Holy See (Vatican City State)
.vc Saint Vincent and the Grenadines
.ve Venezuela
.vg Virgin Islands British
.vi Virgin Islands U.S
.vn Vietnam
.vu Vanuatu
.wf Wallis and Futuna Islands
.ws Samoa
.ye Yemen
.yt Mayotte
.yu Yugoslavia
.za South Africa
.zm Zambia
.zr Zaire (non-existent, see Congo)
.zw Zimbabwe

CaptainMooseInc
04-22-2005, 07:24 PM
I reserve the first set before the double space. This is gonna take a long time so.....

If anyone is interested in helping me do this, this is what is going to need to be done:

1.) Pick a letter of the Alphabet (go in order unless you dont' wanna do a bunch).
2.) Copy all the listed domain extensions for that letter.
3.) Search Google.com by using the format: *.domainname (i.e. *.ac and so forth).
4.) First the first 10 pages copy each URL (don't use the clickable link, highlight and copy the grey URL under it) and paste it into DIMES then hit ENTER.
5.) After 10 pages for a domain extension just simply move to the next one.
6.) When you're done with all extensions listed simply reply to this thread with something like "Letter A extensions completed".

As more and more letters are eliminated then I can get an updated list of more extensions and remove those which have already been done.

The goal is to force DIMES to get measurements from every part of the world. Right now the client seems very biased to US based IP addresses and this thing is supposed to map the whole internet so I'm forcing it to.

In less than 45 mins of doing this I managed to make my graph more diverse than ever before (instead of 300 little floating boxes that say Level 3 Comm or ATT WorldNet Services).

If no one wants to help I'll single handedly rip through these. :bouncy:

-Jeff

CaptainMooseInc
04-24-2005, 01:12 AM
Hahahah! It works!!! I boosted my ASes and AS nodes by a lot in just 1018 measurements! I went through and did the .EDUs from Ivy Tech and look what the stats report back:

Agent Name: CaptainMooseInc_IVYTECH
Registered: 22 April 2005
Number of Measurement Units: 1018
ASes and AS Links: 12

Hahaha! YES! I've found my new addiction....

I am going to dig through all the .govs and .edus I can find, domestic and foreign, and build and ASes and ASnodes EMPIRE!!!

-Jeff

CaptainMooseInc
04-27-2005, 07:37 PM
STATUS UPDATE:

Client name used: CaptainMooseInc_TECH

Google Search:
*.edu
Pages Completed: 26 (restarted at page 11 after already doing pages 1-10)

Google Search:
*.gov
Pages Completed: 11

Google Search:
*.tk
Pages completed: 10
**//REMOVE FROM FUTURE SEARCH QUERIES, GOOGLE PROVIDES TOO MANY NON .TK LINKS SUCH AS .COMs and .DE\\**

Google Search:
*.info
Pages Completed: 0
**//REMOVE FROM FUTURE SEARCH QUERIES, GOOGLE PROVIDES TOO MANY NON .INFO LINKS SUCH AS .COMs\\**

Google Search:
*.tv
Pages Completed: 0
**//REMOVE FROM FUTURE SEARCH QUERIES, GOOGLE PROVIDES TOO MANY NON .TV LINKS SUCH AS .COMs\\**

Total ASes and ASlinks found: -Updated Later, no stats available at this time-

-Jeff

LichtJF
04-27-2005, 11:47 PM
Great Idea, Put me down for :


.cn china
.jp japoan
.sg singapore
.tw taiwan
.th thailand
.vn vietnam

CaptainMooseInc
04-28-2005, 12:34 AM
Number os ASes and ASLinks found: 11

Ha! Tell me this doesn't work!

-Jeff

LichtJF
04-28-2005, 10:24 AM
I have done Japan, China, Taiwan, and Vietnam, and only found 4 links. So much for not much penetration in Asia. I thought that would be ASes and ASLinks heaven. I figured china wouldn't yield much as everything seems to go through a *.gov.cn domain.

PY 222
04-28-2005, 12:40 PM
Originally posted by LichtJF
I have done Japan, China, Taiwan, and Vietnam, and only found 4 links. So much for not much penetration in Asia. I thought that would be ASes and ASLinks heaven. I figured china wouldn't yield much as everything seems to go through a *.gov.cn domain.

That would most likely be the Great Firewall of China. :jester:

LichtJF
04-28-2005, 02:00 PM
And that really isn't too far from the truth.

Empty_5oul
04-29-2005, 02:16 PM
i did first 10 for
.nz (new zealand)


with the links. i take it they are when servers join up from different routes taken. So where every so often it clears the screen on my it only removes certain dots and tends to keep the "good" ones i have found with 5 or more lines coming from them. Does anyone know how it works ???

CaptainMooseInc
04-29-2005, 06:01 PM
Don't worry, if New Zealand returned any ASes and ASLinks it won't matter about it being cleared. :)

I still manage to find ASes and ASLinks using the .EDUs....college networks are incredible....

Are there any foreign .EDUs out there? Kinda like *.EDU.UK or *.EDU.AU or anything like that? I'd really like to focus in on colleges. I've networked all the colleges in America (the big decent ones that is) and now I want to work on cross the ocean and getting those colleges too.

:)

-Jeff

Empty_5oul
04-29-2005, 06:50 PM
just wondering why certain dots stay yet others go.

i am on demon internet and now have a few large icons nearby my machine (dimes logo in the graph) with 8+ links. these always stay as the graph clears and just the outside ones are lost. is their a known process to this or is it just the furthest ones are lost ??

also to gain links do they both need to be open in DIMES on my machine at the same time, so it keeps the best servers with most links as it is more likely to gain them from these ????

CaptainMooseInc
04-29-2005, 08:37 PM
Look for the thing that says "Pruning Level". You prolly have that set in the middle or something. Drag it all the way to the left (0). It'll show you more links. DIMES seems to hold around 100 IPs before it "gets too cluttered" and "has to clear it". Don't worry, DIMES is still working right.

-Jeff

CaptainMooseInc
05-03-2005, 05:40 PM
Google Search: *.mil
Pages Completed: 16
ASes and ASLinks found: -will edit in later-
Node name used: CaptainMooseInc_TECH1

-Jeff

CaptainMooseInc
05-04-2005, 08:15 PM
THIS IS DIRECTLY FROM THE NETDIMES.ORG STATS PAGE!!! AWESOME PAYLOAD WITH .MIL ADDRESSES!!!

Agent Name: CaptainMooseInc_TECH1
Registered: 4 May 2005
Number of Measurement Units: 613
ASes and AS Links: 21

21 ASes and AS Links for 613 measurements!!! That means I was getting an AS or an ASLink every 30 measurements! Ha!

I am banging out those ASes and ASLinks...man :)

-Jeff

jasong
05-04-2005, 08:29 PM
Man, I wish I'd noticed this topic before. Now I want to get DIMES up and running again. I'm going to attempt a reinstall RIGHT-FRICKIN-NOW!!!