what's a Google Spider?

Holiday

Holiday

New Member
what's a Google Spider?
google1vz.jpg
 
Do you know how serah engines get there results?


If notthen i will put it simply, search engines use Crwaler bot's that index pages automoatically for their searches, and they go to each link thats on each page which rengerates tons and tons of more pages to index.
 
If you didn't understand, those spiders are actually a person that typed a word that was in the thread "Another linux question" for example, and the google spider went looking where it could find the word in the web and found it on the thread.
 
If you didn't understand, those spiders are actually a person that typed a word that was in the thread "Another linux question" for example, and the google spider went looking where it could find the word in the web and found it on the thread.
Click to expand...
No it's not!

Do you actually think that a search engine trawls the net real time!

In laymens terms
a) I write a brand new website called www.apj101.com
b) I add a link to my web site in my signature here on CF
c) The google spiders come to CF as they do regularly (lets ignore why for the second)
d) The spiders see my link in my sig and think hmmmm I'll go and visit that site next
e) Spiders come to my site and begin to read EVERY thing i have on my site
f) They copy EVERY peice of text on my site to the google cache (think of this a series of huge computers that contain googles downloaded copy of the entire internet)
e) The spiders will take a note of any external site that i have reference on my web site. e.g. www.Cromewell.com <- and the spiders say hmmm, we'll visit there later
f) The spiders leave, probably to come back another day to see if anything has changed

Now when you type in a query into google. Google will "search" through the google cache and return your results and links to the page on the web where google found the information in the first place. Sometime google is wrong and the cache no longer matches what is on the real site. Or sometime you click on a link that google suggests and the site no longer exists thus highlighting the disparity between the web and the google cache (ps in that case you can click the little link the google provides under every result called "cache")
 
vortmax said:
isn't the net estimated at under 10 Tb? I've seen guys at lan wars with more storage
Click to expand...



LOL NO WAY, there is prabally much more then 10Tb of just PORN alone on the net.

My friends brother has a 80GB hard drive decicated to just that, but only what he could get for free, now think of how much is no those websits you have to pay for(the 80GB harddrive is how iv'e been told, to tell you the truth, i don't think i would even step in that kids room, scary)
 
1000 Bytes = 1 Kilobyte
1000 Kilobytes = 1 Megabyte
1000 Megabytes = 1 Gigabyte
1000 Gigabytes = 1 Terabyte
1000 Terabytes = 1 Petabyte
1000 Petabytes = 1 Exabyte - In 2000, 3 exabytes of information was created
1000 Exabytes = 1 Zettabyte
1000 Zettabyte = 1 Zottabyte
1000 Zottabyte = 1 Brontobyte - that is a 1 followed by 27 zeroes

Probably 100-200 Brontobytes I would guess?
 
actually i googled it and main content is around 100 Tb. If you include the deep web (all databases, blogs, forums, ect), it's near 100000 Tb.
 
100Tb, that can't be right. I know home users that have 1-5Tb of HDD space individually, and i'm sure there are probably more than 100 people worldwide with similiar setups, the net has to be bigger than that! But i doubt a true answer will ever exist...
 
well just because someone has that much on their personal system doesn't mean that it's full of data and networked. When you think about it, a terrabyte is a TON of data. I work with very large files academicly (High res Landsat satellite images) and we make use of a total of 2 TB and only get close to 75% full when we don't clean it up.
 
vortmax said:
actually i googled it and main content is around 100 Tb. If you include the deep web (all databases, blogs, forums, ect), it's near 100000 Tb.
Click to expand...
Oh and im sure everything you read on the web is true.....I don't belive that for one bit, there is SOOOO MUCH on the web, i belive there would have to be more then that.
 
You must log in or register to reply here.
Back
Top