View Full Version : How often does Google spider SD?
benjie
11-12-2007, 11:29 PM
Somebody at google apparently loves SD. I can post something on SD and find it in a google search usually less than 90 seconds later. And it's always at the very top, usually the very first result.
So, somebody who has access to this sort of information, how often does google crawl SD? Is it just a constant thing? I don't think I even wanna know how it pulls down all the new posts pretty much as they occur.
random.
11-13-2007, 12:21 AM
I have no idea but a few times when people have posted in the lounge asking for helping... By the time I google, it's usually in the top 5 results for whatever I'm googling.
slickdeals
11-13-2007, 05:00 AM
We don't keep track of how often Google crawls here but as you noticed, they're here all day long.
finzz2dlft
11-13-2007, 07:38 AM
Spiders? Crawling? INTERWEBS?!!:eek: It all makes sense now!! :lol:
brisar
11-13-2007, 09:34 PM
yikes! :omg: there are spiders crawling around here? :omg:
:spider:
:unsure:
benjie
11-14-2007, 02:44 AM
We don't keep track of how often Google crawls here but as you noticed, they're here all day long.
Good enough for me. Just means I know everything there is to know.
yikes! :omg: there are spiders crawling around here? :omg:
:spider:
:unsure:
Yeah, they eat the trolls.
finzz2dlft
11-14-2007, 04:26 AM
yikes! :omg: there are spiders crawling around here? :omg:
:spider:
:unsure:
Run for the hills!!!!!!! :eek: :lol:
tsuperwanker
11-14-2007, 11:12 AM
Why does Google spider SD? I can understand for the Deals section, but can't you limit it to just those forums? I mean does the Lounge, tech support all have to be accessible to the Google bot? Doesn't it eat resources?
finzz2dlft
11-14-2007, 03:28 PM
Why does Google spider SD? I can understand for the Deals section, but can't you limit it to just those forums? I mean does the Lounge, tech support all have to be accessible to the Google bot? Doesn't it eat resources?
Silly TS! Spiders eat bugs. Didn't you ever see Charlotte's Web? :coverlaf:
SP33DFR34K
11-15-2007, 08:34 AM
Well I posted a deal around 11PM. Next morning when I was doing a google search, the item came up. So yes, they do spider a lot.
tsuperwanker
11-15-2007, 12:49 PM
Silly TS! Spiders eat bugs. Didn't you ever see Charlotte's Web? :coverlaf:
:sadwalk: no
finzz2dlft
11-15-2007, 03:40 PM
:sadwalk: no
You poor, deprived child!! :hug:
quazywong
11-15-2007, 03:41 PM
:sadwalk:
tsuperwanker
11-15-2007, 03:56 PM
You poor, deprived child!! :hug:
Thanks. I was also deprived of beer, noodles and money :whistlin: just sayin...
finzz2dlft
11-15-2007, 04:10 PM
Thanks. I was also deprived of beer, noodles and money :whistlin: just sayin...
It's in the mail. Happy Holidays!! :woot2:
tsuperwanker
11-15-2007, 05:19 PM
It's in the mail. Happy Holidays!! :woot2:
Thanks :woot2:
wait a minute :mad:
you know I always wondered that..I always thought it was because like all the lurkers who hit the posts have those google toolbar add-ons or something..I don't remember..but I think there was like a pagerank or trace program that you could help "google crawl the web" or something as you browsed websites..I thought of it as a complete invasion or privacy..but with the amount of people on SD..i thought it was possible. I just didn't see it fit, that Google crawls so freaking much that an SD post i make can be on there in like less than an hour :scratch:
SP33DFR34K
11-19-2007, 12:14 AM
See below..
http://forums.slickdeals.net/showthread.php?sduid=126924&t=659827
Thread created 10:42PM PST
Search for thread title at 12:37am PST
http://www.google.com/search?q=.25CTW+Diamond+Hugs+and+Kisses+Bracelet+%2470+Shipped&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a
..less than 2 hours..freaking amazing..
benjie
11-19-2007, 02:30 AM
http://forums.slickdeals.net/showthread.php?sduid=126924&t=659827
Thread created 10:42PM PST
Search for thread title at 12:37am PST
http://www.google.com/search?q=.25CTW+Diamond+Hugs+and+Kisses+Bracelet+%2470+Shipped&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a
..less than 2 hours..freaking amazing..
Like I said, somebody at google likes SD. Ok, so who it? Somebody here obviously works for google.