Turkey Day and Dipsie

November 22, 2005 Data Platform

Although I didn't grow up with Thanksgiving, it is probably one of the most enjoyable of American holidays. It is the only time of year when the commercial machine actually takes a break (albeit for one single day), and like it or not we are compelled to gather the family in a single location. On another topic, it is also interesting to see new and useful technologies emerge. Take the launch of Dipsie for example. SiliconBeat summed it up nicely:

"The approach is unique. Imagine a site with content that can't be crawled by a regular search engine, perhaps because its web pages are dynamically generated out of a database. Dipsie takes technology that Weiner has been developing over the last several years and uses it to crawl the hard-to-crawl site. Then the company builds an identical set of static web pages that are loaded onto the Web server and made available to other search engines. In other words, Dipsie takes sites that can't be seen by search engines and builds identical mirror sites that can."

Jonathan Bruce