Think your dataset is large? Search this!

June 18, 2009 | building43

At a recent Twitter conference, we overheard attendees bragging about their datasets. “I have 800 million rows in mine,” one developer said.

Well, did you ever try to search datasets that large, or larger?

At Rackspace, a few developers eat datasets that large for lunch. Stu Hood, tech lead at Rackspace’s Mail and Apps group, is one of them. In this video interview with Robert Scoble, he shares his insights into the tools he uses to search huge datasets, including Hadoop and Lucene. Watch as he explains some of the issues with building search engines that work across huge datasets.

This post was tagged:
 

{ 1 comment }

qin September 29, 2009 at 12:58 pm

<p> Frozen winter is coming,do you like to buy ugg to preventing cold and keeping warm.As a pursuer for the most stylish ,is there any ugg boots you have in mind?I think you have no excuse anymore if you don’t have a pair of <a href=”http://www.realugg.com/ugg-bailey-button-c-52.html“><strong>UGG Bailey Button Boots</strong></a>.The <a href=”http://www.realugg.com/ugg-bailey-button-c-52.html“><strong>Bailey Button UGG</strong></a> can be worn as a <A href=”http://www.realugg.com/ugg-classic-short-c-28.html?zenid=ae999140b41bfc67c4fd4f9ec46cb39e“><STRONG>UGG classic short Boots </STRONG></A> or  <A href=”http://www.realugg.com/ugg-classic-mini-c-33.html?zenid=ae999140b41bfc67c4fd4f9ec46cb39e“><STRONG> UGG classic   mini Boots </STRONG></A>. Hottest pop style.If you like the<a href=”http://www.realugg.com/ugg-tall-boots-c-30.html“><strong> UGG tall boots</strong></a>,www.realugg.com can provide high quality of <a href=”http://www.realugg.com/ugg-tall-boots-c-30.html“><strong>Ugg Tall Boots</strong></a> in low price,Are you straitened for  <a href=”http://www.realugg.com/3-pairs-ugg-boots-insoles-p-2147.html“><strong>Ugg Boots Insoles</strong></a>,don’t worry ,we have the best <a href=”http://www.realugg.com/3-pairs-ugg-boots-insoles-p-2147.html“><strong>Ugg Boots Insoles</strong></a> on sale ,many of which are hand made by craftspeople.RealUGG,Inc came up with some new-styles-<a href=”http://www.realugg.com/ugg-lo-pro-button-c-57.html“><strong> Ugg Lo Pro Button , </strong></a>   <a href=”http://www.realugg.com/ugg-womens-rainier-c-53.html“><strong>Ugg Women’s Rainier</strong></a>, We offer a wide range of UGG Boots in different color and styles.  Browse the website, we are sure you will find <a href=”http://www.realugg.com/“><strong>Real UGG</strong></a>  to tempt you! </p>

Comments on this entry are closed.

{ 2 trackbacks }