Comments for Nodeable Blog http://blog.nodeable.com Enter the Nodebelly of the Beast Thu, 19 Jul 2012 20:11:55 +0000 hourly 1 http://wordpress.com/ Comment on The gold in the Big Data hills is fueled by open-source software by 3 Big Data Startups: Nodeable, Solum, Eliza Corporation | What's The Big Data? http://blog.nodeable.com/2012/07/13/big-data-gold-and-commodity-pickaxes/#comment-76 Thu, 19 Jul 2012 20:11:55 +0000 http://blog.nodeable.com/?p=385#comment-76 [...] Big data quote “21st Century businesses thrive by driving abundance and then selling minimization of complexity inherent in that abundance.  It’s what Red Hat does with open source, what Google does with search, and what Facebook does with social.  It’s also what companies like Nodeable do with all the data your marketing/IT operations/sales/etc. systems throw off”—Matt Asay [...]

]]> Comment on Nodeable Bolsters Hadoop with StreamReduce Analytics Engine for Real-Time Data Insights and Faster Batch Processing by Nodeable Shift Highlights Growing Interest in (and Need For) Streaming Big Data Analytics | DevOpsANGLE http://blog.nodeable.com/2012/07/18/nodeable-bolsters-hadoop-with-streamreduce-analytics-engine-for-real-time-data-insights-and-faster-batch-processing/#comment-75 Wed, 18 Jul 2012 17:28:55 +0000 http://blog.nodeable.com/?p=388#comment-75 [...] new cloud-based service is called StreamReduce and, according to the company, can help clients make sense of (and take action based) on multiple [...]

]]> Comment on When Hadoop isn’t fast enough: The Argument for Storm by The gold in the Big Data hills is fueled by open-source software « Nodeable Blog http://blog.nodeable.com/2012/07/02/when-hadoop-isnt-fast-enough-the-argument-for-storm/#comment-73 Fri, 13 Jul 2012 17:58:18 +0000 http://blog.nodeable.com/?p=375#comment-73 [...] not perfect.  Hadoop can’t do real-time, for example, which is why Nodeable buttresses its fantastic batch-processing capabilities with the real-time computation heroics of Storm.  Storm, of course, is also open [...]

]]> Comment on Are we trying to fit square Hadoop pegs into round real-time holes? by The gold in the Big Data hills is fueled by open-source software « Nodeable Blog http://blog.nodeable.com/2012/07/06/square-hadoop-pegs-and-round-real-time-holes/#comment-72 Fri, 13 Jul 2012 17:58:15 +0000 http://blog.nodeable.com/?p=379#comment-72 [...] 2016.  Admittedly, that’s off a small base, but at that pace the Hadoop ecosystem, which Forrester already sizes at $1 billion per year, will be very, very [...]

]]> Comment on When Hadoop isn’t fast enough: The Argument for Storm by Hadoop –> Storm | bruceparker http://blog.nodeable.com/2012/07/02/when-hadoop-isnt-fast-enough-the-argument-for-storm/#comment-71 Tue, 10 Jul 2012 17:36:15 +0000 http://blog.nodeable.com/?p=375#comment-71 [...] noted elsewhere, Storm competes with Hstreaming, Streambase, and Yahoo S4. Share this:TwitterFacebookLike [...]

]]> Comment on When Hadoop isn’t fast enough: The Argument for Storm by xorlev http://blog.nodeable.com/2012/07/02/when-hadoop-isnt-fast-enough-the-argument-for-storm/#comment-70 Tue, 10 Jul 2012 04:19:00 +0000 http://blog.nodeable.com/?p=375#comment-70 Flume is absolutely awesome for getting data around. I would say Flume is complimentary to Storm, no comparison really. Flume and Storm play a massive role in our architecture. Generally, Flume gets data into HDFS for us. I’ve been working on a Flume spout for Storm.

I’d personally say Storm is better fit for when you need to do immediate processing of your data coming in, e.g. checking analytics, rolling window analysis, etc.. Flume is great for aggregating all your data to begin with.

I’m the Senior Backend Engineer @ FullContact, Dan Lynn is our CTO.

]]> Comment on When Hadoop isn’t fast enough: The Argument for Storm by Are we trying to fit square Hadoop pegs into round real-time holes? « Nodeable Blog http://blog.nodeable.com/2012/07/02/when-hadoop-isnt-fast-enough-the-argument-for-storm/#comment-69 Fri, 06 Jul 2012 18:15:40 +0000 http://blog.nodeable.com/?p=375#comment-69 [...] of which brings me back to the point I made earlier this week: some data are best analyzed in real time, not batch.  For many things, you’ll actually want both: a real-time view into what’s happening [...]

]]> Comment on When Hadoop isn’t fast enough: The Argument for Storm by When Hadoop isn’t fast enough: The Argument for Storm | Innovatie Antenne | Scoop.it http://blog.nodeable.com/2012/07/02/when-hadoop-isnt-fast-enough-the-argument-for-storm/#comment-68 Fri, 06 Jul 2012 18:14:11 +0000 http://blog.nodeable.com/?p=375#comment-68 [...] Big Data is a Big Deal, and Hadoop is arguably the driving force in Big Data.  But as awesome as Hadoop is – and it is quite awesome – it’s incomplete.  For many things, Hadoop&#8…  [...]

]]> Comment on When Hadoop isn’t fast enough: The Argument for Storm by Matt Asay http://blog.nodeable.com/2012/07/02/when-hadoop-isnt-fast-enough-the-argument-for-storm/#comment-67 Thu, 05 Jul 2012 20:23:52 +0000 http://blog.nodeable.com/?p=375#comment-67 Tim: We actually tried to use Flume at first but ran into a fair number of problems. I’ve heard the latest version is much better. Care to comment on how Flume compares? I’d love your feedback.

]]> Comment on When Hadoop isn’t fast enough: The Argument for Storm by Tim Gasper (@TimGasper) http://blog.nodeable.com/2012/07/02/when-hadoop-isnt-fast-enough-the-argument-for-storm/#comment-66 Thu, 05 Jul 2012 18:13:42 +0000 http://blog.nodeable.com/?p=375#comment-66 I love this topic area re: where Big Data meets Fast Data. Storm is an amazing tool. I’m also a big fan of Apache Flume. We’re using it as part of our implementations over at Infochimps to do a lot of real-time analytics / streaming data processing. Depending on the use case, we’re finding sometime Flume is the right near real-time tool for the job, in other instances Storm feels like a better fit.

]]>