Episode 14 – Hadoop Summit – Retrospective

After the last two special edition episodes where we quickly covered each Summit day in a “same-day” episode, we go over the full event in this episode, highlighting the sessions we enjoyed the most and sharing our general feelings about the 2016 Hadoop Summit in Dublin.

 

• Summit!
• Sessions on youtube
• Meetings and planning, Apache Metron
  • https://cwiki.apache.org/confluence/display/METRON/Metron+Wiki
  • https://community.hortonworks.com/articles/26047/apche-metron-tp1-blog-series.html
• Setting up a new podcast recording “studio”

• Summit Schedule App
• Hortonworks emphasising  Streaming ingest using Nifi, but the other talks did not so much
• Summit video sessions are starting to appear online
  • https://www.youtube.com/channel/UCAPa-K_rhylDZAUHVxqqsRA/videos
• Next year: Munich

Day one sessions:

• It’s not the size of your cluster, It’s how you use it
  • Big Fish – David Darden & Don Smith
• Unified stream and batch processing with Apache Flink
  • Artisans Gmbh – Ufuk Celebi
• Taming the Elephant
  •  Hortonworks – Paul Codding
• How To: A beginners guide to becoming an apache contributor
  • Teradata – Venkatesh
•  On-Demand HDP Clusters using Cloudbreak and Ambari
  • Symantec – Karthik Karuppaiya & Narendra Bidari
• Machine Learning in Big Data – Look Forward or be left behind
  • Redpoint Global Inc – Bill Porto
• Past, Present, Future of hadoop at LinkedIn
  • LinkedIn – Carl Steinbach
• Migrating Hundreds of Pipelines in Docker Containers
  • Spotify – Noa Resare

Day two sessions:

• MLLeap: Or how to Productionize Data science workflows using Spark
  • Shift Technologies – Mihkail Semenluk & TrueCar – Hollin Wilkins
• Scaling out to 10 Clusters, 1000 Users, and 10,000 Flows: The Dali Experience at LinkedIn
  • Carl Steinbach, LinkedIn
• Hadoop Platform at Yahoo: A Year in Review
  • Sumeet Singh, Yahoo!, Inc.
• Apache Hive 2.0 SQL Speed Scale
  • Hortonworks – Allen Gates
• Telematics with Hadoop and Nifi
  • Adam Morton, Admiral Insurance – Simon Elliston Ball, Hortonworks
• Apache Eagle – Monitor Hadoop in Real-Time
  • Ebay – Young Zang & Arun manoharan

• Great question in from Rene about small businesses and Big Data which we’ll cover on a future episode!
  • Also Rene’s feedback has helped us tweak the feedback form so it’s easier to use.
• Is this a vendor podcast? No, we’re all community! :o)
• How do you record the podcast, what is your equipment?
  • Skype-saurus: the original, expensive hardware solution.
    • http://www.leoville.com/the-skypesaurus-story (Sadly, this no longer seems to be available anymore.)
  • Skype-o-saurus: a cheaper solution using an OS-X agregate sound device.
    • https://drupalize.me/blog/201504/recording-podcasts-creating-skype-o-saurus

51:48 End