Episode 22 - Big Data in Small Business

The main subject in this episode features answer to a listener question we received a couple of months ago: How can big data help small businesses? What ways can small business use big data? At the moment all the talk is about big data helping enterprise firms. And we are introducing a new section which we hope you will enjoy!

Podcast: Play in new window | Download (Duration: 1:32:35 — 53.2MB)

Subscribe: Apple Podcasts | Spotify | RSS | More

00:00 Recent events

Working with a new team in sunny cork, getting them up to speed
Workshop with a global SI and a European tel-co about the upcoming phases of their big data journey
Workshop with a customer who has been using Hadoop for a very long time, since Hadoop 0.2! Finally looking to migrate into the future
Multi vendor workshop fraud analytics
Object recognition and detection in images.

11:30 Our very own “New and Noteworthy”

- Dave

Jhon
- Apache Spark 2.0 (July 28, 2016)
  - http://spark.apache.org/releases/spark-release-2-0-0.html
  - Unifying DataFrame and Dataset (RDD): In Scala and Java, DataFrame and Dataset have been unified, i.e. DataFrame is just a type alias for Dataset of Row.
  - SparkSession: new entry point that replaces the old SQLContext and HiveContext for DataFrame and Dataset APIs.
  - MLLib: The DataFrame-based API is now the primary API. The RDD-based API is entering maintenance mode.
  - Spark 2.0 substantially improved SQL functionalities with SQL2003 support. Spark SQL can now run all 99 TPC-DS queries
  - Ships the initial experimental release for Structured Streaming, a high level streaming API built on top of Spark SQL
  - Databricks article:
    - https://databricks.com/blog/2016/07/28/continuous-applications-evolving-streaming-in-apache-spark-2-0.html
- Apache Mesos 1.0 released
  - https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces97
  - http://techblog.netflix.com/2016/07/distributed-resource-scheduling-with.html
- Apache Twill becomes top level project
  - http://twill.apache.org/
  - https://blogs.apache.org/foundation/entry/apache_software_foundation_announces_apache1

44:40 Big Data for Small Business

Define “small business”
How can big data help small businesses
What ways can small business use big data
The problems a small business could face
- http://www.columnfivemedia.com/100-best-free-data-sources-infographic
Our answers to those problems
Some conclusions

01:32:35 End

Please use the Contact Form on this blog or our twitter feed to send us your questions, or to suggest future episode topics you would like us to cover.