Episode 9 – SQL in Hadoop

SQL was one of the first data access methods added to vanilla Hadoop. Considering that the many of the people working with Hadoop in the early days came from a database background, this is not surprising. Since then, the SQL ecosystem in Hadoop has grown considerably and in this episode we do a general overview of many of the available choices.This episode runs a bit longer than normal but we hope you’ll find it worthwhile!

• Spark masterclasses
• NiFi on trains
• Mifid II and the active archive
• World Mobile Congress

SQL solutions:

• Apache Hive
  • https://hive.apache.org/
• Apache Spark Sql
  • http://spark.apache.org/sql/
• Apache Phoenix
  • https://phoenix.apache.org/
• Apache Impala (incubating)
  • https://www.cloudera.com/products/apache-hadoop/impala.html
• Apache Hawq (incubating)
  • http://hawq.incubator.apache.org/
• Apache Drill
  • https://drill.apache.org/
• Presto
  • https://prestodb.io/
• Oracle Big Data Sql
  • http://www.oracle.com/us/products/database/big-data-sql/overview/index.html
• IBM BigSql
  • http://www-01.ibm.com/software/data/infosphere/hadoop/big-sql.html

Technology topics:

• JDBC/ODBC
• SQL syntax compliance
• Multi-user concurrency
• Benchmarks

• How much storage overhead should I count on if I add SQL in my Hadoop workflow?
• How do I make my sql faster?

53:38 End