Hive On Spark vs SparkSQL


.       Hive On Spark Engine vs Spark SQL ? when to use what?


     

         Yes you u guessed it right,  it depends on the situation J  In a nutshell if your existing application has heavy hive based workflows, and you want to bring in magical performance , go for Hive on Spark Engine. If it is a new development and are told to invest in Spark, then go for SparkSQL as lot of commits happening in spark project,  it is definitely coming to good shape. SparkSQL is the next gen SQL style data processing in spark even for relational data processing .



      Lets take a deeper look at what both can offer and take a balanced decision.



https://databricks.com/blog/2014/07/01/shark-spark-sql-hive-on-spark-and-the-future-of-sql-on-spark.html

Comments

Popular Posts