Running Shark query in Spark

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Running Shark query in Spark

This post has NOT been accepted by the mailing list yet.

I am creating a poc to run Shark Query in Spark.  However, the Shark context doesn't connect to the same Hive as the Shark Interactive cmd does.  How can do I that?

The goal is to retrieve the data from Hive to process and eventually save it back into Hive.  Can this be done via Spark?