Running Shark query in Spark

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Running Shark query in Spark

gogowater
This post has NOT been accepted by the mailing list yet.
Hi,

I am creating a poc to run Shark Query in Spark.  However, the Shark context doesn't connect to the same Hive as the Shark Interactive cmd does.  How can do I that?

The goal is to retrieve the data from Hive to process and eventually save it back into Hive.  Can this be done via Spark?

Thanks.