programmatically set hadoop_conf_dir for spark

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

programmatically set hadoop_conf_dir for spark

崔苗(数据与人工智能产品开发部)

Hi,
I know we can set  hadoop_conf_dir in spark-env.sh , but we want to set hadoop_conf_dir and hive_home for spark in java code to match different cluster , is there a way to set spark-env in program ?

Thanks for any replys
--------------------------------------------------------------------- To unsubscribe e-mail: [hidden email]