build spark source code

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

build spark source code

MidwestMike
It would be nice if I could download the source code of spark from github, then build it with sbt on my windows machine, and use IntelliJ to make little modifications to the code base. I have installed spark before on windows quite a few times, but I just use the packaged artifact.  Has anyone built the source code on a windows machine before? 
Reply | Threaded
Open this post in threaded view
|

Re: build spark source code

Jörn Franke
You can check if Apache Bigtop provided you something like this for Spark on Windows (well probably not based on sbt but mvn).

> On 23. Nov 2017, at 03:34, Michael Artz <[hidden email]> wrote:
>
> It would be nice if I could download the source code of spark from github, then build it with sbt on my windows machine, and use IntelliJ to make little modifications to the code base. I have installed spark before on windows quite a few times, but I just use the packaged artifact.  Has anyone built the source code on a windows machine before?

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]