We have multiple installations of spark installed on our clusters. They
reside in different directories which the jobs point to when they run.
For a couple of years now, we've run our history server off spark 2.0.2. We
have 2.1.2, 2.2.1 and 2.3.0 installed as well. I've tried upgrading to run
the server out of the 2.3.0 install. The UI loads, but will not show logs.
For fun, I then tried 2.2.1, same deal. However, when I ran 2.1.2, it works
(albeit with a JS error about missing data in some table cell or row).
Are there any special steps to upgrading the history server between spark
versions? I've combed over settings multiple times, it all seems fine.