Error Message Suggestion

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Error Message Suggestion

Josh Herzberg
Hi,

I'd like to suggest this change to the PySpark code. I haven't contributed before so https://spark.apache.org/contributing.html suggested emailing here first.

In the error raised here https://github.com/apache/spark/blob/b2bfe985e8adf55e5df5887340fd862776033a06/python/pyspark/worker.py#L141, the columns returned can be difficult to identify. The error would be more helpful and clear if the columns returned were included in the error message like so,
image.png
Happy to help make this happen if I can. Thanks!

Josh
Reply | Threaded
Open this post in threaded view
|

Re: Error Message Suggestion

srowen
Sure, just open a pull request?

On Mon, Mar 29, 2021 at 10:37 AM Josh Herzberg <[hidden email]> wrote:
Hi,

I'd like to suggest this change to the PySpark code. I haven't contributed before so https://spark.apache.org/contributing.html suggested emailing here first.

In the error raised here https://github.com/apache/spark/blob/b2bfe985e8adf55e5df5887340fd862776033a06/python/pyspark/worker.py#L141, the columns returned can be difficult to identify. The error would be more helpful and clear if the columns returned were included in the error message like so,
image.png
Happy to help make this happen if I can. Thanks!

Josh