SIGBUS (0xa) when using DataFrameWriter.insertInto

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

SIGBUS (0xa) when using DataFrameWriter.insertInto

alexzautke
Hi everyone!

I am currently running into the issue that a call to
DataFrameWriter.insertInto is reproducibly crashing the JVM.

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGBUS (0xa) at pc=3D0x00000001194a3520, pid=3D16154,
tid=3D0x0000000000008417
#
# JRE version: Java(TM) SE Runtime Environment (8.0_121-b13) (build
1.8.0_121-b13)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.121-b13 mixed mode
bsd-amd64 compressed oops)
# Problematic frame:
# v  ~StubRoutines::jshort_disjoint_arraycopy
#
# Failed to write core dump. Core dumps have been disabled. To enable
core dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
#

The last call before the crash is made to =
org.apache.spark.unsafe.types.UTF8String.getBytes().
Is there anyone how is willing to help me debug this issue?

Thank you all in advance!
Alexander Zautke



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: SIGBUS (0xa) when using DataFrameWriter.insertInto

alexzautke
This post was updated on .
Please also find attached a complete error log.

hs_err_pid18703.log

--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Reply | Threaded
Open this post in threaded view
|

Re: SIGBUS (0xa) when using DataFrameWriter.insertInto

Ted Yu
I don't seem to find the log.

Can you double check ?

Thanks

-------- Original message --------
From: alexzautke <[hidden email]>
Date: 10/27/18 8:54 AM (GMT-08:00)
Subject: Re: SIGBUS (0xa) when using DataFrameWriter.insertInto

Please also find attached a complete error log.



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: SIGBUS (0xa) when using DataFrameWriter.insertInto

alexzautke
In reply to this post by alexzautke
Now its uploaded! Thanks :)



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: SIGBUS (0xa) when using DataFrameWriter.insertInto

alexzautke
In reply to this post by alexzautke
Reported as SPARK-25907, if anyone is still interested.



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]