Getting : format(target_id, ".", name), value) .. error

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Getting : format(target_id, ".", name), value) .. error


I am getting this in unclear error message when I read a parquet file, it seems something is wrong with data but what? I googled a lot but did not find any clue. I hope some spark experts could help me with this?


Traceback (most recent call last):
  File "/usr/lib/spark/python/lib/", line 94, in rdd
    jrdd = self._jdf.javaToPython()
  File "/usr/lib/spark/python/lib/", line 1257, in __call__
    answer, self.gateway_client, self.target_id,
  File "/usr/lib/spark/python/lib/", line 63, in deco
    return f(*a, **kw)
  File "/usr/lib/spark/python/lib/", line 328, in get_return_value
    format(target_id, ".", name), value)
py4j.protocol.Py4JJavaError: An error occurred while calling o622.javaToPython.