GraphX Graph Input RDD Partitioning

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

GraphX Graph Input RDD Partitioning

Adam Novak
Hello,

I'm getting ArrayIndexOutOfBoundsExceptions out of GraphX when
operating on my graph. I'm making the graph from an RDD of nodes and
an RDD of edges (the apply method on the Graph object). If I make sure
that the node RDD and the edge RDD have the same number of partitions
when I create the graph, the problem goes away.

Is Graph.apply supposed to require that its arguments have the same
number of partitions? It's not listed as a requirement in the
documentation.

Thanks,
-Adam