Bug in Window Function

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Bug in Window Function

Elior Malul
Exception in thread "main" org.apache.spark.sql.AnalysisException: collect_set(named_struct(value, country#123 AS value#346, count, (cast(count(country#123) windowspecdefinit     ion(campaign_id#104, app_id#93, country#123, ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING) as double) / cast(count(1) windowspecdefinition(campaign_id#104, app_id     #93, ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING) as double)) AS count#349) AS histogram_country#350, 0, 0) windowspecdefinition(campaign_id#104, app_id#93, ROWS      BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING) AS collect_set(named_struct(NamePlaceholder(), country AS `value`, NamePlaceholder(), (CAST(count(country) OVER (PARTITI     ON BY campaign_id, app_id, country UnspecifiedFrame) AS DOUBLE) / CAST(count(1) OVER (PARTITION BY campaign_id, app_id UnspecifiedFrame) AS DOUBLE)) AS `count`) AS `histogram     _country`) OVER (PARTITION BY campaign_id, app_id UnspecifiedFrame)#352 has multiple Window Specifications (ArrayBuffer(windowspecdefinition(campaign_id#104, app_id#93, ROWS      BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING), windowspecdefinition(campaign_id#104, app_id#93, country#123, ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING))     ).Please file a bug report with this error message, stack trace, and the query.;
Reply | Threaded
Open this post in threaded view
|

Re: Bug in Window Function

Jacek Laskowski
Hi Elior,

Could you show the query that led to the exception?


On Wed, Jul 25, 2018 at 10:04 AM, Elior Malul <[hidden email]> wrote:
Exception in thread "main" org.apache.spark.sql.AnalysisException: collect_set(named_struct(value, country#123 AS value#346, count, (cast(count(country#123) windowspecdefinit     ion(campaign_id#104, app_id#93, country#123, ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING) as double) / cast(count(1) windowspecdefinition(campaign_id#104, app_id     #93, ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING) as double)) AS count#349) AS histogram_country#350, 0, 0) windowspecdefinition(campaign_id#104, app_id#93, ROWS      BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING) AS collect_set(named_struct(NamePlaceholder(), country AS `value`, NamePlaceholder(), (CAST(count(country) OVER (PARTITI     ON BY campaign_id, app_id, country UnspecifiedFrame) AS DOUBLE) / CAST(count(1) OVER (PARTITION BY campaign_id, app_id UnspecifiedFrame) AS DOUBLE)) AS `count`) AS `histogram     _country`) OVER (PARTITION BY campaign_id, app_id UnspecifiedFrame)#352 has multiple Window Specifications (ArrayBuffer(windowspecdefinition(campaign_id#104, app_id#93, ROWS      BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING), windowspecdefinition(campaign_id#104, app_id#93, country#123, ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING))     ).Please file a bug report with this error message, stack trace, and the query.;