[SPARK-3349] [SQL] Output partitioning of limit should not be inherited from child

This resolves https://issues.apache.org/jira/browse/SPARK-3349
This is not changing the implementation, just correcting a bug that
prevents exchange operators from being inserted when we need them.
On Sep 3, 2014 11:00 PM, "Cheng Hao" <notifications@github.com> wrote:

> In
> sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala:
>
> > @@ -97,6 +97,7 @@ case class Limit(limit: Int, child: SparkPlan)
> >    // partition local limit -> exchange into one partition -> partition local limit again
> >
> >    override def output = child.output
> > +  override def outputPartitioning = SinglePartition
>
> SinglePartition for LIMIT may cause performance issue for large number of
> records(in multiple partitions), do we really need to change this?
>
> —
> Reply to this email directly or view it on GitHub
> <https://github.com/apache/spark/pull/2262/files#r17096863>.
>