spark.
hint
Specifies some hint on the current DataFrame.
See also
broadcast
Marks a DataFrame as small enough for use in broadcast joins.
Examples
>>> df1 = ks.DataFrame({'lkey': ['foo', 'bar', 'baz', 'foo'], ... 'value': [1, 2, 3, 5]}, ... columns=['lkey', 'value']) >>> df2 = ks.DataFrame({'rkey': ['foo', 'bar', 'baz', 'foo'], ... 'value': [5, 6, 7, 8]}, ... columns=['rkey', 'value']) >>> merged = df1.merge(df2.spark.hint("broadcast"), left_on='lkey', right_on='rkey') >>> merged.spark.explain() == Physical Plan == ... ...BroadcastHashJoin... ...