Which of the following is used to sort data in PySpark?

PySpark - Quiz(MCQ)

sort()

groupByKey()

reduceByKey()

sortByKey()

Correct Answer : sortByKey()

Explanation : sortByKey() is used to sort data in PySpark. It sorts an RDD of (key, value) pairs by the key in ascending or descending order. Other sorting operations in PySpark include sort(), sortBy(), and sortByValue().

Recently Updated in PySpark Questions

____ represents a set of named columns and distributed data.

pyspark.sql.DataFrame

pyspark.sql.Row

pyspark.sql.Column

pyspark.sql.GroupedData

Correct Answer : pyspark.sql.DataFrame

Explanation : pyspark.SQL.DataFrame represents a set of named columns and distributed data.

DataFrame and SQL functionality is accessed through ____.

pyspark.sql.Row

pyspark.sql.Column

pyspark.sql.DataFrame

pyspark.sql.SparkSession

Correct Answer : pyspark.sql.SparkSession

Explanation : DataFrame and SQL functionality are accessed through pyspark.sql.SparkSession.

A UDF extends Spark SQL's DSL vocabulary for transforming DataFrames by defining a new ____-based function.

Tuple

Row

Column

None of the above

Correct Answer : Column

Explaination : A UDF extends Spark SQL's DSL vocabulary for transforming DataFrames by defining a new column-based function.

New Technologies MCQ's

Machine Learning

Artificial Intelligence