To decide how RDDs are stored, PySpark has different StorageLevels, such as the following:

PySpark - Quiz(MCQ)

DISK_ONLY

DISK_ONLY_2

MEMORY_AND_DISK

All of the above

Correct Answer : All of the above

Explanation : To decide how RDDs are stored, PySpark has different StorageLevels, such as the following :

* DISK_ONLY
* DISK_ONLY_2
* MEMORY_AND_DISK

Recently Updated in PySpark Questions

____ represents a set of named columns and distributed data.

pyspark.sql.DataFrame

pyspark.sql.Row

pyspark.sql.Column

pyspark.sql.GroupedData

Correct Answer : pyspark.sql.DataFrame

Explanation : pyspark.SQL.DataFrame represents a set of named columns and distributed data.

DataFrame and SQL functionality is accessed through ____.

pyspark.sql.Row

pyspark.sql.Column

pyspark.sql.DataFrame

pyspark.sql.SparkSession

Correct Answer : pyspark.sql.SparkSession

Explanation : DataFrame and SQL functionality are accessed through pyspark.sql.SparkSession.

A UDF extends Spark SQL's DSL vocabulary for transforming DataFrames by defining a new ____-based function.

Tuple

Row

Column

None of the above

Correct Answer : Column

Explaination : A UDF extends Spark SQL's DSL vocabulary for transforming DataFrames by defining a new column-based function.

New Technologies MCQ's

Machine Learning

Artificial Intelligence