map and flatMap transformations in Spark RDDs

Plain Petrel answered on October 11, 2024 Popularity 1/10 Helpfulness 1/10

answer map and flatMap transformations in Spark RDDs

map and flatMap transformations in Spark RDDs

Comment

Copied!
# Example of map
rdd = spark.sparkContext.parallelize([1, 2, 3])
mapped_rdd = rdd.map(lambda x: x * 2)
print(mapped_rdd.collect())  # Output: [2, 4, 6]
# Example of flatMap
flat_mapped_rdd = rdd.flatMap(lambda x: [x, x * 2])
print(flat_mapped_rdd.collect())  # Output: [1, 2, 2, 4, 3, 6]
POWERED BY

Popularity 1/10 Helpfulness 1/10 Language python

Source: www.datacamp.com

Tags: flatmap map python

Link to this answer
Share Copy Link

Contributed on Oct 11 2024

Plain Petrel

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

map and flatMap transformations in Spark RDDs

Contents

More Related Answers

map and flatMap transformations in Spark RDDs

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.