Unlimited Access

Get Unlimited Contributor Access to the all ExamTopics Exams!
Take advantage of PDF Files for 1000+ Exams along with community discussions and pass IT Certification Exams Easily.

Get Unlimited Access

Databricks Discussions

Exam Certified Machine Learning Associate topic 1 question 18 discussion

Actual exam question from Databricks's Certified Machine Learning Associate

Question #: 18
Topic #: 1

[All Certified Machine Learning Associate Questions]

A data scientist has defined a Pandas UDF function predict to parallelize the inference process for a single-node model:

They have written the following incomplete code block to use predict to score each record of Spark DataFrame spark_df:

Which of the following lines of code can be used to complete the code block to successfully complete the task?

A. predict(*spark_df.columns)
B. mapInPandas(predict)
C. predict(Iterator(spark_df))
D. mapInPandas(predict(spark_df.columns))
E. predict(spark_df.columns)

Show Suggested Answer

Suggested Answer: B 🗳️

by souarav at June 1, 2024, 2:35 p.m.

Comments

Submit Cancel

rajneesharora

3 days, 6 hours ago

correct answer is A, Scalar Pandas UDFs work with column names or expressions and return a column that gets added to the DataFrame. In this particular case, the use of *spark_df.columns unpacks the column names, which allows the UDF to operate on all these columns. No other option provides all column names

upvoted 1 times

...