Differences
This shows you the differences between two versions of the page.
| Next revision | Previous revision | ||
| kb:bigdata:spark:ml_save_and_load_model [2018/06/17 15:18] – created yehuda | kb:bigdata:spark:ml_save_and_load_model [2022/01/03 16:03] (current) – external edit 127.0.0.1 | ||
|---|---|---|---|
| Line 34: | Line 34: | ||
| model.save(" | model.save(" | ||
| - | |||
| - | |||
| - | def o(): | ||
| - | # Prepare test documents, which are unlabeled (id, text) tuples. | ||
| - | test = spark.createDataFrame([ | ||
| - | (4, "spark i j k"), | ||
| - | (5, "l m n"), | ||
| - | (6, "spark hadoop spark" | ||
| - | (7, " | ||
| - | ], [" | ||
| - | |||
| - | # Make predictions on test documents and print columns of interest. | ||
| - | prediction = model.transform(test) | ||
| - | selected = prediction.select(" | ||
| - | for row in selected.collect(): | ||
| - | rid, text, prob, prediction = row | ||
| - | print(" | ||
| </ | </ | ||
