Writing to Delta Table with Spark 3 (much easier!)

May 5, 2022 | 1 min |  #apache-spark

.writeTo actually creates (lots of overloads available) a delta table in the correct database and location, no parameters are required.

1val df = spark.sparkContext.parallelize(Seq(
2  (1, "one"),
3  (2, "two")
4)).toDF("id", "name")
5
6df.writeTo("shared.idname").createOrReplace()

Have feedback or questions? Feel free to email me.