SQL-based INSERTS, DELETES and UPSERTS in S3 using AWS Glue 3.0 and Delta Lake
The purpose of this blog post is to demonstrate how you can use Spark SQL Engine to do UPSERTS, DELETES, and INSERTS. Basically, updates.
Earlier this month, I made a blog post about doing this via PySpark. Check it out below:
https://klescosia.hashn...
klescosia.hashnode.dev7 min read