Support setting a snapshot property in same commit as spark.sql #368
Description
Feature Request / Improvement
This cookbook has a java snippet to update a snapshot property atomically with a sql MERGE INTO.
// Update the target table and set the watermark in the same commit
CommitMetadata.withCommitProperties(
Map.of("watermark:raw.log_source", endSnapshotId),
() -> {
spark.sql("MERGE INTO ...");
return 0;
}, RuntimeException.class);It would be great if pyiceberg allowed me to similarly wrap my spark.sql call and add snapshot properties.
ajosephides and clamar14