spark-lake-catalog

From README

oleander Spark Lake Catalog Use this skill when reading from or writing to the oleander lake catalog in a Spark job. For shared catalog conventions such as table naming, namespaces, and avoiding raw storage paths, also use lake-catalog. Reading tables Use spark.table() with the fully qualified table name: Do not construct raw storage paths for Iceberg tables. Use catalog-qualified names so Spark reads the table through the Iceberg catalog. Writing tables Append (add rows to an existing or new table): Overwrite (replace table contents): Use writeTo(...).append() for incremental pipelines. Use write.mode("overwrite").saveAsTable(...) when replacing the full result set each run. Prefer Spark writes over driver writes Avoid collecting data to the driver and then writing from Python memory. Keep writes as Spark DataFrame operations so Iceberg handles the transaction, partitioning, and metadata correctly.