Update README.md

datahub-project · Nov 6, 2024 · 9f8f5b3 · 9f8f5b3
1 parent d5d4810
commit 9f8f5b3
Showing 1 changed file with 4 additions and 3 deletions.
diff --git a/metadata-integration/java/spark-lineage-legacy/README.md b/metadata-integration/java/spark-lineage-legacy/README.md
@@ -96,9 +96,10 @@ The Spark agent can be configured using Databricks Cluster [Spark configuration]
 - Open Databricks Cluster configuration page. Click the **Advanced Options** toggle. Click the **Spark** tab. Add below configurations under `Spark Config`.
 
     ```text
-    spark.extraListeners                datahub.spark.DatahubSparkListener
-    spark.datahub.rest.server           http://localhost:8080
-    spark.datahub.databricks.cluster    cluster-name<any preferred cluster identifier>
+    spark.extraListeners                    datahub.spark.DatahubSparkListener
+    spark.datahub.rest.server               http://localhost:8080
+    spark.datahub.stage_metadata_coalescing true
+    spark.datahub.databricks.cluster        cluster-name<any preferred cluster identifier>
     ```
 
 - Click the **Init Scripts** tab. Set cluster init script as `dbfs:/datahub/init.sh`.