Optional, opt-in instrumentation that adds extra metrics and metadata to Spark UI.
DataFlint Spark Instrumentation
DataFlint provides optional instrumentation that enhances Spark observability. It injects extra metrics and metadata into the Spark UI. All instrumentation is opt-in and disabled by default
This feature is currently experimental, DataFlint instrument your query physical plan so use with caution.