Unbounded Splittable DoFn Support Status
| Google Cloud Dataflow | Prism Local Runner | Apache Flink | Apache Spark (RDD/DStream based) | Apache Spark Structured Streaming (Dataset based) | Apache Nemo | Hazelcast Jet | Twister2 | Python Direct FnRunner | |
|---|---|---|---|---|---|---|---|---|---|
| Base | Yes : | Yes : fully supported | Partially : Support is either incomplete or broken on portable Flink Runner (#19637) | : | : | : | : | : | Yes : |
| Side Inputs | Yes : fully supported | Yes : fully supported | No : | : | : | : | : | : | : |
| Splittable DoFn Initiated Checkpointing | Yes : | Yes : fully supported | Partially : | : | : | : | : | : | Yes : |
| Dynamic Splitting | No : | Yes : fully supported | No : | : | : | : | : | : | No : |
| Bundle Finalization | Partially : Only Dataflow Runner V2 supports this. | Yes : fully supported | No : | : | : | : | : | : | Yes : |
Last updated on 2026/08/07
Have you found everything you were looking for?
Was it all useful and clear? Is there anything that you would like to change? Let us know!