Bounded Splittable DoFn Support Status
| Google Cloud Dataflow | Prism Local Runner | Apache Flink | Apache Spark (RDD/DStream based) | Apache Spark Structured Streaming (Dataset based) | Apache Nemo | Hazelcast Jet | Twister2 | Python Direct FnRunner | |
|---|---|---|---|---|---|---|---|---|---|
| Base | Partially : Only Dataflow Runner V2 supports this. | Yes : fully supported | Partially : Only portable Flink Runner supports this. | : | : | : | : | : | Yes : |
| Side Inputs | Partially : Only Dataflow Runner V2 supports this. | Yes : fully supported | Partially : Only portable Flink Runner supports this. | : | : | : | : | : | : |
| Splittable DoFn Initiated Checkpointing | Partially : Only Dataflow Runner v2 supports this. | Yes : fully supported | Partially : Only portable Flink Runner supports this. | : | : | : | : | : | Yes : |
| Dynamic Splitting | Partially : Only Dataflow Runner V2 supports this. | Yes : fully supported | No : | : | : | : | : | : | Yes : Only with Python SDK |
| Bundle Finalization | Partially : Only Dataflow Runner V2 supports this. | Yes : fully supported | No : | : | : | : | : | : | Yes : |
Last updated on 2026/08/07
Have you found everything you were looking for?
Was it all useful and clear? Is there anything that you would like to change? Let us know!