A distribution of a set of Apache and Hortonworks open source technologies for processing and running analytics on data 'in motion', with all products integrated with Apache Ranger for security, Apache Ambari for management and Schema Registery for central schema management. All bundled Apache open source projects are based on official Apache project releases, with any patches for bug fixes or new features being official Apache project patches from later releases of the relevant project. Available as RPMs or through Apache Ambari (via a management pack), and as an on-site or in the cloud managed service (as Hortonworks Operational Services), but is not currently available via Cloudbreak or as a cloud service. The HDF softare is provided free of charge, with training, consultancy and support available from Hortonworks. First released in September 2015 as a distribution of just NiFi following the acquisition by Hortonworks of Onyara (a company founded by some of the original creators of NiFi). The details of the Apache projects distributed as part of Hortonworks DataFlow are detailed in the release notes, along with the specific versions included, the unsupported features, the patches pulled forward from future project releases, and the known vulnerabilities and issues.
Other Names HDF Vendors Hortonworks Type Commercial Open Source Last Updated March 2019 - 3.4
Packages Apache Kafka, Apache Knox, Apache NiFi, MiNiFi, NiFi Registry, Apache Ranger, Apache Storm, Apache ZooKeeper, Schema Registry, Streaming Analytics Manager Manageable via Apache Ambari
version release date release links release comment 1.0 2015-09 press release Initial version consisting of just Apache NiFi 1.1 2015-12 blog post 1.2 2016-03 blog post Storm and Kafka added 2.0 2016-09 blog post Ranger and Ambari support added 2.1 2016-12 blog post 3.0 2017-06-12 blog post Streaming Analytics Manager and Schema Registry added; technical preview of SAM Stream Insights which bundles Druid and Apache Superset 3.1 2018-02-01 blog post Upgrade to NiFi 1.5 and Kafka 1.0; adds MiNiFi C++ agent and NiFi Registry 3.2 2018-08-14 blog post; release notes 3.3 2018-11-16 blog post; release notes; Kafka use cases Kafka 2.0; Ranger 1.2; NiFi 1.8; Kafka Streams; Hive+Druid over Kafka 3.4 2018-03-16 release notes Kafka 2.1; NiFi 1.9; NiFi Registry 0.3; Schema Registry 0.7
The details of the Apache projects distributed as part of Hortonworks DataFlow are detailed in the release notes, along with the specific versions included, the unsupported features, the patches pulled forward from future project releases, and the known vulnerabilities and issues.