Schema Registry edit   discuss  

A centralised registry for data schemas with support for NiFi, Kafka and Streaming Analytics Manager, allowing schemas to be defined and versioned centrally and removing the need to attach schema to every piece of data. Supports versioning of schemas (with a definable compatibility policy that validates that schemas are forward compatible, backward compatible, both or none), the ability to store and serve JAR files for serialising and de-serialising data, a REST API, Java SDK and web based user interface for managing schemas. NiFi integration supports record level operations (via RecordReaders and RecordSetWriters); Kafka integration supports Kafka Producers and Consumers. Requires a MySQL backend for schema storage, and either local of HDFS storage for serialiser/de-serialiser JAR files. Stated plan is to support a wider range of schema types (currently only Avro schemas are support), a range of other registry requirements (e.g. templates, machine learning models or business rules), and for integration with Apache Atlas and Ranger. Started by Hortonworks in October 2016, with an initial release as part of HDF 3.0 in June 2017.

Technology Information

VendorsHortonworks
TypeCommercial Open Source
Last UpdatedJune 2017 - v0.7

Related Technologies

Is packaged byHortonworks DataFlow

Release History

versionrelease daterelease linksrelease comment
0.32017-09-14release notes 
0.42018-01-22release notes 
0.52018-01-24release notes 
0.62019-02-21release notesKafka Streams support
0.72019-03-11release notesKafka 2.1

News