Cloudera Navigator Data Management edit   discuss  

Solution for managing data on a CDH Hadoop cluster. Automatically extracts metadata relating to HDFS, Hive, Impala, MapReduce, Oozie, Pig, S3, Spark, Sqoop and YARN, including data structures (databases, tables and columns) and jobs (relating to data transformation) based on activity within a cluster (rather than statically analysing code), allowing it to be searched, filtered and viewed, including displaying lineage diagrams showing how data moves through the system, a Data Stewardship dashboard of key data management information (including statistics on the data held in the cluster and the activity relating to this data), analytics on the data held in HDFS, and a full audit capability of all activity on the cluster. Allows custom metadata to be added to objects, including descriptions, key-value pairs and tags, with the option to define metadata namespaces and data types / value constraints (managed metadata), plus the ability to pre-set custom attributes (via job properties for MapReduce jobs and JSON .navigator files for HDFS files), and the ability to define data lifecycle management policies (allowing actions to be specified based on metadata, e.g. to archive any files that haven't been accessed for six months). Web based, with a full user security model, and a REST API and Java SDK for integrating external applications with metadata held in Navigator. Initial 1.0 release was in February 2013.

Technology Information

Last UpdatedApril 2019 - v6.2

Release History

versionrelease daterelease linksrelease comment
2.102017-04-18See CDH 5.11 release linksCDH 5.11
2.112017-07-13See CDH 5.12 release linksCDH 5.12
2.122017-10-12See CDH 5.13 release linksCDH 5.13
2.132018-01-26See CDH 5.14 release linksCDH 5.14
2.142018-06-15See CDH 5.15 release linksCDH 5.15
2.152018-11-28Release Notes[CDH] 5.16
6.02018-08-30Release notesCDH 6.0
6.12018-12-18Release notesCDH 6.1
6.22019-03-29Release notesCDH 6.2