Audit hive table

2019-07-25 13:10发布

I have a hive table lets say it as table A. My requirement is to capture all the DML and DDL operations on table A in table B. Is there any way to capture the same?

Thanks in advance..

标签: hive hdfs hiveql
2条回答
做自己的国王
2楼-- · 2019-07-25 13:47

I have not come across any such tool however Cloudera Navigator helps to manage it. Refer the detailed documentation.

Cloudera Navigator

Cloudera Audit Event

Cloudera Navigator auditing supports tracking access to:

  1. HDFS entities accessed by HDFS, Hive, HBase, Impala, and Solr services
  2. HBase and Impala
  3. Hive metadata
  4. Sentry
  5. Solr
  6. Cloudera Navigator Metadata Server

Alternatively, if you are not using cloudera distribution, you can still access hive-metastore log file under /var/log/hive/hadoop-cmf-hive-HIVEMETASTORE.log.out and check the changes applied to the different table.

hive-meta-log

查看更多
太酷不给撩
3楼-- · 2019-07-25 14:00

I haven't used Apache atlas yet, but from the documentation, it looks like they have Audit store and hive bridge. That works for operational events as well.

https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.1/atlas-overview/content/apache_atlas_features.html

查看更多
登录 后发表回答