for Hive jars。
viewExpandedText， columns， stored as， startTime， locationUri，。
export DMLs (insert) alter database alter table (skewed table information， true to run the hook synchronously. default false. Recommended to be set to false to avoid delays in hive query completion. atlas.hook.hive.numRetries - number of retries for notification failure. default 3 atlas.hook.hive.minThreads - core number of threads. default 5 atlas.hook.hive.maxThreads - maximum number of threads. default 5 atlas.hook.hive.keepAliveTime - keep alive time in msecs. default 10 atlas.hook.hive.queueSize - queue size for the threadpool. default 10000 Refer Configuration for notification related configurations Limitations Since database name， set HIVE_HOME to the root of Hive installation * Set environment variable HIVE_CONF_DIR to Hive configuration directory * Copy atlas-conf/atlas-application.properties to the hive conf directory Usage: atlas package/bin/import-hive.sh The logs are in atlas package/logs/import-hive.log If you you are importing metadata in a kerberized cluster you need to run the command like this: atlas package/bin/import-hive.sh -Dsun.security.jgss.debug=true -Djavax.security.auth.useSubjectCredsOnly=false -Djava.security.krb5.conf=[krb5.conf location] -Djava.security.auth.login.config=[jaas.conf location] Hive Hook Hive supports listeners on hive command execution using hive hooks. This is used to add/update/remove entities in Atlas using the model defined in org.apache.atlas.hive.model.HiveDataModelGenerator. The hook submits the request to a thread pool executor to avoid blocking the command execution. The thread submits the entities as message to the notification server and atlas server reads these messages and registers the entities. Follow these instructions in your hive set-up to add hive hook for Atlas: Set-up atlas hook in hive-site.xml of your hive configuration: propertynamehive.exec.post.hooks/namevalueorg.apache.atlas.hive.hook.HiveHook/value/property propertynameatlas.cluster.name/namevalueprimary/value/property Add 'export HIVE_AUX_JARS_PATH=atlas package/hook/hive' in hive-env.sh of your hive configuration Copy atlas-conf/atlas-application.properties to the hive conf directory. The following properties in atlas-conf/atlas-application.properties control the thread pool and notification details: atlas.hook.hive.synchronous - boolean， order]hive_serde(StructType) - attributes [name， operationType， queryId]hive_principal_type(EnumType) - values [USER， location， sortCols， aliases， sd。
owner， bucketCols， The default hive modelling is available in org.apache.atlas.hive.model.HiveDataModelGenerator. It defines the following types: hive_db(ClassType) - super types [Referenceable] - attributes [name， tableType， tableName and columnName should be in lower case. clusterName is explained below. hive_db - attribute qualifiedName - dbName@clusterName hive_table - attribute qualifiedName - dbName.tableName@clusterName hive_column - attribute qualifiedName - dbName.tableName.columnName@clusterName hive_process - attribute name - queryString - trimmed query string in lower case Importing Hive Metadata org.apache.atlas.hive.bridge.HiveMetaStoreBridge imports the Hive metadata into Atlas using the model defined in org.apache.atlas.hive.model.HiveDataModelGenerator. import-hive.sh command can be used to facilitate this. The script needs Hadoop and Hive classpath jars. * For Hadoop jars， ROLE， serializationLib， comment， endTime， comment。
table]hive_table(ClassType) - super types [DataSet] - attributes [name， ownerType]hive_storagedesc(ClassType) - super types [Referenceable] - attributes [cols， any search APIs should use lowercase while querying on the entity names The following hive operations are captured by hive hook currently create database create table/view， createTime。
userName， protection is not supported) ， parameters， inputFormat， db， lastAccessTime， viewOriginalText， type。
ownerName， import。
queryText， GROUP]hive_order(StructType) - attributes [col， outputFormat， compressed， parameters。
temporary]hive_process(ClassType) - super types [Process] - attributes [name， parameters] The entities are created and de-duped using unique qualified name. They provide namespace and can be used for querying/lineage as well. Note that dbName。
clusterName， create table as select load， retention， table name and column names are case insensitive in hive。
storedAsSubDirectories]hive_column(ClassType) - super types [Referenceable] - attributes [name。
parameters。
numBuckets， serdeInfo。
the corresponding names in entities are lowercase. So， queryPlan。
description， please make sure that the environment variable HADOOP_CLASSPATH is set. Another way is to set HADOOP_HOME to point to root directory of your Hadoop installation * Similarly， partitionKeys。