Apache Atlas 安装部署

时间:2022-07-26
本文章向大家介绍Apache Atlas 安装部署,主要内容包括其使用实例、应用技巧、基本知识点总结和需要注意事项,具有一定的参考价值,需要的朋友可以参考一下。
官网参考

Apache Atlas

环境

  • Windows 7
  • apache-atlas 2.1.0
    • HBase 2.0.2(apache-atlas内置)
    • Solr 7.5.0(apache-atlas内置)

安装步骤

1. 下载源码
  • 官网下载
2. mvn构建

使用自带的HBase、Solr,构建过程会有点慢,耐心等待

mvn clean -DskipTests package -Pdist,embedded-hbase-solr

3. 运行Apache Atlas

cd 到此文件夹下

.apache-atlas-sources-2.1.0distrotargetapache-atlas-2.1.0-binapache-atlas-2.1.0bin

执行:

set MANAGE_LOCAL_HBASE=true
set MANAGE_LOCAL_SOLR=true
atlas_start.py
注意:
  1. 首先配置环境变量(MANAGE_LOCAL_HBASE、MANAGE_LOCAL_SOLR 让Atlas启动之前先启动HBase 和 Solr)
  2. 保证JDK的版本低于JDK11,否则会报如下错误,我使用的JDK8可正常启动,具体原因见https://github.com/JanusGraph/janusgraph/issues/1979
Caused by: org.janusgraph.diskstorage.PermanentBackendException: Read 1 locks with our rid  97- 99- 49- 50- 49- 48- 50- 54- 49- 51- 56- 49- 54- 45-106-102-112- 49 but mismatched timestamps; no lock column contained our timestamp (2020-10-12T02:09:41.393999800Z)
    at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSeniority(ConsistentKeyLocker.java:528)
    at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:454)
    at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:118)
    at org.janusgraph.diskstorage.locking.AbstractLocker.checkLocks(AbstractLocker.java:351)
    ... 107 more
  • UI界面

HBase-UI: localhost:61510 Solr-UI: localhost:9838 Atlas-UI: localhost:21000

4. 启动成功
  • 启动信息
configured for local hbase.
hbase started.
configured for local solr.
solr started.
setting up solr collections...
starting atlas on host localhost
starting atlas on port 21000
................................................................................
................................................................................
................................................................................
..............................................................
Apache Atlas Server started!!!
  • UI界面 默认账号密码 admin/admin
5. 导入演示数据

执行

quick_start.py

用户名密码 admin/admin

Enter username for atlas :- admin
Enter password for atlas :-
  • 导入成功

备注:

刚开始接触数据中台,现在在排坑阶段,搭建过程中如遇问题可以私信讨论~