zookeeper5 Kafka cluster Getting Started kafka는 분산 메시징 시스템으로 높은 성능을 자랑한다.A high-throughput distributed messaging system. 분산 시스템을 구성 위해서 3개 노드에 zookeeper, kafka를 모두 설치한다. Downloadhttp://kafka.apache.org/downloads.html Setup ZooKeeper $ vi ${KAFKA_HOME}/config/zookeeper.propertieszookeeper.properties 파일에 아래 설정들을 추가해준다. # the directory where the snapshot is stored.dataDir=${data_dir} # The number of milliseconds of each tick tickTime=2000.. 2015. 11. 2. Steps to install Distributed HBase HBaseDownload$ wget http://mirror.apache-kr.org/hbase/hbase-0.98.0/hbase-0.98.0-hadoop2-bin.tar.gz$ tar zxvf hbase-0.98.0-hadoop2-bin.tar.gz Configurationhbase-env.shexport JAVA_HOME=/usr/lib/jvm/java-7-oracle # Tell HBase whether it should manage it's own instance of Zookeeper or not.export HBASE_MANAGES_ZK=false hbase-site.xml hbase.rootdir hdfs://master:9000/hbase hbase.cluster.distributed tr.. 2014. 5. 9. Steps to install Replicated ZooKeeper ZooKeeperdownload http://www.apache.org/dyn/closer.cgi/zookeeper/$ wget http://apache.mirror.cdnetworks.com/zookeeper/stable/zookeeper-3.4.6.tar.gz$ tar zxvf zookeeper-3.4.6.tar.gz Configurationzoo.cfg# the basic time unit in milliseconds used by ZooKeeper. It is used to do heartbeats and the minimum session timeout will be twice the tickTime.tickTime=2000#the location to store the in-memory dat.. 2014. 5. 9. Steps to install Hadoop 2.2.0 release on multi-node cluster HBase 를 위해서 hadoop, zookeeper를 설치하고 HBase 연동까지 테스트한다. EnvironmentOS : Ubuntu 12.04Hadoop : Hadoop 2.2.0ZooKeeper : ZooKeeper 3.4.5HBase : HBase 0.98.0Java : oracle java 7버전은 아래 문서를 참고하여 설치하려는 HBase 지원여부에 따라 선택하였다. http://hbase.apache.org/book/configuration.html#hadoop java$ sudo add-apt-repository ppa:webupd8team/java$ sudo apt-get update$ sudo apt-get install oracle-java[6-8]-installer $ java -.. 2014. 5. 9. ZooKeeper Getting Started 주키퍼는 상호조정에 필요한 다양한 데이터 구조체와 프로토콜 구축을 위한 풍부한 프리미티브를 제공한다.Coordinating Distributed Applications with ZooKeeper Downloadhttp://www.apache.org/dyn/closer.cgi/zookeeper/ Setup Running Replicated ZooKeeper$ vi ${ZOOKEEPER_HOME}/conf/zoo.cfgzoo.cfg 설정파일을 생성하여 아래 설정들을 추가해준다. # The number of milliseconds of each tick tickTime=2000 # The number of ticks that the initial # synchronization phase can take in.. 2014. 4. 30. 이전 1 다음