Categories
CDH Hadoop相关 Linux 学习研究 项目、研究

Fix Alternatives for Cloudera Manager + CDH

By @sskaje
Link: https://sskaje.me/2014/04/fix-alternatives-cloudera-manager-cdh/

Earlier post: Fix Hadoop Conf Alternatives for CDH5

I tried to upgrade Cloudera Manager + CDH 5.0.0 beta 1 and beta 2 from CM+CDH 4 then downgrade and delete, found many alternatives were installed on my small cluster, that made my lately installed CM+CDH 4 and CM+CDH 5 not working well, all because of the dirty uninstallation of CM + CDH 5 beta-s.

To fix these alternatives, I wrote a python script, read default alternative configurations, check all currently installed alternatives and delete broken links, install defaults and bring down priority, so we can use ‘Deploy Client Configuration’ in CM to set up the correct ones.

Repository: https://github.com/sskaje/cm_fix_alternatives

Tested only under centos 6.

Fix Alternatives for Cloudera Manager + CDH by @sskaje: https://sskaje.me/2014/04/fix-alternatives-cloudera-manager-cdh/
Categories
Hadoop相关 学习研究

Cloudera Manager Drop Database/User on Embedded Postgresql

By @sskaje
Link: https://sskaje.me/2014/04/cloudera-manager-drop-databaseuser-embedded-postgresql/

First, you have to find out where the password locates.
https://gist.github.com/mrmichalis/5984131
I ran these on which Cloudera Manager locates.

The cloudera-scm is the superuser.
And the first line in that file is the password.

To drop a database, dropdb is the command:

Commands may like:

To drop a user, using dropuser:

Commands may like:

Cloudera Manager Drop Database/User on Embedded Postgresql by @sskaje: https://sskaje.me/2014/04/cloudera-manager-drop-databaseuser-embedded-postgresql/

Incoming search terms:

Categories
CDH Hadoop相关 Linux Shark Spark

Install Spark/Shark on CDH 4

By @sskaje
Link: https://sskaje.me/2014/02/install-spark-shark-cdh-4/

CDH 4 is the currently stable version of Cloudera Distribution of Hadoop. http://cloudera.com/
Apache Spark is a fast and general engine for large-scale data processing. http://spark.incubator.apache.org/
Shark is a Hive compatible query engine Based on Spark. http://shark.cs.berkeley.edu/

Cloudera provides a parcel for Apache Spark, official parcel at http://archive.cloudera.com/spark/ and you can get it from my mirror (only if you’re on CentOS/RHEL 6 x86_64) Cloudera Mirror.

Environment

CentOS 6.4 x86_64, host names hadoop1-hadoop5.
Cloudera Manager 4.8.1
CDH 4.5.0

Install Spark/Shark on CDH 4 by @sskaje: https://sskaje.me/2014/02/install-spark-shark-cdh-4/

Incoming search terms:

Categories
CDH Cloudera Mirror Hadoop相关 项目、研究

Cloudera Archive Mirror Updated for CM5 & CDH5

By @sskaje
Link: https://sskaje.me/2013/10/cloudera-archive-mirror-updated-for-cm5-cdh5/

Latest Updates @ https://sskaje.me/cloudera-mirror/

Cloudera just released it’s CDH 5 beta download here, this time their don’t use the beta.cloudera.com as non-release product’s repo.

URL: http://cloudera.rst.im/ RHEL/CentOS 6 Only.

You may download Cloudera Manager 4 installer from http://cloudera.rst.im/cm4/installer/latest/
And use http://cloudera.rst.im/cm4/redhat/6/x86_64/cm/4.7.2/ as your yum repo for CM 4.7.2.

Or Cloudera Manager 5 installer from http://cloudera.rst.im/cm5/installer/latest/,
And use http://cloudera.rst.im/cm4/redhat/6/x86_64/cm/5/ as your yum repo for CM 5.

Cloudera Archive Mirror Updated for CM5 & CDH5 by @sskaje: https://sskaje.me/2013/10/cloudera-archive-mirror-updated-for-cm5-cdh5/

Incoming search terms:

Categories
CDH Cloudera Mirror Hadoop相关 项目、研究

Cloudera Archive Mirror for RHEL/CentOS 6

By @sskaje
Link: https://sskaje.me/2013/09/cloudera-archive-mirror-for-rhelcentos-6/

Latest Updates @ https://sskaje.me/cloudera-mirror/

Cloudera does not provide any mirror sites for its parcels/packages downloading, but fortunately the directory list on archive.cloudera.com is on, just create my own!

URL: http://cloudera.rst.im/

You may download CM installer from http://cloudera.rst.im/cm4/installer/latest/

And use http://cloudera.rst.im/cm4/redhat/6/x86_64/cm/4.7.0/ as your yum repo for CM 4.7.0.(No ‘latest’ stuff this time :P)

Cloudera Archive Mirror for RHEL/CentOS 6 by @sskaje: https://sskaje.me/2013/09/cloudera-archive-mirror-for-rhelcentos-6/