Fix Alternatives for Cloudera Manager + CDH

Earlier post: Fix Hadoop Conf Alternatives for CDH5

I tried to upgrade Cloudera Manager + CDH 5.0.0 beta 1 and beta 2 from CM+CDH 4 then downgrade and delete, found many alternatives were installed on my small cluster, that made my lately installed CM+CDH 4 and CM+CDH 5 not working well, all because of the dirty uninstallation of CM + CDH 5 beta-s.

To fix these alternatives, I wrote a python script, read default alternative configurations, check all currently installed alternatives and delete broken links, install defaults and bring down priority, so we can use ‘Deploy Client Configuration’ in CM to set up the correct ones.

Repository: https://github.com/sskaje/cm_fix_alternatives

Tested only under centos 6.

Fix Alternatives for Cloudera Manager + CDH by @sskaje: https://sskaje.me/2014/04/fix-alternatives-cloudera-manager-cdh/

Cloudera Manager Drop Database/User on Embedded Postgresql

First, you have to find out where the password locates.
https://gist.github.com/mrmichalis/5984131
I ran these on which Cloudera Manager locates.

The cloudera-scm is the superuser.
And the first line in that file is the password.

To drop a database, dropdb is the command:

Commands may like:

To drop a user, using dropuser:

Commands may like:

Cloudera Manager Drop Database/User on Embedded Postgresql by @sskaje: https://sskaje.me/2014/04/cloudera-manager-drop-databaseuser-embedded-postgresql/

Incoming search terms:

Install Spark/Shark on CDH 4

CDH 4 is the currently stable version of Cloudera Distribution of Hadoop. http://cloudera.com/
Apache Spark is a fast and general engine for large-scale data processing. http://spark.incubator.apache.org/
Shark is a Hive compatible query engine Based on Spark. http://shark.cs.berkeley.edu/

Cloudera provides a parcel for Apache Spark, official parcel at http://archive.cloudera.com/spark/ and you can get it from my mirror (only if you’re on CentOS/RHEL 6 x86_64) Cloudera Mirror.

Environment

CentOS 6.4 x86_64, host names hadoop1-hadoop5.
Cloudera Manager 4.8.1
CDH 4.5.0
Continue reading “Install Spark/Shark on CDH 4” »

Install Spark/Shark on CDH 4 by @sskaje: https://sskaje.me/2014/02/install-spark-shark-cdh-4/

Incoming search terms:

Cloudera Archive Mirror Updated for CM5 & CDH5

Latest Updates @ https://sskaje.me/cloudera-mirror/

Cloudera just released it’s CDH 5 beta download here, this time their don’t use the beta.cloudera.com as non-release product’s repo.

URL: http://cloudera.rst.im/ RHEL/CentOS 6 Only.

You may download Cloudera Manager 4 installer from http://cloudera.rst.im/cm4/installer/latest/
And use http://cloudera.rst.im/cm4/redhat/6/x86_64/cm/4.7.2/ as your yum repo for CM 4.7.2.

Or Cloudera Manager 5 installer from http://cloudera.rst.im/cm5/installer/latest/,
And use http://cloudera.rst.im/cm4/redhat/6/x86_64/cm/5/ as your yum repo for CM 5.

Continue reading “Cloudera Archive Mirror Updated for CM5 & CDH5” »

Cloudera Archive Mirror Updated for CM5 & CDH5 by @sskaje: https://sskaje.me/2013/10/cloudera-archive-mirror-updated-for-cm5-cdh5/

Incoming search terms:

Cloudera Archive Mirror for RHEL/CentOS 6

Latest Updates @ https://sskaje.me/cloudera-mirror/

Cloudera does not provide any mirror sites for its parcels/packages downloading, but fortunately the directory list on archive.cloudera.com is on, just create my own!

URL: http://cloudera.rst.im/

You may download CM installer from http://cloudera.rst.im/cm4/installer/latest/

And use http://cloudera.rst.im/cm4/redhat/6/x86_64/cm/4.7.0/ as your yum repo for CM 4.7.0.(No ‘latest’ stuff this time :P)

Continue reading “Cloudera Archive Mirror for RHEL/CentOS 6” »

Cloudera Archive Mirror for RHEL/CentOS 6 by @sskaje: https://sskaje.me/2013/09/cloudera-archive-mirror-for-rhelcentos-6/

Incoming search terms: