Cloudera Hadoop Demo VM on VirtualBox – Installation

Cloudera Hadoop Demo VM on VirtualBox – Installation

(

All thanks to Thomas Lockney   (http://blog.cloudera.com/blog/2009/07/cloudera-training-vm-virtualbox/) for writing this down and making it so beautiful to follow

In some cases, authors quickly do things and move on.  But, Thomas made the presentation so clear and elegant and it would have stayed on my mind; unless I followed behind and shared his joy!

)

Install VirtualBox

Download VirtualBox

1) Point a browser @ https://www.virtualbox.org/wiki/Downloads

2) Download a VM corresponding to your work station

3) In our case, our workstation is a MAC and so the most suitable for us is “VirtualBox 4.2.10 for OS X hosts x86/amd64”.  The name of the downloaded file is VirtualBox-4.2.10-84104-OSX.dmg

Install VirtualBox

1) Run the downloaded file by double-clicking on it

2) Double-Click on the 2 VirtualBox.pkg icon

VirtualBox - VirtualBox

Install VirtualBox – Actual

This Package will run a program to determine if the software can be installed.

Virtual Box - Can the Software be installed?

  • Click on the “Continue” button

Welcome to the Oracle VM VirtualBox Installer

Virtual Box - Welcome Screen

  • Press the “Continue” button

Installation Type

Virtual Box - Standard Install

Summary

Virtual Box - Installation was successful

Install Cloudera

Download Cloudera VM Image

1) Point a browser @ https://ccp.cloudera.com/display/SUPPORT/Cloudera%27s+Hadoop+Demo+VM+for+CDH4

2) Download an image that corresponds to our VM, in our case the VM is VirtualBox

3) The name of the image is cloudera-cdh-demo-vm-4.2.0-virtualbox.tar.gz and the file’s full path is https://downloads.cloudera.com/demo_vm/virtualbox/cloudera-cdh-demo-vm-4.2.0-virtualbox.tar.gz

Prepared Downloaded File

1) As the current version is v4.2, the file name is cloudera-cdh-demo-vm-4.2.0-virtualbox.tar.gz

2) Since the file is compressed, un-compress it and you will inherit a single file (cloudera-cdh-demo-vm.vmdk)

Operations – Virtual Box

Review VM Settings



cd /Applications/VirtualBox.app/Contents/MacOS
VBoxManage showvminfo "Cloudera Training" | more

Image:

Virtual Box - Image - Settings - Cloudera [20130326__1044]

Change Memory

From our review we see that we only have 2 GB reserved for our VM.

As the Cloudera VM needs 4 GB of RAM, we need to change our VM foot-print:


VBoxManage modifyvm  "Cloudera Training" --memory 4096

Error Message



VBoxManage: error: The machine is not mutable (state is Saved)

VBoxManage: error: Details: code VBOX_E_INVALID_VM_STATE (0x80bb0002), 
component SessionMachine, interface IMachine, callee nsISupports

VBoxManage: error: Context: "COMSETTER(MemorySize)(ValueUnion.u32)" at 
line 470 of file VBoxManageModifyVM.cpp

Re-start VM

  • VBoxManager controlvm <VMImage> poweroff
  • VBoxManage startvm  <VMImage>


Example:

  VBoxManage controlvm "Cloudera Training" poweroff

Output:

   0%...10%..20%..30%

Make Changes



Example:

  VBoxManage modifyvm "Cloudera Training" -memory 3096

Restart VM


Example:

  VBoxManage startvm "Cloudera Training"

Output:

   Waiting for VM "Cloudera Training" to power on...
   VM "Cloudera Training" has been successfully started.

Operations – Cloudera – VMInstance

User Authentication

username :- cloudera
password :- cloudera

What is installed?

  • hdfs – namenode
  • hdfs – datanode
  • mapreduce
  • yarn
  • hue
  • hive
  • zookeeper

What are the https?

  • NameNode status (localhost:50070)
  • JobTracker status (localhost:50030)
  • The Hue user interface (localhost:8888)
  • The HBase web UI (localhost:60010)

References

References – VirtualBox – Installation Details

References – VirtualBox – Settings

3 thoughts on “Cloudera Hadoop Demo VM on VirtualBox – Installation

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s