# File passed to org.jruby.Main by bin/hbase. Pollutes jirb with hbase imports # and hbase commands and then loads jirb. Outputs a banner that tells user # where to find help, shell version, and loads up a custom hirb. # TODO: Add 'debug' support (client-side logs show in shell). Add it as # command-line option and as command. # TODO: Interrupt a table creation or a connection to a bad master. Currently # has to time out. Below we've set down the retries for rpc and hbase but # still can be annoying (And there seem to be times when we'll retry for # ever regardless) # TODO: Add support for listing and manipulating catalog tables, etc. # TODO: Encoding; need to know how to go from ruby String to UTF-8 bytes # Run the java magic include and import basic HBase types that will help ease # hbase hacking. include Java # Some goodies for hirb. Should these be left up to the user's discretion? require 'irb/completion' # Add the $HBASE_HOME/bin directory, the location of this script, to the ruby # load path so I can load up my HBase ruby modules $LOAD_PATH.unshift File.dirname($PROGRAM_NAME) # Require formatter and hbase require 'Formatter' require 'HBase' # See if there are args for this shell. If any, read and then strip from ARGV # so they don't go through to irb. Output shell 'usage' if user types '--help' cmdline_help = < alter 't1', {NAME => 'f1', VERSIONS => 5} create Create table; pass table name, a dictionary of specifications per column family, and optionally a dictionary of table configuration. Dictionaries are described below in the GENERAL NOTES section. For example, to create a table named 't1' with a single family named 'f1' with an alternate maximum number of cells, type: hbase> create 't1', {NAME => 'f1', VERSIONS => 5} To create a table with 'f1', 'f2', and 'f3' using all defaults: hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'} or in shorthand: hbase> create 't1', 'f1', 'f2', 'f3' describe Describe the named table: e.g. "hbase> describe 't1'" delete Put a delete cell value at specified table/row/column and optionally timestamp coordinates. Deletes must match the deleted cell's coordinates exactly. When scanning, a delete cell suppresses older versions. Takes arguments like the 'put' command described below deleteall Delete all cells in a given row; pass a table name, row, and optionally a column and timestamp disable Disable the named table: e.g. "hbase> disable 't1'" drop Drop the named table. Table must first be disabled enable Enable the named table exists Does the named table exist? e.g. "hbase> exists 't1'" exit Type "hbase> exit" to leave the HBase Shell get Get row or cell contents; pass table name, row, and optionally a dictionary of column(s), timestamp and versions. Examples: hbase> get 't1', 'r1' hbase> get 't1', 'r1', {COLUMN => 'c1'} hbase> get 't1', 'r1', {COLUMN => ['c1', 'c2', 'c3']} hbase> get 't1', 'r1', {TIMESTAMP => ts1, VERSIONS => 4} list List all tables in hbase put Put a cell value at specified table/row/column and optionally timestamp coordinates. To put a cell value into table 't1' at row 'r1' under column 'c1' marked with the time 'ts1', do: hbase> put 't1', 'r1', 'c1', ts1 scan Scan a table; pass table name and optionally an array of column names OR an array of column names AND a dictionary of scanner specifications. If you wish to include scanner specifications, you must also include an array of columns. Scanner specifications may include one or more of the following: LIMIT, STARTROW, STOPROW, or TIMESTAMP. To scan all members of a column family, leave the qualifier empty as in 'col_family:'. Examples: hbase> scan '.META.' hbase> scan '.META.', ['info:regioninfo'] hbase> scan 't1', ['c1', 'c2'], {LIMIT => 10, STARTROW => 'xyz'} version Output this HBase version GENERAL NOTES: Quote all names in the hbase shell such as table and column names. Don't forget commas delimit command parameters. Type after entering a command to run it. Dictionaries of configuration used in the creation and alteration of tables are ruby Hashes. They look like this: {'key1' => 'value1', 'key2' => 'value2', ...} They are opened and closed with curley-braces. Key/values are delimited by the '=>' character combination. Usually keys are predefined constants such as NAME, VERSIONS, COMPRESSION, etc. Constants do not need to be quoted. Type 'Object.constants' to see a (messy) list of all constants in the environment. This HBase shell is the JRuby IRB with the above HBase-specific commands added. For more on the HBase Shell, see http://wiki.apache.org/hadoop/Hbase/Shell HERE puts h end def version # Output version. puts "Version: #{org.apache.hadoop.hbase.util.VersionInfo.getVersion()},\ r#{org.apache.hadoop.hbase.util.VersionInfo.getRevision()},\ #{org.apache.hadoop.hbase.util.VersionInfo.getDate()}" end # DDL def admin() @admin = HBase::Admin.new(@configuration, @formatter) unless @admin @admin end def table(table) # Create new one each time HBase::Table.new(@configuration, table, @formatter) end def create(table, *args) admin().create(table, args) end def drop(table) admin().drop(table) end def alter(table, args) admin().alter(table, args) end # Administration def list admin().list() end def describe(table) admin().describe(table) end def enable(table) admin().enable(table) end def disable(table) admin().disable(table) end def exists(table) admin().exists(table) end # CRUD def get(table, row, args = {}) table(table).get(row, args) end def put(table, row, column, value, timestamp = nil) table(table).put(row, column, value, timestamp) end def scan(table, columns = [], args = {}) table(table).scan(columns, args) end def delete(table, row, column, timestamp = org.apache.hadoop.hbase.HConstants::LATEST_TIMESTAMP) table(table).delete(row, column, timestamp) end def deleteall(table, row, column = nil, timestamp = org.apache.hadoop.hbase.HConstants::LATEST_TIMESTAMP) table(table).deleteall(row, column, timestamp) end # Output a banner message that tells users where to go for help puts <' for list of supported commands. HERE version require "irb" module IRB # Subclass of IRB so can intercept methods class HIRB < Irb def initialize # This is ugly. Our 'help' method above provokes the following message # on irb construction: 'irb: warn: can't alias help from irb_help.' # Below, we reset the output so its pointed at /dev/null during irb # construction just so this message does not come out after we emit # the banner. Other attempts at playing with the hash of methods # down in IRB didn't seem to work. I think the worst thing that can # happen is the shell exiting because of failed IRB construction with # no error (though we're not blanking STDERR) begin f = File.open("/dev/null", "w") $stdout = f super ensure f.close() $stdout = STDOUT end end def output_value # Suppress output if last_value is 'nil' # Otherwise, when user types help, get ugly 'nil' # after all output. if @context.last_value super end end end def IRB.start(ap_path = nil) $0 = File::basename(ap_path, ".rb") if ap_path IRB.setup(ap_path) @CONF[:IRB_NAME] = 'hbase' @CONF[:AP_NAME] = 'hbase' if @CONF[:SCRIPT] hirb = HIRB.new(nil, @CONF[:SCRIPT]) else hirb = HIRB.new end @CONF[:IRB_RC].call(hirb.context) if @CONF[:IRB_RC] @CONF[:MAIN_CONTEXT] = hirb.context trap("SIGINT") do hirb.signal_handle end catch(:IRB_EXIT) do hirb.eval_input end end end IRB.start