Commit Graph

5101 Commits

Author SHA1 Message Date
mbautin a2c1c0cd3e [jira] [HBASE-5684] Make ProcessBasedLocalHBaseCluster run HDFS and make it more
robust

Summary:
Currently ProcessBasedLocalHBaseCluster runs on top of raw local filesystem. We
need it to start a process-based HDFS cluster as well. We also need to make the
whole thing more stable so we can use it in unit tests.

Also all logs of local HBase cluster daemons are now tailed to the primary log
of the unit test with the appropriate prefixes to make debugging easier.

This is a trunk diff. The 89-fb version is D2709.

Test Plan:
Run the new unit test multiple times (10x or 50x).
Run all unit tests.

Reviewers: tedyu, stack, lhofhansl, nspiegelberg, amirshim, JIRA

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D2757

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326036 13f79535-47bb-0310-9956-ffa450edef68
2012-04-14 01:25:27 +00:00
larsh b4a1bb164b HBASE-5604 Addendum. Remove test as per discussion on jira.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326002 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 22:49:09 +00:00
Michael Stack b987a52e36 HBASE-5747 Forward port "hbase-5708 [89-fb] Make MiniMapRedCluster directory a subdirectory of target/test"
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326000 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 22:45:25 +00:00
Michael Stack 4d04f85308 HBASE-5443 Convert the client protocol of HRegionInterface to PB
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325937 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 20:28:21 +00:00
Michael Stack 740ed62e50 HBASE-5784 Enable mvn deploy of website
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325917 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 19:39:06 +00:00
Michael Stack 70109d07fc HBASE-5772 Unable to open the few links in http://hbase.apache.org/
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325893 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 18:14:13 +00:00
Michael Stack 401c4ec014 HBASE-5778 Turn on WAL compression by default
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325801 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 15:24:05 +00:00
Jonathan Hsieh 3976ec641e HBASE-5488 OfflineMetaRepair doesn't support hadoop 0.20's fs.default.name property (gaojinchao)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325625 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 06:44:36 +00:00
larsh ea687c181d HBASE-5604 addendum, mark TestWALPlayer as LargeTest
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325609 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 04:13:14 +00:00
Jean-Daniel Cryans 1478088b10 HBASE-5778 Turn on WAL compression by default
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325566 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 23:00:01 +00:00
larsh 0717d13416 HBASE-5604 M/R tool to replay WAL files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325555 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 22:25:46 +00:00
larsh fc9faf8585 HBASE-5775 ZKUtil doesn't handle deleteRecurisively cleanly (Jesse Yates)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325540 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 21:53:54 +00:00
Michael Stack eb5d2fe9d0 HBASE-5300 Research website symolic links for renaming of "HBase book" to "HBase Reference Guide"
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325512 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 20:58:32 +00:00
larsh 9a0673f8c6 HBASE-3443 ICV optimization to look in memstore first and then store files (HBASE-3082) does not work when deletes are in the mix
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325406 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 17:46:39 +00:00
Jonathan Hsieh 36324e341d HBASE-5719 Enhance hbck to sideline overlapped mega regions (Jimmy Xiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325404 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 17:44:52 +00:00
Michael Stack 38eb4579e4 HBASE-5770 Add a clock skew warning threshold
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325389 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 17:20:25 +00:00
Michael Stack 05e3db77c5 HBASE-5773 HtablePool constructor not reading config files in certain cases
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325380 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 16:58:20 +00:00
larsh 51ec5b2b23 HBASE-5717 Scanner metrics are only reported if you get to the end of a scanner (Ian Varley)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325344 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 16:10:25 +00:00
Jonathan Hsieh 8575edd908 HBASE-5645 [findbugs] Fix correctness warnings (David S Wang and Uma Maheswara Rao G)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324969 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 20:04:12 +00:00
Jonathan Hsieh a2ff41653a HBASE-5599 [hbck] handle NO_VERSION_FILE and SHOULD_NOT_BE_DEPLOYED inconsistencies (fulin wang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324881 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 17:20:19 +00:00
Doug Meil 4e9a9e0585 hbase-5766. adding "bulk loading" to Ops chapter tools list.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324741 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 12:39:43 +00:00
Doug Meil 601f268006 hbase-5765 adding ImportTsv to Ops chapter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324736 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 12:30:20 +00:00
Doug Meil 10f783bd56 hbase-5764 adding turning off SpecEx in Config chapter recommendations
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324730 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 12:20:22 +00:00
Jonathan Hsieh b7844d9dd0 HBASE-5653 [findbugs] Fix perf warnings (Uma Maheswara Rao G)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324547 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 04:36:26 +00:00
Michael Stack 135478ca21 HBASE-5760 Unit tests should write only under /target
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1312043 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 23:33:05 +00:00
Michael Stack a31cb26e5a HBASE-5739 Upgrade guava to 11.0.2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311942 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 19:23:38 +00:00
Michael Stack 4e3a796d92 fix link for birds-of-a-feather session
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311919 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 18:46:09 +00:00
Michael Stack 814616687a HBASE-5755 Region sever looking for master forever with cached stale data
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311910 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 18:29:31 +00:00
Michael Stack 7d1f7b7f37 HBASE-5759 HBaseClient throws NullPointerException when EOFException should be used.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311899 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 18:15:25 +00:00
Michael Stack f4ea4f4f07 HBASE-5758 Forward port "HBASE-4109 Hostname returned via reverse dns lookup contains trailing period if configured interface is not default
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311821 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 16:14:18 +00:00
Michael Stack 51afbfaf96 Add birds-of-a-feather and move old news to old news page
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311763 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 14:45:17 +00:00
Michael Stack c15161771a HBASE-5749 "HBASE-5335 Dynamic Schema Config" broke build, missing change to HRegion heapsize
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311562 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 03:06:36 +00:00
Zhihong Yu 1044d5e353 HBASE-5727 Addendum fixes compilation in AccessController.java
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311525 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 00:05:27 +00:00
Michael Stack 761916cebb HBASE-5740 Compaction interruption may be due to balacing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311514 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 22:58:19 +00:00
Michael Stack 1283155ddc HBASE-5748 Enable lib directory in jar file for coprocessor
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311498 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 22:27:55 +00:00
Doug Meil 56d1587b7e hbase-5753.xml - adding schema design case study in Case Studies chapter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311411 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 20:17:04 +00:00
Michael Stack 66772ce043 HBASE-5727 secure hbase build broke because of 'HBASE-5451 Switch RPC call envelope/headers to PBs'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311287 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 15:44:04 +00:00
Michael Stack f66532d9dc add hackconathon
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311280 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 15:24:27 +00:00
Nicolas Spiegelberg 167f012d64 [jira] [HBASE-5335] Dynamic Schema Config
Summary: Ability to add config options on a per-table & per-cf basis

Test Plan: - mvn test

Reviewers: JIRA, Kannan, stack, mbautin, Liyin

Reviewed By: mbautin

CC: tedyu

Differential Revision: https://reviews.facebook.net/D2247

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311269 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 14:54:52 +00:00
mbautin 00316a4a51 [jira] [HBASE-5744] Thrift server metrics should be long instead of int
Summary:
As we measure our Thrift call latencies in nanoseconds, we need to make
latencies long instead of int everywhere. There is a bug where we truncate a
nanosecond latency to int, which is a problem with RPCs that take more than
2.147483647 seconds to process.

This is a trunk diff. The 89-fb version of this diff is at D2679.

Test Plan:
TestThriftServer is updated to test for the failure case (an RPC is artificially
made to take 3 seconds). The new test case fails without the fix.

Re-run all unit tests.

Reviewers: stack, sc, Kannan, JIRA

Reviewed By: sc

Differential Revision: https://reviews.facebook.net/D2685



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311167 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 09:00:11 +00:00
larsh 720a974794 HBASE-5656 LoadIncrementalHFiles createTable should detect and set compression algorithm(Cosmin Lehene)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311106 13f79535-47bb-0310-9956-ffa450edef68
2012-04-08 21:34:19 +00:00
Michael Stack 2f06c667d3 HBASE-5618 SplitLogManager - prevent unnecessary attempts to resubmits
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310923 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 23:32:28 +00:00
Michael Stack 00781a6eb1 HBASE-5735 Clearer warning message when connecting a non-secure HBase client to a secure HBase server
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310914 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 23:15:40 +00:00
Zhihong Yu 7a0c1daf63 HBASE-5689 Skipping RecoveredEdits may cause data loss (Chunhui)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310788 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 15:30:59 +00:00
Zhihong Yu 915f2cd40d HBASE-5736 ThriftServerRunner.HbaseHandler.mutateRow() does not use ByteBuffer correctly (Scott Chen)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310634 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 23:37:01 +00:00
Jonathan Hsieh 6d43887b88 HBASE-5734 Change hbck sideline root (Jimmy Xiang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310625 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 22:41:10 +00:00
Nicolas Spiegelberg 20e281d7e1 HBASE-5743 Support GIT patches with Hadoop QA
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310600 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 21:40:15 +00:00
Michael Stack af91c18d63 HBASE-5707 Move clusterid and clusterup (shutdown) znodes over to pb
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310568 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 20:15:10 +00:00
Michael Stack 4cc08fa5d6 HBASE-5709 Move active master and backup master znodes to use pbs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310553 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 19:05:42 +00:00
Jonathan Hsieh 4317892dce HBASE-5680 Improve compatibility warning about HBase with Hadoop 0.23.x
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310429 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 16:03:42 +00:00