Michael Stack
8152b444ef
HBASE-5548 Add ability to get a table in the shell; ADDENDUM
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1332766 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 18:04:07 +00:00
Michael Stack
b6fbe9ff87
HBASE-5884 MapReduce package info has broken link to bulk-loads
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1332440 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 22:07:30 +00:00
Michael Stack
aee5d1d286
HBASE-5548 Add ability to get a table in the shell
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1332419 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 21:48:54 +00:00
Jonathan Hsieh
87899ccda8
HBASE-5712 Parallelize load of .regioninfo files in diagnostic/repair portion of hbck
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1332072 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 06:33:59 +00:00
Zhihong Yu
b695b64dfa
HBASE-5611 Replayed edits from regions that failed to open during recovery aren't removed from the global MemStore size (Jieshan)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1331681 13f79535-47bb-0310-9956-ffa450edef68
2012-04-28 04:15:15 +00:00
Michael Stack
6f6b264efc
HBASE-5885 Invalid HFile block magic on Local file System
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1331675 13f79535-47bb-0310-9956-ffa450edef68
2012-04-28 03:59:36 +00:00
Michael Stack
4e080b0dcb
HBASE-5893 Allow spaces in coprocessor conf (aka trim() className)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1331638 13f79535-47bb-0310-9956-ffa450edef68
2012-04-27 23:54:21 +00:00
larsh
4ecfcbde5d
HBASE-5864 Error while reading from hfile in 0.94 (Ram)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1331058 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 20:08:23 +00:00
Michael Stack
f854df4223
HBASE-5862 After Region Close remove the Operation Metrics
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330997 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 17:59:58 +00:00
Michael Stack
6d848a1943
HBASE-5829 Inconsistency between the "regions" map and the "servers" map in AssignmentManager
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330993 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 17:51:17 +00:00
Michael Stack
d7110681df
HBASE-5844 Delete the region servers znode after a regions server crash; REVERT
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330983 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 17:30:13 +00:00
Michael Stack
5f01fcd4fe
HBASE-5672 TestLruBlockCache#testBackgroundEvictionThread fails occasionally
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330971 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 17:03:51 +00:00
Jonathan Hsieh
c8b61833f7
HBASE-5652 [findbugs] Fix lock release on all paths (Gregory Channan)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330628 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 01:58:58 +00:00
larsh
0be3011b5f
HBASE-5873 TimeOut Monitor thread should be started after atleast one region server registers.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330551 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 20:43:35 +00:00
larsh
bbd5306d27
HBASE-5848 Addendum, try 2
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330349 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 15:35:47 +00:00
larsh
33e6443704
HBASE-5871 Usability regression, we don't parse compression algos anymore
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330123 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 06:01:31 +00:00
Michael Stack
ae24697feb
HBASE-5849 On first cluster startup, RS aborts if root znode is not available; REAPPLY
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330116 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 05:46:18 +00:00
Michael Stack
4556bf67ce
HBASE-5866 Canary in tool package but says its in tools
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329898 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 18:01:26 +00:00
ramkrishna
3644d4c8d6
HBASE-5848 Create table with EMPTY_START_ROW passed as splitKey causes the HMaster to abort (Ram)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329819 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 16:14:22 +00:00
Michael Stack
1d6b501c9b
HBASE-4393 Implement a canary monitoring program
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329574 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 07:20:16 +00:00
Michael Stack
e031dc8d34
HBASE-5849 On first cluster startup, RS aborts if root znode is not available; REVERT
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329560 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 05:55:55 +00:00
larsh
9989f83699
Refuse operations from Admin before master is initialized - fix for all branches
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329555 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 05:12:45 +00:00
Michael Stack
afcdced021
HBASE-5849 On first cluster startup, RS aborts if root znode is not available
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329527 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 01:51:14 +00:00
Michael Stack
17cf114310
HBASE-5857 RIT map in RS not getting cleared while region opening
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329470 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 21:54:14 +00:00
Michael Stack
abae95c2aa
HBASE-5830 Cleanup SequenceFileLogWriter to use syncFs api from SequenceFile#Writer directly in trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329443 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 21:05:09 +00:00
Michael Stack
fd4ce7149f
HBASE-5844 Delete the region servers znode after a regions server crash
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329430 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 20:29:45 +00:00
Michael Stack
fabaf478ed
HBASE-5833 0.92 build has been failing pretty consistently on TestMasterFailover
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329400 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 19:40:13 +00:00
Michael Stack
f8c7f1b0fb
HBASE-5443 Convert admin protocol of HRegionInterface to PB
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329358 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 18:12:16 +00:00
ramkrishna
e2cd675020
HBASE-5635 If getTaskList() returns null, splitlogWorker would go down and it won't serve any requests (Ram)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329322 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 16:47:04 +00:00
Jonathan Hsieh
b854d1efb1
HBASE-5654 [findbugs] Address dodgy bugs (Ashutosh Jindal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329132 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 08:46:42 +00:00
ramkrishna
14f80913e5
HBASE-5809 Avoid move api to take the destination server same as the source server. (Rajesh)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328458 13f79535-47bb-0310-9956-ffa450edef68
2012-04-20 17:36:02 +00:00
Zhihong Yu
e05c21c0cb
HBASE-5824 revert changes to single Put case, preserving deprecation for ICV
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328457 13f79535-47bb-0310-9956-ffa450edef68
2012-04-20 17:36:02 +00:00
Zhihong Yu
85842f019e
HBASE-5824 addendum fixes coprocessor tests (Jimmy)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328166 13f79535-47bb-0310-9956-ffa450edef68
2012-04-20 01:07:29 +00:00
Michael Stack
0b30494edb
HBASE-5824 HRegion.incrementColumnValue is not used in trunk
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328142 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 22:49:30 +00:00
Michael Stack
f9fb38e31c
HBASE-3614 Expose per-region request rate metrics
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328140 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 22:45:30 +00:00
ramkrishna
13b35ce82c
HBASE-5737 Minor Improvements related to balancer. (Ram)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328057 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 18:05:31 +00:00
Zhihong Yu
4e0f6a27ab
HBASE-5821 Incorrect handling of null value in Coprocessor aggregation function min() (Maryann Xue)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328030 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 16:19:56 +00:00
Michael Stack
d91ea129e8
HBASE-5819 SplitLogs function could leak resources
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327697 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 21:59:24 +00:00
Michael Stack
7972efeea8
HBASE-5811 TestLoadAndSwitchEncodeOnDisk fails sometimes
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327696 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 21:57:23 +00:00
larsh
5eb1259399
HBASE-5545 region can't be opened for a long time. Because the creating File failed. (Ram)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327677 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 20:54:59 +00:00
larsh
e8ec0b9f8c
HBASE-5782 Edits can be appended out of seqid order since HBASE-4487
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327673 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 20:38:21 +00:00
Michael Stack
89a985f28c
HBASE-3585 isLegalFamilyName() can throw ArrayOutOfBoundException
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327666 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 20:25:50 +00:00
Michael Stack
b196f98194
HBASE-5823 Hbck should be able to print help
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327638 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 19:31:28 +00:00
Michael Stack
5446911066
HBASE-5810 HBASE-5620 Convert the client protocol of HRegionInterface to PB addendum
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327629 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 18:53:30 +00:00
Zhihong Yu
8d84537c19
HBASE-5733 AssignmentManager#processDeadServersAndRegionsInTransition can fail with NPE (Uma Maheswara Rao G)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327364 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 03:15:24 +00:00
Zhihong Yu
34d88b8e23
HBASE-5741 ImportTsv does not check for table existence (Himanshu)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327338 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 00:32:28 +00:00
Michael Stack
b10f06129b
HBASE-5788 Move Dynamic Metrics storage off of HRegion
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327316 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 23:01:30 +00:00
Zhihong Yu
6858d30b13
HBASE-5780 Fix race in HBase regionserver startup vs ZK SASL authentication (Shaneal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326814 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 21:55:57 +00:00
Zhihong Yu
705278ae46
HBASE-5795 HServerLoad$RegionLoad breaks 0.92<->0.94 compatibility
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326794 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 20:44:02 +00:00
Michael Stack
fcfb13e312
HBASE-5792 HLog Performance Evaluation Tool
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326792 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 20:43:23 +00:00
Jonathan Hsieh
44a05d4380
HBASE-5781 Zookeeper session got closed while trying to assign the region to RS using hbck -fix
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326280 13f79535-47bb-0310-9956-ffa450edef68
2012-04-15 08:59:11 +00:00
mbautin
a2c1c0cd3e
[jira] [HBASE-5684] Make ProcessBasedLocalHBaseCluster run HDFS and make it more
...
robust
Summary:
Currently ProcessBasedLocalHBaseCluster runs on top of raw local filesystem. We
need it to start a process-based HDFS cluster as well. We also need to make the
whole thing more stable so we can use it in unit tests.
Also all logs of local HBase cluster daemons are now tailed to the primary log
of the unit test with the appropriate prefixes to make debugging easier.
This is a trunk diff. The 89-fb version is D2709.
Test Plan:
Run the new unit test multiple times (10x or 50x).
Run all unit tests.
Reviewers: tedyu, stack, lhofhansl, nspiegelberg, amirshim, JIRA
Reviewed By: tedyu
Differential Revision: https://reviews.facebook.net/D2757
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326036 13f79535-47bb-0310-9956-ffa450edef68
2012-04-14 01:25:27 +00:00
Michael Stack
b987a52e36
HBASE-5747 Forward port "hbase-5708 [89-fb] Make MiniMapRedCluster directory a subdirectory of target/test"
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326000 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 22:45:25 +00:00
Michael Stack
4d04f85308
HBASE-5443 Convert the client protocol of HRegionInterface to PB
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325937 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 20:28:21 +00:00
Michael Stack
401c4ec014
HBASE-5778 Turn on WAL compression by default
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325801 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 15:24:05 +00:00
Jonathan Hsieh
3976ec641e
HBASE-5488 OfflineMetaRepair doesn't support hadoop 0.20's fs.default.name property (gaojinchao)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325625 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 06:44:36 +00:00
Jean-Daniel Cryans
1478088b10
HBASE-5778 Turn on WAL compression by default
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325566 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 23:00:01 +00:00
larsh
0717d13416
HBASE-5604 M/R tool to replay WAL files
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325555 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 22:25:46 +00:00
larsh
fc9faf8585
HBASE-5775 ZKUtil doesn't handle deleteRecurisively cleanly (Jesse Yates)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325540 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 21:53:54 +00:00
larsh
9a0673f8c6
HBASE-3443 ICV optimization to look in memstore first and then store files (HBASE-3082) does not work when deletes are in the mix
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325406 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 17:46:39 +00:00
Jonathan Hsieh
36324e341d
HBASE-5719 Enhance hbck to sideline overlapped mega regions (Jimmy Xiang)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325404 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 17:44:52 +00:00
Michael Stack
38eb4579e4
HBASE-5770 Add a clock skew warning threshold
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325389 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 17:20:25 +00:00
Michael Stack
05e3db77c5
HBASE-5773 HtablePool constructor not reading config files in certain cases
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325380 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 16:58:20 +00:00
larsh
51ec5b2b23
HBASE-5717 Scanner metrics are only reported if you get to the end of a scanner (Ian Varley)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325344 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 16:10:25 +00:00
Jonathan Hsieh
8575edd908
HBASE-5645 [findbugs] Fix correctness warnings (David S Wang and Uma Maheswara Rao G)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324969 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 20:04:12 +00:00
Jonathan Hsieh
a2ff41653a
HBASE-5599 [hbck] handle NO_VERSION_FILE and SHOULD_NOT_BE_DEPLOYED inconsistencies (fulin wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324881 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 17:20:19 +00:00
Jonathan Hsieh
b7844d9dd0
HBASE-5653 [findbugs] Fix perf warnings (Uma Maheswara Rao G)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324547 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 04:36:26 +00:00
Michael Stack
a31cb26e5a
HBASE-5739 Upgrade guava to 11.0.2
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311942 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 19:23:38 +00:00
Michael Stack
814616687a
HBASE-5755 Region sever looking for master forever with cached stale data
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311910 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 18:29:31 +00:00
Michael Stack
7d1f7b7f37
HBASE-5759 HBaseClient throws NullPointerException when EOFException should be used.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311899 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 18:15:25 +00:00
Michael Stack
f4ea4f4f07
HBASE-5758 Forward port "HBASE-4109 Hostname returned via reverse dns lookup contains trailing period if configured interface is not default
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311821 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 16:14:18 +00:00
Michael Stack
c15161771a
HBASE-5749 "HBASE-5335 Dynamic Schema Config" broke build, missing change to HRegion heapsize
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311562 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 03:06:36 +00:00
Michael Stack
761916cebb
HBASE-5740 Compaction interruption may be due to balacing
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311514 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 22:58:19 +00:00
Michael Stack
1283155ddc
HBASE-5748 Enable lib directory in jar file for coprocessor
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311498 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 22:27:55 +00:00
Michael Stack
66772ce043
HBASE-5727 secure hbase build broke because of 'HBASE-5451 Switch RPC call envelope/headers to PBs'
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311287 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 15:44:04 +00:00
Nicolas Spiegelberg
167f012d64
[jira] [HBASE-5335] Dynamic Schema Config
...
Summary: Ability to add config options on a per-table & per-cf basis
Test Plan: - mvn test
Reviewers: JIRA, Kannan, stack, mbautin, Liyin
Reviewed By: mbautin
CC: tedyu
Differential Revision: https://reviews.facebook.net/D2247
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311269 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 14:54:52 +00:00
mbautin
00316a4a51
[jira] [HBASE-5744] Thrift server metrics should be long instead of int
...
Summary:
As we measure our Thrift call latencies in nanoseconds, we need to make
latencies long instead of int everywhere. There is a bug where we truncate a
nanosecond latency to int, which is a problem with RPCs that take more than
2.147483647 seconds to process.
This is a trunk diff. The 89-fb version of this diff is at D2679.
Test Plan:
TestThriftServer is updated to test for the failure case (an RPC is artificially
made to take 3 seconds). The new test case fails without the fix.
Re-run all unit tests.
Reviewers: stack, sc, Kannan, JIRA
Reviewed By: sc
Differential Revision: https://reviews.facebook.net/D2685
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311167 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 09:00:11 +00:00
larsh
720a974794
HBASE-5656 LoadIncrementalHFiles createTable should detect and set compression algorithm(Cosmin Lehene)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311106 13f79535-47bb-0310-9956-ffa450edef68
2012-04-08 21:34:19 +00:00
Michael Stack
2f06c667d3
HBASE-5618 SplitLogManager - prevent unnecessary attempts to resubmits
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310923 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 23:32:28 +00:00
Zhihong Yu
7a0c1daf63
HBASE-5689 Skipping RecoveredEdits may cause data loss (Chunhui)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310788 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 15:30:59 +00:00
Zhihong Yu
915f2cd40d
HBASE-5736 ThriftServerRunner.HbaseHandler.mutateRow() does not use ByteBuffer correctly (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310634 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 23:37:01 +00:00
Jonathan Hsieh
6d43887b88
HBASE-5734 Change hbck sideline root (Jimmy Xiang)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310625 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 22:41:10 +00:00
Michael Stack
af91c18d63
HBASE-5707 Move clusterid and clusterup (shutdown) znodes over to pb
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310568 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 20:15:10 +00:00
Michael Stack
4cc08fa5d6
HBASE-5709 Move active master and backup master znodes to use pbs
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310553 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 19:05:42 +00:00
Jonathan Hsieh
4317892dce
HBASE-5680 Improve compatibility warning about HBase with Hadoop 0.23.x
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310429 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 16:03:42 +00:00
Zhihong Yu
ccc24e39f9
HBASE-5615 revert due to race condition in case master dies
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310324 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 13:43:03 +00:00
Jonathan Hsieh
9b57215185
HBASE-4348 Add metrics for regions in transition (Himanshu Vashishtha)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310159 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 03:46:04 +00:00
Jonathan Hsieh
be245101ac
HBASE-5644 [findbugs] Fix null pointer warnings (Uma Maheswara Rao G)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310125 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 23:05:07 +00:00
Michael Stack
fa97600ea9
HBASE-5722 NPE in ZKUtil#getChildDataAndWatchForNewChildren when ZK not available or NW down.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310104 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 22:09:41 +00:00
Michael Stack
8fd194d696
HBASE-5711 Tests are failing with incorrect data directory permissions -- OVER-REVERTED; UNDOING LAST COMMIT
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310097 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 22:04:26 +00:00
Michael Stack
050e8df896
HBASE-5711 Tests are failing with incorrect data directory permissions -- REVERT
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310095 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 22:02:38 +00:00
Michael Stack
7ab743986f
HBASE-5724 Row cache of KeyValue should be cleared in readFields().
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310065 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 20:47:38 +00:00
Michael Stack
de4f4aa9e4
HBASE-5715 Revert 'Instant schema alter' for now, HBASE-4213
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310012 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 18:57:09 +00:00
Nicolas Spiegelberg
72dfa4207d
HBASE-5359 Alter in the shell can be too quick and return before the table is altered
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1309611 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 21:53:12 +00:00
Michael Stack
753afe9de3
HBASE-5706 'Dropping fs latency stats since buffer is full' spam
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1309457 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 15:36:28 +00:00
Zhihong Yu
5e07b71ed6
HBASE-5606 SplitLogManger async delete node hangs log splitting when ZK connection is lost
...
(Prakash)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1309173 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 22:04:45 +00:00
Michael Stack
e72b67e20c
HBASE-5451 Switch RPC call envelope/headers to PBs
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1309019 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 16:26:50 +00:00
Michael Stack
b5b0116712
HBASE-5701 Put RegionServerDynamicStatistics under RegionServer in MBean hierarchy rather than have it as a peer
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308971 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 15:08:38 +00:00
Michael Stack
3d06717256
HBASE-5704 HBASE-4398 mistakenly rolled back on trunk
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308964 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 14:57:18 +00:00
Michael Stack
f1a09236ab
HBASE-5688 Convert zk root-region-server znode content to pb; DELETE RLE... causing build to fail because of RAT warnings
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308697 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 05:23:13 +00:00
Michael Stack
3d7e7f1626
HBase-5688 Convert zk root-region-server znode content to pb
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308681 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 04:42:54 +00:00
larsh
450583b9bd
HBASE-3134 [replication] Add the ability to enable/disable streams (Teruyoshi Zenmyo)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308675 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 04:14:46 +00:00
Michael Stack
f9802e4cdf
HBASE-5692 Add real action time for HLogPrettyPrinter
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308609 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 23:02:56 +00:00
Michael Stack
4e99cb4923
HBASE-5688 Convert zk root-region-server znode content to pb
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308560 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 21:00:47 +00:00
Michael Stack
3e23493543
HBASE-5665 Repeated split causes HRegionServer failures and breaks table
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308545 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 20:48:22 +00:00
Michael Stack
fe2f84dbb1
HBASE-5693 When creating a region, the master initializes it and creates a memstore within the master server
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308535 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 20:30:27 +00:00
Michael Stack
6135aa2d5a
HBASE-5694 getRowsWithColumnsTs() in Thrift service handles timestamps incorrectly
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308445 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 17:59:48 +00:00
Zhihong Yu
80722e7290
HBASE-5663 HBASE-5636 MultithreadedTableMapper doesn't work (Takuya Ueshin)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308353 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 13:50:03 +00:00
larsh
86f8282bef
HBASE-5084 Clow different HTable instances to share one ExecutorService
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307661 13f79535-47bb-0310-9956-ffa450edef68
2012-03-31 00:26:22 +00:00
Michael Stack
a99bd2c9ec
HBASE-5564 Bulkload is discarding duplicate records
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307629 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 21:44:08 +00:00
Michael Stack
c7c1dbeb65
HBASE-5443 Create PB protocols for HRegionInterface
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307625 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 21:38:44 +00:00
Zhihong Yu
229cf740b8
HBASE-5667 RegexStringComparator supports java.util.regex.Pattern flags (David Arthur)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307580 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 19:33:27 +00:00
larsh
f1a9b5bed1
HBASE-5542 Addendum - accidentally checked in .orig file
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307562 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 18:04:32 +00:00
Zhihong Yu
06e70aa877
HBASE-5573 Replace client ZooKeeper watchers by simple ZooKeeper reads (N Keywal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307549 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 17:45:57 +00:00
Michael Stack
8ecfa1087c
HBASE-5673 The OOM problem of IPC client call cause all handle block; REVERT OF V2, A SECOND REVERT
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307513 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 16:33:26 +00:00
Michael Stack
277e246110
HBASE-5673 The OOM problem of IPC client call cause all handle block; REAPPLY; V2 OF PATCH
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307277 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 05:33:19 +00:00
Michael Stack
81482cebb8
HBASE-5673 The OOM problem of IPC client call cause all handle block; REVERT -- APPLIED WRONG PATCH
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307270 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 05:30:47 +00:00
Michael Stack
b291485220
HBASE-5673 The OOM problem of IPC client call cause all handle block
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307240 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 04:33:12 +00:00
Michael Stack
89ea8af04f
HBASE-4398 If HRegionPartitioner is used in MapReduce, client side configurations are overwritten by hbase-site.xml
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307116 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 21:23:23 +00:00
Jonathan Hsieh
fbfe3f29e5
HBASE-5638 Readability improvements on HBASE-5633: NPE reading ZK config in HBase (Matteo Bertozzi)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307085 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 20:04:49 +00:00
ramkrishna
26de676dea
HBASE-5097 RegionObserver implementation whose preScannerOpen and postScannerOpen Impl return null can stall the system initialization through NPE (Ram)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307036 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 18:34:02 +00:00
larsh
ea77247c82
HBASE-5670 Have Mutation implement the Row interface.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306959 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 16:21:41 +00:00
Michael Stack
67ded34626
AggregationClient fails validation for open stoprow scan
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306914 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 15:29:01 +00:00
Michael Stack
ec4d59770a
HBASE-5564 Bulkload is discarding duplicate records
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306907 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 15:23:46 +00:00
Michael Stack
8a864815de
HBASE-5671 hbase.metrics.showTableName should be true by default
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306712 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 04:35:48 +00:00
Zhihong Yu
ada9d8d361
HBASE-5544 Add metrics to HRegion.processRow() (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306648 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 23:59:17 +00:00
larsh
16ad2b2898
HBASE-5639 The logic used in waiting for region servers during startup is broken (J-D and NKeyval)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306012 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 20:40:13 +00:00
larsh
ef65dde6b3
HBASE-5641 decayingSampleTick1 prevents HBase from shutting down.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305722 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 03:34:51 +00:00
Jonathan Hsieh
3fd6997380
HBASE-5596 Few minor bugs from HBASE-5209 (David S. Wang)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305661 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 23:06:02 +00:00
larsh
080206de01
HBASE-5623 Race condition when rolling the HLog and hlogFlush (Enis Soztutar and LarsH)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305556 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 20:42:46 +00:00
Michael Stack
8ea1c8ddd6
HBASE-5533 Add more metrics to HBase
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305499 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 19:21:42 +00:00
Zhihong Yu
3c234f13ba
HBASE-5615 the master never does balance because of balancing the parent region (Xufeng)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305171 13f79535-47bb-0310-9956-ffa450edef68
2012-03-25 23:22:00 +00:00
larsh
82670f81b8
HBASE-4957 Clean up some log messages, code in RecoverableZooKeeper (Todd)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304940 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 22:02:41 +00:00
Michael Stack
9cfe7cfa3c
HBASE-5633 NPE reading ZK config in HBase
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304924 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 21:15:40 +00:00
larsh
accf8ee862
HBASE-5434 [REST] Include more metrics in cluster status request (Mubarak Seyed)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304919 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 21:04:45 +00:00
Zhihong Yu
53712ce495
HBASE-5128 Addendum adds two new files Jon forgot to add
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304702 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 03:58:22 +00:00
Jonathan Hsieh
f2d637ffa5
HBASE-5128 [uber hbck] Online automated repair of table integrity and region consistency problems
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304665 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 23:53:55 +00:00
Jean-Daniel Cryans
560173f756
HBASE-5190 Limit the IPC queue size based on calls' payload size
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304634 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 22:32:31 +00:00
mbautin
86962028dd
[jira] [HBASE-5469] Add baseline compression efficiency to DataBlockEncodingTool
...
Summary:
DataBlockEncodingTool currently does not provide baseline compression
efficiency, e.g. Hadoop compression codec applied to unencoded data. E.g. if
we are using LZO to compress blocks, we would like to have the following
columns in the report (possibly as percentages of raw data size).
Baseline K+V in blockcache | Baseline K + V on disk (LZO compressed) | K + V
DataBlockEncoded in block cache | K + V DataBlockEncoded + LZOCompressed (on
disk)
Background: we never store compressed blocks in cache, but we always store
encoded data blocks in cache if data block encoding is enabled for the column
family.
This patch also has multiple bugfixes and improvements to DataBlockEncodingTool,
including presentation format, memory requirements (reduced 3x) and fixing the
handling of compression.
Test Plan:
* Run unit tests.
* Run DataBlockEncodingTool on a variety of real-world HFiles.
Reviewers: JIRA, dhruba, tedyu, stack, heyongqiang
Reviewed By: tedyu
Differential Revision: https://reviews.facebook.net/D2409
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304626 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 22:02:53 +00:00
Michael Stack
1e6c227883
HBASE-5616 Make compaction code standalone; ADDENDUM -- ADD LICENSES
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304624 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:52:55 +00:00
Michael Stack
5a9f595e7d
HBASE-5616 Make compaction code standalone
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304616 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:37:01 +00:00
Michael Stack
358dc6e6e6
HBASE-5624 Aborting regionserver when splitting region, may cause daughter region not assigned by ServerShutdownHandler
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304603 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:18:41 +00:00
Zhihong Yu
26b2950bc7
HBASE-5613 ThriftServer getTableRegions does not return serverName and port (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304602 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:15:50 +00:00
larsh
929113dfab
HBASE-4657 Improve the efficiency of our MR jobs with a few configurations
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304110 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 22:34:35 +00:00
Zhihong Yu
a379a41e3d
HBASE-5591 ThiftServerRunner.HBaseHandler.toBytes() is identical to Bytes.getBytes() (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304047 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 20:43:55 +00:00
Jean-Daniel Cryans
fa98df639e
HBASE-5586 [replication] NPE in ReplicationSource when creating a stream
...
to an inexistent cluster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303945 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 18:13:12 +00:00
larsh
536ff21825
HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) part 2
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303920 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 17:51:37 +00:00
larsh
6fb055da00
HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303915 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 17:49:32 +00:00
Michael Stack
772ecdd236
HBASE-5328 Small changes to Master to make it more testable
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303648 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 03:40:46 +00:00
Michael Stack
327e2d1f74
HBASE-5328 Small changes to Master to make it more testable
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303626 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 00:02:36 +00:00
larsh
4ba5a9d29e
HBASE-5433 [REST] Add metrics to keep track of success/failure count (Mubarak Seyed)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303536 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:48:11 +00:00
Jonathan Hsieh
865b14133b
HBASE-5589 Add of the offline call to the Master Interface
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303519 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:30:54 +00:00
Zhihong Yu
5b2d6ebfc5
HBASE-5542 revert due to broken trunk build
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303517 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:28:33 +00:00
Michael Stack
250252f400
HBASE-5560 Avoid RegionServer GC caused by timed-out calls
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303512 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 19:17:59 +00:00
Zhihong Yu
ce36877d30
HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303490 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 18:25:18 +00:00
larsh
41f31490ff
HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303220 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 23:57:53 +00:00
mbautin
b4dccf9198
HBASE-5605 [jira] compression does not work in Store.java
...
Author: Yongqiang He
Summary: need to pass compression parameter to WriterBuilder
Test Plan: one simple and straightforward change
Reviewers: mbautin
Reviewed By: mbautin
CC: tedyu
Differential Revision: https://reviews.facebook.net/D2391
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303150 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 21:04:38 +00:00
ramkrishna
2f58da0489
HBASE-5520 Support reseek() at RegionScanner (Ram)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303005 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 17:10:50 +00:00
mbautin
6be64072e8
HBASE-5521 [jira] Move compression/decompression to an encoder specific encoding
...
context
Author: Yongqiang He
Summary:
https://issues.apache.org/jira/browse/HBASE-5521
As part of working on HBASE-5313, we want to add a new columnar encoder/decoder.
It makes sense to move compression to be part of encoder/decoder:
1) a scanner for a columnar encoded block can do lazy decompression to a
specific part of a key value object
2) avoid an extra bytes copy from encoder to hblock-writer.
If there is no encoder specified for a writer, the HBlock.Writer will use a
default compression-context to do something very similar to today's code.
Test Plan: existing unit tests verified by mbautin and tedyu. And no new test
added here since this code is just a preparation for columnar encoder. Will add
testcase later in that diff.
Reviewers: dhruba, tedyu, sc, mbautin
Reviewed By: mbautin
Differential Revision: https://reviews.facebook.net/D2097
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302602 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 19:12:19 +00:00
Michael Stack
047d209cee
HBASE-5955 Fix NoSuchMethodException in 0.92 when running on local filesystem
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302207 13f79535-47bb-0310-9956-ffa450edef68
2012-03-18 19:40:24 +00:00
Jonathan Hsieh
37da60f92f
HBASE-5588 Deprecate/remove AssignmentManager#clearRegionFromTransition
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301885 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 07:34:22 +00:00
larsh
fda76c71cb
Revert HBASE-5569
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301872 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 06:59:31 +00:00
Jonathan Hsieh
f34edd6378
HBASE-5563 Add comparison of regionId to HRegionInfo#compareTo (chunhui and jmhsieh)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301779 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 21:50:05 +00:00
Zhihong Yu
1d24d71821
HBASE-5549 HBASE-5572 Master can fail if ZooKeeper session expires (N Keywal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301775 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 21:30:47 +00:00
Michael Stack
8a4c928de0
HBASE-5592 Make it easier to get a table from shell
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301715 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 19:45:06 +00:00
Zhihong Yu
458a3ff092
HBASE-5206 Port HBASE-5155 to trunk (Ashutosh Jindal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301709 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 19:14:11 +00:00
Michael Stack
a388bae569
HBASE-5581 Creating a table with invalid syntax does not give an error message when it fails
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301688 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 18:46:53 +00:00
Zhihong Yu
8e84390b37
HBASE-5568 Multi concurrent flushcache() for one region could cause data loss (Chunhui)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301639 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 16:39:44 +00:00
Zhihong Yu
4a5a27eac2
HBASE-5579 A Delete Version could mask other values (Daniel Ferro)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301173 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 20:03:47 +00:00
Michael Stack
273804e658
HBASE-4608 HLog Compression
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301165 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 19:32:01 +00:00
larsh
5055d4cfff
HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301135 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 18:46:31 +00:00
Zhihong Yu
d73aee4f66
HBASE-5206 revert because of test failues in trunk build.
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300725 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 21:25:51 +00:00
Zhihong Yu
2ec60a022e
HBASE-5206 port HBASE-5155 to TRUNK (Ashutosh Jindal)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300711 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 20:29:54 +00:00
Michael Stack
eebdfb5d65
HBASE-5574 DEFAULT_MAX_FILE_SIZE defaults to a negative value
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300288 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 19:04:41 +00:00
Michael Stack
05423b150b
HBASE-5179 Handle potential data loss due to concurrent processing of processFaileOver and ServerShutdownHandler
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300194 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 15:35:54 +00:00
Michael Stack
e4fefa0073
HBASE-5399 Cut the link between the client and the zookeeper ensemble
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299872 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 21:20:33 +00:00
mbautin
be78e3c4ee
[jira] [HBASE-5292] Prevent counting getSize on compactions
...
Author: Zhiqiu Kong
Summary:
Added two separate metrics for both get() and next(). This is done by
refactoring on internal next() API. To be more specific, only Get.get()
and ResultScanner.next() passes the metric name ("getsize" and
"nextsize" repectively) to
HRegion::RegionScanner::next(List<KeyValue>, String)
This will eventually hit StoreScanner()::next((List<KeyValue>,
int, String) where the metrics are counted.
And their call paths are:
1) Get
HTable::get(final Get get)
=> HRegionServer::get(byte [] regionName, Get get)
=> HRegion::get(final Get get, final Integer lockid)
=> HRegion::get(final Get get) [pass METRIC_GETSIZE to the
callee]
=> HRegion::RegionScanner::next(List<KeyValue> outResults, String
metric)
=> HRegion::RegionScanner::next(List<KeyValue> outResults, int limit,
String metric)
=> HRegion::RegionScanner::nextInternal(int limit, String metric)
=> KeyValueHeap::next(List<KeyValue> result, int limit, String
metric)
=> StoreScanner::next(List<KeyValue> outResult, int limit, String
metric)
2) Next
HTable::ClientScanner::next()
=> ScannerCallable::call()
=> HRegionServer::next(long scannerId)
=> HRegionServer::next(final long scannerId, int nbRows) [pass
METRIC_NEXTSIZE to the callee]
=> HRegion::RegionScanner::next(List<KeyValue> outResults, String
metric)
=> HRegion::RegionScanner::next(List<KeyValue> outResults, int limit,
String metric)
=> HRegion::RegionScanner::nextInternal(int limit, String metric)
=> KeyValueHeap::next(List<KeyValue> result, int limit, String
metric)
=> StoreScanner::next(List<KeyValue> outResult, int limit, String
metric)
Test Plan:
1. Passed unit tests.
2. Created a testcase TestRegionServerMetrics::testGetNextSize to
guarantee:
* Get/Next contributes to getsize/nextsize metrics
* Both getsize/nextsize are per Column Family
* Flush/compaction won't affect these two metrics
Reviewed By: mbautin
Reviewers: Kannan, mbautin, Liyin, JIRA
CC: Kannan, mbautin, Liyin, zhiqiu
Differential Revision: https://reviews.facebook.net/D1617
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299147 13f79535-47bb-0310-9956-ffa450edef68
2012-03-10 02:27:05 +00:00
Michael Stack
e4c43d72bf
HBASE-5535 Make the functions in task monitor synchronized
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299088 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 22:47:54 +00:00
Michael Stack
7d34da889e
HBASE-5538 A metric to measure the size of the response queue in the hbase rpc server
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299084 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 22:40:12 +00:00
mbautin
fc08d20ebd
[jira] [HBASE-4542] Add filter info to slow query logging
...
Author: Zhiqiu Kong
Summary:
The original 89-fb diff is: https://reviews.facebook.net/D1263
Slow opertaion log does not provide enough information when a filter is
present. The followings are done to add the filter info:
1) Added toString() method for filters inheriting FilterBase, this
affect 22 filters and their subclasses. The info added includes the
filter's name and its members. For example, for TimestampsFilter, we'll
output its class name as well as the defined timestamps.
2) Added a field 'filter' in Get::toMap() and Scan::toMap() to enable
the logging of filter info.
Task ID: #750975
Blame Rev:
Test Plan:
1. Run and passed unit-tests to make sure it does not break things
2. Run kannan's script to trigger the slow operation logging, checked
for each filter to make sure the filter info was logged. To be more
detailed, the output log are as following (only 'filter' filed is put
here for ease of reading):
"filter":"TimestampsFilter (3/3): [2, 3, 5]"
"filter":"TimestampsFilter (5/6): [2, 3, 5, 7, 11]"
"filter":"ColumnPrefixFilter col2"
"filter":"ColumnRangeFilter [col2a, col2b]"
"filter":"ColumnCountGetFilter 8"
"filter":"ColumnPaginationFilter (4, 4)"
"filter":"InclusiveStopFilter row"
"filter":"PrefixFilter row"
"filter":"PageFilter 1"
"filter":"SkipFilter TimestampsFilter (1/1): [1000]"
"filter":"WhileMatchFilter TimestampsFilter (3/3): [2, 3, 5]"
"filter":"KeyOnlyFilter"
"filter":"FirstKeyOnlyFilter"
"filter":"MultipleColumnPrefixFilter (3/3): [a, b, c]"
"filter":"DependentColumnFilter (family, qualifier, true, LESS, value)"
"filter":"FamilyFilter (LESS, value)"
"filter":"QualifierFilter (LESS, value)"
"filter":"RowFilter (LESS, value)"
"filter":"ValueFilter (LESS, value)"
"filter":"KeyOnlyFilter"
"filter":"FirstKeyOnlyFilter"
"filter":"SingleColumnValueFilter (family, qualifier, EQUAL, value)"
"filter":"SingleColumnValueExcludeFilter (family, qualifier, EQUAL,
value)"
"filter":"FilterList AND (2/2): [KeyOnlyFilter, FirstKeyOnlyFilter]"
Please check ~zhiqiu/Codes/scripts/testFilter.rb for the testing script.
3. Added unit test cases to TestOperation to verify the filters'
toString() method works well.
Reviewed By: mbautin
Reviewers: Kannan, madhuvaidya, mbautin, JIRA
CC: Kannan, madhuvaidya, mbautin, zhiqiu, stack
Differential Revision: https://reviews.facebook.net/D1539
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299019 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 20:14:26 +00:00
Michael Stack
cbdf0ca007
HBASE-5552 Clean up our jmx view; its a bit of a mess
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298923 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 16:54:13 +00:00
Zhihong Yu
35a36c2c66
HBASE-5213 "hbase master stop" does not bring down backup masters (Gregory)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298859 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 14:47:16 +00:00
larsh
5d9f98e09d
HBASE-5541 Avoid holding the rowlock during HLog sync in HRegion.mutateRowWithLocks
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298678 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 00:52:25 +00:00
larsh
7ce77fc5d3
HBASE-5526 ^Cnfigurable file and directory based umask (Jesse Yates)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298657 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 23:58:17 +00:00
mbautin
961455cd9d
[jira] [HBASE-5074] Support checksums in HBase block cache
...
Author: Dhruba
Summary:
HFile is enhanced to store a checksum for each block. HDFS checksum verification
is avoided while reading data into the block cache. On a checksum verification
failure, we retry the file system read request with hdfs checksums switched on
(thanks Todd).
I have a benchmark that shows that it reduces iops on the disk by about 40%. In
this experiment, the entire memory on the regionserver is allocated to the
regionserver's jvm and the OS buffer cache size is negligible. I also measured
negligible (<5%) additional cpu usage while using hbase-level checksums.
The salient points of this patch:
1. Each hfile's trailer used to have a 4 byte version number. I enhanced this so
that these 4 bytes can be interpreted as a (major version number, minor
version). Pre-existing hfiles have a minor version of 0. The new hfile format
has a minor version of 1 (thanks Mikhail). The hfile major version remains
unchanged at 2. The reason I did not introduce a new major version number is
because the code changes needed to store/read checksums do not differ much from
existing V2 writers/readers.
2. Introduced a HFileSystem object which is a encapsulates the FileSystem
objects needed to access data from hfiles and hlogs. HDFS FileSystem objects
already had the ability to switch off checksum verifications for reads.
3. The majority of the code changes are located in hbase.io.hfie package. The
retry of a read on an initial checksum failure occurs inside the hbase.io.hfile
package itself. The code changes to hbase.regionserver package are minor.
4. The format of a hfileblock is the header followed by the data followed by the
checksum(s). Each 16 K (configurable) size of data has a 4 byte checksum. The
hfileblock header has two additional fields: a 4 byte value to store the
bytesPerChecksum and a 4 byte value to store the size of the user data
(excluding the checksum data). This is well explained in the associated
javadocs.
5. I added a test to test backward compatibility. I will be writing more unit
tests that triggers checksum verification failures aggressively. I have left a
few redundant log messages in the code (just for easier debugging) and will
remove them in later stage of this patch. I will also be adding metrics on
number of checksum verification failures/success in a later version of this
diff.
6. By default, hbase-level checksums are switched on and hdfs level checksums
are switched off for hfile-reads. No changes to Hlog code path here.
Test Plan: The default setting is to switch on hbase checksums for hfile-reads,
thus all existing tests actually validate the new code pieces. I will be writing
more unit tests for triggering checksum verification failures.
Reviewers: mbautin
Reviewed By: mbautin
CC: JIRA, tedyu, mbautin, dhruba, todd, stack
Differential Revision: https://reviews.facebook.net/D1521
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298641 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 22:55:49 +00:00
Zhihong Yu
c4426b5b79
HBASE-5515 Add a processRow API that supports atomic multiple reads and writes on a row (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298533 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 19:40:27 +00:00
Michael Stack
0f7285a81a
HBASE-4890 fix possible NPE in HConnectionManager
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298272 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 05:00:01 +00:00
Andrew Kyle Purtell
edc6696bc5
HBASE-5480. Fixups to MultithreadedTableMapper for Hadoop 0.23
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298259 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 02:28:39 +00:00
Michael Stack
e4f4022493
HBASE-5519 Incorrect warning in splitlogmanager
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297707 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 20:46:02 +00:00
larsh
723e8559e3
HBASE-5523 Fix Delete Timerange logic for KEEP_DELETED_CELLS
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297343 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 06:17:11 +00:00
Zhihong Yu
88115f3d8b
HBASE-5507 ThriftServerRunner.HbaseHandler.getRegionInfo() and getTableRegions() do not use ByteBuffer correctly (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297300 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 00:00:36 +00:00
Zhihong Yu
44e348ea1b
HBASE-5010 Pass region info in LoadBalancer.randomAssignment(List<ServerName> servers) (Anoop Sam John)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297155 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 18:41:03 +00:00
Michael Stack
0132176084
HBASE-5286 bin/hbase's logic of adding Hadoop jar files to the classpath is fragile when presented with split packaged Hadoop 0.23 installation
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296663 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 16:46:57 +00:00
Michael Stack
4343a0a00d
HBASE-5486 Warn message in HTable: Stringify the byte[]
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296478 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 21:16:03 +00:00
Zhihong Yu
a2392c913e
HBASE-5506 Add unit test for ThriftServerRunner.HbaseHandler.getRegionInfo() (Scott Chen)
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296365 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 18:30:27 +00:00
larsh
9ffc748589
HBASE-5489 Addendum
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296011 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 00:26:25 +00:00
Michael Stack
7147bc5424
HBASE-5489 Add HTable accessor to get regions for a key range
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295729 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 18:43:29 +00:00
Michael Stack
dace419238
HBASE-4403 Adopt interface stability/audience classifications from Hadoop AND HBASE-5502 region_mover.rb fails to load regions back to original server for regions only containing empty tables
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295710 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 17:53:03 +00:00
Michael Stack
324a2cfeb4
HBASE-5454 Refuse operations from Admin before master is initialized
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295433 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 06:59:51 +00:00
Michael Stack
8eab15acf5
HBASE-5491 Remove HBaseConfiguration.create() call from coprocessor.Exec class
...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295429 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 06:49:59 +00:00