Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
5,926 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

4313 Commits

Author SHA1 Message Date
Michael Stack d16f6df6e6 HBASE-5903 Detect the test classes without categories 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1332260 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 15:47:23 +00:00
Jonathan Hsieh 87899ccda8 HBASE-5712 Parallelize load of .regioninfo files in diagnostic/repair portion of hbck 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1332072 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 06:33:59 +00:00
Zhihong Yu b695b64dfa HBASE-5611 Replayed edits from regions that failed to open during recovery aren't removed from the global MemStore size (Jieshan) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1331681 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-28 04:15:15 +00:00
Michael Stack 6f6b264efc HBASE-5885 Invalid HFile block magic on Local file System 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1331675 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-28 03:59:36 +00:00
Michael Stack 4e080b0dcb HBASE-5893 Allow spaces in coprocessor conf (aka trim() className) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1331638 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-27 23:54:21 +00:00
larsh 4ecfcbde5d HBASE-5864 Error while reading from hfile in 0.94 (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1331058 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 20:08:23 +00:00
Michael Stack f854df4223 HBASE-5862 After Region Close remove the Operation Metrics 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330997 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 17:59:58 +00:00
Michael Stack 6d848a1943 HBASE-5829 Inconsistency between the "regions" map and the "servers" map in AssignmentManager 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330993 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 17:51:17 +00:00
Michael Stack d7110681df HBASE-5844 Delete the region servers znode after a regions server crash; REVERT 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330983 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 17:30:13 +00:00
Michael Stack 5f01fcd4fe HBASE-5672 TestLruBlockCache#testBackgroundEvictionThread fails occasionally 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330971 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 17:03:51 +00:00
Jonathan Hsieh c8b61833f7 HBASE-5652 [findbugs] Fix lock release on all paths (Gregory Channan) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330628 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 01:58:58 +00:00
Zhihong Yu 8964098cd8 HBASE-5870 Hadoop 23 compilation broken because JobTrackerRunner#getJobTracker() method is not found 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330563 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 21:19:36 +00:00
larsh 0be3011b5f HBASE-5873 TimeOut Monitor thread should be started after atleast one region server registers. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330551 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 20:43:35 +00:00
larsh bbd5306d27 HBASE-5848 Addendum, try 2 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330349 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 15:35:47 +00:00
larsh 13f1e3acff REVERT wrong commit (r1330105), sorry 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330347 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 15:34:30 +00:00
larsh 33e6443704 HBASE-5871 Usability regression, we don't parse compression algos anymore 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330123 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 06:01:31 +00:00
Michael Stack ae24697feb HBASE-5849 On first cluster startup, RS aborts if root znode is not available; REAPPLY 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330116 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 05:46:18 +00:00
larsh f4459661d2 HBASE-5848 Addendum 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330105 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 05:07:15 +00:00
Jonathan Hsieh 917a07b73f HBASE-5861 ADDENDUM (missed new MapredcueTestingShim.java file) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330078 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 01:00:04 +00:00
Jonathan Hsieh 2a853d4a96 HBASE-5861 Hadoop 23 compile broken due to tests introduced in HBASE-5064 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1330072 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-25 00:07:40 +00:00
Michael Stack 4556bf67ce HBASE-5866 Canary in tool package but says its in tools 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329898 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 18:01:26 +00:00
ramkrishna 3644d4c8d6 HBASE-5848 Create table with EMPTY_START_ROW passed as splitKey causes the HMaster to abort (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329819 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 16:14:22 +00:00
Michael Stack 1d6b501c9b HBASE-4393 Implement a canary monitoring program 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329574 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 07:20:16 +00:00
Michael Stack e031dc8d34 HBASE-5849 On first cluster startup, RS aborts if root znode is not available; REVERT 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329560 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 05:55:55 +00:00
larsh 9989f83699 Refuse operations from Admin before master is initialized - fix for all branches 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329555 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 05:12:45 +00:00
Michael Stack afcdced021 HBASE-5849 On first cluster startup, RS aborts if root znode is not available 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329527 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-24 01:51:14 +00:00
Michael Stack 77c6b2bd6b HBASE-5851 TestProcessBasedCluster sometimes fails; DISABLE THE FAILING TEST FOR NOW 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329497 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 22:35:40 +00:00
Michael Stack 17cf114310 HBASE-5857 RIT map in RS not getting cleared while region opening 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329470 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 21:54:14 +00:00
Michael Stack abae95c2aa HBASE-5830 Cleanup SequenceFileLogWriter to use syncFs api from SequenceFile#Writer directly in trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329443 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 21:05:09 +00:00
Michael Stack fd4ce7149f HBASE-5844 Delete the region servers znode after a regions server crash 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329430 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 20:29:45 +00:00
Michael Stack 6fb905120c HBASE-5833 0.92 build has been failing pretty consistently on TestMasterFailover; ADDENDUM; missed import 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329411 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 20:01:31 +00:00
Michael Stack fabaf478ed HBASE-5833 0.92 build has been failing pretty consistently on TestMasterFailover 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329400 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 19:40:13 +00:00
Michael Stack f8c7f1b0fb HBASE-5443 Convert admin protocol of HRegionInterface to PB 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329358 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 18:12:16 +00:00
ramkrishna e2cd675020 HBASE-5635 If getTaskList() returns null, splitlogWorker would go down and it won't serve any requests (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329322 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 16:47:04 +00:00
Jonathan Hsieh b854d1efb1 HBASE-5654 [findbugs] Address dodgy bugs (Ashutosh Jindal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1329132 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-23 08:46:42 +00:00
ramkrishna 144b27d1a3 HBASE-5809 Avoid move api to take the destination server same as the source server. Addendum to correct tet case. (Ted) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328594 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-21 07:00:46 +00:00
ramkrishna 14f80913e5 HBASE-5809 Avoid move api to take the destination server same as the source server. (Rajesh) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328458 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-20 17:36:02 +00:00
Zhihong Yu e05c21c0cb HBASE-5824 revert changes to single Put case, preserving deprecation for ICV 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328457 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-20 17:36:02 +00:00
Zhihong Yu 85842f019e HBASE-5824 addendum fixes coprocessor tests (Jimmy) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328166 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-20 01:07:29 +00:00
Michael Stack a09cea8e44 HBASE-5794 Jenkins builds timing out; undo setting hbase.client.retries.number to 100 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328152 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 23:52:44 +00:00
Michael Stack 0b30494edb HBASE-5824 HRegion.incrementColumnValue is not used in trunk 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328142 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 22:49:30 +00:00
Michael Stack f9fb38e31c HBASE-3614 Expose per-region request rate metrics 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328140 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 22:45:30 +00:00
ramkrishna 13b35ce82c HBASE-5737 Minor Improvements related to balancer. (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328057 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 18:05:31 +00:00
Michael Stack a843058f5f Some more info on test categorization; add the rule that needs to at foot of all new test files 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328035 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 16:24:28 +00:00
Zhihong Yu 4e0f6a27ab HBASE-5821 Incorrect handling of null value in Coprocessor aggregation function min() (Maryann Xue) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1328030 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-19 16:19:56 +00:00
Michael Stack ccdf0557ce HBASE-5791 Apache project branding requirements: DOAP file [PATCH] 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327721 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 23:09:49 +00:00
Michael Stack d91ea129e8 HBASE-5819 SplitLogs function could leak resources 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327697 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 21:59:24 +00:00
Michael Stack 7972efeea8 HBASE-5811 TestLoadAndSwitchEncodeOnDisk fails sometimes 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327696 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 21:57:23 +00:00
Michael Stack 56a4420af1 HBASE-5817 Fix uncategorized tests 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327691 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 21:31:00 +00:00
Michael Stack a0a2674c42 HBASE-5825 TestHLog not running any tests; fix 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327686 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 21:21:37 +00:00
larsh 5eb1259399 HBASE-5545 region can't be opened for a long time. Because the creating File failed. (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327677 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 20:54:59 +00:00
larsh e8ec0b9f8c HBASE-5782 Edits can be appended out of seqid order since HBASE-4487 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327673 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 20:38:21 +00:00
Michael Stack 89a985f28c HBASE-3585 isLegalFamilyName() can throw ArrayOutOfBoundException 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327666 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 20:25:50 +00:00
Michael Stack 9ae52f0eab HBASE-5818 TestScannerSelectionUsingTTL should be in MediumTests category 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327663 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 20:19:44 +00:00
Michael Stack b196f98194 HBASE-5823 Hbck should be able to print help 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327638 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 19:31:28 +00:00
Michael Stack 5446911066 HBASE-5810 HBASE-5620 Convert the client protocol of HRegionInterface to PB addendum 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327629 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 18:53:30 +00:00
Zhihong Yu 8d84537c19 HBASE-5733 AssignmentManager#processDeadServersAndRegionsInTransition can fail with NPE (Uma Maheswara Rao G) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327364 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 03:15:24 +00:00
Zhihong Yu 34d88b8e23 HBASE-5741 ImportTsv does not check for table existence (Himanshu) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327338 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 00:32:28 +00:00
mbautin 421400c256 [jira] [HBASE-5763] Fix random failures in TestFSErrorsExposed 
Summary:
TestFSErrorsExposed frequently fails due to unclean mini-cluster shutdown.
Bringing datanodes back up, waiting for some time, and preemptively killing all
regionservers and the master before shutdown.

This is the trunk fix. The 89-fb patch is at D2739.

Test Plan: Run TestFSErrorsExposed 100 times

Reviewers: stack, tedyu, jdcryans, lhofhansl, jmhsieh, JIRA

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D2793

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327337 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-18 00:22:54 +00:00
Michael Stack 2a3ca44ea4 HBASE-5814 Make HLogPerformanceEvaluation work on top of hdfs 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327322 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 23:23:29 +00:00
Michael Stack b10f06129b HBASE-5788 Move Dynamic Metrics storage off of HRegion 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327316 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 23:01:30 +00:00
Michael Stack 183e36e43b HBASE-5812 Add log rolling to HLogPerformanceEvaluation 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327282 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 21:13:00 +00:00
Michael Stack 1e7ca13fda HBASE-5808 Remove TestHLogBench, HLogPerformanceEvaluation is more comprehensive 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1327143 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 15:26:52 +00:00
Michael Stack ea65619d35 HBASE-5804 Add more to verification step in HLogPerformanceEvaluation; UNDO OVERCOMMIT in hbase-site.xml 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326903 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 03:58:51 +00:00
Michael Stack ae3cbd0605 HBASE-5804 Add more to verification step in HLogPerformanceEvaluation 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326902 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-17 03:57:18 +00:00
Zhihong Yu 6858d30b13 HBASE-5780 Fix race in HBase regionserver startup vs ZK SASL authentication (Shaneal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326814 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 21:55:57 +00:00
Zhihong Yu 705278ae46 HBASE-5795 HServerLoad$RegionLoad breaks 0.92<->0.94 compatibility 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326794 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 20:44:02 +00:00
Michael Stack 9d15d08d71 HBASE-5792 HLog Performance Evaluation Tool 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326793 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 20:43:46 +00:00
Michael Stack fcfb13e312 HBASE-5792 HLog Performance Evaluation Tool 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326792 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 20:43:23 +00:00
Michael Stack fa6cc996df HBASE-5800 Birds of a feather link on web page doesn't work 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326695 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-16 17:50:00 +00:00
Jonathan Hsieh 099ddf36ec HBASE-5793 TestHBaseFsck#testNoHdfsTable test hangs after client retries increased 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326434 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-15 22:43:51 +00:00
Jonathan Hsieh 44a05d4380 HBASE-5781 Zookeeper session got closed while trying to assign the region to RS using hbck -fix 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326280 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-15 08:59:11 +00:00
mbautin a2c1c0cd3e [jira] [HBASE-5684] Make ProcessBasedLocalHBaseCluster run HDFS and make it more 
robust

Summary:
Currently ProcessBasedLocalHBaseCluster runs on top of raw local filesystem. We
need it to start a process-based HDFS cluster as well. We also need to make the
whole thing more stable so we can use it in unit tests.

Also all logs of local HBase cluster daemons are now tailed to the primary log
of the unit test with the appropriate prefixes to make debugging easier.

This is a trunk diff. The 89-fb version is D2709.

Test Plan:
Run the new unit test multiple times (10x or 50x).
Run all unit tests.

Reviewers: tedyu, stack, lhofhansl, nspiegelberg, amirshim, JIRA

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D2757

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326036 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-14 01:25:27 +00:00
larsh b4a1bb164b HBASE-5604 Addendum. Remove test as per discussion on jira. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326002 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 22:49:09 +00:00
Michael Stack b987a52e36 HBASE-5747 Forward port "hbase-5708 [89-fb] Make MiniMapRedCluster directory a subdirectory of target/test" 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1326000 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 22:45:25 +00:00
Michael Stack 4d04f85308 HBASE-5443 Convert the client protocol of HRegionInterface to PB 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325937 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 20:28:21 +00:00
Michael Stack 740ed62e50 HBASE-5784 Enable mvn deploy of website 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325917 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 19:39:06 +00:00
Michael Stack 70109d07fc HBASE-5772 Unable to open the few links in http://hbase.apache.org/ 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325893 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 18:14:13 +00:00
Michael Stack 401c4ec014 HBASE-5778 Turn on WAL compression by default 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325801 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 15:24:05 +00:00
Jonathan Hsieh 3976ec641e HBASE-5488 OfflineMetaRepair doesn't support hadoop 0.20's fs.default.name property (gaojinchao) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325625 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 06:44:36 +00:00
larsh ea687c181d HBASE-5604 addendum, mark TestWALPlayer as LargeTest 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325609 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-13 04:13:14 +00:00
Jean-Daniel Cryans 1478088b10 HBASE-5778 Turn on WAL compression by default 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325566 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 23:00:01 +00:00
larsh 0717d13416 HBASE-5604 M/R tool to replay WAL files 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325555 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 22:25:46 +00:00
larsh fc9faf8585 HBASE-5775 ZKUtil doesn't handle deleteRecurisively cleanly (Jesse Yates) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325540 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 21:53:54 +00:00
Michael Stack eb5d2fe9d0 HBASE-5300 Research website symolic links for renaming of "HBase book" to "HBase Reference Guide" 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325512 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 20:58:32 +00:00
larsh 9a0673f8c6 HBASE-3443 ICV optimization to look in memstore first and then store files (HBASE-3082) does not work when deletes are in the mix 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325406 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 17:46:39 +00:00
Jonathan Hsieh 36324e341d HBASE-5719 Enhance hbck to sideline overlapped mega regions (Jimmy Xiang) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325404 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 17:44:52 +00:00
Michael Stack 38eb4579e4 HBASE-5770 Add a clock skew warning threshold 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325389 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 17:20:25 +00:00
Michael Stack 05e3db77c5 HBASE-5773 HtablePool constructor not reading config files in certain cases 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325380 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 16:58:20 +00:00
larsh 51ec5b2b23 HBASE-5717 Scanner metrics are only reported if you get to the end of a scanner (Ian Varley) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1325344 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-12 16:10:25 +00:00
Jonathan Hsieh 8575edd908 HBASE-5645 [findbugs] Fix correctness warnings (David S Wang and Uma Maheswara Rao G) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324969 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 20:04:12 +00:00
Jonathan Hsieh a2ff41653a HBASE-5599 [hbck] handle NO_VERSION_FILE and SHOULD_NOT_BE_DEPLOYED inconsistencies (fulin wang) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324881 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 17:20:19 +00:00
Doug Meil 4e9a9e0585 hbase-5766. adding "bulk loading" to Ops chapter tools list. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324741 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 12:39:43 +00:00
Doug Meil 601f268006 hbase-5765 adding ImportTsv to Ops chapter 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324736 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 12:30:20 +00:00
Doug Meil 10f783bd56 hbase-5764 adding turning off SpecEx in Config chapter recommendations 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324730 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 12:20:22 +00:00
Jonathan Hsieh b7844d9dd0 HBASE-5653 [findbugs] Fix perf warnings (Uma Maheswara Rao G) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1324547 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 04:36:26 +00:00
Michael Stack 135478ca21 HBASE-5760 Unit tests should write only under /target 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1312043 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 23:33:05 +00:00
Michael Stack a31cb26e5a HBASE-5739 Upgrade guava to 11.0.2 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311942 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 19:23:38 +00:00
Michael Stack 4e3a796d92 fix link for birds-of-a-feather session 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311919 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 18:46:09 +00:00
Michael Stack 814616687a HBASE-5755 Region sever looking for master forever with cached stale data 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311910 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 18:29:31 +00:00
Michael Stack 7d1f7b7f37 HBASE-5759 HBaseClient throws NullPointerException when EOFException should be used. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311899 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 18:15:25 +00:00
Michael Stack f4ea4f4f07 HBASE-5758 Forward port "HBASE-4109 Hostname returned via reverse dns lookup contains trailing period if configured interface is not default 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311821 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 16:14:18 +00:00
Michael Stack 51afbfaf96 Add birds-of-a-feather and move old news to old news page 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311763 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 14:45:17 +00:00
Michael Stack c15161771a HBASE-5749 "HBASE-5335 Dynamic Schema Config" broke build, missing change to HRegion heapsize 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311562 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 03:06:36 +00:00
Michael Stack 761916cebb HBASE-5740 Compaction interruption may be due to balacing 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311514 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 22:58:19 +00:00
Michael Stack 1283155ddc HBASE-5748 Enable lib directory in jar file for coprocessor 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311498 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 22:27:55 +00:00
Doug Meil 56d1587b7e hbase-5753.xml - adding schema design case study in Case Studies chapter 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311411 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 20:17:04 +00:00
Michael Stack 66772ce043 HBASE-5727 secure hbase build broke because of 'HBASE-5451 Switch RPC call envelope/headers to PBs' 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311287 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 15:44:04 +00:00
Michael Stack f66532d9dc add hackconathon 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311280 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 15:24:27 +00:00
Nicolas Spiegelberg 167f012d64 [jira] [HBASE-5335] Dynamic Schema Config 
Summary: Ability to add config options on a per-table & per-cf basis

Test Plan: - mvn test

Reviewers: JIRA, Kannan, stack, mbautin, Liyin

Reviewed By: mbautin

CC: tedyu

Differential Revision: https://reviews.facebook.net/D2247

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311269 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 14:54:52 +00:00
mbautin 00316a4a51 [jira] [HBASE-5744] Thrift server metrics should be long instead of int 
Summary:
As we measure our Thrift call latencies in nanoseconds, we need to make
latencies long instead of int everywhere. There is a bug where we truncate a
nanosecond latency to int, which is a problem with RPCs that take more than
2.147483647 seconds to process.

This is a trunk diff. The 89-fb version of this diff is at D2679.

Test Plan:
TestThriftServer is updated to test for the failure case (an RPC is artificially
made to take 3 seconds). The new test case fails without the fix.

Re-run all unit tests.

Reviewers: stack, sc, Kannan, JIRA

Reviewed By: sc

Differential Revision: https://reviews.facebook.net/D2685



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311167 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 09:00:11 +00:00
larsh 720a974794 HBASE-5656 LoadIncrementalHFiles createTable should detect and set compression algorithm(Cosmin Lehene) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1311106 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-08 21:34:19 +00:00
Michael Stack 2f06c667d3 HBASE-5618 SplitLogManager - prevent unnecessary attempts to resubmits 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310923 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 23:32:28 +00:00
Zhihong Yu 7a0c1daf63 HBASE-5689 Skipping RecoveredEdits may cause data loss (Chunhui) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310788 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 15:30:59 +00:00
Zhihong Yu 915f2cd40d HBASE-5736 ThriftServerRunner.HbaseHandler.mutateRow() does not use ByteBuffer correctly (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310634 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 23:37:01 +00:00
Jonathan Hsieh 6d43887b88 HBASE-5734 Change hbck sideline root (Jimmy Xiang) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310625 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 22:41:10 +00:00
Michael Stack af91c18d63 HBASE-5707 Move clusterid and clusterup (shutdown) znodes over to pb 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310568 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 20:15:10 +00:00
Michael Stack 4cc08fa5d6 HBASE-5709 Move active master and backup master znodes to use pbs 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310553 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 19:05:42 +00:00
Jonathan Hsieh 4317892dce HBASE-5680 Improve compatibility warning about HBase with Hadoop 0.23.x 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310429 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 16:03:42 +00:00
Zhihong Yu ccc24e39f9 HBASE-5615 revert due to race condition in case master dies 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310324 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 13:43:03 +00:00
Jonathan Hsieh 9b57215185 HBASE-4348 Add metrics for regions in transition (Himanshu Vashishtha) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310159 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 03:46:04 +00:00
Jonathan Hsieh be245101ac HBASE-5644 [findbugs] Fix null pointer warnings (Uma Maheswara Rao G) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310125 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 23:05:07 +00:00
Michael Stack fa97600ea9 HBASE-5722 NPE in ZKUtil#getChildDataAndWatchForNewChildren when ZK not available or NW down. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310104 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 22:09:41 +00:00
Michael Stack 1140530cc2 HBASE-5711 Tests are failing with incorrect data directory permissions -- RE-REVERT 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310102 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 22:06:05 +00:00
Michael Stack 8fd194d696 HBASE-5711 Tests are failing with incorrect data directory permissions -- OVER-REVERTED; UNDOING LAST COMMIT 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310097 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 22:04:26 +00:00
Michael Stack 050e8df896 HBASE-5711 Tests are failing with incorrect data directory permissions -- REVERT 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310095 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 22:02:38 +00:00
Michael Stack 7ab743986f HBASE-5724 Row cache of KeyValue should be cleared in readFields(). 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310065 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 20:47:38 +00:00
Michael Stack 1f253c23fa HBASE-5711 Tests are failing with incorrect data directory permissions. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310050 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 20:20:55 +00:00
Michael Stack de4f4aa9e4 HBASE-5715 Revert 'Instant schema alter' for now, HBASE-4213 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1310012 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 18:57:09 +00:00
Nicolas Spiegelberg 72dfa4207d HBASE-5359 Alter in the shell can be too quick and return before the table is altered 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1309611 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 21:53:12 +00:00
Michael Stack 753afe9de3 HBASE-5706 'Dropping fs latency stats since buffer is full' spam 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1309457 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 15:36:28 +00:00
Zhihong Yu 5e07b71ed6 HBASE-5606 SplitLogManger async delete node hangs log splitting when ZK connection is lost 
(Prakash)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1309173 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 22:04:45 +00:00
Michael Stack e72b67e20c HBASE-5451 Switch RPC call envelope/headers to PBs 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1309019 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 16:26:50 +00:00
Michael Stack b5b0116712 HBASE-5701 Put RegionServerDynamicStatistics under RegionServer in MBean hierarchy rather than have it as a peer 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308971 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 15:08:38 +00:00
Michael Stack 3d06717256 HBASE-5704 HBASE-4398 mistakenly rolled back on trunk 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308964 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 14:57:18 +00:00
Michael Stack f1a09236ab HBASE-5688 Convert zk root-region-server znode content to pb; DELETE RLE... causing build to fail because of RAT warnings 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308697 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 05:23:13 +00:00
Michael Stack 3d7e7f1626 HBase-5688 Convert zk root-region-server znode content to pb 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308681 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 04:42:54 +00:00
larsh 450583b9bd HBASE-3134 [replication] Add the ability to enable/disable streams (Teruyoshi Zenmyo) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308675 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 04:14:46 +00:00
Michael Stack f9802e4cdf HBASE-5692 Add real action time for HLogPrettyPrinter 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308609 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 23:02:56 +00:00
Michael Stack 4e99cb4923 HBASE-5688 Convert zk root-region-server znode content to pb 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308560 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 21:00:47 +00:00
Michael Stack 3e23493543 HBASE-5665 Repeated split causes HRegionServer failures and breaks table 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308545 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 20:48:22 +00:00
Michael Stack fe2f84dbb1 HBASE-5693 When creating a region, the master initializes it and creates a memstore within the master server 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308535 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 20:30:27 +00:00
Michael Stack 6135aa2d5a HBASE-5694 getRowsWithColumnsTs() in Thrift service handles timestamps incorrectly 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308445 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 17:59:48 +00:00
Zhihong Yu 80722e7290 HBASE-5663 HBASE-5636 MultithreadedTableMapper doesn't work (Takuya Ueshin) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1308353 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 13:50:03 +00:00
larsh 86f8282bef HBASE-5084 Clow different HTable instances to share one ExecutorService 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307661 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-31 00:26:22 +00:00
Michael Stack a99bd2c9ec HBASE-5564 Bulkload is discarding duplicate records 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307629 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 21:44:08 +00:00
Michael Stack c7c1dbeb65 HBASE-5443 Create PB protocols for HRegionInterface 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307625 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 21:38:44 +00:00
Zhihong Yu 229cf740b8 HBASE-5667 RegexStringComparator supports java.util.regex.Pattern flags (David Arthur) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307580 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 19:33:27 +00:00
larsh f1a9b5bed1 HBASE-5542 Addendum - accidentally checked in .orig file 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307562 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 18:04:32 +00:00
Zhihong Yu 06e70aa877 HBASE-5573 Replace client ZooKeeper watchers by simple ZooKeeper reads (N Keywal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307549 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 17:45:57 +00:00
Michael Stack 8ecfa1087c HBASE-5673 The OOM problem of IPC client call cause all handle block; REVERT OF V2, A SECOND REVERT 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307513 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 16:33:26 +00:00
Michael Stack 277e246110 HBASE-5673 The OOM problem of IPC client call cause all handle block; REAPPLY; V2 OF PATCH 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307277 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 05:33:19 +00:00
Michael Stack 81482cebb8 HBASE-5673 The OOM problem of IPC client call cause all handle block; REVERT -- APPLIED WRONG PATCH 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307270 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 05:30:47 +00:00
Michael Stack b291485220 HBASE-5673 The OOM problem of IPC client call cause all handle block 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307240 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 04:33:12 +00:00
Michael Stack 89ea8af04f HBASE-4398 If HRegionPartitioner is used in MapReduce, client side configurations are overwritten by hbase-site.xml 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307116 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 21:23:23 +00:00
Jonathan Hsieh fbfe3f29e5 HBASE-5638 Readability improvements on HBASE-5633: NPE reading ZK config in HBase (Matteo Bertozzi) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307085 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 20:04:49 +00:00
ramkrishna 26de676dea HBASE-5097 RegionObserver implementation whose preScannerOpen and postScannerOpen Impl return null can stall the system initialization through NPE (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307036 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 18:34:02 +00:00
Michael Stack 2e959382ef Add su meetup to news 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307033 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 18:30:01 +00:00
Michael Stack c7b5588be4 Add blog as link to our nav bar 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1307032 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 18:25:26 +00:00
larsh ea77247c82 HBASE-5670 Have Mutation implement the Row interface. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306959 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 16:21:41 +00:00
Michael Stack 67ded34626 AggregationClient fails validation for open stoprow scan 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306914 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 15:29:01 +00:00
Michael Stack ec4d59770a HBASE-5564 Bulkload is discarding duplicate records 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306907 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 15:23:46 +00:00
Michael Stack 8a864815de HBASE-5671 hbase.metrics.showTableName should be true by default 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306712 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 04:35:48 +00:00
Zhihong Yu ada9d8d361 HBASE-5544 Add metrics to HRegion.processRow() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306648 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 23:59:17 +00:00
Doug Meil d5a548e7ca hbase-5662. ops_mgt.xml, adding entry for HLogPrettyPrinter in tools section. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306037 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 22:44:11 +00:00
Doug Meil 18e7473a53 hbase-5661. adding hbase history section in appendix 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306032 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 22:27:13 +00:00
Doug Meil 528d9ddde1 hbase-5660. Creating Case Studies chapter in RefGuide. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306015 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 20:50:55 +00:00
larsh 16ad2b2898 HBASE-5639 The logic used in waiting for region servers during startup is broken (J-D and NKeyval) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1306012 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 20:40:13 +00:00
Doug Meil 83e552c3b3 hbase-5658. Update to pseudo-distributed.xml's first link on page to point to RefGuide 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305990 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 19:48:32 +00:00
Doug Meil 0fa7062d2c hbase-5657. developer.xml, updating line-width from 80 to 100 in book (and example) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305979 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 19:36:37 +00:00
Michael Stack 46d8f02c3f HBASE-5610 Add GA to hbase.apache.org 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305970 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 19:26:26 +00:00
larsh ef65dde6b3 HBASE-5641 decayingSampleTick1 prevents HBase from shutting down. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305722 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 03:34:51 +00:00
Jonathan Hsieh 3fd6997380 HBASE-5596 Few minor bugs from HBASE-5209 (David S. Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305661 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 23:06:02 +00:00
larsh 080206de01 HBASE-5623 Race condition when rolling the HLog and hlogFlush (Enis Soztutar and LarsH) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305556 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 20:42:46 +00:00
Michael Stack 8ea1c8ddd6 HBASE-5533 Add more metrics to HBase 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305499 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 19:21:42 +00:00
Zhihong Yu 3c234f13ba HBASE-5615 the master never does balance because of balancing the parent region (Xufeng) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1305171 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-25 23:22:00 +00:00
larsh 82670f81b8 HBASE-4957 Clean up some log messages, code in RecoverableZooKeeper (Todd) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304940 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 22:02:41 +00:00
Michael Stack 9cfe7cfa3c HBASE-5633 NPE reading ZK config in HBase 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304924 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 21:15:40 +00:00
larsh accf8ee862 HBASE-5434 [REST] Include more metrics in cluster status request (Mubarak Seyed) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304919 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 21:04:45 +00:00
Zhihong Yu 53712ce495 HBASE-5128 Addendum adds two new files Jon forgot to add 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304702 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 03:58:22 +00:00
Jonathan Hsieh f2d637ffa5 HBASE-5128 [uber hbck] Online automated repair of table integrity and region consistency problems 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304665 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 23:53:55 +00:00
Jean-Daniel Cryans 560173f756 HBASE-5190 Limit the IPC queue size based on calls' payload size 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304634 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 22:32:31 +00:00
mbautin 86962028dd [jira] [HBASE-5469] Add baseline compression efficiency to DataBlockEncodingTool 
Summary:
DataBlockEncodingTool currently does not provide baseline compression
efficiency, e.g. Hadoop compression codec applied to unencoded data. E.g. if
we are using LZO to compress blocks, we would like to have the following
columns in the report (possibly as percentages of raw data size).

Baseline K+V in blockcache | Baseline K + V on disk (LZO compressed) | K + V
DataBlockEncoded in block cache | K + V DataBlockEncoded + LZOCompressed (on
disk)

Background: we never store compressed blocks in cache, but we always store
encoded data blocks in cache if data block encoding is enabled for the column
family.

This patch also has multiple bugfixes and improvements to DataBlockEncodingTool,
including presentation format, memory requirements (reduced 3x) and fixing the
handling of compression.

Test Plan:
* Run unit tests.
* Run DataBlockEncodingTool on a variety of real-world HFiles.

Reviewers: JIRA, dhruba, tedyu, stack, heyongqiang

Reviewed By: tedyu

Differential Revision: https://reviews.facebook.net/D2409

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304626 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 22:02:53 +00:00
Michael Stack 1e6c227883 HBASE-5616 Make compaction code standalone; ADDENDUM -- ADD LICENSES 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304624 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:52:55 +00:00
Michael Stack 5a9f595e7d HBASE-5616 Make compaction code standalone 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304616 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:37:01 +00:00
Michael Stack 358dc6e6e6 HBASE-5624 Aborting regionserver when splitting region, may cause daughter region not assigned by ServerShutdownHandler 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304603 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:18:41 +00:00
Zhihong Yu 26b2950bc7 HBASE-5613 ThriftServer getTableRegions does not return serverName and port (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304602 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:15:50 +00:00
larsh 929113dfab HBASE-4657 Improve the efficiency of our MR jobs with a few configurations 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304110 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 22:34:35 +00:00
Zhihong Yu a379a41e3d HBASE-5591 ThiftServerRunner.HBaseHandler.toBytes() is identical to Bytes.getBytes() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1304047 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 20:43:55 +00:00
Jean-Daniel Cryans fa98df639e HBASE-5586 [replication] NPE in ReplicationSource when creating a stream 
to an inexistent cluster


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303945 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 18:13:12 +00:00
larsh 536ff21825 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) part 2 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303920 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 17:51:37 +00:00
larsh 6fb055da00 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303915 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 17:49:32 +00:00
Michael Stack 772ecdd236 HBASE-5328 Small changes to Master to make it more testable 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303648 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 03:40:46 +00:00
Michael Stack 327e2d1f74 HBASE-5328 Small changes to Master to make it more testable 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303626 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 00:02:36 +00:00
larsh 4ba5a9d29e HBASE-5433 [REST] Add metrics to keep track of success/failure count (Mubarak Seyed) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303536 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 19:48:11 +00:00
Jonathan Hsieh 865b14133b HBASE-5589 Add of the offline call to the Master Interface 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303519 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 19:30:54 +00:00
Zhihong Yu 5b2d6ebfc5 HBASE-5542 revert due to broken trunk build 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303517 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 19:28:33 +00:00
Michael Stack 250252f400 HBASE-5560 Avoid RegionServer GC caused by timed-out calls 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303512 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 19:17:59 +00:00
Zhihong Yu ce36877d30 HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303490 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 18:25:18 +00:00
larsh 41f31490ff HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303220 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 23:57:53 +00:00
mbautin b4dccf9198 HBASE-5605 [jira] compression does not work in Store.java 
Author: Yongqiang He

Summary: need to pass compression parameter to WriterBuilder

Test Plan: one simple and straightforward change

Reviewers: mbautin

Reviewed By: mbautin

CC: tedyu

Differential Revision: https://reviews.facebook.net/D2391

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303150 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 21:04:38 +00:00
ramkrishna 2f58da0489 HBASE-5520 Support reseek() at RegionScanner (Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1303005 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-20 17:10:50 +00:00
Doug Meil 45a15792f0 hbase-5570 ops_mgt.xml - fixed self-reference with compression section 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302658 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 21:14:55 +00:00
mbautin 6be64072e8 HBASE-5521 [jira] Move compression/decompression to an encoder specific encoding 
context

Author: Yongqiang He

Summary:
https://issues.apache.org/jira/browse/HBASE-5521

As part of working on HBASE-5313, we want to add a new columnar encoder/decoder.
It makes sense to move compression to be part of encoder/decoder:
1) a scanner for a columnar encoded block can do lazy decompression to a
specific part of a key value object
2) avoid an extra bytes copy from encoder to hblock-writer.

If there is no encoder specified for a writer, the HBlock.Writer will use a
default compression-context to do something very similar to today's code.

Test Plan: existing unit tests verified by mbautin and tedyu. And no new test
added here since this code is just a preparation for columnar encoder. Will add
testcase later in that diff.

Reviewers: dhruba, tedyu, sc, mbautin

Reviewed By: mbautin

Differential Revision: https://reviews.facebook.net/D2097

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302602 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-19 19:12:19 +00:00
Michael Stack 047d209cee HBASE-5955 Fix NoSuchMethodException in 0.92 when running on local filesystem 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302207 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-18 19:40:24 +00:00
Michael Stack 101e6f08ba Fix flag passed building hbase 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1302004 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-17 20:49:47 +00:00
Jonathan Hsieh 37da60f92f HBASE-5588 Deprecate/remove AssignmentManager#clearRegionFromTransition 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301885 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-17 07:34:22 +00:00
larsh fda76c71cb Revert HBASE-5569 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301872 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-17 06:59:31 +00:00
Jonathan Hsieh f34edd6378 HBASE-5563 Add comparison of regionId to HRegionInfo#compareTo (chunhui and jmhsieh) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301779 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 21:50:05 +00:00
Zhihong Yu 1d24d71821 HBASE-5549 HBASE-5572 Master can fail if ZooKeeper session expires (N Keywal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301775 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 21:30:47 +00:00
Michael Stack 8a4c928de0 HBASE-5592 Make it easier to get a table from shell 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301715 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 19:45:06 +00:00
Zhihong Yu 458a3ff092 HBASE-5206 Port HBASE-5155 to trunk (Ashutosh Jindal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301709 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 19:14:11 +00:00
Michael Stack a388bae569 HBASE-5581 Creating a table with invalid syntax does not give an error message when it fails 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301688 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 18:46:53 +00:00
Zhihong Yu 8e84390b37 HBASE-5568 Multi concurrent flushcache() for one region could cause data loss (Chunhui) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301639 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-16 16:39:44 +00:00
Zhihong Yu 4a5a27eac2 HBASE-5579 A Delete Version could mask other values (Daniel Ferro) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301173 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 20:03:47 +00:00
Michael Stack 273804e658 HBASE-4608 HLog Compression 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301165 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 19:32:01 +00:00
larsh 5055d4cfff HBASE-5569 Do not collect deleted KVs when they are still in use by a scanner. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1301135 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 18:46:31 +00:00
Zhihong Yu d73aee4f66 HBASE-5206 revert because of test failues in trunk build. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300725 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 21:25:51 +00:00
Zhihong Yu 2ec60a022e HBASE-5206 port HBASE-5155 to TRUNK (Ashutosh Jindal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300711 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 20:29:54 +00:00
Michael Stack eebdfb5d65 HBASE-5574 DEFAULT_MAX_FILE_SIZE defaults to a negative value 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300288 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 19:04:41 +00:00
Michael Stack 05423b150b HBASE-5179 Handle potential data loss due to concurrent processing of processFaileOver and ServerShutdownHandler 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1300194 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-13 15:35:54 +00:00
Michael Stack e4fefa0073 HBASE-5399 Cut the link between the client and the zookeeper ensemble 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299872 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-12 21:20:33 +00:00
mbautin be78e3c4ee [jira] [HBASE-5292] Prevent counting getSize on compactions 
Author: Zhiqiu Kong

Summary:
Added two separate metrics for both get() and next(). This is done by
refactoring on internal next() API. To be more specific, only Get.get()
and ResultScanner.next() passes the metric name ("getsize" and
"nextsize" repectively) to
  HRegion::RegionScanner::next(List<KeyValue>, String)

This will eventually hit StoreScanner()::next((List<KeyValue>,
int, String) where the metrics are counted.

And their call paths are:

1) Get

HTable::get(final Get get)
=> HRegionServer::get(byte [] regionName, Get get)
=> HRegion::get(final Get get, final Integer lockid)
=> HRegion::get(final Get get)      [pass METRIC_GETSIZE to the
callee]

=> HRegion::RegionScanner::next(List<KeyValue> outResults, String
metric)
=> HRegion::RegionScanner::next(List<KeyValue> outResults, int limit,
String metric)
=> HRegion::RegionScanner::nextInternal(int limit, String metric)
=> KeyValueHeap::next(List<KeyValue> result, int limit, String
metric)
=> StoreScanner::next(List<KeyValue> outResult, int limit, String
metric)

2) Next

HTable::ClientScanner::next()
=> ScannerCallable::call()
=> HRegionServer::next(long scannerId)
=> HRegionServer::next(final long scannerId, int nbRows)  [pass
METRIC_NEXTSIZE to the callee]

=> HRegion::RegionScanner::next(List<KeyValue> outResults, String
metric)
=> HRegion::RegionScanner::next(List<KeyValue> outResults, int limit,
String metric)
=> HRegion::RegionScanner::nextInternal(int limit, String metric)
=> KeyValueHeap::next(List<KeyValue> result, int limit, String
metric)
=> StoreScanner::next(List<KeyValue> outResult, int limit, String
metric)

Test Plan:
1. Passed unit tests.
2. Created a testcase TestRegionServerMetrics::testGetNextSize to
guarantee:
 * Get/Next contributes to getsize/nextsize metrics
 * Both getsize/nextsize are per Column Family
 * Flush/compaction won't affect these two metrics

Reviewed By: mbautin

Reviewers: Kannan, mbautin, Liyin, JIRA

CC: Kannan, mbautin, Liyin, zhiqiu

Differential Revision: https://reviews.facebook.net/D1617

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299147 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-10 02:27:05 +00:00
Michael Stack e4c43d72bf HBASE-5535 Make the functions in task monitor synchronized 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299088 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 22:47:54 +00:00
Michael Stack 7d34da889e HBASE-5538 A metric to measure the size of the response queue in the hbase rpc server 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299084 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 22:40:12 +00:00
Michael Stack 293114eb51 HBASE-5555 add a pointer to a dns verification utility in hbase book/dns 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299073 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 22:08:31 +00:00
mbautin fc08d20ebd [jira] [HBASE-4542] Add filter info to slow query logging 
Author: Zhiqiu Kong

Summary:
The original 89-fb diff is: https://reviews.facebook.net/D1263

Slow opertaion log does not provide enough information when a filter is
present. The followings are done to add the filter info:

1) Added toString() method for filters inheriting FilterBase, this
affect 22 filters and their subclasses. The info added includes the
filter's name and its members. For example, for TimestampsFilter, we'll
output its class name as well as the defined timestamps.

2) Added a field 'filter' in Get::toMap() and Scan::toMap() to enable
the logging of filter info.

Task ID: #750975

Blame Rev:

Test Plan:
1. Run and passed unit-tests to make sure it does not break things

2. Run kannan's script to trigger the slow operation logging, checked
for each filter to make sure the filter info was logged. To be more
detailed, the output log are as following (only 'filter' filed is put
here for ease of reading):

"filter":"TimestampsFilter (3/3): [2, 3, 5]"
"filter":"TimestampsFilter (5/6): [2, 3, 5, 7, 11]"
"filter":"ColumnPrefixFilter col2"
"filter":"ColumnRangeFilter [col2a, col2b]"
"filter":"ColumnCountGetFilter 8"
"filter":"ColumnPaginationFilter (4, 4)"
"filter":"InclusiveStopFilter row"
"filter":"PrefixFilter row"
"filter":"PageFilter 1"
"filter":"SkipFilter TimestampsFilter (1/1): [1000]"
"filter":"WhileMatchFilter TimestampsFilter (3/3): [2, 3, 5]"
"filter":"KeyOnlyFilter"
"filter":"FirstKeyOnlyFilter"
"filter":"MultipleColumnPrefixFilter (3/3): [a, b, c]"
"filter":"DependentColumnFilter (family, qualifier, true, LESS, value)"
"filter":"FamilyFilter (LESS, value)"
"filter":"QualifierFilter (LESS, value)"
"filter":"RowFilter (LESS, value)"
"filter":"ValueFilter (LESS, value)"
"filter":"KeyOnlyFilter"
"filter":"FirstKeyOnlyFilter"
"filter":"SingleColumnValueFilter (family, qualifier, EQUAL, value)"
"filter":"SingleColumnValueExcludeFilter (family, qualifier, EQUAL,
value)"
"filter":"FilterList AND (2/2): [KeyOnlyFilter, FirstKeyOnlyFilter]"
Please check ~zhiqiu/Codes/scripts/testFilter.rb for the testing script.

3. Added unit test cases to TestOperation to verify the filters'
toString() method works well.

Reviewed By: mbautin

Reviewers: Kannan, madhuvaidya, mbautin, JIRA

CC: Kannan, madhuvaidya, mbautin, zhiqiu, stack

Differential Revision: https://reviews.facebook.net/D1539

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1299019 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 20:14:26 +00:00
Michael Stack cbdf0ca007 HBASE-5552 Clean up our jmx view; its a bit of a mess 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298923 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 16:54:13 +00:00
Zhihong Yu 35a36c2c66 HBASE-5213 "hbase master stop" does not bring down backup masters (Gregory) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298859 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 14:47:16 +00:00
larsh 5d9f98e09d HBASE-5541 Avoid holding the rowlock during HLog sync in HRegion.mutateRowWithLocks 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298678 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-09 00:52:25 +00:00
larsh 7ce77fc5d3 HBASE-5526 ^Cnfigurable file and directory based umask (Jesse Yates) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298657 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 23:58:17 +00:00
mbautin 961455cd9d [jira] [HBASE-5074] Support checksums in HBase block cache 
Author: Dhruba

Summary:
HFile is enhanced to store a checksum for each block. HDFS checksum verification
is avoided while reading data into the block cache. On a checksum verification
failure, we retry the file system read request with hdfs checksums switched on
(thanks Todd).

I have a benchmark that shows that it reduces iops on the disk by about 40%. In
this experiment, the entire memory on the regionserver is allocated to the
regionserver's jvm and the OS buffer cache size is negligible. I also measured
negligible (<5%) additional cpu usage while using hbase-level checksums.

The salient points of this patch:

1. Each hfile's trailer used to have a 4 byte version number. I enhanced this so
that these 4 bytes can be interpreted as a (major version number, minor
version). Pre-existing hfiles have a minor version of 0. The new hfile format
has a minor version of 1 (thanks Mikhail). The hfile major version remains
unchanged at 2. The reason I did not introduce a new major version number is
because the code changes needed to store/read checksums do not differ much from
existing V2 writers/readers.

2. Introduced a HFileSystem object which is a encapsulates the FileSystem
objects needed to access data from hfiles and hlogs.  HDFS FileSystem objects
already had the ability to switch off checksum verifications for reads.

3. The majority of the code changes are located in hbase.io.hfie package. The
retry of a read on an initial checksum failure occurs inside the hbase.io.hfile
package itself.  The code changes to hbase.regionserver package are minor.

4. The format of a hfileblock is the header followed by the data followed by the
checksum(s). Each 16 K (configurable) size of data has a 4 byte checksum.  The
hfileblock header has two additional fields: a 4 byte value to store the
bytesPerChecksum and a 4 byte value to store the size of the user data
(excluding the checksum data). This is well explained in the associated
javadocs.

5. I added a test to test backward compatibility. I will be writing more unit
tests that triggers checksum verification failures aggressively. I have left a
few redundant log messages in the code (just for easier debugging) and will
remove them in later stage of this patch. I will also be adding metrics on
number of checksum verification failures/success in a later version of this
diff.

6. By default, hbase-level checksums are switched on and hdfs level checksums
are switched off for hfile-reads. No changes to Hlog code path here.

Test Plan: The default setting is to switch on hbase checksums for hfile-reads,
thus all existing tests actually validate the new code pieces. I will be writing
more unit tests for triggering checksum verification failures.

Reviewers: mbautin

Reviewed By: mbautin

CC: JIRA, tedyu, mbautin, dhruba, todd, stack

Differential Revision: https://reviews.facebook.net/D1521

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298641 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 22:55:49 +00:00
Zhihong Yu c4426b5b79 HBASE-5515 Add a processRow API that supports atomic multiple reads and writes on a row (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298533 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 19:40:27 +00:00
Zhihong Yu 990de61c9b HBASE-5514 Compile against hadoop 0.24-SNAPSHOT (Mingjie) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298488 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 17:58:08 +00:00
Michael Stack 0f7285a81a HBASE-4890 fix possible NPE in HConnectionManager 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298272 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 05:00:01 +00:00
Andrew Kyle Purtell edc6696bc5 HBASE-5480. Fixups to MultithreadedTableMapper for Hadoop 0.23 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1298259 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 02:28:39 +00:00
Michael Stack e4f4022493 HBASE-5519 Incorrect warning in splitlogmanager 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297707 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 20:46:02 +00:00
larsh 723e8559e3 HBASE-5523 Fix Delete Timerange logic for KEEP_DELETED_CELLS 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297343 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 06:17:11 +00:00
Zhihong Yu 88115f3d8b HBASE-5507 ThriftServerRunner.HbaseHandler.getRegionInfo() and getTableRegions() do not use ByteBuffer correctly (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297300 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 00:00:36 +00:00
Zhihong Yu 44e348ea1b HBASE-5010 Pass region info in LoadBalancer.randomAssignment(List<ServerName> servers) (Anoop Sam John) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1297155 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-05 18:41:03 +00:00
Michael Stack 0132176084 HBASE-5286 bin/hbase's logic of adding Hadoop jar files to the classpath is fragile when presented with split packaged Hadoop 0.23 installation 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296663 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-03 16:46:57 +00:00
Michael Stack 4343a0a00d HBASE-5486 Warn message in HTable: Stringify the byte[] 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296478 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 21:16:03 +00:00
Zhihong Yu a2392c913e HBASE-5506 Add unit test for ThriftServerRunner.HbaseHandler.getRegionInfo() (Scott Chen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296365 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 18:30:27 +00:00
Michael Stack 2c37d21a52 HBASE-5511 More doc on maven release process 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296316 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 17:26:34 +00:00
larsh 9ffc748589 HBASE-5489 Addendum 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1296011 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-02 00:26:25 +00:00
Doug Meil 0c4e1dfa75 hbase-5503. performance.xml, troubleshooting.xml - adding Troubleshooting case study 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295915 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 21:40:34 +00:00
Michael Stack 7147bc5424 HBASE-5489 Add HTable accessor to get regions for a key range 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295729 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 18:43:29 +00:00
Michael Stack dace419238 HBASE-4403 Adopt interface stability/audience classifications from Hadoop AND HBASE-5502 region_mover.rb fails to load regions back to original server for regions only containing empty tables 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295710 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 17:53:03 +00:00
Michael Stack 2b5b8bb4f8 HBASE-4403 Adopt interface stability/audience classifications from Hadoop 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295668 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 16:48:44 +00:00
Michael Stack 324a2cfeb4 HBASE-5454 Refuse operations from Admin before master is initialized 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1295433 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 06:59:51 +00:00