Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,310 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

1388 Commits

Author SHA1 Message Date
Michael Stack dc104e7669 HBASE-4936 Cached HRegionInterface connections crash when getting UnknownHost exceptions 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211232 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 23:48:13 +00:00
Michael Stack 1f176022fe HBASE-4927 CatalogJanior:SplitParentFirstComparator doesn't sort as expected, for the last region when the endkey is empty 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211204 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 22:15:11 +00:00
Michael Stack cb4320232d HBASE-4729 Clash between region unassign and splitting kills the master 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1211197 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 22:02:10 +00:00
Nicolas Spiegelberg 9498f9baf3 HBASE-4860 RegionSplitter Should Allow NSFRE during logical split verification 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210699 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 23:14:31 +00:00
Nicolas Spiegelberg 806ccf03dd HBASE-4932 Block cache can be mistakenly instantiated by tools 
Summary: disable block cache for HFile writers created for tools

Test Plan:
ran the following tests that call getWriterFactory

test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java
test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlockIndex.java
test/java/org/apache/hadoop/hbase/io/hfile/TestHFilePerformance.java
test/java/org/apache/hadoop/hbase/io/hfile/TestHFileSeek.java
test/java/org/apache/hadoop/hbase/io/hfile/TestReseekTo.java
test/java/org/apache/hadoop/hbase/io/hfile/TestSeekTo.java
test/java/org/apache/hadoop/hbase/io/TestHalfStoreFileReader.java
test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFiles.java
test/java/org/apache/hadoop/hbase/regionserver/TestHRegionServerBulkLoad.java
test/java/org/apache/hadoop/hbase/regionserver/wal/TestWALReplay.java

Reviewers: dhruba, jgray, nspiegelberg, JIRA, mbautin

Reviewed By: nspiegelberg

CC: HBase Diffs Facebook Group, mbautin, khemani, nspiegelberg

Differential Revision: 573

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210697 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 23:01:48 +00:00
Nicolas Spiegelberg b955fa6c32 Ability to calculate the blockcache hit ratio for the last few minutes 
Summary:
The metric blockcacheHitRatio is since the beginning of time. It would be nice
to calculate the block cache hit ratio for the past few minutes.

This patch remembers the blockcacheHitRatio for the last 5 periods by default.

Test Plan: unit test attached.

Reviewers: jgray, khemani, nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, dhruba

Differential Revision: 585

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210640 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 21:17:47 +00:00
Andrew Kyle Purtell d9f39151c5 HBASE-4944. Optionally verify bulk loaded HFiles 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210311 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 02:20:55 +00:00
Zhihong Yu 5021d29ef4 HBASE-4942 HMaster is unable to start of HFile V1 is used (Honghua Zhu) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210303 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 01:11:10 +00:00
larsh 8fe805ce29 HBASE-4945 NPE in HRegion.bulkLoadHFiles (Andrew P and Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210212 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 20:54:37 +00:00
Doug Meil 73b59715e9 hbase-4941. Fixed mis-spelling of 'configuration' in 2 places (configuration.xml and hbase-default.xml) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209912 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-03 13:53:48 +00:00
Michael Stack 5a0f0313b9 HBASE-4899 Region would be assigned twice easily with continually killing server and moving region in testing environment 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209367 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-02 05:55:25 +00:00
Michael Stack 1e2757e33b HBASE-4918 HTablePool Constructor may cause unintended behavior 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209210 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 19:44:53 +00:00
larsh 9581eea546 HBASE-4903 Return a result from RegionObserver.preIncrement (Daniel Gómez Ferro) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208952 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 05:06:24 +00:00
karthik 50de126b79 HBASE-4463 [jira] Run more aggressive compactions during off peak hours 
Summary:
HBASE-4463 Run more aggressive compactions during off peak hours

Increases the compact selection ratio from 1.3 to 5 at off-peak hours. This
will help utilize the available iops and bandwidth to decrease average num of
files per store. Only one such aggressive compaction is queued per store at any
point.

The number of iops on the disk and the top of the rack bandwidth utilization at
off peak hours is much lower than at peak hours depending on the application
usage pattern. We can utilize this knowledge to improve the performance of the
HBase cluster by increasing the compact selection ratio to a much larger value
during off-peak hours than otherwise - increasing hbase.hstore.compaction.ratio
(1.2 default) to hbase.hstore.compaction.ratio.offpeak (5 default). This will
help reduce the average number of files per store.

Test Plan: Started running the unit tests.

Reviewers: JIRA, Kannan, nspiegelberg, mbautin, stack

Reviewed By: nspiegelberg

CC: nspiegelberg, tedyu, lhofhansl, Karthik

Differential Revision: 471

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208885 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 23:42:21 +00:00
karthik a9ca67a2c5 [jira] [HBASE-4867] A tool to merge configuration files 
Summary: With our cluster configuration setup it would be good to have a tool
that would merge HBase configuration files so that files appearing later in the
list would override properties specified in earlier files. This way we could
merge an application-specific configuration file with a cluster-specific
configuration file (with the latter overriding the former) and produce a single
HBase configuration file to install on the cluster.

Test Plan: Run the tool on two configuration files (common and
cluster-specific). Use the resulting configuration on a dev cluster.

Reviewers: todd, Karthik, tedyu, stack, JIRA

Reviewed By: Karthik

CC: Karthik, mbautin, todd

Differential Revision: 537

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208832 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 22:12:22 +00:00
Todd Lipcon 54e463f519 HBASE-4820. Distributed log splitting coding enhancement to make it easier to understand, no semantics change. Contributed by Jimmy Xiang. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208801 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 21:28:36 +00:00
karthik 99263fecfc HBASE-4721 Retain Delete Markers after Major Compaction 
Summary: major compactions *try* to retain delete markers for the configured
time interval

Test Plan:
added a new test testDeleteMarkerLongevity() in TestStoreScanner

following tests passed
TestMemStore
TestStoreScanner
TestQueryMatcher
TestCompaction

Reviewers: jgray, dhruba, lhofhansl, Karthik, nspiegelberg

Reviewed By: nspiegelberg

CC: HBase Diffs Facebook Group, lhofhansl, khemani, nspiegelberg

Differential Revision: 321

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208055 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 20:31:57 +00:00
Michael Stack 8db322ebdd HBASE-4889 HRegionInfo.isMetaTable() should be true for -ROOT- regions 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208006 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 18:29:31 +00:00
larsh 01652cecb9 HBASE-4886 - truncate fails in HBase shell (Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207651 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 22:12:25 +00:00
Zhihong Yu bdc28714e1 HBASE-4878 Master crash when splitting hlog may cause data loss (Chunhui Shen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207560 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 20:10:58 +00:00
Zhihong Yu d88f53bced HBASE-4773 HBaseAdmin may leak ZooKeeper connections (Xufeng) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207297 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 15:30:55 +00:00
Zhihong Yu b1159115a4 HBASE-4862 Splitting hlog and opening region concurrently may cause data loss 
(Chunhui Shen)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206965 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 02:35:35 +00:00
Zhihong Yu f584f12260 HBASE-4833 HRegionServer stops could be 0.5s faster (N Keywal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206490 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-26 16:50:35 +00:00
Zhihong Yu 91a19bf59a HBASE-4863 Phabricator D531 Make Thrift server thread pool bounded and add a command-line UI test 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206267 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-25 17:26:40 +00:00
Zhihong Yu 3ba5e7b318 HBASE-4855 SplitLogManager hangs on cluster restart due to batch.installed doubly counted 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205959 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 19:03:46 +00:00
Michael Stack 8d056194e1 HBASE-4861 Fix some misspells and extraneous characters in logs; set some to TRACE 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205732 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 06:13:10 +00:00
Michael Stack fc20e56a0f HBASE-4853 HBASE-4789 does overzealous pruning of seqids 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205722 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 04:24:56 +00:00
Michael Stack aaabb3e8a5 HBASE-4853 HBASE-4789 does overzealous pruning of seqids; REVERT TEMPORARILY TO GET TED COMMENT IN 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205721 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 04:22:05 +00:00
Michael Stack 054c0a2418 HBASE-4853 HBASE-4789 does overzealous pruning of seqids 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205719 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 04:13:09 +00:00
Zhihong Yu 2c1c5223f4 HBASE-4739 Master dying while going to close a region can leave it in transition 
forever (Gao Jinchao)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205706 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 02:09:09 +00:00
Nicolas Spiegelberg 2fb8275da0 HBASE-4787 Rename HTable thread pool 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205684 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 00:46:05 +00:00
karthik a01617ba90 HBASE-4772 Utility to Create StoreFiles 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205661 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 23:34:09 +00:00
Nicolas Spiegelberg 0d73a879b3 HBASE-4785 Improve recovery time of HBase client when a region server dies. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205656 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 23:21:47 +00:00
ramkrishna 42104d08f2 HBASE-4308 Race between RegionOpenedHandler and AssignmentManager(Ram) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205513 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 18:03:10 +00:00
Nicolas Spiegelberg 10407c9a16 HBASE-4783 Improve RowCounter to count rows in a specific key range. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205510 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 17:48:26 +00:00
Zhihong Yu 351e75629f HBASE-4797 [availability] Skip recovered.edits files with edits we know older than what region currently has (Jimmy Jiang) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205290 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 05:23:45 +00:00
Nicolas Spiegelberg 4a2bea25be [jira] [HBASE-4809] Per-CF set RPC metrics 
Summary: Porting RPC metrics incremented for each column family set touched by a
request from 0.89-fb.

Test Plan:
Unit tests, 5-node cluster. Observe metrics through JMX.
The current version of patch compiles but no testing done yet.

Reviewers: nspiegelberg, JIRA, Kannan, Karthik

Reviewed By: nspiegelberg

CC: nspiegelberg, mbautin

Differential Revision: 483

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204799 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 03:48:58 +00:00
Michael Stack 23532b3538 HBASE-4798 Sleeps and synchronisation improvements for tests 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204769 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 01:04:40 +00:00
Zhihong Yu 7a8c36be23 HBASE-4213 Support for fault tolerant, instant schema updates with out master's intervention through ZK 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204611 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 17:29:32 +00:00
Andrew Kyle Purtell 46b1b65cc7 HBASE-2418 Support for ZooKeeper authentication 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204227 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 19:46:21 +00:00
Michael Stack 72c3a34146 HBASE-4829 Fix javadoc warnings in 0.92 branch 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204094 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 22:11:17 +00:00
Michael Stack 39d7828814 HBASE-4789 On split, parent region is sticking around in oldest sequenceid to region map though not online; we don't cleanup WALs 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1204034 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 18:27:51 +00:00
Michael Stack eba8dab3ec HBASE-4436 Remove @deprecated Scan methods in 0.90 from TRUNK and 0.92 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203959 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 04:45:14 +00:00
Michael Stack c42e7e1028 HBASE-4815 Disable online altering by default, create a config for it 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203916 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 00:26:59 +00:00
Gary Helmling cc7e469310 HBASE-3025 Security: coprocessor based access control 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203909 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 00:15:27 +00:00
Michael Stack b5f5e2aeeb HBASE-4816 Regionserver wouldn't go down because split happened exactly at same time we issued bulk user region close call on our way out 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203814 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 20:01:30 +00:00
Michael Stack 8df0e84cf7 HBASE-4819 TestShell broke in trunk; typo 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203788 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 18:45:51 +00:00
Gary Helmling e0e0d94f97 HBASE-2742 Provide strong authentication with a secure RPC engine 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203515 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 07:34:43 +00:00
Nicolas Spiegelberg e7fb30c371 HBASE-4544 change RWCC to MVCC 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203468 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 02:19:37 +00:00
Nicolas Spiegelberg 1e68440431 HBASE-4594 Fix maxVersions when scanning a file with a TS > read point 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1203467 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 02:19:33 +00:00