Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,298 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

4298 Commits

Author SHA1 Message Date
Nicolas Spiegelberg b955fa6c32 Ability to calculate the blockcache hit ratio for the last few minutes 
Summary:
The metric blockcacheHitRatio is since the beginning of time. It would be nice
to calculate the block cache hit ratio for the past few minutes.

This patch remembers the blockcacheHitRatio for the last 5 periods by default.

Test Plan: unit test attached.

Reviewers: jgray, khemani, nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: nspiegelberg, dhruba

Differential Revision: 585

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210640 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 21:17:47 +00:00
Doug Meil c1ac1f4d80 hbase-4958 book.xml, troubleshooting.xml, external_apis.xml several cleanup items. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210608 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 20:24:18 +00:00
Andrew Kyle Purtell d9f39151c5 HBASE-4944. Optionally verify bulk loaded HFiles 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210311 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 02:20:55 +00:00
Zhihong Yu 5021d29ef4 HBASE-4942 HMaster is unable to start of HFile V1 is used (Honghua Zhu) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210303 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 01:11:10 +00:00
Doug Meil 1a2ea74705 hbase-4950. book.xml, corrected BigTable link throughout paper (it was actually producing 404 from Google Labs) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210290 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 00:13:12 +00:00
Doug Meil c7d0ae2692 hbase-4949. book.xml, more links for "more information about hbase" 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210216 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 20:56:20 +00:00
larsh 8fe805ce29 HBASE-4945 NPE in HRegion.bulkLoadHFiles (Andrew P and Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210212 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 20:54:37 +00:00
Doug Meil f547de07c8 hbase-4948. book.xml, adding more links to resources in appendix 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210189 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 19:57:09 +00:00
Doug Meil ca79114d4c hbase-4943. book updates (more FAQ, add to appendix for other resources) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1210010 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-03 21:28:58 +00:00
Doug Meil 73b59715e9 hbase-4941. Fixed mis-spelling of 'configuration' in 2 places (configuration.xml and hbase-default.xml) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209912 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-03 13:53:48 +00:00
Doug Meil 7df968e09a hbase-4939 book.xml (architecture/faq), troubleshooting.xml (created resources section) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209688 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-02 20:57:35 +00:00
Doug Meil b3d87416d2 hbase-4930. home page (index.html) reformat. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209684 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-02 20:40:51 +00:00
Michael Stack 5a0f0313b9 HBASE-4899 Region would be assigned twice easily with continually killing server and moving region in testing environment 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209367 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-02 05:55:25 +00:00
larsh 31468fa7ac HBASE-4903 addendum for security build 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209365 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-02 05:41:55 +00:00
Doug Meil dbb016a527 hbase-4928. overhauled FAQ in book. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209233 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 20:46:53 +00:00
Michael Stack 1e2757e33b HBASE-4918 HTablePool Constructor may cause unintended behavior 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1209210 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 19:44:53 +00:00
larsh 9581eea546 HBASE-4903 Return a result from RegionObserver.preIncrement (Daniel Gómez Ferro) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208952 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 05:06:24 +00:00
karthik 50de126b79 HBASE-4463 [jira] Run more aggressive compactions during off peak hours 
Summary:
HBASE-4463 Run more aggressive compactions during off peak hours

Increases the compact selection ratio from 1.3 to 5 at off-peak hours. This
will help utilize the available iops and bandwidth to decrease average num of
files per store. Only one such aggressive compaction is queued per store at any
point.

The number of iops on the disk and the top of the rack bandwidth utilization at
off peak hours is much lower than at peak hours depending on the application
usage pattern. We can utilize this knowledge to improve the performance of the
HBase cluster by increasing the compact selection ratio to a much larger value
during off-peak hours than otherwise - increasing hbase.hstore.compaction.ratio
(1.2 default) to hbase.hstore.compaction.ratio.offpeak (5 default). This will
help reduce the average number of files per store.

Test Plan: Started running the unit tests.

Reviewers: JIRA, Kannan, nspiegelberg, mbautin, stack

Reviewed By: nspiegelberg

CC: nspiegelberg, tedyu, lhofhansl, Karthik

Differential Revision: 471

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208885 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 23:42:21 +00:00
karthik a9ca67a2c5 [jira] [HBASE-4867] A tool to merge configuration files 
Summary: With our cluster configuration setup it would be good to have a tool
that would merge HBase configuration files so that files appearing later in the
list would override properties specified in earlier files. This way we could
merge an application-specific configuration file with a cluster-specific
configuration file (with the latter overriding the former) and produce a single
HBase configuration file to install on the cluster.

Test Plan: Run the tool on two configuration files (common and
cluster-specific). Use the resulting configuration on a dev cluster.

Reviewers: todd, Karthik, tedyu, stack, JIRA

Reviewed By: Karthik

CC: Karthik, mbautin, todd

Differential Revision: 537

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208832 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 22:12:22 +00:00
Todd Lipcon 54e463f519 HBASE-4820. Distributed log splitting coding enhancement to make it easier to understand, no semantics change. Contributed by Jimmy Xiang. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208801 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 21:28:36 +00:00
Doug Meil b290b43264 hbase-4906 book.xml - repatch of MR to RDBMS example. fixed typo missed in first patch. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208671 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 18:34:58 +00:00
Doug Meil c4078275ea hbase-4906. book.xml. added MR summary to RDBMS section in MR chapter. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208654 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 18:30:10 +00:00
Doug Meil 338e4d602c hbase-4905. book.xml (keyvalue types), ops_mgt.xml (metrics corrections) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208495 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 16:32:58 +00:00
Doug Meil d11ddc0622 hbase-4898. book.xml (1 correction in no-reducer summary) 
troubleshooting.xml 1 addition for MapReduce related documentation.

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208230 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 03:08:14 +00:00
Doug Meil a0cce57e46 hbase-4897 book.xml (clarified scan example), troubleshooting.xml (mr example) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208225 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 02:48:58 +00:00
karthik 99263fecfc HBASE-4721 Retain Delete Markers after Major Compaction 
Summary: major compactions *try* to retain delete markers for the configured
time interval

Test Plan:
added a new test testDeleteMarkerLongevity() in TestStoreScanner

following tests passed
TestMemStore
TestStoreScanner
TestQueryMatcher
TestCompaction

Reviewers: jgray, dhruba, lhofhansl, Karthik, nspiegelberg

Reviewed By: nspiegelberg

CC: HBase Diffs Facebook Group, lhofhansl, khemani, nspiegelberg

Differential Revision: 321

git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208055 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 20:31:57 +00:00
Doug Meil a10fb0ccad hbase-4892 book.xml, ops_mgt.xml book changes. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208028 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 19:08:17 +00:00
Michael Stack 8db322ebdd HBASE-4889 HRegionInfo.isMetaTable() should be true for -ROOT- regions 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1208006 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 18:29:31 +00:00
Michael Stack e0a283fa3c HBASE-4885 Building against Hadoop 0.23 uses out-of-date MapReduce artifacts 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207763 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 06:04:17 +00:00
Michael Stack 44fd83732d HBASE-4884 Allow environment overrides for various HBase processes 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207760 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 05:54:59 +00:00
larsh 01652cecb9 HBASE-4886 - truncate fails in HBase shell (Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207651 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 22:12:25 +00:00
Michael Stack 01c389c879 HBASE-4883 TestCatalogTracker failing for me on ubuntu 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207639 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 21:49:58 +00:00
Zhihong Yu bdc28714e1 HBASE-4878 Master crash when splitting hlog may cause data loss (Chunhui Shen) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207560 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 20:10:58 +00:00
Michael Stack 228ebc64d8 HBASE-4877 TestHCM failing sporadically on jenkins and always for me on an ubuntu machine 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207491 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 18:22:18 +00:00
Zhihong Yu d88f53bced HBASE-4773 HBaseAdmin may leak ZooKeeper connections (Xufeng) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1207297 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 15:30:55 +00:00
Zhihong Yu 4368ce9401 HBASE-4862 Splitting hlog and opening region concurrently may cause data loss 
(Chunhui Shen) Move JIRA to 0.90 section


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206975 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 05:00:09 +00:00
Zhihong Yu b1159115a4 HBASE-4862 Splitting hlog and opening region concurrently may cause data loss 
(Chunhui Shen)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206965 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 02:35:35 +00:00
larsh 2d2e75a7fb Run tests with non-secure random, some tests hang otherwise (Lars H) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206908 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-27 23:12:52 +00:00
Zhihong Yu 26a4ab4a15 HBASE-4868 TestOfflineMetaRebuildBase#testMetaRebuild occasionally fails 
(Gao Jinchao)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206755 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-27 16:21:10 +00:00
Zhihong Yu f584f12260 HBASE-4833 HRegionServer stops could be 0.5s faster (N Keywal) 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206490 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-26 16:50:35 +00:00
Zhihong Yu 6ce8bf9130 HBASE-4832 TestRegionServerCoprocessorExceptionWithAbort fails if the region server stops too fast 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206462 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-26 15:46:18 +00:00
Zhihong Yu 7dd0694984 HBASE-4863 Addendum to add category for TestThreads 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206369 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-25 23:05:27 +00:00
Doug Meil ec4ebc7ee3 HBASE-4871 hbase book. docs cleanup. 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206362 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-25 22:20:48 +00:00
Doug Meil 66e47a99f9 HBASE-4870 developer.xml, integration test info 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206318 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-25 20:58:01 +00:00
Zhihong Yu 91a19bf59a HBASE-4863 Phabricator D531 Make Thrift server thread pool bounded and add a command-line UI test 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1206267 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-25 17:26:40 +00:00
Zhihong Yu 3ba5e7b318 HBASE-4855 SplitLogManager hangs on cluster restart due to batch.installed doubly counted 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205959 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 19:03:46 +00:00
Zhihong Yu 70f14867fb HBASE-4856 Upgrade zookeeper to 3.4.0 release 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205891 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 15:44:48 +00:00
Zhihong Yu 5392c55cf6 HBASE-4864 TestMasterObserver#testRegionTransitionOperations occasionally 
fails (Gao Jinchao)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205872 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 15:17:38 +00:00
Michael Stack 8d056194e1 HBASE-4861 Fix some misspells and extraneous characters in logs; set some to TRACE 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205732 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 06:13:10 +00:00
Michael Stack fc20e56a0f HBASE-4853 HBASE-4789 does overzealous pruning of seqids 
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1205722 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 04:24:56 +00:00