Commit Graph

4252 Commits

Author SHA1 Message Date
Sean Busbey a3071327b5 HBASE-15478 add comments to syncRunnerIndex handling explaining constraints on possible values.
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-03-21 00:29:52 -05:00
Yu Li 17815ded74 HBASE-15490 Remove duplicated CompactionThroughputControllerFactory in branch-1 2016-03-20 16:16:40 +08:00
Yu Li 463374ecfa HBASE-15451 Remove unnecessary wait in MVCC 2016-03-20 02:42:44 +08:00
tedyu 6977c5dee5 HBASE-15302 Revert TestWALSplitCompressed which extends TestWALSplit 2016-03-18 20:56:03 -07:00
tedyu 27d59d3ebb HBASE-15302 Revert two tests which hung in build #31 2016-03-18 20:53:29 -07:00
tedyu d942d4e5a1 HBASE-15302 Reenable the other tests disabled by HBASE-14678 (Phil Yang) 2016-03-18 09:06:34 -07:00
tedyu eda2656b88 HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun) 2016-03-18 05:38:05 -07:00
tedyu a319941425 HBASE-15456 Revert due to unit test failure in thrift module 2016-03-17 17:28:13 -07:00
tedyu e4409c2f8c HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun) 2016-03-17 13:06:42 -07:00
Elliott Clark f1bb26c223 HBASE-15470 Add a setting for Priority queue length
Summary:
Move the config keys to one place
Make Two different config keys. One for default, one for priority

Test Plan: unit tests

Differential Revision: https://reviews.facebook.net/D55575
2016-03-16 16:52:17 -07:00
Elliott Clark aaaae83423 HBASE-15441 Fix WAL splitting when region has moved multiple times
Summary:
Currently WAL splitting is broken when a region has been opened multiple times in recent minutes.

Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail.

We need to:

It appears that the close event with a sequence id of one is coming from region warm up.

This patch fixes that by making sure the close on warm up doesn't happen. Also splitting will ignore any of the events that are already in the logs.

Test Plan: Unit tests pass

Differential Revision: https://reviews.facebook.net/D55557
2016-03-16 16:35:18 -07:00
Matteo Bertozzi 103c313b0d HBASE-15430 Failed taking snapshot - Manifest proto-message too large (JunHo Cho) 2016-03-16 09:06:11 -07:00
stack 3f9ce9785a HBASE-15360 Fix flaky TestSimpleRpcScheduler (Duo Zhang) 2016-03-16 08:04:37 -07:00
tedyu a00ed93fae HBASE-15456 Revert due to TestCloseRegionHandler failure 2016-03-15 21:24:37 -07:00
tedyu f8bcb54479 HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun) 2016-03-15 16:21:16 -07:00
Enis Soztutar 934c0274e3 HBASE-15377 Per-RS Get metric is time based, per-region metric is size-based (Heng Chen)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2016-03-15 13:35:13 -07:00
tedyu d0bd4903c6 HBASE-15463 Region normalizer should check whether split/merge is enabled 2016-03-15 09:10:00 -07:00
Enis Soztutar 95421d276e HBASE-15435 Add WAL (in bytes) written metric (Alicia Ying Shu)
Conflicts:
	hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/wal/MetricsWALSource.java
	hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/wal/MetricsWALSourceImpl.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestMetricsWAL.java
2016-03-10 20:21:53 -08:00
stack e445272724 Revert "HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun)"
Not needed afterall
This reverts commit e42065c308.
2016-03-10 15:41:30 -08:00
tedyu f82147831b HBASE-15425 Failing to write bulk load event marker in the WAL is ignored (Ashish Singhi) 2016-03-10 07:19:59 -08:00
tedyu e103f75ae7 HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang) 2016-03-09 10:05:06 -08:00
Matteo Bertozzi 46bf3c3275 HBASE-15113 Procedure v2 - Speedup eviction of sys operation results 2016-03-08 11:08:05 -08:00
Mikhail Antonov 3339bac563 HBASE-15137 CallTimeoutException and CallQueueTooBigException should trigger PFFE 2016-03-08 02:59:20 -08:00
tedyu 4ec6ad12c9 HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT 2016-03-07 19:28:21 -08:00
Mikhail Antonov 43698b3fcb HBASE-15354 Use same criteria for clearing meta cache for all operations (Ashu Pachauri) 2016-03-07 17:34:11 -08:00
stack e42065c308 HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun) 2016-03-07 16:35:58 -08:00
tedyu c1524485c5 HBASE-15393 Enable table replication command will fail when parent znode is not default in peer cluster (Ashish Singhi) 2016-03-07 04:57:55 -08:00
chenheng bbb10c4c18 HBASE-15376 ScanNext metric is size-based while every other per-operation metric is time based
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
2016-03-07 17:48:37 +08:00
stack d089ac1ec6 HBASE-15373 DEPRECATED_NAME_OF_NO_LIMIT_THROUGHPUT_CONTROLLER_CLASS value is wrong in CompactionThroughputControllerFactory 2016-03-03 19:43:10 -08:00
tedyu b3c62680bc HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang) 2016-03-03 16:01:15 -08:00
tedyu 77c3c61b34 HBASE-15291 Revert due to the bug Haitao discovered 2016-03-02 00:49:59 -08:00
tedyu 231a5807b4 HBASE-15181 Addendum fixes findbugs warning (Clara Xiong) 2016-03-01 18:21:37 -08:00
Elliott Clark 404e9145c2 HBASE-15315 Remove always set super user call as high priority (Yong Zhang) 2016-03-01 15:34:12 -08:00
chenheng 18194f8a56 HBASE-15128 Disable region splits and merges switch in master 2016-02-29 20:41:27 +08:00
Phil Yang 03a02969c4 HBASE-15358 canEnforceTimeLimitFromScope should use timeScope instead of sizeScope
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-02-29 17:22:23 +08:00
Mikhail Antonov 998e339d6e HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
tedyu 0cd299dfca HBASE-15181 A simple implementation of date based tiered compaction (Clara Xiong) 2016-02-27 07:33:19 -08:00
Elliott Clark e0d7e0eb3b HBASE-15348 Disable metrics tests until fixed. 2016-02-26 09:05:01 -08:00
Samir Ahmic e28b01be50 HBASE-15311 Prevent NPE in BlockCacheViewTmpl.
Signed-off-by: stack <stack@apache.org>
2016-02-25 15:24:32 -08:00
Samir Ahmic 210ed97688 HBASE-15144 Procedure v2 - Web UI displaying Store state 2016-02-25 10:50:16 -08:00
Mikhail Antonov 04a3b27330 HBASE-15136 Explore different queuing behaviors while busy 2016-02-24 20:42:23 -08:00
Elliott Clark 3352173ec8 HBASE-15222 Use less contended classes for metrics
Summary:
Use less contended things for metrics.
For histogram which was the largest culprit we use FastLongHistogram
For atomic long where possible we now use counter.

Test Plan: unit tests

Reviewers:

Subscribers:

Differential Revision: https://reviews.facebook.net/D54381
2016-02-24 14:47:00 -08:00
Mikhail Antonov bcbe174a27 HBASE-15306 Make RPC call queue length dynamically configurable 2016-02-23 14:22:58 -08:00
Josh Elser d747188f2c HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
Further investigation after HBASE-15221 lead to some findings that
AsyncProcess should have been managing the contents of the region
location cache, appropriately clearing it when necessary (e.g. an
RPC to a server fails because the server doesn't host that region)

For multi() RPCs, the tableName argument is null since there is no
single table that the updates are destined to. This inadvertently
caused the existing region location cache updates to fail on 1.x
branches. AsyncProcess needs to handle when tableName is null
and perform the necessary cache evictions.

As such, much of the new retry logic in HTableMultiplexer is
unnecessary and is removed with this commit. Getters which were
added as a part of testing were left since that are mostly
harmless and should contain no negative impact.

Signed-off-by: stack <stack@apache.org>
2016-02-23 10:28:33 -08:00
tedyu 49cb0cfccb HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang) 2016-02-23 06:12:13 -08:00
anoopsjohn cc45b4ab38 HBASE-15247 InclusiveStopFilter does not respect reverse Filter property. (Amal Joshy) 2016-02-23 09:59:35 +05:30
Mikhail Antonov 4784717235 HBASE-15135 Add metrics for storefile age 2016-02-22 02:43:24 -08:00
tedyu 215cccdffc HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state 2016-02-20 20:25:41 -08:00
zhangduo 7a1c407ea6 HBASE-14949 addendum fix compilation error on branch-1 2016-02-18 21:04:14 +08:00
zhangduo b8f92312b3 HBASE-14949 Resolve name conflict when splitting if there are duplicated WAL entries 2016-02-18 19:49:36 +08:00