Commit Graph

4537 Commits

Author SHA1 Message Date
tedyu fbf58f330b HBASE-15325 ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests (Phil Yang) 2016-03-17 11:03:29 -07:00
Elliott Clark ac1a7a4a78 HBASE-15470 Add a setting for Priority queue length
Summary:
Move the config keys to one place
Make Two different config keys. One for default, one for priority

Test Plan: unit tests

Differential Revision: https://reviews.facebook.net/D55575
2016-03-16 16:52:04 -07:00
Elliott Clark ecec35ae4e HBASE-15441 Fix WAL splitting when region has moved multiple times
Summary:
Currently WAL splitting is broken when a region has been opened multiple times in recent minutes.

Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail.

We need to:

It appears that the close event with a sequence id of one is coming from region warm up.

This patch fixes that by making sure the close on warm up doesn't happen. Also splitting will ignore any of the events that are already in the logs.

Test Plan: Unit tests pass

Differential Revision: https://reviews.facebook.net/D55557
2016-03-16 16:26:09 -07:00
Matteo Bertozzi 3bf0945a11 HBASE-15430 Failed taking snapshot - Manifest proto-message too large (JunHo Cho) 2016-03-16 08:52:02 -07:00
stack 9eb25bd5c9 HBASE-15360 Fix flaky TestSimpleRpcScheduler (Duo Zhang) 2016-03-16 08:04:10 -07:00
tedyu f120602f1e HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun) 2016-03-15 16:15:03 -07:00
Enis Soztutar 51259fe4a5 HBASE-15377 Per-RS Get metric is time based, per-region metric is size-based (Heng Chen) 2016-03-15 11:22:18 -07:00
tedyu 8fcc1e8e95 HBASE-15463 Region normalizer should check whether split/merge is enabled 2016-03-15 09:03:27 -07:00
Enis Soztutar ca816f0780 HBASE-6721 RegionServer Group based Assignment (Francis Liu) 2016-03-14 18:28:50 -07:00
anoopsjohn eea8b38dfa HBASE-15180 Reduce garbage created while reading Cells from Codec Decoder. 2016-03-11 13:58:41 +05:30
Enis Soztutar a979d85582 HBASE-15435 Add WAL (in bytes) written metric (Alicia Ying Shu) 2016-03-10 20:16:30 -08:00
stack bb5bfe82f2 Revert "HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun)"
Not needed afterall

This reverts commit d15ae0e6ab.
2016-03-10 15:41:04 -08:00
tedyu d14b6c3810 HBASE-15425 Failing to write bulk load event marker in the WAL is ignored (Ashish Singhi) 2016-03-09 18:49:41 -08:00
tedyu ad9b91a904 HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang) 2016-03-09 09:28:54 -08:00
Matteo Bertozzi 9e967e5c1d HBASE-15113 Procedure v2 - Speedup eviction of sys operation results 2016-03-08 19:47:15 -08:00
Liu Shaohui 7e4e8dc3e9 HBASE-15420: TestCacheConfig failed after HBASE-15338 2016-03-09 10:15:35 +08:00
Gábor Lipták 14217cef24 HBASE-15364 Fix unescaped < and > characters in Javadoc 2016-03-08 16:44:04 -08:00
Mikhail Antonov 46cc3d4972 HBASE-15137 CallTimeoutException and CallQueueTooBigException should trigger PFFE 2016-03-07 20:54:54 -08:00
stack 4f044cf6be HBASE-15421 Convert TestStoreScanner to junit4 from junit3 and clean up close of scanners 2016-03-07 20:46:46 -08:00
Mikhail Antonov e477c143bc HBASE-15354 Use same criteria for clearing meta cache for all operations (addendum) (Ashu Pachauri) 2016-03-07 18:11:15 -08:00
stack d15ae0e6ab HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun) 2016-03-07 16:34:11 -08:00
stack 0f14856b01 HBASE-15416 TestHFileBackedByBucketCache is flakey since it went in 2016-03-07 16:31:09 -08:00
tedyu ed977fd125 HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT 2016-03-07 16:15:59 -08:00
tedyu dfc650a953 HBASE-15243 Revert due to compilation error - master branch change makes the patch stale 2016-03-07 15:59:29 -08:00
tedyu 05c1309b3c HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT 2016-03-07 15:41:06 -08:00
tedyu 05161fcbfd HBASE-15393 Addendum adds TestReplicationAdminWithTwoDifferentZKClusters (Ashish) 2016-03-07 04:56:00 -08:00
chenheng f30afa05d9 HBASE-15376 ScanNext metric is size-based while every other per-operation metric is time based 2016-03-07 17:36:40 +08:00
Liu Shaohui 4483b3cbed HBASE-15338: Add a option to disable the data block cache for testing the performance of underlying file system 2016-03-07 16:37:07 +08:00
Jesse Yates ef712df944 HBASE-14703 HTable.mutateRow does not collect stats (Heng Chen) 2016-03-05 11:01:45 -08:00
tedyu d083e4f29f HBASE-15393 Enable table replication command will fail when parent znode is not default in peer cluster (Ashish Singhi) 2016-03-05 06:28:09 -08:00
Ashu Pachauri 27cf0c8c36 HBASE-15354 Same criteria to clear metacache across operations (Ashu Pachauri)
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-03-04 17:55:35 -08:00
stack 7dabcf23e8 HBASE-15373 DEPRECATED_NAME_OF_NO_LIMIT_THROUGHPUT_CONTROLLER_CLASS value is wrong in CompactionThroughputControllerFactory 2016-03-03 19:42:42 -08:00
tedyu 4fba1c3627 HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang) 2016-03-03 15:59:37 -08:00
Jonathan M Hsieh f658f3ef83 HBASE-15356 Remove unused imports (Youngjoon Kim) 2016-03-03 11:42:38 -08:00
stack 8ace5bbfce HBASE-15366 Add doc, trace-level logging, and test around hfileblock
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileContext.java
 Make it emit its toString in format that matches the way we log
 elsewhere

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
 Capitalize statics.

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
 Verify and cleanup documentation of hfileblock format at head of class.
 Explain what 'EXTRA_SERIALIZATION_SPACE' is all about.
 Connect how we serialize and deserialize... done in different places
 and one way when pulling from HDFS and another when pulling from cache
 (TO BE FIXED). Shut down a load of public access.

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpl.java
 Add trace-level logging

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileScanner.java
 Make it Closeable
2016-03-03 09:16:30 -08:00
chenheng 4b3e38705c HBASE-15329 Cross-Site Scripting: Reflected in table.jsp (Samir Ahmic) 2016-03-03 12:20:00 +08:00
zhangduo 5e395c4294 HBASE-15375 Do not write to '/tmp' in TestRegionMover 2016-03-02 17:04:19 +08:00
tedyu edc5ab5af9 HBASE-15291 Revert due to the bug Haitao discovered 2016-03-02 00:49:17 -08:00
eshcar dc44943666 HBASE-15359 Simplifying segment hierarchy
Signed-off-by: stack <stack@apache.org>
2016-03-01 23:25:11 -08:00
tedyu bab8d1527b HBASE-15181 Addendum fixes findbugs warning (Clara Xiong) 2016-03-01 18:17:43 -08:00
Elliott Clark 9ad13468a0 HBASE-15315 Remove always set super user call as high priority (Yong Zhang) 2016-03-01 15:34:16 -08:00
Phil Yang 88f775996b HBASE-15358 canEnforceTimeLimitFromScope should use timeScope instead of sizeScope
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-02-29 17:21:42 +08:00
tedyu 03ffb30efe HBASE-15181 adds TestCompactionPolicy which was missing in first commit 2016-02-26 19:58:33 -08:00
tedyu f7f96b9fb7 HBASE-15181 A simple implementation of date based tiered compaction (Clara Xiong) 2016-02-26 17:36:23 -08:00
chenheng 99955a3240 HBASE-15128 Disable region splits and merges switch in master 2016-02-27 08:36:59 +08:00
Elliott Clark e88d943183 HBASE-15348 Disable metrics tests until fixed. 2016-02-26 09:04:51 -08:00
ramkrishna 8f2bd06019 HBASE-15205 Do not find the replication scope for every WAL#append() (Ram) 2016-02-26 22:30:55 +05:30
ramkrishna 538815d82a HBASE-15215 TestBlockEvictionFromClient is flaky in jdk1.7 build (setting
offheap)
2016-02-26 11:43:00 +05:30
chenheng bf4fcc30c6 Revert "HBASE-15128 Disable region splits and merges switch in master"
This reverts commit 24d481c580.
2016-02-26 08:52:12 +08:00
chenheng 24d481c580 HBASE-15128 Disable region splits and merges switch in master 2016-02-26 08:11:16 +08:00