463374ecfa
HBASE-15451 Remove unnecessary wait in MVCC
2016-03-20 02:42:44 +08:00
6977c5dee5
HBASE-15302 Revert TestWALSplitCompressed which extends TestWALSplit
2016-03-18 20:56:03 -07:00
27d59d3ebb
HBASE-15302 Revert two tests which hung in build #31
2016-03-18 20:53:29 -07:00
d942d4e5a1
HBASE-15302 Reenable the other tests disabled by HBASE-14678 (Phil Yang)
2016-03-18 09:06:34 -07:00
eda2656b88
HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun)
2016-03-18 05:38:05 -07:00
a319941425
HBASE-15456 Revert due to unit test failure in thrift module
2016-03-17 17:28:13 -07:00
e4409c2f8c
HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun)
2016-03-17 13:06:42 -07:00
f1bb26c223
HBASE-15470 Add a setting for Priority queue length
...
Summary:
Move the config keys to one place
Make Two different config keys. One for default, one for priority
Test Plan: unit tests
Differential Revision: https://reviews.facebook.net/D55575
2016-03-16 16:52:17 -07:00
aaaae83423
HBASE-15441 Fix WAL splitting when region has moved multiple times
...
Summary:
Currently WAL splitting is broken when a region has been opened multiple times in recent minutes.
Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail.
We need to:
It appears that the close event with a sequence id of one is coming from region warm up.
This patch fixes that by making sure the close on warm up doesn't happen. Also splitting will ignore any of the events that are already in the logs.
Test Plan: Unit tests pass
Differential Revision: https://reviews.facebook.net/D55557
2016-03-16 16:35:18 -07:00
103c313b0d
HBASE-15430 Failed taking snapshot - Manifest proto-message too large (JunHo Cho)
2016-03-16 09:06:11 -07:00
3f9ce9785a
HBASE-15360 Fix flaky TestSimpleRpcScheduler (Duo Zhang)
2016-03-16 08:04:37 -07:00
a00ed93fae
HBASE-15456 Revert due to TestCloseRegionHandler failure
2016-03-15 21:24:37 -07:00
f8bcb54479
HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun)
2016-03-15 16:21:16 -07:00
934c0274e3
HBASE-15377 Per-RS Get metric is time based, per-region metric is size-based (Heng Chen)
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2016-03-15 13:35:13 -07:00
d0bd4903c6
HBASE-15463 Region normalizer should check whether split/merge is enabled
2016-03-15 09:10:00 -07:00
95421d276e
HBASE-15435 Add WAL (in bytes) written metric (Alicia Ying Shu)
...
Conflicts:
hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/wal/MetricsWALSource.java
hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/wal/MetricsWALSourceImpl.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestMetricsWAL.java
2016-03-10 20:21:53 -08:00
e445272724
Revert "HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun)"
...
Not needed afterall
This reverts commit e42065c308
2016-03-10 15:41:30 -08:00
f82147831b
HBASE-15425 Failing to write bulk load event marker in the WAL is ignored (Ashish Singhi)
2016-03-10 07:19:59 -08:00
e103f75ae7
HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang)
2016-03-09 10:05:06 -08:00
46bf3c3275
HBASE-15113 Procedure v2 - Speedup eviction of sys operation results
2016-03-08 11:08:05 -08:00
3339bac563
HBASE-15137 CallTimeoutException and CallQueueTooBigException should trigger PFFE
2016-03-08 02:59:20 -08:00
4ec6ad12c9
HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT
2016-03-07 19:28:21 -08:00
43698b3fcb
HBASE-15354 Use same criteria for clearing meta cache for all operations (Ashu Pachauri)
2016-03-07 17:34:11 -08:00
e42065c308
HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun)
2016-03-07 16:35:58 -08:00
c1524485c5
HBASE-15393 Enable table replication command will fail when parent znode is not default in peer cluster (Ashish Singhi)
2016-03-07 04:57:55 -08:00
bbb10c4c18
HBASE-15376 ScanNext metric is size-based while every other per-operation metric is time based
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
2016-03-07 17:48:37 +08:00
d089ac1ec6
HBASE-15373 DEPRECATED_NAME_OF_NO_LIMIT_THROUGHPUT_CONTROLLER_CLASS value is wrong in CompactionThroughputControllerFactory
2016-03-03 19:43:10 -08:00
b3c62680bc
HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang)
2016-03-03 16:01:15 -08:00
77c3c61b34
HBASE-15291 Revert due to the bug Haitao discovered
2016-03-02 00:49:59 -08:00
231a5807b4
HBASE-15181 Addendum fixes findbugs warning (Clara Xiong)
2016-03-01 18:21:37 -08:00
404e9145c2
HBASE-15315 Remove always set super user call as high priority (Yong Zhang)
2016-03-01 15:34:12 -08:00
18194f8a56
HBASE-15128 Disable region splits and merges switch in master
2016-02-29 20:41:27 +08:00
03a02969c4
HBASE-15358 canEnforceTimeLimitFromScope should use timeScope instead of sizeScope
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-02-29 17:22:23 +08:00
998e339d6e
HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT
2016-02-28 16:23:29 -08:00
0cd299dfca
HBASE-15181 A simple implementation of date based tiered compaction (Clara Xiong)
2016-02-27 07:33:19 -08:00
e0d7e0eb3b
HBASE-15348 Disable metrics tests until fixed.
2016-02-26 09:05:01 -08:00
e28b01be50
HBASE-15311 Prevent NPE in BlockCacheViewTmpl.
...
Signed-off-by: stack <stack@apache.org>
2016-02-25 15:24:32 -08:00
210ed97688
HBASE-15144 Procedure v2 - Web UI displaying Store state
2016-02-25 10:50:16 -08:00
04a3b27330
HBASE-15136 Explore different queuing behaviors while busy
2016-02-24 20:42:23 -08:00
3352173ec8
HBASE-15222 Use less contended classes for metrics
...
Summary:
Use less contended things for metrics.
For histogram which was the largest culprit we use FastLongHistogram
For atomic long where possible we now use counter.
Test Plan: unit tests
Reviewers:
Subscribers:
Differential Revision: https://reviews.facebook.net/D54381
2016-02-24 14:47:00 -08:00
bcbe174a27
HBASE-15306 Make RPC call queue length dynamically configurable
2016-02-23 14:22:58 -08:00
d747188f2c
HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
...
Further investigation after HBASE-15221 lead to some findings that
AsyncProcess should have been managing the contents of the region
location cache, appropriately clearing it when necessary (e.g. an
RPC to a server fails because the server doesn't host that region)
For multi() RPCs, the tableName argument is null since there is no
single table that the updates are destined to. This inadvertently
caused the existing region location cache updates to fail on 1.x
branches. AsyncProcess needs to handle when tableName is null
and perform the necessary cache evictions.
As such, much of the new retry logic in HTableMultiplexer is
unnecessary and is removed with this commit. Getters which were
added as a part of testing were left since that are mostly
harmless and should contain no negative impact.
Signed-off-by: stack <stack@apache.org>
2016-02-23 10:28:33 -08:00
49cb0cfccb
HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang)
2016-02-23 06:12:13 -08:00
cc45b4ab38
HBASE-15247 InclusiveStopFilter does not respect reverse Filter property. (Amal Joshy)
2016-02-23 09:59:35 +05:30
4784717235
HBASE-15135 Add metrics for storefile age
2016-02-22 02:43:24 -08:00
215cccdffc
HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state
2016-02-20 20:25:41 -08:00
7a1c407ea6
HBASE-14949 addendum fix compilation error on branch-1
2016-02-18 21:04:14 +08:00
b8f92312b3
HBASE-14949 Resolve name conflict when splitting if there are duplicated WAL entries
2016-02-18 19:49:36 +08:00
ab1b2c6603
HBASE-15270 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon.
...
Signed-off-by: chenheng <chenheng@apache.org>
2016-02-17 23:59:31 -06:00
6ed63180e1
HBASE-15263 TestIPv6NIOServerSocketChannel.testServerSocketFromLocalhostResolution can hang indefinetly
...
Signed-off-by: stack <stack@apache.org>
2016-02-16 12:54:34 -08:00
29ce46a67f
HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic)
2016-02-15 14:17:43 +08:00
822a064195
HBASE-15219 Revert pending verification of test result
2016-02-12 12:05:07 -08:00
9df8d4c1ce
HBASE-15252 Data loss when replaying wal if HDFS timeout
2016-02-12 16:16:49 +08:00
19f8faeb88
HBASE-15198 RPC client not using Codec and CellBlock for puts by default.
2016-02-11 16:37:20 +05:30
cd2b4dfa12
HBASE-15204 Try to estimate the cell count for adding into WALEdit (Ram)
2016-02-11 09:27:19 +05:30
bc1d836738
HBASE-15223 Make convertScanToString public for Spark
2016-02-10 14:55:38 -08:00
e85575f568
HBASE-15229 Canary Tools should not call System.Exit on error (Vishal Khandelwal)
2016-02-10 10:21:22 -08:00
5fe081eb33
HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state
2016-02-10 02:38:12 -08:00
7a718cce71
HBASE-15216 Canary does not accept config params from command line (Vishal Khandelwal)
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java
2016-02-09 22:46:20 -08:00
869c0cf43c
HBASE-15238 HFileReaderV2 prefetch overreaches; runs off the end of the data
2016-02-09 20:55:20 -08:00
0649755d34
HBASE-15163 Add sampling code and metrics for get/scan/multi/mutate count separately (Yu Li)
2016-02-06 06:36:47 -08:00
bd4a4ecf5e
HBASE-15204 Try to estimate the cell count for adding into WALEdit (Revert
...
for making it more cleaner)
2016-02-06 13:08:02 +05:30
0e6bef4de7
HBASE-15220 Change two logs in SimpleRegionNormalizer to INFO level
2016-02-05 20:54:21 -08:00
6a2fa739fd
HBASE-15209 (compatibility) Disable table in HBaseTestingUtility.truncateTable. (Apekshit)
...
Signed-off-by: stack <stack@apache.org>
2016-02-05 20:42:26 -08:00
97fc7abd5b
HBASE-15157 Add *PerformanceTest for Append, CheckAnd*
2016-02-05 20:38:06 -08:00
64c87f2476
HBASE-15214 Valid mutate Ops fail with RPC Codec in use and region moves across.
2016-02-06 02:41:29 +05:30
f03c8801c9
HBASE-15218 On RS crash and replay of WAL, loosing all Tags in Cells (Anoop Sam John)
2016-02-05 10:09:13 -08:00
9bd679de42
HBASE-11262 Addendum fixes new unit test
2016-02-05 10:05:46 -08:00
8473fae1de
HBASE-11262 Avoid empty columns while doing bulk-load (Ashish Kumar)
2016-02-05 09:01:46 -08:00
f9ce069e15
HBASE-15204 Try to estimate the cell count for adding into WALEdit (Ram)
2016-02-05 14:25:58 +05:30
38e79b09c9
HBASE-15202 Reduce garbage while setting response (Ram)
2016-02-05 10:06:07 +05:30
846a2f31c1
HBASE-15210 Undo aggressive load balancer logging at tens of lines per millisecond; ADDENDUM changing LOG.debug to LOG.trace -- noticed by matteo
2016-02-04 16:25:47 -08:00
2203d55b7d
HBASE-15210 Undo aggressive load balancer logging at tens of lines per millisecond
2016-02-04 16:10:17 -08:00
8061fa4af8
Revert "HBASE-15120 Undo aggressive load balancer logging at tens of lines per millisecond"
...
This reverts commit 66da601cdc
2016-02-04 16:09:52 -08:00
66da601cdc
HBASE-15120 Undo aggressive load balancer logging at tens of lines per millisecond
2016-02-04 14:24:44 -08:00
73d6778820
HBASE-15177 Reduce garbage created under high load
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
2016-02-04 13:26:22 -08:00
908e5a6620
HBASE-15211 Don't run the CatalogJanitor if there are regions in transition
2016-02-04 08:52:20 -08:00
1404d5a973
HBASE-HBASE-15203 Reduce garbage created by path.toString() during
...
Checksum verification (Ram)
2016-02-04 11:46:32 +05:30
f1e7c06539
HBASE-15129 Set default value for hbase.fs.tmp.dir rather than fully depend on hbase-default.xml (Yu Li)
...
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/security/SecureBulkLoadUtil.java
2016-02-02 17:06:20 -08:00
b69b8aced6
HBASE-15206 Fix flakey testSplitDaughtersNotInMeta (Huaxiang Sun)
2016-02-02 16:58:05 -08:00
1bf58675c7
HBASE-15194 TestStochasticLoadBalancer.testRegionReplicationOnMidClusterSameHosts flaky on trunk
2016-02-02 13:44:21 -08:00
3cc80e37c6
HBASE-14969 Add throughput controller for flush; ADDENDUM
2016-02-01 08:08:07 -08:00
0d21fa9279
HBASE-14969 Add throughput controller for flush
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-01-29 09:39:15 +08:00
2f571b1457
HBASE-15142 Procedure v2 - Basic WebUI listing the procedures
2016-01-28 10:35:10 -08:00
67c2fc7cd6
HBASE-15019 Replication stuck when HDFS is restarted.
...
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2016-01-28 10:10:55 -08:00
486f7612be
HBASE-15173 Execute mergeRegions RPC call as the request user
2016-01-28 10:02:49 -08:00
dfa9484137
HBASE-15171 Addendum removes extra loop (Yu Li)
2016-01-28 07:08:03 -08:00
421fe24e9b
HBASE-15146 Don't block on Reader threads queueing to a scheduler queue
2016-01-28 08:11:11 -05:00
630ad95c92
HBASE-15171 Avoid counting duplicate kv and generating lots of small hfiles in PutSortReducer (Yu Li)
2016-01-27 09:49:45 -08:00
70fb2e5aab
HBASE-14526 Remove delayed rpc
2016-01-26 12:06:48 -08:00
5728416419
HBASE-15123 Remove duplicate code in LocalHBaseCluster and minor formatting (Appy)
2016-01-25 13:00:49 -04:00
bc0e5fc048
HBASE-14970 Backport HBASE-13082 and its sub-jira to branch-1 - recommit
...
(Ram)
2016-01-25 08:04:22 +05:30
889e60f36f
HBASE-15125 HBaseFsck's adoptHdfsOrphan function creates region with wrong end key boundary (chenrongwei)
2016-01-23 12:47:41 -08:00
63f4ba183a
HBASE-15132 Master region merge RPC should authorize user request
2016-01-23 07:49:50 -08:00
a5228a0b4d
Revert "HBASE-14970 Backport HBASE-13082 and its sub-jira to branch-1 (Ram)"
...
Causes TestHFileOutputFormat to fail every time. Messes up our 1.3 CI.
This reverts commit 58521869b0
2016-01-22 10:45:51 -08:00
37d15e05d8
HBASE-15148 Resolve IS2_INCONSISTENT_SYNC findbugs warning in AuthenticationTokenSecretManager (Yu Li)
2016-01-22 02:49:04 -08:00
17b5f04270
HBASE-15133 Data loss after compaction when a row has more than Integer.MAX_VALUE columns (Toshihiro Suzuki)
2016-01-22 02:41:02 -08:00
fd7862889f
HBASE-15152 Automatically include prefix-tree module in MR jobs if present
2016-01-21 19:04:43 -08:00
a9c008344f
HBASE-15091 Forward-port to 1.2 HBASE-15031 "Fix merge of MVCC and SequenceID performance regression in branch-1.0"
2016-01-21 10:26:46 -08:00
d965d14a63
Revert "HBASE-14865 Support passing multiple QOPs to SaslClient/Server via hbase.rpc.protection (Apply)"
...
Needs newer Hadoop with n HADOOP-10786/HADOOP-11287 (courtesy of Matteo)
This reverts commit e76a2e4e6d
2016-01-21 08:27:06 -08:00
58521869b0
HBASE-14970 Backport HBASE-13082 and its sub-jira to branch-1 (Ram)
2016-01-21 21:22:40 +05:30
8f34f85fe7
HBASE-15098 Normalizer switch in configuration is not used; addendum
2016-01-20 09:46:10 -08:00
44dc9d1162
HBASE-15098 Normalizer switch in configuration is not used
2016-01-20 09:36:46 -08:00
e76a2e4e6d
HBASE-14865 Support passing multiple QOPs to SaslClient/Server via hbase.rpc.protection (Apply)
2016-01-19 13:08:24 -08:00
a61f3ecc8b
HBASE-15102 Fix HeapMemoryTuner overtuning memstore
...
HeapMemoryTuner often over tunes memstore without looking at
the lower limit of the previous memstore size and causing a
situation in which memstore used size suddenly exceeds the
total memstore size.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-01-19 12:23:59 -08:00
7d7a2d8712
HBASE-15106 Procedure v2 - Procedure Queue pass Procedure for better debuggability
2016-01-19 12:03:01 -08:00
7a096ac6cb
HBASE-15073 Revert due to different opinion on usefulness
2016-01-18 17:35:18 -08:00
d6654ea7ea
HBASE-15118 Fix findbugs complaint in hbase-server
2016-01-18 15:37:53 -08:00
032f5574b0
HBASE-14962 TestSplitWalDataLoss fails on all branches
2016-01-16 15:53:33 -08:00
8272c84f60
Amend HBASE-14512 Cache UGI groups
...
Handle the case where tests might create a call with a null connection
2016-01-15 19:27:14 -08:00
1f1a8fd7d3
Amend HBASE-14771 RpcServer#getRemoteAddress always returns null
...
This change has been reported to cause Phoenix's PhoenixIndexRpcSchedulerTest to fail
with a NPE
2016-01-15 19:27:14 -08:00
795f91439c
HBASE-15114 NPE when IPC server ByteBuffer reservoir is turned off
2016-01-15 16:42:41 -08:00
f8427aba2b
HBASE-15105 Procedure V2 - Procedure Queue with Namespaces
2016-01-14 13:50:35 -08:00
b753226e72
HBASE-13590 TestEnableTableHandler.testEnableTableWithNoRegionServers is flakey (Yu Li)
2016-01-14 11:15:23 -08:00
3c2229a9a8
HBASE-14837 Procedure v2 - Procedure Queue Improvement
2016-01-14 09:25:06 -08:00
53fa76bc01
HBASE-15099 Move RegionStateListener class out of quotas package
2016-01-13 15:20:06 -08:00
89eba459f2
HBASE-15085 IllegalStateException was thrown when scanning on bulkloaded
...
HFiles (Victor Xu)
2016-01-12 14:38:29 +05:30
417e3c4a73
HBASE-15083 Gets from Multiactions are not counted in metrics for gets
2016-01-12 14:39:59 +08:00
bb5026c6a4
HBASE-15052 Use EnvironmentEdgeManager in ReplicationSource
2016-01-11 09:39:32 -08:00
d277c15330
HBASE-15065 Addendum fixes checkstyle warnings
2016-01-08 14:51:17 -08:00
27c578d685
HBASE-14975 Don't color the total RIT line yellow if it's zero (Pallavi Adusumilli)
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-01-08 14:29:58 -08:00
5a0658377d
HBASE-15065 SimpleRegionNormalizer should return multiple normalization plans in one run
2016-01-08 12:05:00 -08:00
bc4b9eb084
HBASE-14221 - Reduce the number of time row comparison is done in a Scan
...
(Ram)
2016-01-08 13:58:52 +05:30
323d5c97d9
Revert "HBASE-14227 Reduce the number of time row comparison is done in a Scan"
...
This reverts commit e32e4df780
2016-01-08 13:55:06 +05:30
e32e4df780
HBASE-14227 Reduce the number of time row comparison is done in a Scan
...
(Ram)
2016-01-08 10:42:49 +05:30
90ca944e1b
HBASE-15079 TestMultiParallel.validateLoadedData AssertionError: null
2016-01-07 15:36:27 -08:00
01ecd30906
HBASE-15076 Add getScanner(Scan scan, List<KeyValueScanner> additionalScanners) API into Region interface (Anoop Sam John)
2016-01-07 14:15:33 -08:00
e7d935cbed
HBASE-15068 Add metrics for region normalization plans
2016-01-07 03:28:50 -08:00
53983f5b2e
HBASE-15073 Finer grained control over normalization actions for RegionNormalizer
2016-01-06 15:38:46 -08:00
c73b4f8df6
HBASE-15066 Small improvements to Canary tool
2016-01-06 02:47:32 -08:00
f4a66fc083
HBASE-14468 addendum.
2016-01-05 15:55:00 -08:00
254af5a321
Merge branch 'branch-1' of https://git-wip-us.apache.org/repos/asf/hbase into branch-1
2016-01-05 15:54:49 -08:00
407cda4a0c
HBASE-15058 AssignmentManager should account for unsuccessful split correctly which initially passes quota check
2016-01-05 06:24:42 -08:00
2797adf45f
HBASE-14987 Compaction marker whose region name doesn't match current region's needs to be handled
2016-01-04 07:19:13 -08:00
bb744b4090
HBASE-15038 ExportSnapshot should support separate configs for source and destination
2016-01-04 00:15:25 -08:00
64553236a9
HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implementations
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-12-30 09:18:48 -06:00
c4173777dd
HBASE-14867 SimpleRegionNormalizer needs to have better heuristics to trigger merge operation
2015-12-29 06:25:14 -08:00
1098dfd918
HBASE-15023 Reenable TestShell and TestStochasticLoadBalancer
2015-12-28 13:27:42 -08:00
03e1451070
HBASE-15035 bulkloading hfiles with tags that require splits do not preserve tags
2015-12-25 12:24:47 -08:00
30361079c7
HBASE-15039 HMaster and RegionServers should try to refresh token keys from zk when facing InvalidToken (Yong Zhang)
2015-12-25 10:35:17 -08:00
31f8d71ffe
HBASE-14822; addendum - handle callSeq.
2015-12-24 12:55:59 -08:00
afaa7f843a
HBASE-14717 enable_table_replication command should only create specified table for a peer cluster (Ashish)
2015-12-24 11:18:32 -08:00
d65210d213
HBASE-15030 Deadlock in master TableNamespaceManager while running IntegrationTestDDLMasterFailover
2015-12-23 09:56:21 -08:00
f7b67ca763
HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests
2015-12-23 10:35:48 +08:00
ff069ef97b
HBASE-15028 Minor fix on RegionGroupingProvider (Yu Li)
2015-12-22 06:49:14 -08:00
cf059e54b5
Revert "HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests"
...
This reverts commit b0965b1805
2015-12-22 16:10:58 +08:00
a51dc02ed3
HBASE-15014 Fix filterCellByStore in WALsplitter is awful for performance
2015-12-21 22:50:50 -08:00
b0965b1805
HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests
2015-12-22 11:25:57 +08:00
b82148b705
HBASE-14976 fix tests
...
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2015-12-21 11:40:08 -08:00
79baaeb540
HBASE-14976 Add RPC call queues to the web ui (Pallavi Adusumilli)
2015-12-19 12:45:36 -08:00
c27d2c9c3e
HBASE-14822 Renewing leases of scanners doesn't work.
2015-12-19 10:15:26 -08:00
574774d8b1
HBASE-13158 When client supports CellBlock, return the result Cells as controller payload for get(Get) API also.
2015-12-19 14:58:52 +05:30
b3300602ed
HBASE-15001 Fix thread-safety issues with replication
...
ReplicationSinkManager and HBaseInterClusterReplicationEndpoint
perform certain unsafe operations which might lead to undesirable
behavior with multiwal enabled.
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-18 11:49:37 -08:00
d1c412ae8f
HBASE-15003 remove BoundedConcurrentLinkedQueue.
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestBoundedConcurrentLinkedQueue.java
2015-12-18 12:28:02 -06:00
736dd2ed6d
HBASE-15005 Use value array in computing block length for 1.2 and 1.3
2015-12-18 00:22:37 -08:00
345d008ede
HBASE-14978 Don't allow Multi to retain too many blocks -- ADD
2015-12-17 17:56:32 -08:00
c825a26ad1
HBASE-14978 Don't allow Multi to retain too many blocks
2015-12-17 16:13:33 -08:00
a93c0e822e
HBASE-14999 Remove ref to org.mortbay.log.Log.
2015-12-17 23:33:39 +05:30
3919f38e0d
HBASE-15000 Fix javadoc warn in LoadIncrementalHFiles. (Ashish)
2015-12-17 22:49:49 +05:30
6ec92281ed
HBASE-14955 OOME: cannot create native thread is back
2015-12-17 18:33:37 +08:00
988ab048ee
HBASE-14995 Revert according to Ram's feedback
2015-12-16 21:55:55 -08:00
b9070b2a45
HBASE-14995 Optimize setting tagsPresent in DefaultMemStore.java (huaxiang sun)
2015-12-16 18:17:28 -08:00
8bd0d9dacd
HBASE-14951 Make hbase.regionserver.maxlogs obsolete
2015-12-16 14:58:05 -08:00
42518fa646
HBASE-14974 Total number of Regions in Transition number on UI incorrect
2015-12-16 14:11:36 -08:00
00805b399f
HBASE-14838 Add clarification docs to SimpleRegionNormalizer.
...
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-12-16 08:59:53 -06:00
fbad4d2466
HBASE-14968 ConcurrentModificationException in region close resulting in the region staying in closing state
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/CoprocessorHost.java
2015-12-15 11:34:40 -08:00
7d3af71db5
HBASE-14929 There is a space missing from table "foo" is not currently available (Carlos A. Morillo)
2015-12-14 16:10:00 -08:00
3b9b8cc667
HBASE-14936 CombinedBlockCache should overwrite CacheStats#rollMetricsPeriod() (Jianwei Cui)
2015-12-14 17:34:16 +08:00
9e6acffca0
HBASE-14953 Replication: retry on RejectedExecutionException
...
In HBaseInterClusterReplicationEndpoint, we fail the whole batch
in case of a RejectedExecutionException on an individual sub-batch.
We should let the submitted sub-batches finish and retry only for
the remaining ones.
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-11 13:21:25 -08:00
aeb6ae97d3
HBASE-14960 Fallback to using default RPCControllerFactory if class cannot be loaded
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRpcControllerFactory.java
2015-12-10 19:13:14 -08:00
8508dd07ff
HBASE-14946 Don't allow multi's to over run the max result size.
...
Summary:
* Add VersionInfoUtil to determine if a client has a specified version or better
* Add an exception type to say that the response should be chunked
* Add on client knowledge of retry exceptions
* Add on metrics for how often this happens
Test Plan: Added a unit test
Differential Revision: https://reviews.facebook.net/D51771
2015-12-10 18:31:05 -08:00
65117d3d04
HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi)
2015-12-10 13:10:41 +05:30
5dec5ad250
HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection
2015-12-09 16:47:25 -08:00
c6e73f80c5
HBASE-14942 Allow turning off BoundedByteBufferPool
2015-12-09 15:30:58 -08:00
07e2496ad1
HBASE-14954 IllegalArgumentException was thrown when doing online configuration change in CompactSplitThread (Victor Xu)
2015-12-09 07:20:55 -08:00
9f39d356c4
HBASE-7171 Initial web UI for region/memstore/storefiles details
2015-12-08 17:30:00 -08:00
fba9e49dcf
HBASE-14869 Better request latency and size histograms. (Vikas Vishwakarma and Lars Hofhansl)
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
2015-12-08 17:07:45 -08:00
2e5499ed6c
HBASE-14719 Add metrics for master WAL count (numMasterWALs). Metric numMasterWALs appears as follows in metrics dump
...
{
"name" : "Hadoop:service=HBase,name=Master,sub=Procedure",
"modelerType" : "Master,sub=Procedure",
"tag.Context" : "master",
"tag.Hostname" : "vrishal-mbp",
"numMasterWALs" : 1
},
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-07 11:15:25 -08:00
3dcac2861d
HBASE-14923 VerifyReplication should not mask the exception during result comparison (Vishal Khandelwal)
2015-12-04 18:53:01 -08:00
85167849ab
HBASE-14922 Delayed flush doesn't work causing flush storms.
2015-12-04 16:53:56 -08:00
edb8edfeb3
HBASE-14904 Mark Base[En|De]coder LimitedPrivate and fix binary compat issue
...
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/codec/BaseDecoder.java
hbase-common/src/main/java/org/apache/hadoop/hbase/codec/BaseEncoder.java
2015-12-03 18:27:20 -08:00
b001019d9b
HBASE-14905 VerifyReplication does not honour versions option (Vishal Khandelwal)
2015-12-03 16:13:59 -08:00
7f2e09f9c9
HBASE-14909 NPE testing for RIT; addendum -- forgot import
2015-12-02 12:02:56 -08:00
96e5f04036
HBASE-14909 NPE testing for RIT
2015-12-02 10:40:51 -08:00
81de832732
HBASE-14908 TestRowCounter flakey especially on branch-1
2015-12-02 10:23:13 -08:00
3b6ae17a72
HBASE-14575 Relax region read lock for compactions (Nick and Ted)
2015-12-02 06:25:26 -08:00
c4bc1c07bc
Revert "HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts"
...
Test TestRegionRebalancing is failing fairly reliably since this went in.
This reverts commit c719e8c456
2015-12-01 16:02:31 -08:00
2d7db89590
HBASE-14891 Add log for uncaught exception in RegionServerMetricsWrapperRunnable(Yu Li)
2015-12-01 17:16:23 +08:00
c719e8c456
HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts
2015-11-30 17:07:54 -08:00
66adeb3048
HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim)
2015-11-28 10:10:27 -08:00
9de4691a0a
HBASE-14893 Race between mutation on region and region closing operation leads to NotServingRegionException
2015-11-27 15:32:42 -08:00
9a11c025f2
HBASE-14355 Scan different TimeRange for each column family - fixing memstore bug
...
Signed-off-by: stack <stack@apache.org>
2015-11-25 22:04:02 -08:00
dbbdb7b2e8
HBASE-14777 second addendum, better fix using CompletionService.
2015-11-25 21:18:27 -08:00
06c233834f
HBASE-14885 NullPointerException in HMaster#normalizeRegions() due to missing TableDescriptor
2015-11-25 16:08:49 -08:00
30604761c4
HBASE-14883 TestSplitTransactionOnCluster#testFailedSplit flakey
2015-11-25 09:45:52 -08:00
e80face0e9
HBASE-14689 Addendum and unit test for HBASE-13471
2015-11-24 19:15:13 -08:00
1917516ffd
HBASE-14875 Forward port HBASE-14207 'Region was hijacked and remained in transition when RS failed to open a region and later regionplan changed to new RS on retry'
2015-11-24 14:30:37 -08:00
07b07300b8
HBASE-14821 Allow configuration overrides in TableOutputFormat
2015-11-24 12:15:25 -08:00
447a0e7b7e
HBASE-14737 Clear cachedMaxVersions when HColumnDescriptor#setValue(VERSIONS, value) is called (Pankaj Kumar)
2015-11-23 20:26:18 -08:00
81e7eb2805
HBASE-13347 Deprecate FirstKeyValueMatchingQualifiersFilter. (Abhishek)
2015-11-24 09:52:37 +05:30
085bf60b42
HBASE-14807 TestWALLockup is flakey Second attempt at stabilizing this test.
...
Patch includes loosening of the test so we continue when threads
run in not-expected order. Also includes minor clean ups in
FSHLog -- a formatting change, removal of an unused trace logging,
and a check so we don't create a new exception when not needed --
but it also includes a subtle so we check if we need to get to safe
point EVEN IF an outstanding exception. Previous we could by-pass
the safe point check. This should make us even more robust against
lockup (though this is a change that comes of code reading, not of
any issue seen in test).
Here is some detail on how I loosened the test:
The test can run in an unexpected order. Attempts at dictating the
order in which threads fire only had me deadlocking one latch
against another (the test latch vs the WAL zigzag latch) so I
gave up trying and instead, if we happen to go the unusual route of
rolling WALs and failing flush before the scheduled log roll
latch goes into place, just time out the run after a few seconds
and exit the test (but do not fail it); just log a WARN.
This is less than ideal but allows us keep some coverage of the
tricky scenario that was bringing on deadlock (a broken WAL that
is throwing exceptions getting stuck waiting on a sync to clear
out the ring buffer getting overshadowed by a subsequent append
added in by a concurrent flush).
2015-11-20 12:07:32 -08:00
11b2131013
HBASE-14840 Sink cluster reports data replication request as success
...
though the data is not replicated(Ashish Singhi)
2015-11-20 16:00:15 +05:30
f56c605e73
HBASE-14777 ADDENDUM Fix failing TestReplicationEndpoint test
...
Signed-off-by: stack <stack@apache.org>
2015-11-20 00:21:33 -06:00
ccee3d8dd5
Revert "Fix failing TestReplicationEndpoint test"
...
This reverts commit 5b5ff1d8b2
2015-11-20 00:21:24 -06:00
5b5ff1d8b2
Fix failing TestReplicationEndpoint test
...
Signed-off-by: stack <stack@apache.org>
2015-11-19 13:26:37 -08:00
b06acfbf0b
HBASE-14761 Deletes with and without visibility expression do not delete
...
the matching mutation (Ram)
2015-11-19 11:24:35 +05:30
40e01512cf
HBASE-14782 FuzzyRowFilter skips valid rows (Vladimir Rodionov)
2015-11-19 11:41:05 +08:00
8a69dd5b08
HBASE-14468 Compaction improvements: FIFO compaction policy (Vladimir Rodionov)
2015-11-18 19:27:15 -08:00
de4f235bf4
HBASE-14777 Fix Inter Cluster Replication Future ordering issues
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-11-18 16:41:52 -08:00
a6e0ad636a
HBASE-14824 HBaseAdmin.mergeRegions should recognize both full region names and encoded region names (Eungsop Yoo)
2015-11-18 14:26:31 -08:00
d4d3b1954c
Revert "HBASE-14689 Addendum and unit test for HBASE-13471"
...
This reverts commit ec021a7b25
2015-11-17 20:37:16 -08:00
5362ac0311
HBASE-14771 RpcServer#getRemoteAddress always returns null (Abhishek Kumar)
2015-11-17 18:49:05 -08:00
604c9b2cca
HBASE-14793 Allow limiting size of block into L1 block cache.
2015-11-17 10:38:02 -08:00
47d59288a7
HBASE-14809 Grant / revoke Namespace admin permission to group
2015-11-16 09:32:11 -08:00
b7a4c5f5dc
HBASE-14802 Replaying server crash recovery procedure after a failover causes incorrect handling of deadservers; ADDENDUM
2015-11-15 15:00:15 -08:00
aaa2294126
HBASE-14798 NPE reporting server load causes regionserver abort; causes TestAcidGuarantee to fail
2015-11-14 09:08:07 -08:00
336eb92016
HBASE-14355 Scan different TimeRange for each column family
2015-11-13 22:44:05 -08:00
72fbfb589e
HBASE-14807 TestWALLockup is flakey
2015-11-13 22:40:07 -08:00
bb9fbdb2d2
HBASE-14802 Replaying server crash recovery procedure after a failover causes incorrect handling of deadservers
2015-11-13 22:10:07 -08:00
c725356e4a
HBASE-13982 Add info for visibility labels/cell TTLs to ImportTsv (NIDHI GAMBHIR)
2015-11-10 22:11:14 -08:00
7280ec09df
HBASE-14794 Cleanup TestAtomicOperation
...
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMetaWithReplicas.java
Fix a few missing table closes (This suite seems to leave loads of threads
when test is done but have not figured the how yet).
hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
Fix some missing table closes. We were leaving around client
resources.
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
Close up WALs when done.
2015-11-10 18:57:35 -10:00
37815cac9e
HBASE-14788 Splitting a region does not support the hbase.rs.evictblocksonclose config when closing source region
2015-11-10 18:38:32 -08:00
1d29d8c004
HBASE-14786 TestProcedureAdmin hangs
2015-11-10 13:17:58 -08:00
e8e0e86b49
HBASE-14778 Make block cache hit percentages not integer in the metrics system
2015-11-10 12:28:24 -08:00
3de347f6e0
HBASE-14387 Compaction improvements: Maximum off-peak compaction size (Vladimir Rodionov)
2015-11-09 19:54:35 -08:00
7330e11aa4
HBASE-14693 Add client-side metrics for received pushback signals
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestClientPushback.java
2015-11-09 15:32:28 -08:00
d3e653a261
HBASE-14784 Port conflict is not resolved in HBaseTestingUtility.randomFreePort() (Youngjoon Kim)
2015-11-08 08:51:44 -08:00
61e2566c1c
HBASE-14463 Severe performance downgrade when parallel reading a single key from BucketCache (Yu Li)
2015-11-06 17:34:14 -08:00
234f31bd4a
HBASE-14759 Avoid using Math.abs when selecting SyncRunner in FSHLog
2015-11-07 08:47:56 +08:00
c1a19dece0
HBASE-14632 Region server aborts due to unguarded dereference of Reader
2015-11-06 13:40:14 -08:00
c69c74fcbf
HBASE-14632 Revert due to over commit
2015-11-06 13:39:24 -08:00
0e2e5d3280
HBASE-14632 Region server aborts due to unguarded dereference of Reader
2015-11-06 12:06:58 -08:00
2b84c40f01
HBASE-14765 Remove snappy profile
2015-11-05 10:21:14 -08:00
6c239f1816
HBASE-14706 RegionLocationFinder should return multiple servernames by top host (Guanghao Zhang)
2015-11-04 14:25:53 -08:00
fa2d0859f7
HBASE-12986 Compaction pressure based client pushback
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ClientProtos.java
2015-11-03 18:40:59 -08:00
b24324cc23
HBASE-14742 Fix TestHeapMemoryManager being flakey
2015-11-02 17:02:41 -08:00
2e1711f209
HBASE-14631 Addendum restores a method in RegionMergeTransactionImpl
2015-11-02 15:54:28 -08:00
bd4addcedf
HBASE-14605 Addendum restores two methods in SplitTransactionImpl
2015-11-02 15:50:03 -08:00
51f5412a92
Revert "HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets"
...
Reverting. It seems to have destabilized the build.
This reverts commit aaaa813225
2015-11-02 08:16:59 -08:00
aaaa813225
HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets
2015-11-01 22:55:59 -08:00
85f2aee070
HBASE-14700 Support a permissive mode for secure clusters to allow SIMPLE auth clients
2015-10-30 20:06:23 -07:00
de89172244
HBASE-14557 MapReduce WALPlayer issue with NoTagsKeyValue.
2015-10-30 21:19:12 +05:30
a3842caf77
HBASE-14721 Memstore add cells - Avoid many garbage.
2015-10-30 18:41:45 +05:30
569fe82acf
HBASE-14714 some cleanup to snapshot code
2015-10-29 14:04:48 -07:00
066f3f7545
HBASE-14720 Make TestHCM and TestMetaWithReplicas large tests rather than mediums
2015-10-29 10:36:39 -07:00
45faf38028
HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs; REMOVED TestWALSplitCompressed and TestWALSplit
2015-10-28 22:00:02 -07:00
4ef38f0c37
HBASE-14710 Add category-based timeouts to MR tests
2015-10-28 17:16:11 -07:00
3c8e92019c
HBASE-12769 Replication fails to delete all corresponding zk nodes when peer is removed (Jianwei Cui)
2015-10-28 15:43:26 -07:00
e5b566e01c
HBASE-14529 - Addendum to avoid SIGHUP call for WINDOWS OS
2015-10-28 11:54:56 +05:30
68f0fff281
HBASE-14674 Rpc handler / task monitoring seems to be broken after 0.98 (Heng Chen)
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestCallRunner.java
2015-10-27 15:06:38 -07:00
Yu Li
tedyu
Elliott Clark
Matteo Bertozzi
stack
Enis Soztutar
Mikhail Antonov
chenheng
Phil Yang
Samir Ahmic
Josh Elser
anoopsjohn
zhangduo
ramkrishna
Jerry He
Andrew Purtell
Apekshit
Jonathan M Hsieh
绝顶
Ashu Pachauri
Lars Hofhansl
Gary Helmling
Ashish Singhi
Pallavi Adusumilli
Sean Busbey
Vrishal Kulkarni
rahulgidwani
Gary Helmling
chenheng