Commit Graph

4390 Commits

Author SHA1 Message Date
stack 3f9ce9785a HBASE-15360 Fix flaky TestSimpleRpcScheduler (Duo Zhang) 2016-03-16 08:04:37 -07:00
tedyu a00ed93fae HBASE-15456 Revert due to TestCloseRegionHandler failure 2016-03-15 21:24:37 -07:00
tedyu f8bcb54479 HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun) 2016-03-15 16:21:16 -07:00
Enis Soztutar 934c0274e3 HBASE-15377 Per-RS Get metric is time based, per-region metric is size-based (Heng Chen)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2016-03-15 13:35:13 -07:00
tedyu d0bd4903c6 HBASE-15463 Region normalizer should check whether split/merge is enabled 2016-03-15 09:10:00 -07:00
Enis Soztutar 95421d276e HBASE-15435 Add WAL (in bytes) written metric (Alicia Ying Shu)
Conflicts:
	hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/wal/MetricsWALSource.java
	hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/wal/MetricsWALSourceImpl.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestMetricsWAL.java
2016-03-10 20:21:53 -08:00
stack e445272724 Revert "HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun)"
Not needed afterall
This reverts commit e42065c308.
2016-03-10 15:41:30 -08:00
tedyu f82147831b HBASE-15425 Failing to write bulk load event marker in the WAL is ignored (Ashish Singhi) 2016-03-10 07:19:59 -08:00
tedyu e103f75ae7 HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang) 2016-03-09 10:05:06 -08:00
Matteo Bertozzi 46bf3c3275 HBASE-15113 Procedure v2 - Speedup eviction of sys operation results 2016-03-08 11:08:05 -08:00
Mikhail Antonov 3339bac563 HBASE-15137 CallTimeoutException and CallQueueTooBigException should trigger PFFE 2016-03-08 02:59:20 -08:00
tedyu 4ec6ad12c9 HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT 2016-03-07 19:28:21 -08:00
Mikhail Antonov 43698b3fcb HBASE-15354 Use same criteria for clearing meta cache for all operations (Ashu Pachauri) 2016-03-07 17:34:11 -08:00
stack e42065c308 HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun) 2016-03-07 16:35:58 -08:00
tedyu c1524485c5 HBASE-15393 Enable table replication command will fail when parent znode is not default in peer cluster (Ashish Singhi) 2016-03-07 04:57:55 -08:00
chenheng bbb10c4c18 HBASE-15376 ScanNext metric is size-based while every other per-operation metric is time based
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
2016-03-07 17:48:37 +08:00
stack d089ac1ec6 HBASE-15373 DEPRECATED_NAME_OF_NO_LIMIT_THROUGHPUT_CONTROLLER_CLASS value is wrong in CompactionThroughputControllerFactory 2016-03-03 19:43:10 -08:00
tedyu b3c62680bc HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang) 2016-03-03 16:01:15 -08:00
tedyu 77c3c61b34 HBASE-15291 Revert due to the bug Haitao discovered 2016-03-02 00:49:59 -08:00
tedyu 231a5807b4 HBASE-15181 Addendum fixes findbugs warning (Clara Xiong) 2016-03-01 18:21:37 -08:00
Elliott Clark 404e9145c2 HBASE-15315 Remove always set super user call as high priority (Yong Zhang) 2016-03-01 15:34:12 -08:00
chenheng 18194f8a56 HBASE-15128 Disable region splits and merges switch in master 2016-02-29 20:41:27 +08:00
Phil Yang 03a02969c4 HBASE-15358 canEnforceTimeLimitFromScope should use timeScope instead of sizeScope
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-02-29 17:22:23 +08:00
Mikhail Antonov 998e339d6e HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
tedyu 0cd299dfca HBASE-15181 A simple implementation of date based tiered compaction (Clara Xiong) 2016-02-27 07:33:19 -08:00
Elliott Clark e0d7e0eb3b HBASE-15348 Disable metrics tests until fixed. 2016-02-26 09:05:01 -08:00
Samir Ahmic e28b01be50 HBASE-15311 Prevent NPE in BlockCacheViewTmpl.
Signed-off-by: stack <stack@apache.org>
2016-02-25 15:24:32 -08:00
Samir Ahmic 210ed97688 HBASE-15144 Procedure v2 - Web UI displaying Store state 2016-02-25 10:50:16 -08:00
Mikhail Antonov 04a3b27330 HBASE-15136 Explore different queuing behaviors while busy 2016-02-24 20:42:23 -08:00
Elliott Clark 3352173ec8 HBASE-15222 Use less contended classes for metrics
Summary:
Use less contended things for metrics.
For histogram which was the largest culprit we use FastLongHistogram
For atomic long where possible we now use counter.

Test Plan: unit tests

Reviewers:

Subscribers:

Differential Revision: https://reviews.facebook.net/D54381
2016-02-24 14:47:00 -08:00
Mikhail Antonov bcbe174a27 HBASE-15306 Make RPC call queue length dynamically configurable 2016-02-23 14:22:58 -08:00
Josh Elser d747188f2c HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
Further investigation after HBASE-15221 lead to some findings that
AsyncProcess should have been managing the contents of the region
location cache, appropriately clearing it when necessary (e.g. an
RPC to a server fails because the server doesn't host that region)

For multi() RPCs, the tableName argument is null since there is no
single table that the updates are destined to. This inadvertently
caused the existing region location cache updates to fail on 1.x
branches. AsyncProcess needs to handle when tableName is null
and perform the necessary cache evictions.

As such, much of the new retry logic in HTableMultiplexer is
unnecessary and is removed with this commit. Getters which were
added as a part of testing were left since that are mostly
harmless and should contain no negative impact.

Signed-off-by: stack <stack@apache.org>
2016-02-23 10:28:33 -08:00
tedyu 49cb0cfccb HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang) 2016-02-23 06:12:13 -08:00
anoopsjohn cc45b4ab38 HBASE-15247 InclusiveStopFilter does not respect reverse Filter property. (Amal Joshy) 2016-02-23 09:59:35 +05:30
Mikhail Antonov 4784717235 HBASE-15135 Add metrics for storefile age 2016-02-22 02:43:24 -08:00
tedyu 215cccdffc HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state 2016-02-20 20:25:41 -08:00
zhangduo 7a1c407ea6 HBASE-14949 addendum fix compilation error on branch-1 2016-02-18 21:04:14 +08:00
zhangduo b8f92312b3 HBASE-14949 Resolve name conflict when splitting if there are duplicated WAL entries 2016-02-18 19:49:36 +08:00
Samir Ahmic ab1b2c6603 HBASE-15270 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon.
Signed-off-by: chenheng <chenheng@apache.org>
2016-02-17 23:59:31 -06:00
chenheng 6ed63180e1 HBASE-15263 TestIPv6NIOServerSocketChannel.testServerSocketFromLocalhostResolution can hang indefinetly
Signed-off-by: stack <stack@apache.org>
2016-02-16 12:54:34 -08:00
chenheng 29ce46a67f HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic) 2016-02-15 14:17:43 +08:00
tedyu 822a064195 HBASE-15219 Revert pending verification of test result 2016-02-12 12:05:07 -08:00
zhangduo 9df8d4c1ce HBASE-15252 Data loss when replaying wal if HDFS timeout 2016-02-12 16:16:49 +08:00
anoopsjohn 19f8faeb88 HBASE-15198 RPC client not using Codec and CellBlock for puts by default. 2016-02-11 16:37:20 +05:30
ramkrishna cd2b4dfa12 HBASE-15204 Try to estimate the cell count for adding into WALEdit (Ram) 2016-02-11 09:27:19 +05:30
Jerry He bc1d836738 HBASE-15223 Make convertScanToString public for Spark 2016-02-10 14:55:38 -08:00
Andrew Purtell e85575f568 HBASE-15229 Canary Tools should not call System.Exit on error (Vishal Khandelwal) 2016-02-10 10:21:22 -08:00
tedyu 5fe081eb33 HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state 2016-02-10 02:38:12 -08:00
Andrew Purtell 7a718cce71 HBASE-15216 Canary does not accept config params from command line (Vishal Khandelwal)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java
2016-02-09 22:46:20 -08:00
stack 869c0cf43c HBASE-15238 HFileReaderV2 prefetch overreaches; runs off the end of the data 2016-02-09 20:55:20 -08:00
stack 0649755d34 HBASE-15163 Add sampling code and metrics for get/scan/multi/mutate count separately (Yu Li) 2016-02-06 06:36:47 -08:00
ramkrishna bd4a4ecf5e HBASE-15204 Try to estimate the cell count for adding into WALEdit (Revert
for making it more cleaner)
2016-02-06 13:08:02 +05:30
tedyu 0e6bef4de7 HBASE-15220 Change two logs in SimpleRegionNormalizer to INFO level 2016-02-05 20:54:21 -08:00
Apekshit 6a2fa739fd HBASE-15209 (compatibility) Disable table in HBaseTestingUtility.truncateTable. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2016-02-05 20:42:26 -08:00
stack 97fc7abd5b HBASE-15157 Add *PerformanceTest for Append, CheckAnd* 2016-02-05 20:38:06 -08:00
anoopsjohn 64c87f2476 HBASE-15214 Valid mutate Ops fail with RPC Codec in use and region moves across. 2016-02-06 02:41:29 +05:30
stack f03c8801c9 HBASE-15218 On RS crash and replay of WAL, loosing all Tags in Cells (Anoop Sam John) 2016-02-05 10:09:13 -08:00
tedyu 9bd679de42 HBASE-11262 Addendum fixes new unit test 2016-02-05 10:05:46 -08:00
tedyu 8473fae1de HBASE-11262 Avoid empty columns while doing bulk-load (Ashish Kumar) 2016-02-05 09:01:46 -08:00
ramkrishna f9ce069e15 HBASE-15204 Try to estimate the cell count for adding into WALEdit (Ram) 2016-02-05 14:25:58 +05:30
ramkrishna 38e79b09c9 HBASE-15202 Reduce garbage while setting response (Ram) 2016-02-05 10:06:07 +05:30
stack 846a2f31c1 HBASE-15210 Undo aggressive load balancer logging at tens of lines per millisecond; ADDENDUM changing LOG.debug to LOG.trace -- noticed by matteo 2016-02-04 16:25:47 -08:00
stack 2203d55b7d HBASE-15210 Undo aggressive load balancer logging at tens of lines per millisecond 2016-02-04 16:10:17 -08:00
stack 8061fa4af8 Revert "HBASE-15120 Undo aggressive load balancer logging at tens of lines per millisecond"
This reverts commit 66da601cdc.
2016-02-04 16:09:52 -08:00
stack 66da601cdc HBASE-15120 Undo aggressive load balancer logging at tens of lines per millisecond 2016-02-04 14:24:44 -08:00
Enis Soztutar 73d6778820 HBASE-15177 Reduce garbage created under high load
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
2016-02-04 13:26:22 -08:00
Elliott Clark 908e5a6620 HBASE-15211 Don't run the CatalogJanitor if there are regions in transition 2016-02-04 08:52:20 -08:00
ramkrishna 1404d5a973 HBASE-HBASE-15203 Reduce garbage created by path.toString() during
Checksum verification (Ram)
2016-02-04 11:46:32 +05:30
Enis Soztutar f1e7c06539 HBASE-15129 Set default value for hbase.fs.tmp.dir rather than fully depend on hbase-default.xml (Yu Li)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/SecureBulkLoadUtil.java
2016-02-02 17:06:20 -08:00
Jonathan M Hsieh b69b8aced6 HBASE-15206 Fix flakey testSplitDaughtersNotInMeta (Huaxiang Sun) 2016-02-02 16:58:05 -08:00
stack 1bf58675c7 HBASE-15194 TestStochasticLoadBalancer.testRegionReplicationOnMidClusterSameHosts flaky on trunk 2016-02-02 13:44:21 -08:00
stack 3cc80e37c6 HBASE-14969 Add throughput controller for flush; ADDENDUM 2016-02-01 08:08:07 -08:00
绝顶 0d21fa9279 HBASE-14969 Add throughput controller for flush
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-01-29 09:39:15 +08:00
Matteo Bertozzi 2f571b1457 HBASE-15142 Procedure v2 - Basic WebUI listing the procedures 2016-01-28 10:35:10 -08:00
Matteo Bertozzi 67c2fc7cd6 HBASE-15019 Replication stuck when HDFS is restarted.
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2016-01-28 10:10:55 -08:00
tedyu 486f7612be HBASE-15173 Execute mergeRegions RPC call as the request user 2016-01-28 10:02:49 -08:00
tedyu dfa9484137 HBASE-15171 Addendum removes extra loop (Yu Li) 2016-01-28 07:08:03 -08:00
Elliott Clark 421fe24e9b HBASE-15146 Don't block on Reader threads queueing to a scheduler queue 2016-01-28 08:11:11 -05:00
tedyu 630ad95c92 HBASE-15171 Avoid counting duplicate kv and generating lots of small hfiles in PutSortReducer (Yu Li) 2016-01-27 09:49:45 -08:00
Elliott Clark 70fb2e5aab HBASE-14526 Remove delayed rpc 2016-01-26 12:06:48 -08:00
stack 5728416419 HBASE-15123 Remove duplicate code in LocalHBaseCluster and minor formatting (Appy) 2016-01-25 13:00:49 -04:00
ramkrishna bc0e5fc048 HBASE-14970 Backport HBASE-13082 and its sub-jira to branch-1 - recommit
(Ram)
2016-01-25 08:04:22 +05:30
tedyu 889e60f36f HBASE-15125 HBaseFsck's adoptHdfsOrphan function creates region with wrong end key boundary (chenrongwei) 2016-01-23 12:47:41 -08:00
tedyu 63f4ba183a HBASE-15132 Master region merge RPC should authorize user request 2016-01-23 07:49:50 -08:00
stack a5228a0b4d Revert "HBASE-14970 Backport HBASE-13082 and its sub-jira to branch-1 (Ram)"
Causes TestHFileOutputFormat to fail every time. Messes up our 1.3 CI.

This reverts commit 58521869b0.
2016-01-22 10:45:51 -08:00
tedyu 37d15e05d8 HBASE-15148 Resolve IS2_INCONSISTENT_SYNC findbugs warning in AuthenticationTokenSecretManager (Yu Li) 2016-01-22 02:49:04 -08:00
tedyu 17b5f04270 HBASE-15133 Data loss after compaction when a row has more than Integer.MAX_VALUE columns (Toshihiro Suzuki) 2016-01-22 02:41:02 -08:00
Jonathan M Hsieh fd7862889f HBASE-15152 Automatically include prefix-tree module in MR jobs if present 2016-01-21 19:04:43 -08:00
stack a9c008344f HBASE-15091 Forward-port to 1.2 HBASE-15031 "Fix merge of MVCC and SequenceID performance regression in branch-1.0" 2016-01-21 10:26:46 -08:00
stack d965d14a63 Revert "HBASE-14865 Support passing multiple QOPs to SaslClient/Server via hbase.rpc.protection (Apply)"
Needs newer Hadoop with n HADOOP-10786/HADOOP-11287 (courtesy of Matteo)

This reverts commit e76a2e4e6d.
2016-01-21 08:27:06 -08:00
ramkrishna 58521869b0 HBASE-14970 Backport HBASE-13082 and its sub-jira to branch-1 (Ram) 2016-01-21 21:22:40 +05:30
stack 8f34f85fe7 HBASE-15098 Normalizer switch in configuration is not used; addendum 2016-01-20 09:46:10 -08:00
stack 44dc9d1162 HBASE-15098 Normalizer switch in configuration is not used 2016-01-20 09:36:46 -08:00
tedyu e76a2e4e6d HBASE-14865 Support passing multiple QOPs to SaslClient/Server via hbase.rpc.protection (Apply) 2016-01-19 13:08:24 -08:00
Ashu Pachauri a61f3ecc8b HBASE-15102 Fix HeapMemoryTuner overtuning memstore
HeapMemoryTuner often over tunes memstore without looking at
the lower limit of the previous memstore size and causing a
situation in which memstore used size suddenly exceeds the
total memstore size.

Signed-off-by: Elliott Clark <eclark@apache.org>
2016-01-19 12:23:59 -08:00
Matteo Bertozzi 7d7a2d8712 HBASE-15106 Procedure v2 - Procedure Queue pass Procedure for better debuggability 2016-01-19 12:03:01 -08:00
tedyu 7a096ac6cb HBASE-15073 Revert due to different opinion on usefulness 2016-01-18 17:35:18 -08:00
stack d6654ea7ea HBASE-15118 Fix findbugs complaint in hbase-server 2016-01-18 15:37:53 -08:00
stack 032f5574b0 HBASE-14962 TestSplitWalDataLoss fails on all branches 2016-01-16 15:53:33 -08:00
Andrew Purtell 8272c84f60 Amend HBASE-14512 Cache UGI groups
Handle the case where tests might create a call with a null connection
2016-01-15 19:27:14 -08:00
Andrew Purtell 1f1a8fd7d3 Amend HBASE-14771 RpcServer#getRemoteAddress always returns null
This change has been reported to cause Phoenix's PhoenixIndexRpcSchedulerTest to fail
with a NPE
2016-01-15 19:27:14 -08:00
Enis Soztutar 795f91439c HBASE-15114 NPE when IPC server ByteBuffer reservoir is turned off 2016-01-15 16:42:41 -08:00
Matteo Bertozzi f8427aba2b HBASE-15105 Procedure V2 - Procedure Queue with Namespaces 2016-01-14 13:50:35 -08:00
stack b753226e72 HBASE-13590 TestEnableTableHandler.testEnableTableWithNoRegionServers is flakey (Yu Li) 2016-01-14 11:15:23 -08:00
Matteo Bertozzi 3c2229a9a8 HBASE-14837 Procedure v2 - Procedure Queue Improvement 2016-01-14 09:25:06 -08:00
tedyu 53fa76bc01 HBASE-15099 Move RegionStateListener class out of quotas package 2016-01-13 15:20:06 -08:00
ramkrishna 89eba459f2 HBASE-15085 IllegalStateException was thrown when scanning on bulkloaded
HFiles (Victor Xu)
2016-01-12 14:38:29 +05:30
chenheng 417e3c4a73 HBASE-15083 Gets from Multiactions are not counted in metrics for gets 2016-01-12 14:39:59 +08:00
Matteo Bertozzi bb5026c6a4 HBASE-15052 Use EnvironmentEdgeManager in ReplicationSource 2016-01-11 09:39:32 -08:00
tedyu d277c15330 HBASE-15065 Addendum fixes checkstyle warnings 2016-01-08 14:51:17 -08:00
Elliott Clark 27c578d685 HBASE-14975 Don't color the total RIT line yellow if it's zero (Pallavi Adusumilli)
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-01-08 14:29:58 -08:00
tedyu 5a0658377d HBASE-15065 SimpleRegionNormalizer should return multiple normalization plans in one run 2016-01-08 12:05:00 -08:00
ramkrishna bc4b9eb084 HBASE-14221 - Reduce the number of time row comparison is done in a Scan
(Ram)
2016-01-08 13:58:52 +05:30
ramkrishna 323d5c97d9 Revert "HBASE-14227 Reduce the number of time row comparison is done in a Scan"
This reverts commit e32e4df780.
2016-01-08 13:55:06 +05:30
ramkrishna e32e4df780 HBASE-14227 Reduce the number of time row comparison is done in a Scan
(Ram)
2016-01-08 10:42:49 +05:30
stack 90ca944e1b HBASE-15079 TestMultiParallel.validateLoadedData AssertionError: null 2016-01-07 15:36:27 -08:00
stack 01ecd30906 HBASE-15076 Add getScanner(Scan scan, List<KeyValueScanner> additionalScanners) API into Region interface (Anoop Sam John) 2016-01-07 14:15:33 -08:00
tedyu e7d935cbed HBASE-15068 Add metrics for region normalization plans 2016-01-07 03:28:50 -08:00
tedyu 53983f5b2e HBASE-15073 Finer grained control over normalization actions for RegionNormalizer 2016-01-06 15:38:46 -08:00
Enis Soztutar c73b4f8df6 HBASE-15066 Small improvements to Canary tool 2016-01-06 02:47:32 -08:00
Lars Hofhansl f4a66fc083 HBASE-14468 addendum. 2016-01-05 15:55:00 -08:00
Lars Hofhansl 254af5a321 Merge branch 'branch-1' of https://git-wip-us.apache.org/repos/asf/hbase into branch-1 2016-01-05 15:54:49 -08:00
tedyu 407cda4a0c HBASE-15058 AssignmentManager should account for unsuccessful split correctly which initially passes quota check 2016-01-05 06:24:42 -08:00
tedyu 2797adf45f HBASE-14987 Compaction marker whose region name doesn't match current region's needs to be handled 2016-01-04 07:19:13 -08:00
Gary Helmling bb744b4090 HBASE-15038 ExportSnapshot should support separate configs for source and destination 2016-01-04 00:15:25 -08:00
Ashish Singhi 64553236a9 HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implementations
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-12-30 09:18:48 -06:00
tedyu c4173777dd HBASE-14867 SimpleRegionNormalizer needs to have better heuristics to trigger merge operation 2015-12-29 06:25:14 -08:00
stack 1098dfd918 HBASE-15023 Reenable TestShell and TestStochasticLoadBalancer 2015-12-28 13:27:42 -08:00
Jonathan M Hsieh 03e1451070 HBASE-15035 bulkloading hfiles with tags that require splits do not preserve tags 2015-12-25 12:24:47 -08:00
tedyu 30361079c7 HBASE-15039 HMaster and RegionServers should try to refresh token keys from zk when facing InvalidToken (Yong Zhang) 2015-12-25 10:35:17 -08:00
Lars Hofhansl 31f8d71ffe HBASE-14822; addendum - handle callSeq. 2015-12-24 12:55:59 -08:00
tedyu afaa7f843a HBASE-14717 enable_table_replication command should only create specified table for a peer cluster (Ashish) 2015-12-24 11:18:32 -08:00
Matteo Bertozzi d65210d213 HBASE-15030 Deadlock in master TableNamespaceManager while running IntegrationTestDDLMasterFailover 2015-12-23 09:56:21 -08:00
chenheng f7b67ca763 HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests 2015-12-23 10:35:48 +08:00
tedyu ff069ef97b HBASE-15028 Minor fix on RegionGroupingProvider (Yu Li) 2015-12-22 06:49:14 -08:00
chenheng cf059e54b5 Revert "HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests"
This reverts commit b0965b1805.
2015-12-22 16:10:58 +08:00
Elliott Clark a51dc02ed3 HBASE-15014 Fix filterCellByStore in WALsplitter is awful for performance 2015-12-21 22:50:50 -08:00
chenheng b0965b1805 HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests 2015-12-22 11:25:57 +08:00
Pallavi Adusumilli b82148b705 HBASE-14976 fix tests
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2015-12-21 11:40:08 -08:00
Mikhail Antonov 79baaeb540 HBASE-14976 Add RPC call queues to the web ui (Pallavi Adusumilli) 2015-12-19 12:45:36 -08:00
Lars Hofhansl c27d2c9c3e HBASE-14822 Renewing leases of scanners doesn't work. 2015-12-19 10:15:26 -08:00
anoopsjohn 574774d8b1 HBASE-13158 When client supports CellBlock, return the result Cells as controller payload for get(Get) API also. 2015-12-19 14:58:52 +05:30
Ashu Pachauri b3300602ed HBASE-15001 Fix thread-safety issues with replication
ReplicationSinkManager and HBaseInterClusterReplicationEndpoint
perform certain unsafe operations which might lead to undesirable
behavior with multiwal enabled.

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-18 11:49:37 -08:00
Sean Busbey d1c412ae8f HBASE-15003 remove BoundedConcurrentLinkedQueue.
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestBoundedConcurrentLinkedQueue.java
2015-12-18 12:28:02 -06:00
Elliott Clark 736dd2ed6d HBASE-15005 Use value array in computing block length for 1.2 and 1.3 2015-12-18 00:22:37 -08:00
Elliott Clark 345d008ede HBASE-14978 Don't allow Multi to retain too many blocks -- ADD 2015-12-17 17:56:32 -08:00
Elliott Clark c825a26ad1 HBASE-14978 Don't allow Multi to retain too many blocks 2015-12-17 16:13:33 -08:00
anoopsjohn a93c0e822e HBASE-14999 Remove ref to org.mortbay.log.Log. 2015-12-17 23:33:39 +05:30
anoopsjohn 3919f38e0d HBASE-15000 Fix javadoc warn in LoadIncrementalHFiles. (Ashish) 2015-12-17 22:49:49 +05:30
chenheng 6ec92281ed HBASE-14955 OOME: cannot create native thread is back 2015-12-17 18:33:37 +08:00
tedyu 988ab048ee HBASE-14995 Revert according to Ram's feedback 2015-12-16 21:55:55 -08:00
tedyu b9070b2a45 HBASE-14995 Optimize setting tagsPresent in DefaultMemStore.java (huaxiang sun) 2015-12-16 18:17:28 -08:00
Enis Soztutar 8bd0d9dacd HBASE-14951 Make hbase.regionserver.maxlogs obsolete 2015-12-16 14:58:05 -08:00
Mikhail Antonov 42518fa646 HBASE-14974 Total number of Regions in Transition number on UI incorrect 2015-12-16 14:11:36 -08:00
Josh Elser 00805b399f HBASE-14838 Add clarification docs to SimpleRegionNormalizer.
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-12-16 08:59:53 -06:00
Enis Soztutar fbad4d2466 HBASE-14968 ConcurrentModificationException in region close resulting in the region staying in closing state
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/CoprocessorHost.java
2015-12-15 11:34:40 -08:00
Jonathan M Hsieh 7d3af71db5 HBASE-14929 There is a space missing from table "foo" is not currently available (Carlos A. Morillo) 2015-12-14 16:10:00 -08:00
chenheng 3b9b8cc667 HBASE-14936 CombinedBlockCache should overwrite CacheStats#rollMetricsPeriod() (Jianwei Cui) 2015-12-14 17:34:16 +08:00
Ashu Pachauri 9e6acffca0 HBASE-14953 Replication: retry on RejectedExecutionException
In HBaseInterClusterReplicationEndpoint, we fail the whole batch
in case of a RejectedExecutionException on an individual sub-batch.
We should let the submitted sub-batches finish and retry only for
the remaining ones.

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-11 13:21:25 -08:00
Enis Soztutar aeb6ae97d3 HBASE-14960 Fallback to using default RPCControllerFactory if class cannot be loaded
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRpcControllerFactory.java
2015-12-10 19:13:14 -08:00
Elliott Clark 8508dd07ff HBASE-14946 Don't allow multi's to over run the max result size.
Summary:
* Add VersionInfoUtil to determine if a client has a specified version or better
* Add an exception type to say that the response should be chunked
* Add on client knowledge of retry exceptions
* Add on metrics for how often this happens

Test Plan: Added a unit test

Differential Revision: https://reviews.facebook.net/D51771
2015-12-10 18:31:05 -08:00
ramkrishna 65117d3d04 HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi) 2015-12-10 13:10:41 +05:30
Gary Helmling 5dec5ad250 HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection 2015-12-09 16:47:25 -08:00
Elliott Clark c6e73f80c5 HBASE-14942 Allow turning off BoundedByteBufferPool 2015-12-09 15:30:58 -08:00
tedyu 07e2496ad1 HBASE-14954 IllegalArgumentException was thrown when doing online configuration change in CompactSplitThread (Victor Xu) 2015-12-09 07:20:55 -08:00
Mikhail Antonov 9f39d356c4 HBASE-7171 Initial web UI for region/memstore/storefiles details 2015-12-08 17:30:00 -08:00
Lars Hofhansl fba9e49dcf HBASE-14869 Better request latency and size histograms. (Vikas Vishwakarma and Lars Hofhansl)
Conflicts:

	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
2015-12-08 17:07:45 -08:00
Vrishal Kulkarni 2e5499ed6c HBASE-14719 Add metrics for master WAL count (numMasterWALs). Metric numMasterWALs appears as follows in metrics dump
{
    "name" : "Hadoop:service=HBase,name=Master,sub=Procedure",
    "modelerType" : "Master,sub=Procedure",
    "tag.Context" : "master",
    "tag.Hostname" : "vrishal-mbp",
    "numMasterWALs" : 1
},

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-07 11:15:25 -08:00
Andrew Purtell 3dcac2861d HBASE-14923 VerifyReplication should not mask the exception during result comparison (Vishal Khandelwal) 2015-12-04 18:53:01 -08:00
Elliott Clark 85167849ab HBASE-14922 Delayed flush doesn't work causing flush storms. 2015-12-04 16:53:56 -08:00
Enis Soztutar edb8edfeb3 HBASE-14904 Mark Base[En|De]coder LimitedPrivate and fix binary compat issue
Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/codec/BaseDecoder.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/codec/BaseEncoder.java
2015-12-03 18:27:20 -08:00
tedyu b001019d9b HBASE-14905 VerifyReplication does not honour versions option (Vishal Khandelwal) 2015-12-03 16:13:59 -08:00
stack 7f2e09f9c9 HBASE-14909 NPE testing for RIT; addendum -- forgot import 2015-12-02 12:02:56 -08:00
stack 96e5f04036 HBASE-14909 NPE testing for RIT 2015-12-02 10:40:51 -08:00
stack 81de832732 HBASE-14908 TestRowCounter flakey especially on branch-1 2015-12-02 10:23:13 -08:00
tedyu 3b6ae17a72 HBASE-14575 Relax region read lock for compactions (Nick and Ted) 2015-12-02 06:25:26 -08:00
stack c4bc1c07bc Revert "HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts"
Test TestRegionRebalancing is failing fairly reliably since this went in.

This reverts commit c719e8c456.
2015-12-01 16:02:31 -08:00
chenheng 2d7db89590 HBASE-14891 Add log for uncaught exception in RegionServerMetricsWrapperRunnable(Yu Li) 2015-12-01 17:16:23 +08:00
Enis Soztutar c719e8c456 HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts 2015-11-30 17:07:54 -08:00
tedyu 66adeb3048 HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:10:27 -08:00
tedyu 9de4691a0a HBASE-14893 Race between mutation on region and region closing operation leads to NotServingRegionException 2015-11-27 15:32:42 -08:00
rahulgidwani 9a11c025f2 HBASE-14355 Scan different TimeRange for each column family - fixing memstore bug
Signed-off-by: stack <stack@apache.org>
2015-11-25 22:04:02 -08:00
Lars Hofhansl dbbdb7b2e8 HBASE-14777 second addendum, better fix using CompletionService. 2015-11-25 21:18:27 -08:00
tedyu 06c233834f HBASE-14885 NullPointerException in HMaster#normalizeRegions() due to missing TableDescriptor 2015-11-25 16:08:49 -08:00
stack 30604761c4 HBASE-14883 TestSplitTransactionOnCluster#testFailedSplit flakey 2015-11-25 09:45:52 -08:00
Enis Soztutar e80face0e9 HBASE-14689 Addendum and unit test for HBASE-13471 2015-11-24 19:15:13 -08:00
tedyu 1917516ffd HBASE-14875 Forward port HBASE-14207 'Region was hijacked and remained in transition when RS failed to open a region and later regionplan changed to new RS on retry' 2015-11-24 14:30:37 -08:00
Gary Helmling 07b07300b8 HBASE-14821 Allow configuration overrides in TableOutputFormat 2015-11-24 12:15:25 -08:00
tedyu 447a0e7b7e HBASE-14737 Clear cachedMaxVersions when HColumnDescriptor#setValue(VERSIONS, value) is called (Pankaj Kumar) 2015-11-23 20:26:18 -08:00
anoopsjohn 81e7eb2805 HBASE-13347 Deprecate FirstKeyValueMatchingQualifiersFilter. (Abhishek) 2015-11-24 09:52:37 +05:30
stack 085bf60b42 HBASE-14807 TestWALLockup is flakey Second attempt at stabilizing this test.
Patch includes loosening of the test so we continue when threads
run in not-expected order. Also includes minor clean ups in
FSHLog -- a formatting change, removal of an unused trace logging,
and a check so we don't create a new exception when not needed --
but it also includes a subtle so we check if we need to get to safe
point EVEN IF an outstanding exception. Previous we could by-pass
the safe point check. This should make us even more robust against
lockup (though this is a change that comes of code reading, not of
any issue seen in test).

Here is some detail on how I loosened the test:

The test can run in an unexpected order. Attempts at dictating the
order in which threads fire only had me deadlocking one latch
against another (the test latch vs the WAL zigzag latch) so I
gave up trying and instead, if we happen to go the unusual route of
rolling WALs and failing flush before the scheduled log roll
latch goes into place, just time out the run after a few seconds
and exit the test (but do not fail it); just log a WARN.

This is less than ideal but allows us keep some coverage of the
tricky scenario that was bringing on deadlock (a broken WAL that
is throwing exceptions getting stuck waiting on a sync to clear
out the ring buffer getting overshadowed by a subsequent append
added in by a concurrent flush).
2015-11-20 12:07:32 -08:00
ramkrishna 11b2131013 HBASE-14840 Sink cluster reports data replication request as success
though the data is not replicated(Ashish Singhi)
2015-11-20 16:00:15 +05:30
Ashu Pachauri f56c605e73 HBASE-14777 ADDENDUM Fix failing TestReplicationEndpoint test
Signed-off-by: stack <stack@apache.org>
2015-11-20 00:21:33 -06:00
Sean Busbey ccee3d8dd5 Revert "Fix failing TestReplicationEndpoint test"
This reverts commit 5b5ff1d8b2.
2015-11-20 00:21:24 -06:00
Ashu Pachauri 5b5ff1d8b2 Fix failing TestReplicationEndpoint test
Signed-off-by: stack <stack@apache.org>
2015-11-19 13:26:37 -08:00
ramkrishna b06acfbf0b HBASE-14761 Deletes with and without visibility expression do not delete
the matching mutation (Ram)
2015-11-19 11:24:35 +05:30
chenheng 40e01512cf HBASE-14782 FuzzyRowFilter skips valid rows (Vladimir Rodionov) 2015-11-19 11:41:05 +08:00
Enis Soztutar 8a69dd5b08 HBASE-14468 Compaction improvements: FIFO compaction policy (Vladimir Rodionov) 2015-11-18 19:27:15 -08:00
Ashu Pachauri de4f235bf4 HBASE-14777 Fix Inter Cluster Replication Future ordering issues
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-11-18 16:41:52 -08:00
tedyu a6e0ad636a HBASE-14824 HBaseAdmin.mergeRegions should recognize both full region names and encoded region names (Eungsop Yoo) 2015-11-18 14:26:31 -08:00