Commit Graph

4419 Commits

Author SHA1 Message Date
Enis Soztutar 550d253ead HBASE-15671 Add per-table metrics on memstore, storefile and regionsize (Alicia Ying Shu) 2016-04-21 13:33:31 -07:00
stack 0b65f2002b HBASE-15366 Add doc, trace-level logging, and test around No change in operation, just adding doc., and some helpful logging
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileContext.java
 Make it emit its toString in format that matches the way we log
 elsewhere
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
 Capitalize statics.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
 Verify and cleanup documentation of hfileblock format at head of class.
 Explain what 'EXTRA_SERIALIZATION_SPACE' is all about.
 Connect how we serialize and deserialize... done in different places
 and one way when pulling from HDFS and another when pulling from cache
 (TO BE FIXED). Shut down a load of public access.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpl.java
 Add trace-level logging

Signed-off-by: stack <stack@apache.org>
2016-04-21 10:56:07 -07:00
chenheng 5d497d5ba8 HBASE-15674 HRegionLocator#getAllRegionLocations should put the results in cache
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HRegionLocator.java
2016-04-21 14:28:07 +08:00
zhangduo 80e324cdc7 HBASE-15368 Add pluggable window support 2016-04-21 12:02:42 +08:00
Andrew Purtell 780cff5886 HBASE-15614 Report metrics from JvmPauseMonitor 2016-04-20 17:36:59 -07:00
Enis Soztutar 1311e25171 HBASE-15518 Add Per-Table metrics back (Alicia Ying Shu) 2016-04-20 14:35:52 -07:00
stack 71c55d182d HBASE-15640 L1 cache doesn't give fair warning that it is showing partial stats only when it hits limit 2016-04-20 14:19:12 -07:00
stack a331a57ef8 HBASE-15385 PREFETCH_BLOCKS_ON_OPEN in HColumnDescriptor is ignored 2016-04-20 09:41:28 -07:00
tedyu 1aa07404a9 HBASE-15679 Assertion on wrong variable in TestReplicationThrottler#testThrottling 2016-04-20 07:11:50 -07:00
stack 2d99f626d1 HBASE-15672 hadoop.hbase.security.visibility.TestVisibilityLabelsWithDeletes fails (Anoop Sam John) 2016-04-19 21:54:43 -07:00
Apekshit bd64db97c8 HBASE-15673 Fix latency metrics for multiGet. - Also fixes some stuff in help text. (Apekshit)
Change-Id: I95cfa2be74605efab0368417d59c50b94af0facb

Signed-off-by: stack <stack@apache.org>
2016-04-19 17:18:45 -07:00
zhangduo 22b1061044 HBASE-15665 Support using different StoreFileComparators for different CompactionPolicies 2016-04-19 19:35:36 +08:00
Gábor Lipták 2b5da6f7a0 HBASE-13372 Add unit tests for SplitTransaction and RegionMergeTransaction listeners
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-04-18 16:56:59 -07:00
Ashish Singhi 6d40b7a0e4 HBASE-15668 HFileReplicator fails to replicate other hfiles in the request when a hfile in not found in FS anywhere 2016-04-18 22:18:46 +05:30
zhangduo ee78b6da7a HBASE-15664 Use Long.MAX_VALUE instead of HConstants.FOREVER in CompactionPolicy 2016-04-18 20:11:35 +08:00
tedyu 7dacf9f10c HBASE-15287 mapreduce.RowCounter returns incorrect result with binary row key inputs (Matt Warhaftig) 2016-04-16 18:11:27 -07:00
stack fd49923350 HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile
Refactor so we use the immutable, unsynchronized TimeRange when doing
time-based checks at read time rather than use heavily synchronized
TimeRangeTracker; let TimeRangeTracker be for write-time only.

While in here, changed the Segment stuff so that when an immutable
segment, it uses TimeRange rather than TimeRangeTracker too.

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
  Make allTime final.
  Add a includesTimeRange method copied from TimeRangeTracker.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
  Change name of a few methods so they match TimeRange methods that do
  same thing.
  (getTimeRangeTracker, getTimeRange, toTimeRange) add utility methods

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
  Change Reader to use TimeRange-based checks instead of
  TimeRangeTracker.
2016-04-15 16:56:05 -07:00
Matteo Bertozzi 6cf4bfe62c HBASE-15622 Superusers does not consider the keytab credentials 2016-04-15 08:31:46 -07:00
chenheng 96e9c466d2 HBASE-15406 Split / merge switch left disabled after early termination of hbck
Conflicts:
        hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
        hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
        hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
        hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java
        hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
        hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
        hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
        hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestSplitOrMergeStatus.java
        hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsckOneRS.java
2016-04-15 15:34:43 +08:00
Apekshit d378975351 HBASE-15405 Fix PE logging and wrong defaults in help message. (Apekshit)
Change-Id: I81f5f57e1db18df252fa92c0cc14bf950ab17034

Signed-off-by: stack <stack@apache.org>
2016-04-14 09:00:38 -07:00
Elliott Clark 07dc75f4fe HBASE-15504 Fix Balancer in 1.3 not moving regions off overloaded regionserver 2016-04-13 18:07:21 -07:00
tedyu 85f2caf184 HBASE-15633 Backport HBASE-15507 to branch-1 (Geoffrey Jacoby) 2016-04-13 02:25:32 -07:00
Matteo Bertozzi cd84796b39 HBASE-15481 Add pre/post roll to WALObserver
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractFSWAL.java
2016-04-13 01:06:51 -05:00
Stephen Yuan Jiang 4981d4c207 HBASE-15636 hard coded wait time out value in HBaseTestingUtility#waitUntilAllRegionsAssigned might cause test failure (Stephen Yuan Jiang) 2016-04-12 16:47:21 -07:00
Matteo Bertozzi d896a51291 HBASE-15621 Suppress Hbase SnapshotHFile cleaner error messages when a snaphot is going on (Huaxiang Sun) 2016-04-12 12:23:28 -07:00
Matteo Bertozzi 59bf00562c HBASE-15632 Undo the checking of lastStoreFlushTimeMap.isEmpty() introduced in HBASE-13145 (Huaxiang Sun) 2016-04-12 11:41:00 -07:00
tedyu e31361dcb8 HBASE-14985 TimeRange constructors should set allTime when appropriate (Geoffrey Jacoby) 2016-04-11 17:58:38 -07:00
Matteo Bertozzi 2dbbe8960a HBASE-15627 Miss space and closing quote in AccessController#checkSystemOrSuperUser (Huaxiang Sun) 2016-04-11 08:28:02 -07:00
tedyu b7502feff3 HBASE-15093 Replication can report incorrect size of log queue for the global source when multiwal is enabled (Ashu Pachauri) 2016-04-11 08:23:34 -07:00
Jerry He ff835d5ae6 HBASE-15591 ServerCrashProcedure not yielding 2016-04-10 17:07:39 -07:00
zhangduo 7303c7e479 HBASE-15527 Refactor Compactor related classes 2016-04-10 09:26:42 +08:00
zhangduo 2b75562701 HBASE-15537 Make multi WAL work with WALs other than FSHLog 2016-04-08 10:42:40 +08:00
Enis Soztutar d94c18a0e7 HBASE-15586 Unify human readable numbers in the web UI 2016-04-07 17:07:38 -07:00
tedyu b17350210b HBASE-15400 Use DateTieredCompactor for Date Tiered Compaction (Clara Xiong) 2016-04-07 15:06:22 -07:00
Harsh J ff075fd9df HBASE-15396 Enhance mapreduce.TableSplit to add encoded region name
(cherry picked from commit 7d3a89ce8e)

Signed-off-by: Sean Busbey <busbey@apache.org>
2016-04-06 08:32:32 -07:00
Enis Soztutar e6a32141b3 HBASE-15587 FSTableDescriptors.getDescriptor() logs stack trace erronously 2016-04-05 18:13:47 -07:00
tedyu 8957dc1033 HBASE-15485 Filter.reset() should not be called between batches (Phil Yang) 2016-04-04 20:07:39 -07:00
Ashish Singhi e5fb045aa9 HBASE-15578 Handle HBASE-15234 for ReplicationHFileCleaner 2016-04-04 15:07:56 +05:30
Matteo Bertozzi 4bae771b65 HBASE-15582 SnapshotManifestV1 too verbose when there are no regions 2016-04-01 20:59:08 -07:00
Ashish Singhi bcbef7b401 HBASE-15424 Add bulk load hfile-refs for replication in ZK after the event is appended in the WAL 2016-04-01 15:55:08 +05:30
Gary Helmling d7d12aedd4 HBASE-15234 Don't abort ReplicationLogCleaner on ZooKeeper errors 2016-03-31 22:45:45 -07:00
tedyu b7df66f1a8 HBASE-15571 Make MasterProcedureManagerHost accessible through MasterServices 2016-03-31 15:49:07 -07:00
stack 407e644607 HBASE-15324 Jitter may cause desiredMaxFileSize overflow in ConstantSizeRegionSplitPolicy and trigger unexpected split (Yu Li) 2016-03-30 13:31:34 -07:00
Elliott Clark 75d46e4697 HBASE-14983 Create metrics for per block type hit/miss ratios
Summary: Missing a root index block is worse than missing a data block. We should know the difference

Test Plan: Tested on a local instance. All numbers looked reasonable.

Differential Revision: https://reviews.facebook.net/D55563
2016-03-30 11:53:46 -07:00
Elliott Clark fee0212da0 HBASE-15559 Fix BaseMasterAndRegionObserver doesn't implement all the methods 2016-03-30 11:18:15 -07:00
tedyu e339bec3f1 HBASE-15327 Canary will always invoke admin.balancer() in each sniffing period when writeSniffing is enabled (Jianwei Cui) 2016-03-30 09:00:04 -07:00
Enis Soztutar 1e44dd82eb HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock - ADDENDUM for failing test 2016-03-29 15:02:23 -07:00
tedyu c7ad42867d HBASE-15191 CopyTable and VerifyReplication - Option to specify batch size, versions (Parth Shah) 2016-03-29 10:29:56 -07:00
chenheng 13df653215 HBASE-15384 Avoid using '/tmp' directory in TestBulkLoad 2016-03-29 11:10:44 +08:00
Enis Soztutar 5202d3c25b HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/CoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/MasterCoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionCoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/DistributedHBaseCluster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide3.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannersFromClientSide.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestClockSkewDetection.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestNamespaceCommands.java
2016-03-28 17:00:21 -07:00
tedyu 5851ad0230 HBASE-15548 SyncTable: sourceHashDir is supposed to be optional but won't work without (Dave Latham) 2016-03-28 16:53:27 -07:00
tedyu 87f1af842a HBASE-15496 Throw RowTooBigException only for user scan/get (Guanghao Zhang) 2016-03-25 19:05:15 -07:00
zhangduo d5bc56c266 HBASE-15389 Write out multiple files when compaction 2016-03-25 15:33:20 +08:00
tedyu 4b5b8e01d0 HBASE-15526 Make SnapshotManager accessible through MasterServices 2016-03-24 16:02:00 -07:00
tedyu ff261efbf7 HBASE-15515 Improve LocalityBasedCandidateGenerator in Balancer (Guanghao Zhang) 2016-03-24 11:22:34 -07:00
Jerry He 1361a25e6d HBASE-14256 Flush task message may be confusing when region is recovered (Gabor Liptak) 2016-03-24 10:01:53 -07:00
Jesse Yates ee33bf0c7d HBASE-14703 HTable.mutateRow does not collect stats (Heng Chen)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncProcess.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerFactory.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerImpl.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/StatsTrackingRpcRetryingCaller.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ClientProtos.java
2016-03-24 11:27:54 +08:00
zhangduo 9fa44a8126 HBASE-15520 Fix broken TestAsyncIPC
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/AsyncRpcChannel.java
2016-03-24 10:57:42 +08:00
Elliott Clark 604415e827 HBASE-15475 Allow TimestampsFilter to provide a seek hint 2016-03-23 18:57:02 -07:00
stack a3d550fbca HBASE-15360 Fix flaky TestSimpleRpcScheduler; ADDENDUM 2016-03-23 15:47:22 -07:00
Matteo Bertozzi 47eb79311f HBASE-15508 Add command for exporting snapshot in hbase command script (Yufeng Jiang) 2016-03-23 10:38:13 -07:00
Enis Soztutar b697f53be3 HBASE-15212 RRCServer should enforce max request size 2016-03-22 16:23:20 -07:00
Enis Soztutar d07230a759 HBASE-15412 Add average region size metric (Alicia Ying Shu)
Conflicts:
	hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperStub.java
2016-03-22 14:50:14 -07:00
tedyu 2331d9efe3 HBASE-15488 Add ACL for setting split merge switch 2016-03-22 10:41:08 -07:00
Enis Soztutar 249e37f83c HBASE-15464 Flush / Compaction metrics revisited
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/MockRegionServerServices.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockRegionServer.java
2016-03-21 17:56:22 -07:00
tedyu 1c5002660b HBASE-15325 ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests (Phil Yang) 2016-03-21 13:20:23 -07:00
tedyu ee4bf43577 HBASE-15433 SnapshotManager#restoreSnapshot not update table and region count quota correctly when encountering exception (Jianwei Cui) 2016-03-21 03:47:43 -07:00
Sean Busbey a3071327b5 HBASE-15478 add comments to syncRunnerIndex handling explaining constraints on possible values.
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-03-21 00:29:52 -05:00
Yu Li 17815ded74 HBASE-15490 Remove duplicated CompactionThroughputControllerFactory in branch-1 2016-03-20 16:16:40 +08:00
Yu Li 463374ecfa HBASE-15451 Remove unnecessary wait in MVCC 2016-03-20 02:42:44 +08:00
tedyu 6977c5dee5 HBASE-15302 Revert TestWALSplitCompressed which extends TestWALSplit 2016-03-18 20:56:03 -07:00
tedyu 27d59d3ebb HBASE-15302 Revert two tests which hung in build #31 2016-03-18 20:53:29 -07:00
tedyu d942d4e5a1 HBASE-15302 Reenable the other tests disabled by HBASE-14678 (Phil Yang) 2016-03-18 09:06:34 -07:00
tedyu eda2656b88 HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun) 2016-03-18 05:38:05 -07:00
tedyu a319941425 HBASE-15456 Revert due to unit test failure in thrift module 2016-03-17 17:28:13 -07:00
tedyu e4409c2f8c HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun) 2016-03-17 13:06:42 -07:00
Elliott Clark f1bb26c223 HBASE-15470 Add a setting for Priority queue length
Summary:
Move the config keys to one place
Make Two different config keys. One for default, one for priority

Test Plan: unit tests

Differential Revision: https://reviews.facebook.net/D55575
2016-03-16 16:52:17 -07:00
Elliott Clark aaaae83423 HBASE-15441 Fix WAL splitting when region has moved multiple times
Summary:
Currently WAL splitting is broken when a region has been opened multiple times in recent minutes.

Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail.

We need to:

It appears that the close event with a sequence id of one is coming from region warm up.

This patch fixes that by making sure the close on warm up doesn't happen. Also splitting will ignore any of the events that are already in the logs.

Test Plan: Unit tests pass

Differential Revision: https://reviews.facebook.net/D55557
2016-03-16 16:35:18 -07:00
Matteo Bertozzi 103c313b0d HBASE-15430 Failed taking snapshot - Manifest proto-message too large (JunHo Cho) 2016-03-16 09:06:11 -07:00
stack 3f9ce9785a HBASE-15360 Fix flaky TestSimpleRpcScheduler (Duo Zhang) 2016-03-16 08:04:37 -07:00
tedyu a00ed93fae HBASE-15456 Revert due to TestCloseRegionHandler failure 2016-03-15 21:24:37 -07:00
tedyu f8bcb54479 HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun) 2016-03-15 16:21:16 -07:00
Enis Soztutar 934c0274e3 HBASE-15377 Per-RS Get metric is time based, per-region metric is size-based (Heng Chen)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2016-03-15 13:35:13 -07:00
tedyu d0bd4903c6 HBASE-15463 Region normalizer should check whether split/merge is enabled 2016-03-15 09:10:00 -07:00
Enis Soztutar 95421d276e HBASE-15435 Add WAL (in bytes) written metric (Alicia Ying Shu)
Conflicts:
	hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/wal/MetricsWALSource.java
	hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/wal/MetricsWALSourceImpl.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestMetricsWAL.java
2016-03-10 20:21:53 -08:00
stack e445272724 Revert "HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun)"
Not needed afterall
This reverts commit e42065c308.
2016-03-10 15:41:30 -08:00
tedyu f82147831b HBASE-15425 Failing to write bulk load event marker in the WAL is ignored (Ashish Singhi) 2016-03-10 07:19:59 -08:00
tedyu e103f75ae7 HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang) 2016-03-09 10:05:06 -08:00
Matteo Bertozzi 46bf3c3275 HBASE-15113 Procedure v2 - Speedup eviction of sys operation results 2016-03-08 11:08:05 -08:00
Mikhail Antonov 3339bac563 HBASE-15137 CallTimeoutException and CallQueueTooBigException should trigger PFFE 2016-03-08 02:59:20 -08:00
tedyu 4ec6ad12c9 HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT 2016-03-07 19:28:21 -08:00
Mikhail Antonov 43698b3fcb HBASE-15354 Use same criteria for clearing meta cache for all operations (Ashu Pachauri) 2016-03-07 17:34:11 -08:00
stack e42065c308 HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun) 2016-03-07 16:35:58 -08:00
tedyu c1524485c5 HBASE-15393 Enable table replication command will fail when parent znode is not default in peer cluster (Ashish Singhi) 2016-03-07 04:57:55 -08:00
chenheng bbb10c4c18 HBASE-15376 ScanNext metric is size-based while every other per-operation metric is time based
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
2016-03-07 17:48:37 +08:00
stack d089ac1ec6 HBASE-15373 DEPRECATED_NAME_OF_NO_LIMIT_THROUGHPUT_CONTROLLER_CLASS value is wrong in CompactionThroughputControllerFactory 2016-03-03 19:43:10 -08:00
tedyu b3c62680bc HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang) 2016-03-03 16:01:15 -08:00
tedyu 77c3c61b34 HBASE-15291 Revert due to the bug Haitao discovered 2016-03-02 00:49:59 -08:00
tedyu 231a5807b4 HBASE-15181 Addendum fixes findbugs warning (Clara Xiong) 2016-03-01 18:21:37 -08:00
Elliott Clark 404e9145c2 HBASE-15315 Remove always set super user call as high priority (Yong Zhang) 2016-03-01 15:34:12 -08:00
chenheng 18194f8a56 HBASE-15128 Disable region splits and merges switch in master 2016-02-29 20:41:27 +08:00
Phil Yang 03a02969c4 HBASE-15358 canEnforceTimeLimitFromScope should use timeScope instead of sizeScope
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-02-29 17:22:23 +08:00
Mikhail Antonov 998e339d6e HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
tedyu 0cd299dfca HBASE-15181 A simple implementation of date based tiered compaction (Clara Xiong) 2016-02-27 07:33:19 -08:00
Elliott Clark e0d7e0eb3b HBASE-15348 Disable metrics tests until fixed. 2016-02-26 09:05:01 -08:00
Samir Ahmic e28b01be50 HBASE-15311 Prevent NPE in BlockCacheViewTmpl.
Signed-off-by: stack <stack@apache.org>
2016-02-25 15:24:32 -08:00
Samir Ahmic 210ed97688 HBASE-15144 Procedure v2 - Web UI displaying Store state 2016-02-25 10:50:16 -08:00
Mikhail Antonov 04a3b27330 HBASE-15136 Explore different queuing behaviors while busy 2016-02-24 20:42:23 -08:00
Elliott Clark 3352173ec8 HBASE-15222 Use less contended classes for metrics
Summary:
Use less contended things for metrics.
For histogram which was the largest culprit we use FastLongHistogram
For atomic long where possible we now use counter.

Test Plan: unit tests

Reviewers:

Subscribers:

Differential Revision: https://reviews.facebook.net/D54381
2016-02-24 14:47:00 -08:00
Mikhail Antonov bcbe174a27 HBASE-15306 Make RPC call queue length dynamically configurable 2016-02-23 14:22:58 -08:00
Josh Elser d747188f2c HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
Further investigation after HBASE-15221 lead to some findings that
AsyncProcess should have been managing the contents of the region
location cache, appropriately clearing it when necessary (e.g. an
RPC to a server fails because the server doesn't host that region)

For multi() RPCs, the tableName argument is null since there is no
single table that the updates are destined to. This inadvertently
caused the existing region location cache updates to fail on 1.x
branches. AsyncProcess needs to handle when tableName is null
and perform the necessary cache evictions.

As such, much of the new retry logic in HTableMultiplexer is
unnecessary and is removed with this commit. Getters which were
added as a part of testing were left since that are mostly
harmless and should contain no negative impact.

Signed-off-by: stack <stack@apache.org>
2016-02-23 10:28:33 -08:00
tedyu 49cb0cfccb HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang) 2016-02-23 06:12:13 -08:00
anoopsjohn cc45b4ab38 HBASE-15247 InclusiveStopFilter does not respect reverse Filter property. (Amal Joshy) 2016-02-23 09:59:35 +05:30
Mikhail Antonov 4784717235 HBASE-15135 Add metrics for storefile age 2016-02-22 02:43:24 -08:00
tedyu 215cccdffc HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state 2016-02-20 20:25:41 -08:00
zhangduo 7a1c407ea6 HBASE-14949 addendum fix compilation error on branch-1 2016-02-18 21:04:14 +08:00
zhangduo b8f92312b3 HBASE-14949 Resolve name conflict when splitting if there are duplicated WAL entries 2016-02-18 19:49:36 +08:00
Samir Ahmic ab1b2c6603 HBASE-15270 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon.
Signed-off-by: chenheng <chenheng@apache.org>
2016-02-17 23:59:31 -06:00
chenheng 6ed63180e1 HBASE-15263 TestIPv6NIOServerSocketChannel.testServerSocketFromLocalhostResolution can hang indefinetly
Signed-off-by: stack <stack@apache.org>
2016-02-16 12:54:34 -08:00
chenheng 29ce46a67f HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic) 2016-02-15 14:17:43 +08:00
tedyu 822a064195 HBASE-15219 Revert pending verification of test result 2016-02-12 12:05:07 -08:00
zhangduo 9df8d4c1ce HBASE-15252 Data loss when replaying wal if HDFS timeout 2016-02-12 16:16:49 +08:00
anoopsjohn 19f8faeb88 HBASE-15198 RPC client not using Codec and CellBlock for puts by default. 2016-02-11 16:37:20 +05:30
ramkrishna cd2b4dfa12 HBASE-15204 Try to estimate the cell count for adding into WALEdit (Ram) 2016-02-11 09:27:19 +05:30
Jerry He bc1d836738 HBASE-15223 Make convertScanToString public for Spark 2016-02-10 14:55:38 -08:00
Andrew Purtell e85575f568 HBASE-15229 Canary Tools should not call System.Exit on error (Vishal Khandelwal) 2016-02-10 10:21:22 -08:00
tedyu 5fe081eb33 HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state 2016-02-10 02:38:12 -08:00
Andrew Purtell 7a718cce71 HBASE-15216 Canary does not accept config params from command line (Vishal Khandelwal)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java
2016-02-09 22:46:20 -08:00
stack 869c0cf43c HBASE-15238 HFileReaderV2 prefetch overreaches; runs off the end of the data 2016-02-09 20:55:20 -08:00
stack 0649755d34 HBASE-15163 Add sampling code and metrics for get/scan/multi/mutate count separately (Yu Li) 2016-02-06 06:36:47 -08:00
ramkrishna bd4a4ecf5e HBASE-15204 Try to estimate the cell count for adding into WALEdit (Revert
for making it more cleaner)
2016-02-06 13:08:02 +05:30
tedyu 0e6bef4de7 HBASE-15220 Change two logs in SimpleRegionNormalizer to INFO level 2016-02-05 20:54:21 -08:00
Apekshit 6a2fa739fd HBASE-15209 (compatibility) Disable table in HBaseTestingUtility.truncateTable. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2016-02-05 20:42:26 -08:00
stack 97fc7abd5b HBASE-15157 Add *PerformanceTest for Append, CheckAnd* 2016-02-05 20:38:06 -08:00
anoopsjohn 64c87f2476 HBASE-15214 Valid mutate Ops fail with RPC Codec in use and region moves across. 2016-02-06 02:41:29 +05:30
stack f03c8801c9 HBASE-15218 On RS crash and replay of WAL, loosing all Tags in Cells (Anoop Sam John) 2016-02-05 10:09:13 -08:00
tedyu 9bd679de42 HBASE-11262 Addendum fixes new unit test 2016-02-05 10:05:46 -08:00
tedyu 8473fae1de HBASE-11262 Avoid empty columns while doing bulk-load (Ashish Kumar) 2016-02-05 09:01:46 -08:00
ramkrishna f9ce069e15 HBASE-15204 Try to estimate the cell count for adding into WALEdit (Ram) 2016-02-05 14:25:58 +05:30
ramkrishna 38e79b09c9 HBASE-15202 Reduce garbage while setting response (Ram) 2016-02-05 10:06:07 +05:30
stack 846a2f31c1 HBASE-15210 Undo aggressive load balancer logging at tens of lines per millisecond; ADDENDUM changing LOG.debug to LOG.trace -- noticed by matteo 2016-02-04 16:25:47 -08:00
stack 2203d55b7d HBASE-15210 Undo aggressive load balancer logging at tens of lines per millisecond 2016-02-04 16:10:17 -08:00
stack 8061fa4af8 Revert "HBASE-15120 Undo aggressive load balancer logging at tens of lines per millisecond"
This reverts commit 66da601cdc.
2016-02-04 16:09:52 -08:00
stack 66da601cdc HBASE-15120 Undo aggressive load balancer logging at tens of lines per millisecond 2016-02-04 14:24:44 -08:00
Enis Soztutar 73d6778820 HBASE-15177 Reduce garbage created under high load
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
2016-02-04 13:26:22 -08:00
Elliott Clark 908e5a6620 HBASE-15211 Don't run the CatalogJanitor if there are regions in transition 2016-02-04 08:52:20 -08:00
ramkrishna 1404d5a973 HBASE-HBASE-15203 Reduce garbage created by path.toString() during
Checksum verification (Ram)
2016-02-04 11:46:32 +05:30
Enis Soztutar f1e7c06539 HBASE-15129 Set default value for hbase.fs.tmp.dir rather than fully depend on hbase-default.xml (Yu Li)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/SecureBulkLoadUtil.java
2016-02-02 17:06:20 -08:00
Jonathan M Hsieh b69b8aced6 HBASE-15206 Fix flakey testSplitDaughtersNotInMeta (Huaxiang Sun) 2016-02-02 16:58:05 -08:00
stack 1bf58675c7 HBASE-15194 TestStochasticLoadBalancer.testRegionReplicationOnMidClusterSameHosts flaky on trunk 2016-02-02 13:44:21 -08:00