b6b72361b6
HBASE-16586 Procedure v2 - Cleanup sched wait/lock semantic
2016-09-16 08:50:17 -07:00
2597217ae5
HBASE-16349 TestClusterId may hang during cluster shutdown
2016-09-16 02:32:03 -07:00
e19632a19a
HBASE-16634 Speedup TestExportSnapshot
2016-09-15 18:29:09 -07:00
8c4b09dfba
HBASE-16624 Fix MVCC DeSerialization bug in the HFileScannerImpl
...
Change-Id: Ia970619ac7369d24ed432e827319dfdca16143c2
Signed-off-by: stack <stack@apache.org>
2016-09-15 11:01:51 -07:00
56be3ac7c8
HBASE-16626 User customized RegionScanner from 1.X is incompatible with 2.0.0's off-heap part. (Charlie Qiangeng Xu)
2016-09-15 18:07:43 +05:30
8ef6c76344
HBASE-16388 Prevent client threads being blocked by only one slow region server
...
Signed-off-by: stack <stack@apache.org>
2016-09-14 09:08:20 -07:00
4c6a98bd76
HBASE-16618 Procedure v2 - Add base class for table and ns procedures
2016-09-13 11:37:52 -07:00
a602aaf9ba
HBASE-16615 Fix flaky TestScannerHeartbeatMessages
2016-09-13 17:41:01 +08:00
77b327320a
HBASE-16229 Cleaning up size and heapSize calculation.
2016-09-12 23:23:38 -07:00
2566cfeb60
HBASE-16592 Unify Delete request with AP
2016-09-12 23:23:38 -07:00
8855670cd7
HBASE-16616 Rpc handlers stuck on ThreadLocalMap.expungeStaleEntry (Tomu Tsuruhara)
2016-09-12 15:49:23 -07:00
80d8b2100d
HBASE-16086 TableCfWALEntryFilter and ScopeWALEntryFilter should not redundantly iterate over cells (Vincent Poon)
2016-09-11 09:55:08 +08:00
cc2a40a78f
HBASE-16596 Reduce redundant interfaces in AsyncProcess
2016-09-10 11:13:28 +08:00
6c8d1f0ae8
HBASE-16309 TestDefaultCompactSelection.testCompactionRatio is flaky
2016-09-09 14:20:39 +08:00
e11aafae95
HBASE-16570 Compute region locality in parallel at startup (binlijin)
2016-09-09 10:54:48 +08:00
46c756a4a7
HBASE-16589 Adjust log level for FATAL messages from HBaseReplicationEndpoint that are not fatal
2016-09-08 13:04:18 -07:00
d7e5c6fa8e
HBASE-16505 Add AsyncRegion interface to pass deadline and support async operations - revert due to open questions
2016-09-08 11:55:46 -07:00
1574c6ef39
HBASE-16505 Add AsyncRegion interface to pass deadline and support async operations (Phil Yang)
2016-09-08 06:57:03 -07:00
c04b389181
HBASE-16445 Refactor and reimplement RpcClient
2016-09-08 20:32:56 +08:00
fc224ed0ed
HBASE-16530 Reduce DBE code duplication
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-09-08 13:48:27 +08:00
e9cfbfd107
HBASE-16572 Sync method in RecoverableZooKeeper failed to pass callback function in (Allan Yang)
2016-09-07 11:35:35 -07:00
b6ba13c377
HBASE-16460 Can't rebuild the BucketAllocator's data structures when BucketCache uses FileIOEngine (Guanghao Zhang)
2016-09-05 06:50:50 -07:00
91227f8f98
HBASE-16516 Revisit the implementation of PayloadCarryingRpcController
2016-09-04 09:16:15 +08:00
592245ff13
HBASE-16556 The read/write timeout are not used in HTable.delete(List), HTable.get(List), and HTable.existsAll(List) (ChiaPing Tsai)
2016-09-03 17:14:57 -07:00
008091fe8a
HBASE-16552 MiniHBaseCluster#getServerWith() does not ignore stopped RSs
2016-09-02 16:49:17 -07:00
5e905c02d9
HBASE-16399 Provide an API to get list of failed regions and servername in Canary (Vishal Khandelwal)
2016-09-02 10:13:35 -07:00
0b6eccf4c3
HBASE-16311 Audit log for delete snapshot operation is missing in case of snapshot owner deleting the same (Yi Liang)
2016-09-02 09:47:28 -07:00
f6ccae3502
HBASE-16507 Procedure v2 - Force DDL operation to always roll forward
2016-09-01 21:06:32 -07:00
b839d04d8e
HBASE-16375 Mapreduce mini cluster using HBaseTestingUtility not setting correct resourcemanager and jobhistory webapp address of MapReduceTestingShim
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-09-01 15:57:39 -07:00
a1cd601ad7
HBASE-16527 IOExceptions from DFS client still can cause CatalogJanitor to delete referenced files (Vladimir Rodionov)
2016-09-01 12:31:20 -07:00
3892550484
HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response
2016-09-01 10:33:24 +08:00
8479554275
HBASE-16519 Procedure v2 - Avoid sync wait on DDLs operation (addendum)
2016-08-31 13:48:25 -07:00
605af95132
HBASE-16528 Procedure-V2: ServerCrashProcedure misses owner information (Stephen Yuan Jiang)
2016-08-31 09:25:51 -07:00
45af3831fe
HBASE-16526 Add more ipc tests
2016-08-31 20:44:56 +08:00
647a65ce01
HBASE-16531 Move cell block related code out of IPCUtil
2016-08-31 13:09:22 +08:00
7b95ac117d
HBASE-16502 Reduce garbage in BufferedDataBlockEncoder - addendum adopts Hiroshi's suggestion (binlijin)
2016-08-30 18:04:34 -07:00
af33f94513
HBASE-16522 Procedure v2 - Cache system user and avoid IOException
2016-08-30 15:39:49 -07:00
4a4f8e7049
HBASE-16519 Procedure v2 - Avoid sync wait on DDLs operation
2016-08-30 09:45:56 -07:00
2acd788dce
HBASE-16082 Procedure v2 - Move out helpers from MasterProcedureScheduler
2016-08-30 09:44:35 -07:00
9cb0094bdb
HBASE-16509 Add option to LoadIncrementalHFiles which allows skipping unmatched column families
2016-08-30 03:00:59 -07:00
0d05c75184
HBASE-16510 Reset RpcController before retry
2016-08-30 16:56:28 +08:00
c000f29e47
HBASE-16224 Reduce the number of RPCs for the large PUTs (ChiaPing Tsai)
2016-08-30 06:35:33 +08:00
950d547dae
HBASE-16407 Handle MemstoreChunkPool size when HeapMemoryManager tunes memory.
2016-08-29 10:22:27 +05:30
7eaba369e7
HBASE016490 Fix race condition between SnapshotManager and SnapshotCleaner
2016-08-27 10:48:21 +08:00
1b9af2a2fa
HBASE-16508 Move UnexpectedStateException to common
2016-08-26 16:40:30 -07:00
0d99e827b2
HBASE-16213 A new HFileBlock structure for fast random get. (binlijin)
2016-08-26 10:50:36 +05:30
b1ee8a88c3
HBASE-16502 Reduce garbage in BufferedDataBlockEncoder (binlijin)
2016-08-25 20:35:30 -07:00
3fd59b0ba9
HBASE-16409 Addendum fixes the case where delimiter is not specified by user
2016-08-25 11:53:49 -07:00
a1f760ff76
HBASE-16433 Remove AsyncRpcChannel related stuffs
2016-08-25 08:15:46 +08:00
8a692ff189
HBASE-16486 Unify system table creation using the same createSystemTable API (Stephen Yuan Jiang)
2016-08-24 15:21:20 -07:00
bf7015d320
HBASE-16304 HRegion#RegionScannerImpl#handleFileNotFoundException may lead to deadlock when trying to obtain write lock on updatesLock
2016-08-24 09:04:47 -07:00
dda8f67b2c
HBASE-16270 Handle duplicate clearing of snapshot in region replicas (Robert Yokota)
2016-08-24 06:33:46 -07:00
31f16d6aec
HBASE-16471 Region Server metrics context will be wrong when machine hostname contain "master" word (Pankaj Kumar)
2016-08-24 18:59:44 +05:30
cbfd6eecbd
HBASE-16474 Remove dfs.support.append related code and documentation
2016-08-24 03:41:54 -07:00
3909b7c96f
HBASE-16464 archive folder grows bigger and bigger due to corrupt snapshot under tmp dir
2016-08-24 13:38:32 +08:00
32c21f4594
HBASE-14921 In-Memory MemStore Flush and Compaction : Memory optimizations. (Anastasia)
2016-08-24 09:25:21 +05:30
cb02be38ab
HBASE-16448 Custom metrics for custom replication endpoints
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-08-23 17:17:08 -07:00
cb507b8cff
HBASE-16360 TableMapReduceUtil addHBaseDependencyJars has the wrong class name for PrefixTreeCodec (Jing Pu Chen)
2016-08-23 14:22:20 -07:00
897631f8d1
HBASE-16440 MemstoreChunkPool might cross its maxCount of chunks to pool.
2016-08-23 22:28:14 +05:30
77a7394f17
HBASE-16446 append_peer_tableCFs failed when there already have this table's partial cfs in the peer (Guanghao Zhang)
2016-08-23 15:28:33 +05:30
ff6182b020
HBASE-16454 Compactor's shipping logic decision should be based on the
...
current store's block size (Ram)
2016-08-23 11:06:02 +05:30
abc64fa69f
HBASE-16450 Shell tool to dump replication queues
...
New tool to dump existing replication peers, configurations and
queues when using HBase Replication. The tool provides two flags:
--distributed This flag will poll each RS for information about
the replication queues being processed on this RS.
By default this is not enabled and the information
about the replication queues and configuration will
be obtained from ZooKeeper.
--hdfs When --distributed is used, this flag will attempt
to calculate the total size of the WAL files used
by the replication queues. Since its possible that
multiple peers can be configured this value can be
overestimated.
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-08-22 19:50:10 -07:00
ae42a934d8
HBASE-16467 Move AbstractHBaseTool to hbase-common.
...
Change-Id: I64775f875f6900520e66c22c007704a067e8c2a4
2016-08-22 16:06:17 -07:00
f174fec391
HBASE-16455 Provide API for obtaining all the WAL files
2016-08-22 01:34:58 -07:00
d077219d3a
HBASE-16409 Row key for bad row should be properly delimited in VerifyReplication
2016-08-20 17:16:39 -07:00
5f61f9cc5c
HBASE-16405 Change read path Bloom check to work with Cells with out any copy.
2016-08-19 11:25:35 +05:30
642d2fe0f8
HBASE-16429 FSHLog: deadlock if rollWriter called when ring buffer filled with appends
2016-08-18 09:59:36 +08:00
e637a61e26
HBASE-16378 Procedure v2 - Make ProcedureException extend HBaseException
2016-08-17 14:31:08 -07:00
fb4ef53571
HBASE-15635 Mean age of Blocks in cache (seconds) on webUI should be greater than zero
...
Signed-off-by: stack <stack@apache.org>
2016-08-17 10:59:00 -07:00
233ca65b8f
HBASE-16419 check REPLICATION_SCOPE's value more stringently (Guangxu Cheng)
2016-08-17 07:58:06 -07:00
907ac1f655
HBASE-16341 Missing bit on "Regression: Random Read/WorkloadC slower in 1.x than 0.98"
2016-08-13 20:16:44 -07:00
65c03b058c
HBASE-16404 Make DeleteBloomFilters work with BloomContext (Ram)
2016-08-12 15:09:31 +05:30
285e104176
HBASE-15554 - StoreFile$Writer.appendGeneralBloomFilter generates extra KV
...
(Ram)
2016-08-12 10:21:41 +05:30
fb668a0d3f
HBASE-16267 Remove commons-httpclient dependency from hbase-rest module
2016-08-10 21:28:45 -07:00
9e116e048b
HBASE-16389 Thread leak in CoprocessorHost#getTable(TableName) API (Ankit Singhal)
2016-08-10 19:58:13 -07:00
45bb6180a3
REVERT of revert of "HBASE-16308 Contain protobuf references Gather up the pb references into a few locations only rather than have pb references distributed all about the code base."
...
This is a revert of a revert; i.e. we are adding back the change only adding
back with fixes for the broken unit test; was a real issue on a test that
went in just at same time as this commit; I was getting a new nonce on each
retry rather than getting one for the mutation.
Other changes since revert are more hiding of RpcController. Use
accessor method rather than always pass in a RpcController
Walked back retrying operations that used to be single-shot (though
code comment said need a retry) because it opens a can of worms where
we retry stuff like bad column family when we shouldn't (needs
work adding in DoNotRetryIOEs)
Changed name of class from PayloadCarryingServerCallable to
CancellableRegionServerCallable.
Fix javadoc and findbugs warnings.
Fix case of not initializing the ScannerCallable RpcController.
Below is original commit message:
Remove mention of ServiceException and other protobuf classes from all over the codebase.
Purge TimeLimitedRpcController. Lets just have one override of RpcController.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/AbstractRegionServerCallable.java
Cleanup. Make it clear this is an odd class for async hbase intro.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
Refactor of RegionServerCallable allows me clean up a bunch of
boilerplate in here and remove protobuf references.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
Purge protobuf references everywhere except a reference to a throw of a
ServiceException in method checkHBaseAvailable. I deprecated it in favor
of new available method (the SE is not actually needed)
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/PayloadCarryingServerCallable.java
Move the RetryingTimeTracker instance in here from HTable.
Allows me to contain tracker and remove a repeated code in HTable.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionServerCallable.java
Clean up move set up of rpc in here rather than have it repeat in HTable.
Allows me to remove protobuf references from a bunch of places.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/FlushRegionCallable.java
Make use of the push of boilerplate up into RegionServerCallable
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/MultiServerCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/PayloadCarryingServerCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionAdminServiceCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerWithReadReplicas.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/ScannerCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/SecureBulkLoadClient.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/LoadIncrementalHFiles.java
Move boilerplate up into superclass.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetryingTimeTracker.java
Cleanup
M hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/PayloadCarryingRpcController.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALEditsReplaySink.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
Factor in TimeLimitedRpcController. Just have one RpcController override.
D hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/TimeLimitedRpcController.java
Removed. Lets have one override of pb rpccontroller only.
M hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
(handleRemoteException) added
(toText) added
2016-08-10 10:12:06 -07:00
091a17e3c9
HBASE-16368 test*WhenRegionMove in TestPartialResultsFromClientSide is flaky
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-10 18:13:12 +08:00
ede9940a7b
HBASE-16285 Drop RPC requests if it must be considered as timeout at client
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-10 16:56:27 +08:00
46defe8e31
HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (Guanghao Zhang): ADDENDUM
2016-08-09 07:09:44 -07:00
5cadcd59aa
HBASE-9465 Push entries to peer clusters serially
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-09 15:25:50 +08:00
1ecb0fce34
HBASE-16367 Race between master and region server initialization may lead to premature server abort - addendum shortens the waiting duration
2016-08-08 10:39:35 -07:00
50f3c9572c
HBASE-16367 Race between master and region server initialization may lead to premature server abort
2016-08-08 04:07:30 -07:00
e5f9df1e23
HBASE-12770 Don't transfer all the queued hlogs of a dead server to the same alive server
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-08 16:30:23 +08:00
30d7eeaefe
HBASE-15866 Split hbase.rpc.timeout into *.read.timeout and *.write.timeout
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-08-06 16:55:09 -07:00
977858c9cb
HBASE-16362 Mob compaction does not set cacheBlocks to false when creating StoreScanner
2016-08-06 22:38:26 +08:00
0206dc67d6
Revert "HBASE-16308 Contain protobuf references Gather up the pb references into a few locations only rather than have pb references distributed all about the code base."
...
This reverts commit ed87a81b4b
2016-08-05 15:18:48 -07:00
ed87a81b4b
HBASE-16308 Contain protobuf references Gather up the pb references into a few locations only rather than have pb references distributed all about the code base.
...
Purge ServiceException from Callable subclasses by pushing SE handling
up into the parent Callable class (varies by context but this is basic
patten). Allows us remove a bunch of boilerplate.
Do this in the public facing classes in particular (though if
an API has SE in it -- which a few do, this patch leaves these
untouched -- for now.) Make it so HBaseAdmin and HTable have no
direct pb imports (except for endpoint processor API).
Change a few of the HBaseAdmin calls to be retrying where comments
ask that we do retry rather than one time.
Purge TimeLimitedRpcController. Lets just have one override of RpcController.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/AbstractRegionServerCallable.java
Cleanup. Make it clear this is an odd class for async hbase intro.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
Refactor of RegionServerCallable allows me clean up a bunch of
boilerplate in here and remove protobuf references.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
Purge protobuf references everywhere except a reference to a throw of a
ServiceException in method checkHBaseAvailable. I deprecated it in favor
of new available method (the SE is not actually needed)
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/PayloadCarryingServerCallable.java
Move the RetryingTimeTracker instance in here from HTable.
Allows me to contain tracker and remove a repeated code in HTable.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionServerCallable.java
Clean up move set up of rpc in here rather than have it repeat in HTable.
Allows me to remove protobuf references from a bunch of places.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/FlushRegionCallable.java
Make use of the push of boilerplate up into RegionServerCallable
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/MultiServerCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/PayloadCarryingServerCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionAdminServiceCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerWithReadReplicas.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/ScannerCallable.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/SecureBulkLoadClient.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/LoadIncrementalHFiles.java
Move boilerplate up into superclass.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetryingTimeTracker.java
Cleanup
M hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/PayloadCarryingRpcController.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALEditsReplaySink.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
Factor in TimeLimitedRpcController. Just have one RpcController override.
D hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/TimeLimitedRpcController.java
Removed. Lets have one override of pb rpccontroller only.
M hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
(handleRemoteException) added
(toText) added
Signed-off-by: stack <stack@apache.org>
2016-08-05 10:13:58 -07:00
431c8c9ad0
HBASE-8386 deprecate TableMapReduce.addDependencyJars(Configuration, class<?> ...)
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-08-05 10:35:02 -05:00
60b79e2daa
HBASE-16321 ensure no findbugs-jsr305
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2016-08-05 10:16:29 -05:00
4b3e45fceb
HBASE-16359 Addendum moves null checking as suggested by Heng
2016-08-05 03:18:28 -07:00
19c609fa5e
HBASE-16303 FilterList with MUST_PASS_ONE optimization (Ram)
2016-08-05 10:58:02 +05:30
5e23b3aad5
HBASE-16359 NullPointerException in RSRpcServices.openRegion()
2016-08-04 20:46:48 -07:00
975f0dd958
HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (Guanghao Zhang)
2016-08-04 12:40:19 -07:00
550b937bcf
HBASE-16287 LruBlockCache size should not exceed acceptableSize too many(Yu Sun)
2016-08-04 21:13:42 +08:00
0eaf3edc3a
HBASE-15574 Fix typo in HRegionServerCommandLine
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-03 23:43:33 -05:00
209b6f74c7
HBASE-16317 revert all ESAPI changes
...
Revert "HBASE-15270 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon."
This reverts commit bba4f107c168b300173f4b3e38705c3826894f89
2016-08-03 20:47:02 -07:00
81b06b3bdd
HBASE-16350 Undo server abort from HBASE-14968
2016-08-03 19:37:58 -07:00
bcf2738a01
HBASE-16301 Trigger flush without waiting when compaction is disabled on a table (huaxiang sun)
2016-08-02 18:46:07 -07:00
e63fb6c025
HBASE-16319 Fix TestCacheOnWrite after HBASE-16288
2016-08-02 16:53:32 -07:00
eef6a4834a
HBASE-16284 Unauthorized client can shutdown the cluster
2016-08-02 11:21:31 -07:00
b35cf8f93a
HBASE-16225 Refactor ScanQueryMatcher
2016-08-02 14:01:28 +08:00
78361243c8
HBASE-16296 Reverse scan performance degrades when using filter lists (Ted Yu)
2016-08-01 17:41:10 -07:00
aa0235f98c
HBASE-16288 HFile intermediate block level indexes might recurse forever creating multi TB files
2016-08-01 11:08:56 -07:00
7e6f562754
HBASE-16234 Expect and handle nulls when assigning replicas(Yi Liang)
2016-08-01 11:21:13 +08:00
3729320099
HBASE-16209 Removed unnecessary method and method calls from AssignmentManager and AssignmentManager UI (addendum)
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-07-29 16:05:00 -07:00
fe44383619
HBASE-16209 provide an ExponentialBackOffPolicy sleep between failed region open requests
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-29 09:47:00 -07:00
2b1cbeb28d
HBASE-16300 LruBlockCache.CACHE_FIXED_OVERHEAD should calculate LruBlockCache size correctly
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-07-29 14:29:01 +08:00
66fb697f81
HBASE-16275 Change ServerManager#onlineServers from ConcurrentHashMap to ConcurrentSkipListMap (Huaxiang Sun)
2016-07-28 11:13:58 -07:00
64804a0497
HBASE-16293 TestSnapshotFromMaster#testSnapshotHFileArchiving flakey (Huaxiang Sun)
2016-07-28 10:42:30 -07:00
00c2a5da7b
HBASE-16286 When TagRewriteCell are not copied to MSLAB, deep clone it while adding to Memstore.
2016-07-27 22:29:26 +05:30
bcf409e11f
HBASE-16280 Use hash based map in SequenceIdAccounting
2016-07-26 11:31:32 +08:00
0da8119fbc
HBASE-16281 TestMasterReplication is flaky
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-07-26 10:54:46 +08:00
abfd584fe6
HBASE-14743 Add metrics around HeapMemoryManager. (Reid Chan)
...
Change-Id: I7305f7b7034b216930b5fb5c57de9ba5eabf96d8
Signed-off-by: Apekshit Sharma <appy@apache.org>
2016-07-25 14:32:38 -07:00
eff38ccf8c
Revert HBASE-14743 because of wrong attribution. Since I added commit message to the raw patch, it's making me as author instead of Reid. I should have used --author flag to set Reid as author.
...
This reverts commit 064271da16
2016-07-25 14:32:38 -07:00
064271da16
HBASE-14743 Add metrics around HeapMemoryManager. (Reid Chan)
...
Change-Id: I60b2435355b3e605e7d91cbf5aca5d2988f26f33
2016-07-25 13:45:50 -07:00
2df0ef549a
HBASE-16205 When Cells are not copied to MSLAB, deep clone it while adding to Memstore.
2016-07-25 22:58:32 +05:30
6dbce2a8cb
HBASE-16266 Do not throw ScannerTimeoutException when catch UnknownScannerException
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-07-25 22:26:19 +08:00
bdd7782f05
HBASE-16008 A robust way deal with early termination of HBCK (Stephen Yuan Jiang)
2016-07-23 14:47:11 -07:00
cd0b85e0a8
Revert HBASE-15406: Split / merge switch left disabled after early termination of hbck (HBASE-16008 will address this issue)
2016-07-22 20:09:03 -07:00
744248c131
HBASE-16096 Properly remove the replication queue and peer znodes after calling ReplicationSourceManager.removePeer().
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-22 18:11:41 -07:00
03fe257a64
HBASE-16221 Have ThriftScanner update the ConnectionCache's last used time overtime getScannerRow() to keep the connection alive for long lived scanners
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-22 17:58:39 -07:00
cc766df28b
HBASE-16272 Overflow in ServerName's compareTo method (Huaxiang Sun)
2016-07-22 15:28:04 -07:00
519f87fc2b
HBASE-15291 Revert due to race condition resulting in closed FileSystem error
2016-07-21 18:51:47 -07:00
65834a1ced
HBASE-16217 Pass through the calling user in ObserverContext
2016-07-21 16:45:09 -07:00
9d740f7b8b
HBASE-16263 Move all to do w/ protobuf -- *.proto files and generated classes -- under hbase-protocol
...
Signed-off-by: stack <stack@apache.org>
2016-07-21 10:02:05 -07:00
ce657d5911
HBASE-13701 Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load -- addendum
2016-07-20 13:28:01 -07:00
70f330dc84
Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load
2016-07-19 19:53:10 -07:00
5051ab4e70
HBASE-16244 LocalHBaseCluster start timeout should be configurable (Siddharth Wagle)
2016-07-19 14:12:47 -07:00
638ca24f01
HBASE-14552 (addendum) Procedure V2: Reimplement DispatchMergingRegionHandler (add nonce support) (Stephen Yuan Jiang)
2016-07-19 08:49:23 -07:00
515c499f95
HBASE-16110 AsyncFS WAL doesn't work with Hadoop 2.8+
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-07-18 06:54:20 -05:00
a1cc2c4bfe
HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely
...
(cherry picked from commit a8dfd8c436
2016-07-18 06:48:17 -05:00
a0aa017ae9
Revert "Replication queue's lock will live forever if RS acquiring the lock has died prematurely"
...
This reverts commit a8dfd8c436
2016-07-18 06:47:56 -05:00
cf0f4f72d9
HBASE-16076 Cannot configure split policy in HBase shell
2016-07-18 10:28:05 +08:00
a8dfd8c436
Replication queue's lock will live forever if RS acquiring the lock has died prematurely
2016-07-18 09:32:36 +08:00
9bc7ecfb9d
HBASE-16235 Addendum uses hfile count of 20 (ChiaPing)
2016-07-16 16:07:11 -07:00
60847a2d76
HBASE-3727 MultiHFileOutputFormat (yi liang)
2016-07-15 21:07:12 -07:00
66c68f8ea3
HBASE-16235 TestSnapshotFromMaster#testSnapshotHFileArchiving will fail if there are too many hfiles (ChiaPing Tsai)
2016-07-15 15:07:14 -07:00
3978aa3af0
HBASE-13823 Procedure V2: remove unnecessaery operaions on AssignmentManager#recoverTableInDisablingState() and recoverTableInEnablingState() (Stephen Yuan Jiang)
2016-07-15 12:26:31 -07:00
f04eeecffc
HBASE-14552 Procedure V2: Reimplement DispatchMergingRegionHandler (Stephen Yuan Jiang)
2016-07-15 07:06:53 -07:00
28d8609e5d
HBASE-16233 Procedure V2: Support acquire/release shared table lock concurrently (Stephen Yuan Jiang)
2016-07-14 21:32:59 -07:00
243fe287b9
HBASE-16219 addendum move MasterMetaBootstrap to the right place
2016-07-15 09:58:17 +08:00
a55af38689
HBASE-16219 Move meta bootstrap out of HMaster
2016-07-14 06:14:53 -07:00
a07892558b
HBASE-16095 Add priority to TableDescriptor and priority region open thread pool
2016-07-13 18:19:59 -07:00
3b3c3dc02d
HBASE-16195 Should not add chunk into chunkQueue if not using chunk pool in HeapMemStoreLAB
2016-07-13 09:33:24 +08:00
911706a873
HBASE-16220 Demote log level for "HRegionFileSystem - No StoreFiles for" messages to TRACE
2016-07-12 15:44:06 -07:00
f292048ffd
HBASE-16208 Check that the row exists before attempting to remove a queue from TableBasedReplicationQueuesImpl
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-12 14:50:07 -07:00
90ba723dc6
HBASE-16214 Add in a UI description for the Replication Table
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-12 12:21:55 -07:00
2650711e94
HBASE-16207 can't restore snapshot without "Admin" permission
2016-07-12 05:50:06 -07:00
ccf293d7fb
HBASE-16081 Wait for Replication Tasks to complete before killing the ThreadPoolExecutor inside of HBaseInterClusterReplicationEndpoint
...
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-07-11 17:34:12 -07:00
3b5fbf8d73
HBASE-16160 Support RPC encryption with direct ByteBuffers (Colin Ma via garyh)
2016-07-11 10:33:22 -07:00
356c130702
HBASE-16194 Should count in MSLAB chunk allocation into heap size change when adding duplicate cells, addendum
2016-07-11 22:44:32 +08:00
0875c35781
HBASE-16185 TestReplicationSmallTests fails in master branch (Phil Yang)
2016-07-10 23:28:32 -07:00
9cf012cd00
HBASE-16194 Should count in MSLAB chunk allocation into heap size change when adding duplicate cells
2016-07-10 13:45:17 +08:00
496fd9837a
HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove
...
TimeRangeTracker as point of contention when many threads reading a StoreFile
Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken
scanning because of a side effect of a clean up in HBASE-15650 to make
TimeRange construction consistent exposed a latent issue in
TimeRange#compare. See HBASE-16074 for more detail.
Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
Call through to next constructor (if minStamp was 0, we'd skip setting
allTime=true). Add asserts that timestamps are not < 0 cos it messes
us up if they are (we already were checking for < 0 on construction but
assert passed in timestamps are not < 0).
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
Add constructor override that takes a TimeRangeTracker (set when flushing
but not when compacting)
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
Add override creating an HFile in tmp that takes a TimeRangeTracker
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
Add override for HFile Writer that takes a TimeRangeTracker Take it on
construction instead of having it passed by a setter later (flags and
reference set by the setter were not volatile... could have been prob
in concurrent case)
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
Log WARN if bad initial TimeRange value (and then 'fix' it)
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 18:20:31 -07:00
3c39cbd92c
HBASE-16201 NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication
2016-07-09 02:02:00 +08:00
1578a045b6
Revert "NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication"
...
This reverts commit a33097e067
2016-07-09 02:01:43 +08:00
5e0d97e0e9
HBASE-16171 Fix the potential problems in TestHCM.testConnectionCloseAllowsInterrupt (Colin Ma)
2016-07-08 10:18:36 -07:00
a33097e067
NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication
2016-07-09 01:05:10 +08:00
581d2b7de5
HBASE-16162 Compacting Memstore : unnecessary push of active segments to pipeline.
2016-07-06 18:54:35 +05:30
ae92668dd6
HBASE-16087 Replication shouldn't start on a master if if only hosts system tables
2016-07-05 13:50:37 -07:00
20a99b4c06
HBASE-16144 Revert - test failure in TestMultiSlaveReplication#testMultiSlaveReplication seems to be related
2016-07-05 13:19:33 -07:00
318751cfd6
HBASE-16091 Canary takes lot more time when there are delete markers in the table (Vishal Khandelwal)
2016-07-05 11:13:48 -07:00
d016338e45
HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai)
2016-07-05 10:21:27 -07:00
b5cdb38dc7
HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely (Phil Yang)
2016-07-05 07:16:12 -07:00
7f44dfd85f
HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin)
2016-07-04 21:45:04 +08:00
6944a17ad4
HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted
2016-07-04 19:26:27 +08:00
d22c23c396
HBASE-16163 Compacting Memstore : CompactionPipeline#addFirst can use LinkedList#addFirst.
2016-07-03 21:35:29 +05:30
97f2294bfd
HBASE-16164 Missing close of new compacted segments in few occasions which might leak MSLAB chunks from pool.
2016-07-02 11:42:08 +05:30
561eb82968
HBASE-15844 We should respect hfile.block.index.cacheonwrite when write intermediate index Block
2016-07-02 09:04:15 +08:00
fe75edb556
HBASE-16157 Revert - ChiaPing has new fix
2016-07-01 13:00:05 -07:00
d92a99da0e
HBASE-16125 RegionMover uses hardcoded, Unix-style tmp folder - breaks Windows (Vladimir Rodionov)
2016-07-01 10:02:25 -07:00
5a7c9939cb
HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai)
2016-07-01 09:43:39 -07:00
cc73c03118
HBASE-16108 RowCounter should support multiple key ranges (Konstantin Ryakhovskiy)
2016-07-01 03:41:17 -07:00
139f0ed53c
HBASE-16155 Compacting Memstore : Few log improvements.
2016-07-01 10:14:07 +05:30
d1d8cc71c9
HBASE-16150 Remove ConcurrentIndex (Hiroshi Ikeda)
2016-06-30 15:03:32 -07:00
e2566eb0ee
HBASE-16153 Correct the config name
...
'hbase.memestore.inmemoryflush.threshold.factor' (Ram)
2016-06-30 17:44:08 +05:30
e1d130946b
HBASE-16117 Fix Connection leak in mapred.TableOutputFormat
2016-06-29 17:18:43 -07:00
42106b89b1
HBASE-16114 Get regionLocation of required regions only for MR jobs (Thiruvel Thirumoolan)
2016-06-29 16:34:44 -07:00
9b1ecb31f0
HBASE-16143 Change MemstoreScanner constructor to accept
...
List<KeyValueScanner> (Ram)
2016-06-29 23:10:55 +05:30
727394c2e9
HBASE-16140 bump owasp.esapi from 2.1.0 to 2.1.0.1
2016-06-29 08:51:00 -07:00
6fb0dd07a8
HBASE-16139 Use CellUtil instead of KeyValueUtil in Import (NIDHI GAMBHIR)
2016-06-29 02:45:00 -07:00
432868b038
HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache. - Addendum
2016-06-29 16:31:23 +08:00
394e7224a9
HBASE-16122 PerformanceEvaluation should provide user friendly hint when client threads argument is missing (Konstantin Ryakhovskiy)
2016-06-28 17:42:51 -07:00
8bc4d4131c
HBASE-16121 Require only MasterServices to the ServerManager constructor
2016-06-28 07:42:40 -07:00
e768c4afac
HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache.
2016-06-28 13:45:41 +08:00
13cf4fb3fc
HBASE-16052 Improve HBaseFsck Scalability (Ben Lau)
2016-06-27 13:24:35 -07:00
424b789e03
HBASE-14007 Writing to table through MR should fail upfront if table does not exist/is disabled (Thiruvel Thirumoolan)
2016-06-27 06:41:00 -07:00
ba9286911f
HBASE-16109 Add Interface audience annotation to a few classes
2016-06-27 06:29:04 -07:00
fc4b8aa89d
HBASE-16089 Add on FastPath for CoDel
2016-06-25 12:57:15 -07:00
e8599a2921
HBASE-16103 Procedure v2 - TestCloneSnapshotProcedure relies on execution order
2016-06-24 09:09:59 -07:00
99dc300d37
HBASE-16055 PutSortReducer loses any Visibility/acl attribute set on the
...
Puts (Ram)
2016-06-24 15:09:53 +05:30
518faa735b
HBASE-15353 Add metric for number of CallQueueTooBigException's
2016-06-24 13:00:06 +08:00
68c1b34dbc
HBASE-16040 Remove configuration "hbase.replication"
2016-06-24 10:41:35 +08:00
f4cec2e202
HBASE-16085 Add a metric for failed compactions
2016-06-23 15:38:58 -07:00
9cd097cfac
HBASE-16090 ResultScanner is not closed in SyncTable#finishRemainingHashRanges()
2016-06-23 07:28:35 -07:00
d66316fd80
HBASE-16068 Procedure v2 - use consts for conf properties in tests
2016-06-22 22:48:07 -07:00
c1a559a666
HBASE-16070 Mapreduce Serialization classes do not have Interface audience
...
(Ram)
2016-06-23 10:22:24 +05:30
d297ecdf3c
HBASE-16083 Addendum fixes config property names in tests (Joseph Hwang)
2016-06-22 17:31:57 -07:00
0ea4d2f461
HBASE-16083 revert Addendum - Joseph discovered the mistake first
2016-06-22 17:31:24 -07:00
da09fd0781
HBASE-16083 Addendum fixes config property names in tests
2016-06-22 16:35:37 -07:00
f3b3a7c9b5
HBASE-16080 Fix flakey test TestTableBasedReplicationSourceManager.cleanupFailoverQueues().
...
Instead of running the primary test in a separate thread and hoping it finishes in time, just run the test in the primary thread.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-22 12:26:35 -07:00
6fc71c5d31
HBASE-16049 TestRowProcessorEndpoint is failing on Apache Builds (Guanghao Zhang)
2016-06-22 12:24:07 -07:00
2846113b59
HBASE-16012 Major compaction can't work due to obsolete scanner read point in RegionServer (Guanghao Zhang)
2016-06-22 02:08:45 -07:00
152594560e
HBASE-16036 Made Replication Table creation non-blocking.
...
All ReplicationTableBase method's that need to access the Replication Table will block until it is created though.
Also refactored ReplicationSourceManager so that abandoned queue adoption is run in the background too so that it does not block HRegionServer initialization.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-21 13:05:50 -07:00
b006e41a37
HBASE-16051 TestScannerHeartbeatMessages fails on some machines (Phil Yang)
2016-06-21 07:32:30 -07:00
471f942ec8
HBASE-16032 Possible memory leak in StoreScanner
2016-06-21 20:06:33 +08:00
3de0c63105
HBASE-16035 Nested AutoCloseables might not all get closed (Sean Mackrory)
2016-06-20 16:25:50 -07:00
313a3d23a8
HBASE-14644 Region in transition metric is broken -- addendum (Huaxiang Sun)
2016-06-20 10:46:25 -07:00
be56b5ae71
HBASE-16059 Region normalizer fails to trigger merge action where one of the regions is empty
2016-06-20 10:40:50 -07:00
095a82584e
HBASE-16062 Improper error handling in WAL Reader/Writer creation (Vladimir Rodionov)
2016-06-20 07:34:26 -07:00
71c8cd5b1f
HBASE-16042 Add support in PE tool for InMemory Compaction (Ram)
2016-06-20 16:29:24 +05:30
01684c3417
HBASE-16023 Fastpath for the FIFO rpcscheduler AMENDMENT
2016-06-20 08:34:32 +01:00
4421fdf981
HBASE-16066 Resolve RpC_REPEATED_CONDITIONAL_TEST findbugs warnings in HMaster, addendum to HBASE-15467
2016-06-19 17:25:26 +08:00
6717f0e388
HBASE-16058 TestHRegion fails on 1.4 builds
2016-06-17 18:41:51 -07:00
bdb0cc8808
HBASE-15467 Remove 1.x/2.0 TableDescriptor incompatibility
2016-06-17 17:25:04 -07:00
81a9c1ac31
HBASE-16053 Master code is not setting the table in ENABLING state in create table
2016-06-17 13:29:33 -07:00
61ff6ced5b
HBASE-16018 Refactored the ReplicationPeers interface to clear up what some methods do and move away from a ZooKeeper-specific implementation.
...
Also added some documentation for undocumented methods.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-17 13:04:21 -07:00
5147fb12a5
HBASE-16048 Tag InternalScanner with LimitedPrivate(HBaseInterfaceAudience.COPROC)
2016-06-17 07:27:52 -07:00
3abd52bdc6
HBASE-15429 Add split policy for busy regions
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-16 17:36:54 -07:00
6d0e0e3721
HBASE-5291 Addendum 2 passes correct path to deleteRecursively
2016-06-16 17:00:57 -07:00
d8902ba0e6
HBASE-16045 endtime argument for VerifyReplication was incorrectly specified in usage
2016-06-16 15:50:29 -07:00
62a4a2c029
HBASE-16047 TestFastFail is broken again
2016-06-16 14:09:48 -07:00
6d02f36ac7
HBASE-16033 Add more details in logging of responseTooSlow/TooLarge
2016-06-16 16:42:10 +08:00
f19f1d9e99
HBASE-15999 NPE in MemstoreCompactor (Ram)
2016-06-16 10:06:40 +05:30
1bad166f67
HBASE-5291 Addendum removes duplicate spnego (Josh Elser)
2016-06-15 14:59:17 -07:00
bff35d6387
HBASE-15950 Fix memstore size estimates to be more tighter
2016-06-15 13:34:39 -07:00
5f9d1a71c8
HBASE-16026 Master UI should display status of additional ZK switches
2016-06-15 12:59:24 -07:00
2093aadec1
HBASE-15974 Create a ReplicationQueuesClientHBaseImpl
...
Building on HBase-15958.
Provided a ReplicationQueuesClientHBaseImpl that relies on the HBase Replication Table to track WAL queues.
Refactored out a large section of ReplicationQueuesHBaseImpl into a ReplicationTableClient class that handles Replication Table operations.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-15 10:43:14 -07:00
ae5fe1e616
HBASE-5291 Add Kerberos HTTP SPNEGO authentication support to HBase web consoles (Josh Elser)
2016-06-15 09:26:44 -07:00
6c60bc9f6c
HBASE-16017 HBase TableOutputFormat has connection leak in getRecordWriter (Zhan Zhang)
2016-06-15 06:32:23 -07:00
db234bf15d
HBASE-16023 Fastpath for the FIFO rpcscheduler. addendum
2016-06-15 16:20:55 +08:00
ee86e91e7e
HBASE-16023 Fastpath for the FIFO rpcscheduler Adds an executor that does balanced queue and fast path handing off requests directly to waiting handlers if any present. Idea taken from Apace Kudu (incubating). See https://gerrit.cloudera.org/#/c/2938/7/src/kudu/rpc/service_queue.h
...
M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcExecutor.java
Refactor which makes a Handler type. Put all 'handler' stuff inside this
new type. Also make it so subclass can provide its own Handler type.
M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcScheduler.java
Name the handler threads for their type so can tell if configs are
having an effect.
Signed-off-by: stack <stack@apache.org>
2016-06-14 17:42:01 -07:00
fa50d456a8
HBASE-15971 Regression: Random Read/WorkloadC slower in 1.x than 0.98 Restore FIFO as the default in place of 'deadline' that sorted on request priority. The sort costs us throughput. Enable it if you want it rather than have it as default.
...
Name threads to include the scheduler type.
2016-06-14 16:51:24 -07:00
df24004353
HBASE-15746 Remove extra RegionCoprocessor preClose() in RSRpcServices#closeRegion (Stephen Yuan Jiang)
2016-06-14 13:30:41 -07:00
17bcf14fea
HBASE-15525 OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts.
2016-06-14 19:03:54 +05:30
e486d274c5
HBASE-16016 Fix overflow deadline value in AssignmentManager#waitForAssignment (Stephen Yuan Jiang)
2016-06-13 18:21:41 -07:00
56c209c8aa
HBASE-15991 CompactingMemstore#InMemoryFlushRunnable should implement
...
Comparable/Comparator (Ram)
2016-06-13 17:42:35 +05:30
2d0448fa84
Revert HBASE-15991 commit
2016-06-13 15:05:50 +05:30
2738518d43
HBASE-15991 CompactingMemstore#InMemoryFlushRunnable should implement
...
Comparable/Comparator (Ram)
2016-06-13 12:43:52 +05:30
6360cc0307
HBASE-16007 Job's Configuration should be passed to TableMapReduceUtil#addDependencyJars() in WALPlayer
2016-06-11 07:05:27 -07:00
4c885f4fdb
HBASE-14644 Region in transition metric is broken (Huaxiang Sun)
2016-06-10 21:52:24 -07:00
6da6babe4f
HBASE-15946. Eliminate possible security concerns in Store File metrics.
...
Invoking 'hbase hfile' inside a servlet raises several concerns. This
patch avoids invoking a separate process, and also adds validation that
the file being read is at least inside the HBase root directory.
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-06-09 16:08:19 -07:00
babdedc1b0
HBASE-15958 Implement ClaimQueues on top of HBase
...
Building on HBase-15883.
Now implementing the claim queues procedure within an HBase table.
Also added UnitTests to test claimQueue.
Peer tracking will still be performed by ZooKeeper though.
Also modified the queueId tracking procedure so we no longer have to perform scans over the Replication Table.
This does make our queue naming schema slightly different from ReplicationQueuesZKImpl though.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-09 15:05:54 -07:00
55a04b7810
HBASE-15990 The priority value of subsequent coprocessors in the Coprocessor.Priority.SYSTEM list are not incremented by one (ChiaPing Tsai)
2016-06-09 10:26:10 -07:00
9012a0b123
HBASE-15952 Bulk load data replication is not working when RS user does not have permission on hfile-refs node
2016-06-09 18:44:29 +05:30
031b745001
HBASE-15994 Allow selection of RpcSchedulers
...
Adds logging by the RpcExecutors of their run configs
Adds a FifoRpcSchedulerFactory so you can try Fifo scheduler.
2016-06-08 20:23:11 -07:00
407aa4d496
Revert "HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler"
...
This reverts commit 3ac4a57fd2
2016-06-08 20:22:50 -07:00
3ac4a57fd2
HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler
...
Signed-off-by: stack <stack@apache.org>
2016-06-08 20:20:50 -07:00
a7172d5611
HBASE-15959 Fix flaky test TestRegionServerMetrics.testMobMetrics (Huaxiang Sun and Jingcheng Du)
2016-06-08 19:07:13 -07:00
d9463bcce0
HBASE-15989 Remove hbase.online.schema.update.enable
2016-06-08 13:09:31 -07:00
d5d9b7d500
HBASE-15107 Procedure v2 - Procedure Queue with Region locks
2016-06-08 12:52:58 -07:00
d05a3722c8
HBASE-15600 Add provision for adding mutations to memstore or able to write to same region in batchMutate coprocessor hooks (Rajeshbabu and Enis)
2016-06-07 20:12:51 -07:00
3a95552cfe
HBASE-15948 Port "HADOOP-9956 RPC listener inefficiently assigns connections to readers" Adds HADOOP-9955 RPC idle connection closing is extremely inefficient
...
Changes how we do accounting of Connections to match how it is done in Hadoop.
Adds a ConnectionManager class. Adds new configurations for this new class.
"hbase.ipc.client.idlethreshold" 4000
"hbase.ipc.client.connection.idle-scan-interval.ms" 10000
"hbase.ipc.client.connection.maxidletime" 10000
"hbase.ipc.client.kill.max", 10
"hbase.ipc.server.handler.queue.size", 100
The new scheme does away with synchronization that purportedly would freeze out
reads while we were cleaning up stale connections (according to HADOOP-9955)
Also adds in new mechanism for accepting Connections by pulling in as many
as we can at a time adding them to a Queue instead of doing one at a time.
Can help when bursty traffic according to HADOOP-9956. Removes a blocking
while Reader is busy parsing a request. Adds configuration
"hbase.ipc.server.read.connection-queue.size" with default of 100 for
queue size.
Signed-off-by: stack <stack@apache.org>
2016-06-07 16:42:21 -07:00
e66ecd7db6
Revert "HBASE-15948 Port "HADOOP-9956 RPC listener inefficiently assigns connections to readers""
...
Revert mistaken commit...
This reverts commit e0b70c00e7
2016-06-07 16:41:30 -07:00
6d5a25935e
Revert "HBASE-15967 Metric for active ipc Readers and make default fraction of cpu count"
...
Revert mistaken commit
This reverts commit 1125215aad
2016-06-07 16:41:01 -07:00
1125215aad
HBASE-15967 Metric for active ipc Readers and make default fraction of cpu count
...
Add new metric hbase.regionserver.ipc.runningReaders
Also make it so Reader count is a factor of processor count
2016-06-07 13:10:14 -07:00
e0b70c00e7
HBASE-15948 Port "HADOOP-9956 RPC listener inefficiently assigns connections to readers"
...
Adds HADOOP-9955 RPC idle connection closing is extremely inefficient
Then removes queue added by HADOOP-9956 at Enis suggestion
Changes how we do accounting of Connections to match how it is done in Hadoop.
Adds a ConnectionManager class. Adds new configurations for this new class.
"hbase.ipc.client.idlethreshold" 4000
"hbase.ipc.client.connection.idle-scan-interval.ms" 10000
"hbase.ipc.client.connection.maxidletime" 10000
"hbase.ipc.client.kill.max", 10
"hbase.ipc.server.handler.queue.size", 100
The new scheme does away with synchronization that purportedly would freeze out
reads while we were cleaning up stale connections (according to HADOOP-9955)
Also adds in new mechanism for accepting Connections by pulling in as many
as we can at a time adding them to a Queue instead of doing one at a time.
Can help when bursty traffic according to HADOOP-9956. Removes a blocking
while Reader is busy parsing a request. Adds configuration
"hbase.ipc.server.read.connection-queue.size" with default of 100 for
queue size.
2016-06-07 13:10:14 -07:00
376ad0d986
HBASE-15698 Increment TimeRange not serialized to server (Ted Yu)
2016-06-06 22:17:00 -07:00
3d7840a173
HBASE-15954 REST server should log requests with TRACE instead of DEBUG
2016-06-06 10:58:37 -07:00
de1b5ff776
HBASE-15955 Disable action in CatalogJanitor#setEnabled should wait for active cleanup scan to finish (Stephen Yuan Jiang)
2016-06-03 15:49:23 -07:00
21e98271c3
HBASE-15883 Adding WAL files and tracking offsets in HBase.
...
Implemented ReplicationQueuesHBaseImpl that tracks WAL offsets and replication queues in an HBase table.
Only wrote the basic tracking methods, have not implemented claimQueue() or HFileRef methods yet.
Wrote a basic unit test for ReplicationQueueHBaseImpl that tests the implemented functions on a single Region Server
Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-03 15:23:10 -07:00
9a53d8b385
HBASE-15929 There are two tests named TestRegionServerMetrics. This causes slight issues when parsing console output for hanging tests and flaky tests analysis. Moving .../hbase/TestRegionServerMetrics.java to .../hbase/regionserver/TestRegionServerReadRequestMetrics.java. (Apekshit)
...
Change-Id: I379c15fe2c2c01bed53bddf7619d5f2a07c5640e
2016-06-03 15:13:49 -07:00
b557f0bec6
HBASE-15949 Cleanup TestRegionServerMetrics.
...
@Before and @After to setup/teardown tables using @Rule to set table name based on testname.
Refactor out copy-pasted code fragments to single function.
(Apekshit)
Change-Id: Ic22e5027cc3952bab5ec30070ed20e98017db65a
2016-06-03 14:27:24 -07:00
f0c159b5fe
HBASE-15927 Remove HMaster.assignRegion()
2016-06-03 12:36:25 -07:00
0cbce07626
HBASE-15888 Extend HBASE-12769 for bulk load data replication
2016-06-03 18:42:00 +05:30
fc890a2ecb
HBASE-15881 Allow BZIP2 compression.
2016-06-02 12:19:02 -07:00
7e5d530870
HBASE-15727 Canary Tool for Zookeeper (churro morales)
2016-06-02 10:15:08 -07:00
cd2588001c
HBASE-15933 Addendum - make merge decision when sizes of both regions are known
2016-06-02 09:30:36 -07:00
cfe868d56e
HBASE-15933 NullPointerException may be thrown from SimpleRegionNormalizer#getRegionSize()
2016-06-02 01:55:28 -07:00
1a27278624
HBASE-15915 Set timeouts on hanging tests. Tests run: 8, Time elapsed: 94.191 sec - in org.apache.hadoop.hbase.master.procedure.TestMasterFailoverWithProcedures Tests run: 103, Time elapsed: 69.057 sec - in org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 103, Time elapsed: 67.957 sec - in org.apache.hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush Tests run: 5, Time elapsed: 34.629 sec - in org.apache.hadoop.hbase.regionserver.TestRegionMergeTransactionOnCluster Tests run: 9, Time elapsed: 82.913 sec - in org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient Tests run: 9, Time elapsed: 80.458 sec - in org.apache.hadoop.hbase.snapshot.TestMobFlushSnapshotFromClient (Apekshit)
...
Change-Id: Ia7b986ca6276ff5498f588c0b1b9c570e2a9d798
Signed-off-by: stack <stack@apache.org>
2016-05-30 21:13:55 -07:00
e6d613de70
HBASE-15835 - Prevent HBaseTestingUtility#startMiniCluster from throwing _HMasterAddress already in use_ RuntimeException when another HBase thread is running
...
Signed-off-by: stack <stack@apache.org>
2016-05-30 20:05:19 -07:00
a1f0c1cbb3
HBASE-15875 Remove HTable references and HTableInterface
...
Signed-off-by: stack <stack@apache.org>
2016-05-30 19:56:54 -07:00
cdd532da8a
HBASE-15610 Remove deprecated HConnection for 2.0 thus removing all PB references for 2.0
...
Signed-off-by: stack <stack@apache.org>
2016-05-29 07:50:55 -07:00
f4470af95d
HBASE-15891. Closeable resources potentially not getting closed if exception is thrown.
...
Signed-off-by: stack <stack@apache.org>
2016-05-28 21:32:22 -07:00
3b6e6e6c25
HBASE-15889. String case conversions are locale-sensitive, used without locale
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-28 10:41:31 -07:00
60c8f76a9d
HBASE-15908 Checksum verification is broken due to incorrect passing of ByteBuffers in DataChecksum (Mikhail Antonov and Appy)
2016-05-28 03:14:52 -07:00
da0d74cd27
HBASE-15830 SASL encryption doesn't work with AsyncRpcChannelImpl (Colin Ma)
2016-05-26 21:58:27 -07:00
43d1a999fe
HBASE-15837 Memstore size accounting is wrong if postBatchMutate() throws exception
2016-05-26 11:12:17 -07:00
94696d4067
HBASE-14635 Fix flaky test TestSnapshotCloneIndependence
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-05-25 21:14:06 -07:00
b3362ccb0c
HBASE-15471 Added in Priority, General, and Replication queue sizes for RegionServers to the Web UI
...
Changed UI labels so that queue "size" refers to size in bytes and queue "length" refers to number of items in queue.
Signed-off-by: Elliott Clark <elliott@fb.com>
2016-05-25 15:10:48 -07:00
fa74baeb40
HBASE-15884 NPE in StoreFileScanner#skipKVsNewerThanReadpoint during reverse scan (Sergey Soldatov)
2016-05-25 08:58:28 -07:00
39dc19236e
HBASE-15806 revert due to discussion on security
2016-05-24 02:08:11 -07:00
c03ea895c4
HBASE-15806 An endpoint-based export tool (ChiaPing Tsai)
2016-05-23 10:51:25 -07:00
7130a222ce
HBASE-15876 Remove doBulkLoad(Path hfofDir, final HTable table) though it has not been through a full deprecation cycle
...
Signed-off-by: stack <stack@apache.org>
2016-05-23 10:25:22 -07:00
ae42c65cfd
HBASE-15802 ConnectionUtils should use ThreadLocalRandom instead of Random (Matt Warhaftig)
2016-05-21 21:15:10 -07:00
56e4b85d06
HBASE-14818 user_permission does not list namespace permissions (li xiang)
2016-05-21 20:06:05 -07:00
0671cba65f
HBASE-15529 Override needBalance in StochasticLoadBalancer (Guanghao Zhang)
2016-05-21 04:03:00 -07:00
0e52ac2464
HBASE-15228 Add the methods to RegionObserver to trigger start/complete restoring WALs. (Toshihiro Suzuki)
2016-05-21 09:56:28 +05:30
2bb07e209e
HBASE-15529 Revert due to TestRegionRebalancing failing
2016-05-20 12:56:17 -07:00
4793988aef
HBASE-15856 Don't cache unresolved addresses for connections
2016-05-20 09:36:11 -07:00
58798fc091
HBASE-15529 Override needBalance in StochasticLoadBalancer (Guanghao Zhang)
2016-05-20 07:44:05 -07:00
d34f5d4b96
HBASE-15865 Move TestTableDeleteFamilyHandler and TestTableDescriptorModification handler tests to procedure
2016-05-20 07:03:11 -07:00
7a84ee262f
HBASE-15864 Reuse the testing helper to wait regions in transition
2016-05-20 06:48:38 -07:00
a27504c701
HBASE-14920: Compacting memstore
...
Signed-off-by: stack <stack@apache.org>
2016-05-20 03:41:43 -07:00
af5146ee04
HBASE-15465 userPermission returned by getUserPermission() for the selected namespace does not have namespace set (li xiang)
2016-05-19 20:35:58 -07:00
a050e1d9f8
HBASE-15847 VerifyReplication prefix filtering (Geoffrey Jacoby)
2016-05-19 06:38:27 -07:00
460b41c800
HBASE-15617 Canary in regionserver mode might not enumerate all regionservers
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-05-18 16:25:29 -07:00
8aa8abfcb6
HBASE-15850 Localize the configuration change in testCheckTableLocks to reduce flakiness of TestHBaseFsck test suite (Stephen Yuan Jiang)
2016-05-18 13:22:41 -07:00
5ac54e6abb
HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set
2016-05-18 12:48:26 -07:00
393bcd69f9
HBASE-15841 Performance Evaluation tool total rows may not be set correctly
2016-05-18 12:09:13 -07:00
Matteo Bertozzi
tedyu
Nitin Aggarwal
anoopsamjohn
Phil Yang
zhangduo
chenheng
Andrew Purtell
binlijin
Jerry He
Loknath Priyatham Teja Singamsetty
Stephen Yuan Jiang
Enis Soztutar
Ashish Singhi
Geoffrey
Ramkrishna
Esteban Gutierrez
Apekshit Sharma
Yu Li
stack
Vivek
Sean Busbey
Lim Chee Hau
Nick Dimiduk
Deokwoo Han
Joseph Hwang
Yu Sun
Reid Chan
Gary Helmling
Elliott Clark
Jonathan M Hsieh
Jingcheng Du
Ashu Pachauri
Mikhail Antonov
Sean Mackrory
Apekshit
Lars Hofhansl
Daniel Vimont
Jurriaan Mous
eshcar
Vincent