Commit Graph

4975 Commits

Author SHA1 Message Date
Andrew Purtell 0f6a2c4113 HBASE-17924 Consider sorting the row order when processing multi() ops before taking rowlocks
(Allan Yang)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2017-05-08 17:04:50 -07:00
Allan Yang 9a97e28bdf HBASE-17471 Region Seqid will be out of order in WAL if using mvccPreAssign
Signed-off-by: Yu Li <liyu@apache.org>
2017-05-06 23:29:49 +08:00
zhangduo 408645c4ef HBASE-18000 Make sure we always return the scanner id with ScanResponse
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-05 11:49:07 -07:00
tedyu dd321c4a35 HBASE-17991 Add more details about compaction queue on /dump (Guangxu Cheng) 2017-05-04 08:28:02 -07:00
Jingyun Tian a5f52360f6 HBASE-17993 Delete useless info log in RpcServer.processResponse
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-05-04 20:59:10 +08:00
Chinmay Kulkarni e08277ac8f Addendum patch for HBASE-12870. Added check for null pointer.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-03 14:03:27 -07:00
Guanghao Zhang 9f25836d99 HBASE-17958 Avoid passing unexpected cell to ScanQueryMatcher when optimize SEEK to SKIP 2017-05-03 21:39:30 +08:00
ckulkarni d2fcfd74d9 HBASE-12870 "Major compaction triggered" and "Skipping major compaction" messages lack the region information
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-02 10:54:37 -07:00
Allan Yang 262c66f614 HBASE-17757 Unify blocksize after encoding to decrease memory fragment
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
2017-05-02 10:06:33 +05:30
QilinCao 9a71bacdf0 HBASE-17835 Spelling mistakes in the Java source
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-28 11:40:47 -05:00
Steen Manniche 0f5932b059 HBASE-17817 add table name to output (if available) when removing coprocessors
Amending-Author: Sean Busbey <busbey@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-28 11:39:54 -05:00
huaxiang sun cdda1d0302 HBASE-17904 Get runs into NoSuchElementException when using Read Replica, with hbase. ipc.client.specificThreadForWriting to be true and hbase.rpc.client.impl to be org.apache.hadoop.hbase.ipc.RpcClientImpl
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-04-28 06:53:37 +08:00
Guanghao Zhang aca4eb8d5c HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (addendum for branch-1) 2017-04-27 17:08:21 +08:00
Karan Mehta 78c64c360f HBASE-17965 Canary tool should print the regionserver name on failure
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestCanaryTool.java
2017-04-26 18:25:31 -07:00
zhangduo cbae657632 HBASE-17956 Raw scan should ignore TTL 2017-04-26 15:34:14 +08:00
tedyu 5f1691d06e HBASE-17302 The region flush request disappeared from flushQueue - addendum (Guangxu Cheng) 2017-04-22 15:09:29 -07:00
Abhishek Singh Chouhan d69a6366f6 HBASE-17937 Memstore size becomes negative in case of expensive postPut/Delete Coprocessor call
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-04-21 08:50:53 +08:00
zhangduo c8c2e07aa1 HBASE-17930 Avoid using Canary.sniff in HBaseTestingUtility 2017-04-18 18:17:38 +08:00
gjacoby a26de9b51e HBASE-17912 - Avoid major compactions on region server startup
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-17 19:43:03 -07:00
Xiang Li cb2f2a7d1b HBASE-17916 Error message not clear when the permission of staging dir
is not as expected

Signed-off-by: Michael Stack <stack@apache.org>
2017-04-14 08:12:09 -07:00
qgxiaozhan 1afb86a1c1 HBASE-17816 HRegion#mutateRowWithLocks should update writeRequestCount metric
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-04-11 18:08:06 -07:00
Nemo Chen 4030facc99 HBASE-16469 Several log refactoring/improvement suggestions
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-11 14:28:47 -05:00
Tomu Tsuruhara a6e9de3a0e HBASE-17871 scan#setBatch(int) call leads wrong result of VerifyReplication
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-06 07:00:36 -07:00
Yi Liang 4057a6c89c HBASE-17861: Regionserver down when checking the permission of staging dir if hbase.rootdir is on S3
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-04 07:22:31 -07:00
Karan Mehta 19e4e4d49a HBASE-17698 ReplicationEndpoint choosing sinks
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-03-31 16:31:29 -07:00
Ramkrishna 589a0e2efb HBASE-17837 Backport HBASE-15314 to branch-1.3 (Chunhui shen & Ram)) 2017-03-30 17:03:36 +05:30
tedyu d0139a8777 HBASE-17287 Master becomes a zombie if filesystem object closes 2017-03-29 04:50:49 -07:00
Ashu Pachauri babb857940 HBASE-16755 Honor flush policy under global memstore pressure
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-27 11:48:17 -07:00
Chia-Ping Tsai 006bfc7054 HBASE-17623 Reuse the bytes array when building the hfile block 2017-03-25 23:51:14 +08:00
zhangduo 849ab5ff29 HBASE-17595 addendum fix the problem for mayHaveMoreCellsInRow 2017-03-23 20:35:12 +08:00
tedyu 9726c71681 HBASE-17798 RpcServer.Listener.Reader can abort due to CancelledKeyException (Guangxu Cheng) 2017-03-21 08:06:56 -07:00
zhangduo b973d3fd46 HBASE-17584 Expose ScanMetrics with ResultScanner rather than Scan 2017-03-20 16:32:20 +08:00
Chia-Ping Tsai 02d9bf0c57 HBASE-17803 PE always re-creates table when we specify the split policy 2017-03-19 19:10:24 +08:00
Michael Stack d1ea718e43 HBASE-17501 Revert "Revert "guard against NPE while reading FileTrailer and HFileBlock""
This reverts commit e92a147e19.

This is a revert of a revert -- i.e. a restore -- just so I can change
the commit message to add the JIRA number.
2017-03-16 14:56:04 -07:00
Michael Stack e92a147e19 Revert "guard against NPE while reading FileTrailer and HFileBlock"
This reverts commit c97905a962.

This is a revert just so I can add the JIRA number to the commit
message.
2017-03-16 14:55:41 -07:00
zhangduo 094e9a311b HBASE-16584 Backport the new ipc implementation in HBASE-16432 to branch-1 2017-03-16 23:00:30 +08:00
tedyu 318298047b HBASE-17779 disable_table_replication returns misleading message and does not turn off replication (Janos Gub) 2017-03-14 12:34:04 -07:00
James Moore c97905a962 guard against NPE while reading FileTrailer and HFileBlock
guard against NPE from FSInputStream#seek

Signed-off-by: Michael Stack <stack@apache.org>
2017-03-13 14:53:57 -07:00
Guanghao Zhang 759d63b15c HBASE-17773 VerifyReplication tool wrongly emits Invalid arguments error (Tom Tsuruhara) 2017-03-13 17:53:43 +08:00
Guanghao Zhang 531598d67f HBASE-17746 TestSimpleRpcScheduler.testCoDelScheduling is broken 2017-03-13 11:10:33 +08:00
zhangduo dc84c7b9a7 HBASE-17712 Addendum modify log message 2017-03-10 16:01:45 +08:00
Stephen Yuan Jiang 7dfb3b3194 HBASE-17764 Solve TestMultiSlaveReplication flakiness (Stephen Yuan Jiang) 2017-03-09 18:38:57 -08:00
Ashu Pachauri 20cb390529 HBASE-15429 Add split policy for busy regions
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-09 17:33:53 -08:00
Andrew Purtell 0bc9ad0628 HBASE-17731 Fractional latency reporting in MultiThreadedAction 2017-03-09 16:54:38 -08:00
Ashu Pachauri 598dd9bb0e HBASE-16977 VerifyReplication should log a printable representation of the row keys
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-09 16:36:10 -08:00
Umesh Agashe 3d9520b140 HBASE-17761: Test TestRemoveRegionMetrics.testMoveRegion fails intermittently because of race condition
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-03-09 14:26:10 -08:00
Esteban Gutierrez c70769ea89 HBASE-15941 HBCK repair should not unsplit healthy splitted region
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-08 22:03:47 -08:00
Michael Stack ca5b8a44a4 HBASE-17718 Difference between RS's servername and its ephemeral node cause SSH stop working
This patch reverts HBASE-9593 -- i.e. registering in zk before we
register with master putting it back to how it was where we register
in zk AFTER we report for duty with the master (because then we'll
register in zk with the name the master gave us). It then fixes the
problem reported in HBASE-9593 in an alternate fashion by checking
for a RS znode if we failed a connect on assign; if none found, we
remove a server from online servers list.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Make move method available to tests.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
 Correct method name changing moveFromOnelineToDeadServers to
 moveFromOnlineToDeadServers

 Add actual fix which is call to checkForRSznode if exception trying to
 open a region; if none found, call expire on the server so it gets
 removed from the list of online servers.

 This patch exposes sloppyness in the waitForRegionServers around our
 current case where Master is hosting regions but ONLY hbase:meta;
 in this case we need to wait on at least another server to report
 in beyond Master (we weren't but stuff was 'working' because of the
 early registration of RS nodes in zk).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 Make 'killed' available to tests.

 Put registry of ephemeral node back to where it was originally,
 so it is AFTER we get response from Master on registering for duty
 so we can put our znode up in zk with the name the Master gave us
 rather than local name (which could be unknown to the Master).
   private boolean stopping = false;

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRSKilledWhenInitializing.java
 Cleanup and test of new cleanup.
2017-03-08 10:47:53 -08:00
tedyu f34709e1b7 HBASE-17460 enable_table_replication can not perform cyclic replication of a table (Janos Gub) 2017-03-08 01:27:35 -08:00
zhangduo dcaa9bd715 HBASE-17712 Remove/Simplify the logic of RegionScannerImpl.handleFileNotFound 2017-03-08 14:51:11 +08:00
Karan Mehta 5f630935bb HBASE-17716 Formalize Scan Metric names
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-07 07:42:40 -08:00
Phil Yang f45d261902 HBASE-15484 Correct the semantic of batch and partial - amend to fix bug and revise the JavaDoc for related APIs. 2017-03-07 22:42:58 +08:00
Phil Yang 6afe696e53 HBASE-15484 Correct the semantic of batch and partial 2017-03-07 12:04:09 +08:00
Andrew Purtell ccf1f17d78 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging
Conflicts:
	hbase-spark/src/test/resources/log4j.properties
2017-03-03 12:35:21 -08:00
tedyu 88f909cf1f HBASE-17710 HBase in standalone mode creates directories with 777 permission 2017-03-02 11:33:36 -08:00
dvdreddy f64a52a0c2 HBASE-16630 Fragmentation in long running Bucket Cache
Bug Fix : Added Memory block type also to the list of
evictions that need to happen when there is a needForExtra

Improvement : Inorder to fix the non availabilty of Buckets and force
the movement of buckets to transformed sizes, whenever we encounter a
situation where an allocation cant be made for a BucketSize, we will
forcefully free the entire buckets that have least occupancy ratio. This
is the same strategy used by MemCached when they encounter a similar
issue going by the name 'Slab Calcification'. Only improvement is that
we use a heuristic to evict from the buckets that are least occupied
and also avoid the BucketSizes where there is a single Bucket

Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
2017-03-01 18:10:54 +05:30
Ramkrishna bef27396e5 Revert "HBASE-16630 Handle Fragmentation in bucket cache"
This reverts commit 779f9cb07f.
2017-03-01 11:41:02 +05:30
dvdreddy 779f9cb07f HBASE-16630 Handle Fragmentation in bucket cache
Currently whenever a compaction/bulkload happen and the
blocks are evicted from theirs buckets the buckets become
fragmented and are not available to be used by other
BucketSizes

Bug Fix : Added Memory block type also to the list of
evictions that need to happen when there is a needForExtra

Improvement : Inorder to fix the non availabilty of Buckets and force
the movement of buckets to transformed sizes, whenever we encounter a
situation where an allocation cant be made for a BucketSize, we will
forcefully free the entire buckets that have least occupancy ratio. This
is the same strategy used by MemCached when they encounter a similar
issue going by the name 'Slab Calcification'. Only improvement is that
we use a heuristic to evict from the buckets that are least occupied
and also avoid the BucketSizes where there is a single Bucket

Change-Id: I9e3b4deb8d893953003ddf5f1e66312ed97ea9cb

Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
2017-03-01 10:37:22 +05:30
tedyu 7d38e6126a HBASE-17673 Monitored RPC Handler not shown in the WebUI (Allan Yang) 2017-02-28 07:44:35 -08:00
Jingcheng Du 2131c79552 HBASE-17688 MultiRowRangeFilter not working correctly if given same start and stop RowKey 2017-02-28 12:15:38 +08:00
Jan Hentschel ec84118c97 HBASE-17634 Cleaned up the usage of Result.isPartial
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-27 20:45:58 +08:00
tedyu 8528e82875 HBASE-17674 Major compaction may be cancelled in CompactionChecker (Guangxu Cheng) 2017-02-25 16:33:34 -08:00
Ashu Pachauri 4b8195f22c HBASE-17057 Minor compactions should also drop page cache (Ashu Pachauri)
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-24 15:31:36 -08:00
Abhishek Singh Chouhan b0780bdc63 HBASE-17682 Region stuck in merging_new state indefinitely
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-23 15:19:13 -08:00
zhangduo 3e2a6784c7 HBASE-17595 Add partial result support for small/limited scan 2017-02-23 16:10:10 +08:00
Sean Busbey 7917314477 HBASE-17677 Just the new tests from 'ServerName parsing from directory name should be more robust to errors.'
Signed-off-by: Michael Stack <stack@apache.org>
2017-02-22 21:23:11 -06:00
Ashu Pachauri a373445730 HBASE-17590 Drop cache hint should work on store file write path (Ashu Pachauri)
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-22 13:37:12 -08:00
Sean Busbey a404bfa0c2 HBASE-17561 table status page should escape values that may contain arbitrary characters.
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-02-21 23:22:55 -06:00
Joao Girao e7efa23d07 HBASE-13718 added columns schema to table description in web view
Summary:
 * added a new table "Table Schema" on the table description page
 * per column, list all the key/values on the column description

Test Plan:
 * mvn test # and wait..
 * create a new table using hbase shell:
   * create 'mytesttable', {NAME=>'CF1'}, {NAME=>'CF2'}
 * open http://localhost:16010/table.jsp?name=mytesttable
 * check the "Table Schema" appears and lists the columns correctly

Reviewers: eclark, vicka.dudin

Differential Revision: https://reviews.facebook.net/D38649

Signed-off-by: Elliott Clark <eclark@apache.org>
2017-02-21 23:22:55 -06:00
Phil Yang f5ae21ea32 HBASE-17210 Set timeout on trying rowlock according to client's RPC timeout 2017-02-22 11:43:47 +08:00
rgidwani 27a8aa99d9 HBASE-17675 ReplicationEndpoint should choose new sinks if a SaslException occurs
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-21 18:45:15 -08:00
Sean Busbey cdb38830d7 HBASE-15328 sanity check the redirect used to send master info requests to the embedded regionserver.
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-02-21 09:05:31 -06:00
huzheng 45357c078d HBASE-17472: Correct the semantic of permission grant
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-20 20:24:09 +08:00
ChiaPing Tsai 964e17f7b0 HBASE-17661 fix the queue length passed to FastPathBalancedQueueRpcExecutor
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-19 13:26:24 -08:00
Tim Brown 6b96b0ce85 HBASE-17658 Fix bookkeeping error with max regions for a table
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-17 07:42:21 -08:00
Yi Liang b141603e2e HBASE-17648: HBase Table-level synchronization fails between two secured(kerberized) cluster
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-17 07:04:35 -08:00
Abhishek Singh Chouhan 4038917239 HBASE-17069 RegionServer writes invalid META entries for split daughters in some circumstances
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-16 15:36:33 +08:00
zhangduo f835d1efc2 HBASE-17583 Add inclusive/exclusive support for startRow and endRow of scan for sync client 2017-02-15 10:18:58 +08:00
Phil Yang 0a25bf5b3f HBASE-17639 Do not stop server if ReplicationSourceManager's waitUntilCanBePushed throws InterruptedException 2017-02-14 17:48:49 +08:00
Sean Busbey d7c304573f HBASE-17558 ZK dumping jsp should escape HTML.
Signed-off-by: Enis Soztutar <enis@apache.org>
2017-02-13 23:49:12 -05:00
rgidwani 4588bdee9f HBASE-17609 Allow for region merging in the UI
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-09 14:06:48 -08:00
tedyu 52c51fc271 HBASE-17265 Region left unassigned in master failover when region failed to open (Allan Yang) 2017-02-09 12:43:37 -08:00
Ajay Jadhav 67fe516ec9 HBASE-17280 Add mechanism to control hbase cleaner behavior
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-09 12:18:42 -08:00
zhangduo e9abe07629 HBASE-17599 Use mayHaveMoreCellsInRow instead of isPartial 2017-02-09 15:38:23 +08:00
Jerry He f61b840a31 HBASE-15437 Response size calculated in RPCServer for warning tooLarge responses does NOT count CellScanner payload 2017-02-08 17:21:56 -08:00
Zach York 8f6388503b HBASE-17437 Support specifying a WAL directory outside of the root directory (Yishan Yang and Zach York)
HBASE-17588 Remove unused imports brought in by HBASE-17437 (Zach York)

Signed-off-by: Enis Soztutar <enis@apache.org>
2017-02-08 15:01:59 -08:00
Enis Soztutar 753169a3af HBASE-17105 Annotate RegionServerObserver 2017-02-08 13:35:29 -08:00
huzheng 8574934f59 HBASE-17381 ReplicationSourceWorkerThread can die due to unhandled exceptions (huzheng)
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-07 17:33:42 -08:00
tedyu a75e5a5435 HBASE-17275 Assign timeout may cause region to be unassigned forever (Allan yang) 2017-02-07 12:57:07 -08:00
tedyu 0553290c6a HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum - addendum resets min cost 2017-02-07 12:24:54 -08:00
tedyu 5a0020e867 HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum 2017-02-07 06:26:12 -08:00
tedyu 0a0aef345a HBASE-17264 Processing RIT with offline state will always fail to open the first time (Allan Yang) 2017-02-06 19:48:14 -08:00
zhangduo f708d986a0 HBASE-17597 TestMetaWithReplicas.testMetaTableReplicaAssignment is flaky 2017-02-07 09:51:46 +08:00
Enis Soztutar 7cac85b667 HBASE-17187 DoNotRetryExceptions from coprocessors should bubble up to the application 2017-02-06 13:39:09 -08:00
tedyu 35e4eb7a7a HBASE-17601 close() in TableRecordReaderImpl assumes the split has started (Michael Axiak) 2017-02-06 10:33:05 -08:00
zhangduo 4456d22859 HBASE-17508 Unify the implementation of small scan and regular scan for sync client 2017-02-05 08:49:51 +08:00
Zach York cd847e599c HBASE-17587 Do not Rethrow DoNotRetryIOException as UnknownScannerException
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-02 17:09:34 -08:00
tedyu f59cf6f02e HBASE-16621 HBCK should have -fixHFileLinks (Janos Gub) 2017-02-02 07:31:35 -08:00
Sean Busbey fab0b2e603 Addendum HBASE-17522 missed some branch-1 specific direct uses of MemoryMXBean 2017-02-01 11:32:13 -06:00
Sean Busbey 3d4639f34d HBASE-17522 Handle JVM throwing runtime exceptions when we ask for details on heap usage the same as a correctly returned 'undefined'.
Signed-off-by: Michael Stack <stack@apache.org>

 Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/io/util/HeapMemorySizeUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheConfig.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java
2017-02-01 10:38:29 -06:00
gjacoby 3aac1b6884 HBASE-17543 - Create additional ReplicationEndpoint WALEntryFilters by configuration
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-01-31 16:16:20 -08:00
Sukumar Maddineni c937e97864 HBASE-17540 Change SASL server GSSAPI callback log line from DEBUG to TRACE in RegionServer
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-01-27 15:13:56 -08:00
tedyu 3dc03ccfb7 HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer - revert due to pending discussion 2017-01-26 10:46:03 -08:00
tedyu a0fac0894b HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer (Tim Brown) 2017-01-25 20:36:48 -08:00
tedyu ed023058d2 HBASE-17519 Rollback the removed cells (ChiaPing Tsai) 2017-01-25 06:29:56 -08:00
tedyu 19f9a1a643 HBASE-17462 Use sliding window for read/write request costs in StochasticLoadBalancer (Tim Brown) 2017-01-23 14:55:40 -08:00
tedyu 50ecbf1c8a HBASE-17510 DefaultMemStore gets the wrong heap size after rollback (ChiaPing Tsai) 2017-01-23 09:30:39 -08:00
tedyu 6e0f3f5bbc HBASE-17504 The passed durability of Increment is ignored when syncing WAL (ChiaPing Tsai) 2017-01-22 08:44:11 -08:00
zhangduo 57409371a0 HBASE-17489 ClientScanner may send a next request to a RegionScanner which has been exhausted 2017-01-22 16:39:14 +08:00
Dave Navarro c64236584b HBASE-17357 FIX PerformanceEvaluation parameters parsing triggers NPE.
check command name is not null, if null print usage and exit

Signed-off-by: Michael Stack <stack@apache.org>
2017-01-20 22:53:23 -08:00
Michael Stack f7d1d25fd7 HBASE-17488 WALEdit should be lazily instantiated (ChiaPing Tsai) 2017-01-20 09:38:55 -08:00
tedyu abc8c5edd3 HBASE-17494 Guard against cloning family of all cells if no data need be replicated (ChiaPing Tsai) 2017-01-19 16:21:17 -08:00
tedyu 0e06ade694 HBASE-17469 Properly handle empty TableName in TablePermission#readFields and #write (Manjunath Anand) 2017-01-17 09:38:50 -08:00
Michael Stack 354e213852 HBASE-17464 Fix HBaseTestingUtility.getNewDataTestDirOnTestFS to always return a unique path 2017-01-13 17:53:48 -08:00
tedyu ee66ab8e29 HBASE-17450 TablePermission#equals throws NPE after namespace support was added (huzheng) 2017-01-13 09:39:06 -08:00
tedyu 49b5a6e803 HBASE-17452 Failed taking snapshot - region Manifest proto-message too large (huaxiang sun) 2017-01-13 09:00:15 -08:00
tedyu 56f963f4a6 HBASE-17445 Count size of serialized exceptions in checking max result size quota 2017-01-11 10:06:40 -08:00
tedyu 2f7ce65b81 HBASE-17429 HBase bulkload cannot support HDFS viewFs (shenxianqiang) 2017-01-09 18:53:39 -08:00
Michael Stack 6130ea4d54 HBASE-12148 Remove TimeRangeTracker as point of contention when many threads writing a Store (Huaxiang Sun) 2017-01-09 13:35:20 -08:00
tedyu 9b26c9ff37 HBASE-17435 Call to preCommitStoreFile() hook encounters SaslException in secure deployment 2017-01-09 08:53:17 -08:00
Ashish Singhi e8e40d8625 HBASE-17290 Potential loss of data for replication of bulk loaded hfiles 2017-01-06 16:57:52 +05:30
rahul gidwani 667c5eb3a0 HBASE-16710 Add ZStandard Codec to Compression.java
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-01-05 10:47:12 -08:00
Jan Hentschel a9bac6a496 HBASE-17390 Added master and backup masters to online update of configuration
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-01-04 22:25:22 -08:00
Josh Elser 4dcb07f996 HBASE-17409 Limit jsonp callback name to prevent xss 2017-01-04 19:36:24 -05:00
tedyu 36f16bbe10 HBASE-17387 Reduce the overhead of exception report in RegionActionResult for multi() 2016-12-29 19:23:44 -08:00
tedyu cec40f941f HBASE-17374 ZKPermissionWatcher crashed when grant after region close (Liu Junhong) 2016-12-29 05:46:40 -08:00
Stephen Yuan Jiang ce33cf2d3d HBASE-17149 Procedure V2 - Fix nonce submission to avoid unnecessary calling coprocessor multiple times (Matteo Bertozzi) 2016-12-28 15:43:50 -08:00
Stephen Yuan Jiang d4b2627916 HBASE-17238 Wrong in-memory hbase:meta location causing SSH failure (Stephen Yuan jiang) 2016-12-28 13:53:22 -08:00
Phil Yang 29e390c808 HBASE-17314 Limit total buffered size for all replication sources 2016-12-23 12:17:39 +08:00
Phil Yang dd0206ff31 Revert "HBASE-17314 Limit total buffered size for all replication sources"
This reverts commit e9444ed077.
2016-12-22 19:08:17 +08:00
tedyu 819d32f951 HBASE-17330 SnapshotFileCache will always refresh the file cache (Jianwei Cui) 2016-12-22 02:30:41 -08:00
tedyu f94180a3e9 HBASE-17341 Add a timeout during replication endpoint termination (Vincent Poon) 2016-12-21 08:27:45 -08:00
Phil Yang e9444ed077 HBASE-17314 Limit total buffered size for all replication sources 2016-12-21 13:10:29 +08:00
Vincent e79afbf0cb HBASE-17328 Properly dispose of looped replication peers
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMasterReplication.java
2016-12-20 18:01:33 -08:00
tedyu fa975fa382 HBASE-17347 ExportSnapshot may write snapshot info file to wrong directory when specifying target name (Jianwei Cui) 2016-12-20 15:58:28 -08:00
tedyu 0b69f59133 HBASE-17292 Add observer notification before bulk loaded hfile is moved to region directory 2016-12-20 13:23:27 -08:00
tedyu b9689808eb HBASE-17344 The regionserver web UIs miss the coprocessors of RegionServerCoprocessorHost (ChiaPing Tsai) 2016-12-20 08:55:07 -08:00
Guanghao Zhang 97d1ba4015 HBASE-17317 [branch-1] The updatePeerConfig method in ReplicationPeersZKImpl didn't update the table-cfs map 2016-12-20 18:51:26 +08:00
binlijin 4c7f0f2436 HBASE-17332 Replace HashMap to Array for DataBlockEncoding.idToEncoding 2016-12-20 12:28:04 +08:00
binlijin ed39396497 HBASE-16398 optimize HRegion computeHDFSBlocksDistribution 2016-12-16 13:57:43 +08:00
tedyu f3a3069796 HBASE-17319 Truncate table with preserve after split may cause truncation to fail (Allan Yang) 2016-12-15 13:45:11 -08:00
tedyu ffe70158cc HBASE-17318 Increment does not add new column if the increment amount is zero at first time writing (Guangxu Cheng) 2016-12-15 08:45:05 -08:00
Guanghao Zhang 4b3df0f926 HBASE-17296 Provide per peer throttling for replication
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
2016-12-15 16:13:04 +08:00
tedyu e029c554bb HBASE-17302 The region flush request disappeared from flushQueue (Guangxu Cheng) 2016-12-13 12:46:42 -08:00
tedyu 1f9214bee7 HBASE-17297 Single Filter in parenthesis cannot be parsed correctly (Xuesen Liang) 2016-12-12 12:09:22 -08:00
tedyu 30576991bc HBASE-17289 Avoid adding a replication peer named "lock" 2016-12-12 09:38:55 -08:00
Josh Elser f13283bc05 HBASE-17276 Only log stacktraces for exceptions once for updates in a batch
For large batches of updates, repeatedly logging WrongRegionExceptions,
FailedSanityCheckExceptions, and/or NoSuchColumnFamilyExceptions can
easily dominate the contents of a RegionServer log. After the first
occurence of logging the full exception, switch to logging only the
message on the exception.
2016-12-11 15:40:22 -05:00
tedyu d87b05f040 HBASE-16336 Removing peers seems to be leaving spare queues (Guanghao Zhang) 2016-12-11 07:43:10 -08:00
Stephen Yuan Jiang e51584381a HBASE-17023 Region left unassigned due to AM and SSH each thinking others would do the assignment work (Stephen Yuan Jiang) 2016-12-10 15:05:00 -08:00
tedyu c2801a2ea8 HBASE-17256 Rpc handler monitoring will be removed when the task queue is full (Guangxu Cheng) 2016-12-05 12:14:20 -08:00
Ashu Pachauri cbdc9fcb8a Addendum HBASE-16209: Add an ExponentialBackOffPolicy so that we spread out the timing of open region retries in AssignmentManager.
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-12-02 10:30:28 +08:00
Guanghao Zhang 682dd57cd6 HBASE-17205 Add a metric for the duration of region in transition 2016-12-01 10:32:24 -08:00
Jonathan M Hsieh 9da0d5d00e HBASE-17224 Fix lots of spelling errors in HBase logging and exception messages (Grant Sohn) 2016-12-01 09:10:03 -08:00
zhangduo c8ea82299c HBASE-17206 FSHLog may roll a new writer successfully with unflushed entries 2016-12-01 14:20:38 +08:00
Yu Li b3627ef51e HBASE-17212 Should add null checker on table name in HTable and RegionServerCallable constructor (addendum) 2016-12-01 13:32:33 +08:00
Guanghao Zhang f26b3bf5ba HBASE-17178 Add region balance throttling
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
2016-11-30 18:07:02 +08:00
zhangduo af69783128 HBASE-17167 Pass mvcc to client when scan 2016-11-30 10:02:17 +08:00
Ashu Pachauri b8da9f83cb HBASE-16302 age of last shipped op and age of last applied op should be histograms
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2016-11-29 13:54:28 +05:30
Guanghao Zhang 7b2673db12 HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-11-29 16:09:56 +08:00
zhangduo be042652aa Revert "HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count"
Forget to add signoff

This reverts commit 5ec218dbc2.
2016-11-29 16:09:22 +08:00
Guanghao Zhang 5ec218dbc2 HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count 2016-11-29 16:00:37 +08:00
Stephen Yuan Jiang cdf539a8e0 HBASE-17189 TestMasterObserver#wasModifyTableActionCalled uses wrong variables (Stephen Yuan Jiang) 2016-11-28 23:18:42 -08:00
Michael Stack 987205caf9 HBASE-17072 CPU usage starts to climb up to 90-100% when using G1GC
Removes ThreadLocal. Uses AtomicReference instead (based on patch
posted up in HBASE-10676 "Removing ThreadLocal of PrefetchedHeader in
HFileBlock.FSReaderV2 make higher perforamce of scan")

Signed-off-by: Michael Stack <stack@apache.org>
2016-11-28 13:41:17 -08:00
Jerry He 10c070825f HBASE-17116 [PerformanceEvaluation] Add option to configure block size (Yi Liang) 2016-11-27 19:13:08 -08:00
Jingcheng Du fb1ace490c HBASE-17095 The ClientSimpleScanner keeps retrying if the hfile is corrupt or cannot found 2016-11-22 11:26:57 +08:00
binlijin 2da5ed098e HBASE-17118 StoreScanner leaked in KeyValueHeap (addendum) 2016-11-21 20:55:52 +08:00
tedyu e8f056935b HBASE-17131 Avoid livelock caused by HRegion#processRowsWithLocks (ChiaPing Tsai) 2016-11-20 18:17:21 -08:00
Guanghao Zhang 3c45ff08d9 HBASE-17088 Refactor RWQueueRpcExecutor/BalancedQueueRpcExecutor/RpcExecutor
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-11-19 14:18:06 +08:00
Esteban Gutierrez 19441937ea HBASE-17058 Lower epsilon used for jitter verification from HBASE-15324 2016-11-17 12:29:08 -08:00
tedyu c6f1b6e624 HBASE-17112 Prevent setting timestamp of delta operations the same as previous value's (Phil Yang) 2016-11-17 09:04:39 -08:00
tedyu d722b2aab7 HBASE-17118 StoreScanner leaked in KeyValueHeap (binlijin) 2016-11-17 08:46:11 -08:00
Andrew Purtell e54826434e HBASE-17044 Fix merge failed before creating merged region leaves meta inconsistent 2016-11-14 17:14:48 -08:00
tedyu b77bfe9d3b HBASE-17077 Don't copy the replication queue belonging to the peer which has been deleted (Guanghao Zhang) 2016-11-13 07:00:25 -08:00
tedyu 469462c850 HBASE-17062 RegionSplitter throws ClassCastException (Jeongdae Kim) 2016-11-11 07:18:22 -08:00
thiruvel 44ab659b93 HBASE-16962: Add readPoint to preCompactScannerOpen() and preFlushScannerOpen() API
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
2016-11-11 11:09:55 +05:30
Yu Sun 18b31fdd32 HBASE-17020 keylen in midkey() dont computed correctly
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-11 08:01:00 +08:00
Guanghao Zhang a6397e3b0c HBASE-16938 TableCFsUpdater maybe failed due to no write permission on peerNode
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-11-10 14:07:20 -08:00
binlijin dac73eceb0 HBASE-16570 Compute region locality in parallel at startup (addendum)
Addendum mainly for:
1. Avoid interfering with block location cache in RegionLocationFinder
2. Avoid refreshing block lcoations during HMaster startup (or else the startup could be really slow)

Signed-off-by: Yu Li <liyu@apache.org>
2016-11-10 16:53:39 +08:00
Guanghao Zhang e929156f96 HBASE-16985 TestClusterId failed due to wrong hbase rootdir
Signed-off-by: Michael Stack <stack@apache.org>
2016-11-09 17:19:31 -08:00
tedyu 1e322e68a5 HBASE-17054 Compactor#preCreateCoprocScanner should be passed user 2016-11-09 07:00:19 -08:00
Charlie Qiangeng Xu d248d6b0b3 HBASE-17039 SimpleLoadBalancer schedules large amount of invalid region moves
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-09 17:07:28 +08:00
Enis Soztutar 123d26ed90 HBASE-17017 Remove the current per-region latency histogram metrics 2016-11-08 18:31:12 -08:00
Michael Stack a70f73c1e1 HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to create region directory: /tmp/... (Addendum by Guanghao Zhang) 2016-11-08 11:59:49 -08:00
tedyu 97276da9a7 HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang) 2016-11-08 06:35:12 -08:00
Stephen Yuan Jiang 874cf5128f HBASE-17042 Remove 'public' keyword from MasterObserver interface (Stephen Yuan Jiang) 2016-11-07 17:51:44 -08:00
Enis Soztutar b99690ac6b HBASE-17033 LogRoller makes a lot of allocations unnecessarily 2016-11-07 14:31:30 -08:00
anoopsamjohn 2fdba6521d HBASE-16992 The usage of mutation from CP is weird. (ChiaPing Tsai) 2016-11-07 23:26:27 +05:30
tedyu ecd4de938b HBASE-17026 VerifyReplication log should distinguish whether good row key is result of revalidation 2016-11-07 07:41:55 -08:00
binlijin c4132bbf30 HBASE-16840 Reuse cell's timestamp and type in ScanQueryMatcher
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-07 22:42:46 +08:00
Yu Li a67481209f Revert "HBASE-16840 Reuse cell's timestamp and type in ScanQueryMatcher" to update author
This reverts commit 4d8611fa0f.
2016-11-07 22:42:38 +08:00
Yu Li 4d8611fa0f HBASE-16840 Reuse cell's timestamp and type in ScanQueryMatcher
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-07 21:38:03 +08:00
Mikhail Antonov 3063943c78 HBASE-17032 CallQueueTooBigException and CallDroppedException should not be triggering PFFE 2016-11-06 21:34:11 -08:00
tedyu 8ade73c0cb HBASE-16946 Provide Raw scan as an option in VerifyReplication (Sreekar Pallapothu) 2016-11-04 03:36:17 -07:00
binlijin 5bfec397d1 HBASE-16960 RegionServer hang when aborting
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-04 14:08:42 +08:00
Apekshit Sharma 51ba7cfde3 HBASE-17006 Give name to existing threads.
Having thread names in logs and thread dumps greatly improve debugability. This patch is simply adding the names to the threads we spawn.

Change-Id: I6ff22cc3804bb81147dde3a8e9ab671633c6f6ce
2016-11-03 18:31:03 -07:00
Eddie Elizondo b4676d51ad HBASE-14329 Report region in transition should check all regions in request
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-11-03 11:32:19 -07:00
Gary Helmling 4fe51ebaa7 HBASE-16964 Always clear successfully archived files from compacted files list 2016-11-03 09:28:22 -07:00
Yu Li 514add0086 HBASE-16972 Log more details for Scan#next request when responseTooSlow 2016-11-02 14:33:44 +08:00
Andrew Purtell 961b952171 HBASE-16980 TestRowProcessorEndpoint failing consistently (Yu Li) 2016-11-01 19:09:17 -07:00
Lars Hofhansl 6113f9a34f HBASE-16765 New SteppingRegionSplitPolicy, avoid too aggressive spread of regions for small tables. 2016-11-01 13:07:12 -07:00