Andrew Purtell
0f6a2c4113
HBASE-17924 Consider sorting the row order when processing multi() ops before taking rowlocks
...
(Allan Yang)
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2017-05-08 17:04:50 -07:00
Allan Yang
9a97e28bdf
HBASE-17471 Region Seqid will be out of order in WAL if using mvccPreAssign
...
Signed-off-by: Yu Li <liyu@apache.org>
2017-05-06 23:29:49 +08:00
zhangduo
408645c4ef
HBASE-18000 Make sure we always return the scanner id with ScanResponse
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-05 11:49:07 -07:00
tedyu
dd321c4a35
HBASE-17991 Add more details about compaction queue on /dump (Guangxu Cheng)
2017-05-04 08:28:02 -07:00
Jingyun Tian
a5f52360f6
HBASE-17993 Delete useless info log in RpcServer.processResponse
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-05-04 20:59:10 +08:00
Chinmay Kulkarni
e08277ac8f
Addendum patch for HBASE-12870. Added check for null pointer.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-03 14:03:27 -07:00
Guanghao Zhang
9f25836d99
HBASE-17958 Avoid passing unexpected cell to ScanQueryMatcher when optimize SEEK to SKIP
2017-05-03 21:39:30 +08:00
ckulkarni
d2fcfd74d9
HBASE-12870 "Major compaction triggered" and "Skipping major compaction" messages lack the region information
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-02 10:54:37 -07:00
Allan Yang
262c66f614
HBASE-17757 Unify blocksize after encoding to decrease memory fragment
...
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
2017-05-02 10:06:33 +05:30
QilinCao
9a71bacdf0
HBASE-17835 Spelling mistakes in the Java source
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-28 11:40:47 -05:00
Steen Manniche
0f5932b059
HBASE-17817 add table name to output (if available) when removing coprocessors
...
Amending-Author: Sean Busbey <busbey@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-28 11:39:54 -05:00
huaxiang sun
cdda1d0302
HBASE-17904 Get runs into NoSuchElementException when using Read Replica, with hbase. ipc.client.specificThreadForWriting to be true and hbase.rpc.client.impl to be org.apache.hadoop.hbase.ipc.RpcClientImpl
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-04-28 06:53:37 +08:00
Guanghao Zhang
aca4eb8d5c
HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (addendum for branch-1)
2017-04-27 17:08:21 +08:00
Karan Mehta
78c64c360f
HBASE-17965 Canary tool should print the regionserver name on failure
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestCanaryTool.java
2017-04-26 18:25:31 -07:00
zhangduo
cbae657632
HBASE-17956 Raw scan should ignore TTL
2017-04-26 15:34:14 +08:00
tedyu
5f1691d06e
HBASE-17302 The region flush request disappeared from flushQueue - addendum (Guangxu Cheng)
2017-04-22 15:09:29 -07:00
Abhishek Singh Chouhan
d69a6366f6
HBASE-17937 Memstore size becomes negative in case of expensive postPut/Delete Coprocessor call
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-04-21 08:50:53 +08:00
zhangduo
c8c2e07aa1
HBASE-17930 Avoid using Canary.sniff in HBaseTestingUtility
2017-04-18 18:17:38 +08:00
gjacoby
a26de9b51e
HBASE-17912 - Avoid major compactions on region server startup
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-17 19:43:03 -07:00
Xiang Li
cb2f2a7d1b
HBASE-17916 Error message not clear when the permission of staging dir
...
is not as expected
Signed-off-by: Michael Stack <stack@apache.org>
2017-04-14 08:12:09 -07:00
qgxiaozhan
1afb86a1c1
HBASE-17816 HRegion#mutateRowWithLocks should update writeRequestCount metric
...
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-04-11 18:08:06 -07:00
Nemo Chen
4030facc99
HBASE-16469 Several log refactoring/improvement suggestions
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-11 14:28:47 -05:00
Tomu Tsuruhara
a6e9de3a0e
HBASE-17871 scan#setBatch(int) call leads wrong result of VerifyReplication
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-06 07:00:36 -07:00
Yi Liang
4057a6c89c
HBASE-17861: Regionserver down when checking the permission of staging dir if hbase.rootdir is on S3
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-04 07:22:31 -07:00
Karan Mehta
19e4e4d49a
HBASE-17698 ReplicationEndpoint choosing sinks
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-03-31 16:31:29 -07:00
Ramkrishna
589a0e2efb
HBASE-17837 Backport HBASE-15314 to branch-1.3 (Chunhui shen & Ram))
2017-03-30 17:03:36 +05:30
tedyu
d0139a8777
HBASE-17287 Master becomes a zombie if filesystem object closes
2017-03-29 04:50:49 -07:00
Ashu Pachauri
babb857940
HBASE-16755 Honor flush policy under global memstore pressure
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-27 11:48:17 -07:00
Chia-Ping Tsai
006bfc7054
HBASE-17623 Reuse the bytes array when building the hfile block
2017-03-25 23:51:14 +08:00
zhangduo
849ab5ff29
HBASE-17595 addendum fix the problem for mayHaveMoreCellsInRow
2017-03-23 20:35:12 +08:00
tedyu
9726c71681
HBASE-17798 RpcServer.Listener.Reader can abort due to CancelledKeyException (Guangxu Cheng)
2017-03-21 08:06:56 -07:00
zhangduo
b973d3fd46
HBASE-17584 Expose ScanMetrics with ResultScanner rather than Scan
2017-03-20 16:32:20 +08:00
Chia-Ping Tsai
02d9bf0c57
HBASE-17803 PE always re-creates table when we specify the split policy
2017-03-19 19:10:24 +08:00
Michael Stack
d1ea718e43
HBASE-17501 Revert "Revert "guard against NPE while reading FileTrailer and HFileBlock""
...
This reverts commit e92a147e19
.
This is a revert of a revert -- i.e. a restore -- just so I can change
the commit message to add the JIRA number.
2017-03-16 14:56:04 -07:00
Michael Stack
e92a147e19
Revert "guard against NPE while reading FileTrailer and HFileBlock"
...
This reverts commit c97905a962
.
This is a revert just so I can add the JIRA number to the commit
message.
2017-03-16 14:55:41 -07:00
zhangduo
094e9a311b
HBASE-16584 Backport the new ipc implementation in HBASE-16432 to branch-1
2017-03-16 23:00:30 +08:00
tedyu
318298047b
HBASE-17779 disable_table_replication returns misleading message and does not turn off replication (Janos Gub)
2017-03-14 12:34:04 -07:00
James Moore
c97905a962
guard against NPE while reading FileTrailer and HFileBlock
...
guard against NPE from FSInputStream#seek
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-13 14:53:57 -07:00
Guanghao Zhang
759d63b15c
HBASE-17773 VerifyReplication tool wrongly emits Invalid arguments error (Tom Tsuruhara)
2017-03-13 17:53:43 +08:00
Guanghao Zhang
531598d67f
HBASE-17746 TestSimpleRpcScheduler.testCoDelScheduling is broken
2017-03-13 11:10:33 +08:00
zhangduo
dc84c7b9a7
HBASE-17712 Addendum modify log message
2017-03-10 16:01:45 +08:00
Stephen Yuan Jiang
7dfb3b3194
HBASE-17764 Solve TestMultiSlaveReplication flakiness (Stephen Yuan Jiang)
2017-03-09 18:38:57 -08:00
Ashu Pachauri
20cb390529
HBASE-15429 Add split policy for busy regions
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-09 17:33:53 -08:00
Andrew Purtell
0bc9ad0628
HBASE-17731 Fractional latency reporting in MultiThreadedAction
2017-03-09 16:54:38 -08:00
Ashu Pachauri
598dd9bb0e
HBASE-16977 VerifyReplication should log a printable representation of the row keys
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-09 16:36:10 -08:00
Umesh Agashe
3d9520b140
HBASE-17761: Test TestRemoveRegionMetrics.testMoveRegion fails intermittently because of race condition
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-03-09 14:26:10 -08:00
Esteban Gutierrez
c70769ea89
HBASE-15941 HBCK repair should not unsplit healthy splitted region
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-08 22:03:47 -08:00
Michael Stack
ca5b8a44a4
HBASE-17718 Difference between RS's servername and its ephemeral node cause SSH stop working
...
This patch reverts HBASE-9593 -- i.e. registering in zk before we
register with master putting it back to how it was where we register
in zk AFTER we report for duty with the master (because then we'll
register in zk with the name the master gave us). It then fixes the
problem reported in HBASE-9593 in an alternate fashion by checking
for a RS znode if we failed a connect on assign; if none found, we
remove a server from online servers list.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Make move method available to tests.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
Correct method name changing moveFromOnelineToDeadServers to
moveFromOnlineToDeadServers
Add actual fix which is call to checkForRSznode if exception trying to
open a region; if none found, call expire on the server so it gets
removed from the list of online servers.
This patch exposes sloppyness in the waitForRegionServers around our
current case where Master is hosting regions but ONLY hbase:meta;
in this case we need to wait on at least another server to report
in beyond Master (we weren't but stuff was 'working' because of the
early registration of RS nodes in zk).
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
Make 'killed' available to tests.
Put registry of ephemeral node back to where it was originally,
so it is AFTER we get response from Master on registering for duty
so we can put our znode up in zk with the name the Master gave us
rather than local name (which could be unknown to the Master).
private boolean stopping = false;
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRSKilledWhenInitializing.java
Cleanup and test of new cleanup.
2017-03-08 10:47:53 -08:00
tedyu
f34709e1b7
HBASE-17460 enable_table_replication can not perform cyclic replication of a table (Janos Gub)
2017-03-08 01:27:35 -08:00
zhangduo
dcaa9bd715
HBASE-17712 Remove/Simplify the logic of RegionScannerImpl.handleFileNotFound
2017-03-08 14:51:11 +08:00
Karan Mehta
5f630935bb
HBASE-17716 Formalize Scan Metric names
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-07 07:42:40 -08:00
Phil Yang
f45d261902
HBASE-15484 Correct the semantic of batch and partial - amend to fix bug and revise the JavaDoc for related APIs.
2017-03-07 22:42:58 +08:00
Phil Yang
6afe696e53
HBASE-15484 Correct the semantic of batch and partial
2017-03-07 12:04:09 +08:00
Andrew Purtell
ccf1f17d78
HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging
...
Conflicts:
hbase-spark/src/test/resources/log4j.properties
2017-03-03 12:35:21 -08:00
tedyu
88f909cf1f
HBASE-17710 HBase in standalone mode creates directories with 777 permission
2017-03-02 11:33:36 -08:00
dvdreddy
f64a52a0c2
HBASE-16630 Fragmentation in long running Bucket Cache
...
Bug Fix : Added Memory block type also to the list of
evictions that need to happen when there is a needForExtra
Improvement : Inorder to fix the non availabilty of Buckets and force
the movement of buckets to transformed sizes, whenever we encounter a
situation where an allocation cant be made for a BucketSize, we will
forcefully free the entire buckets that have least occupancy ratio. This
is the same strategy used by MemCached when they encounter a similar
issue going by the name 'Slab Calcification'. Only improvement is that
we use a heuristic to evict from the buckets that are least occupied
and also avoid the BucketSizes where there is a single Bucket
Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
2017-03-01 18:10:54 +05:30
Ramkrishna
bef27396e5
Revert "HBASE-16630 Handle Fragmentation in bucket cache"
...
This reverts commit 779f9cb07f
.
2017-03-01 11:41:02 +05:30
dvdreddy
779f9cb07f
HBASE-16630 Handle Fragmentation in bucket cache
...
Currently whenever a compaction/bulkload happen and the
blocks are evicted from theirs buckets the buckets become
fragmented and are not available to be used by other
BucketSizes
Bug Fix : Added Memory block type also to the list of
evictions that need to happen when there is a needForExtra
Improvement : Inorder to fix the non availabilty of Buckets and force
the movement of buckets to transformed sizes, whenever we encounter a
situation where an allocation cant be made for a BucketSize, we will
forcefully free the entire buckets that have least occupancy ratio. This
is the same strategy used by MemCached when they encounter a similar
issue going by the name 'Slab Calcification'. Only improvement is that
we use a heuristic to evict from the buckets that are least occupied
and also avoid the BucketSizes where there is a single Bucket
Change-Id: I9e3b4deb8d893953003ddf5f1e66312ed97ea9cb
Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
2017-03-01 10:37:22 +05:30
tedyu
7d38e6126a
HBASE-17673 Monitored RPC Handler not shown in the WebUI (Allan Yang)
2017-02-28 07:44:35 -08:00
Jingcheng Du
2131c79552
HBASE-17688 MultiRowRangeFilter not working correctly if given same start and stop RowKey
2017-02-28 12:15:38 +08:00
Jan Hentschel
ec84118c97
HBASE-17634 Cleaned up the usage of Result.isPartial
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-27 20:45:58 +08:00
tedyu
8528e82875
HBASE-17674 Major compaction may be cancelled in CompactionChecker (Guangxu Cheng)
2017-02-25 16:33:34 -08:00
Ashu Pachauri
4b8195f22c
HBASE-17057 Minor compactions should also drop page cache (Ashu Pachauri)
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-24 15:31:36 -08:00
Abhishek Singh Chouhan
b0780bdc63
HBASE-17682 Region stuck in merging_new state indefinitely
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-23 15:19:13 -08:00
zhangduo
3e2a6784c7
HBASE-17595 Add partial result support for small/limited scan
2017-02-23 16:10:10 +08:00
Sean Busbey
7917314477
HBASE-17677 Just the new tests from 'ServerName parsing from directory name should be more robust to errors.'
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-02-22 21:23:11 -06:00
Ashu Pachauri
a373445730
HBASE-17590 Drop cache hint should work on store file write path (Ashu Pachauri)
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-22 13:37:12 -08:00
Sean Busbey
a404bfa0c2
HBASE-17561 table status page should escape values that may contain arbitrary characters.
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-02-21 23:22:55 -06:00
Joao Girao
e7efa23d07
HBASE-13718 added columns schema to table description in web view
...
Summary:
* added a new table "Table Schema" on the table description page
* per column, list all the key/values on the column description
Test Plan:
* mvn test # and wait..
* create a new table using hbase shell:
* create 'mytesttable', {NAME=>'CF1'}, {NAME=>'CF2'}
* open http://localhost:16010/table.jsp?name=mytesttable
* check the "Table Schema" appears and lists the columns correctly
Reviewers: eclark, vicka.dudin
Differential Revision: https://reviews.facebook.net/D38649
Signed-off-by: Elliott Clark <eclark@apache.org>
2017-02-21 23:22:55 -06:00
Phil Yang
f5ae21ea32
HBASE-17210 Set timeout on trying rowlock according to client's RPC timeout
2017-02-22 11:43:47 +08:00
rgidwani
27a8aa99d9
HBASE-17675 ReplicationEndpoint should choose new sinks if a SaslException occurs
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-21 18:45:15 -08:00
Sean Busbey
cdb38830d7
HBASE-15328 sanity check the redirect used to send master info requests to the embedded regionserver.
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-02-21 09:05:31 -06:00
huzheng
45357c078d
HBASE-17472: Correct the semantic of permission grant
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-20 20:24:09 +08:00
ChiaPing Tsai
964e17f7b0
HBASE-17661 fix the queue length passed to FastPathBalancedQueueRpcExecutor
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-19 13:26:24 -08:00
Tim Brown
6b96b0ce85
HBASE-17658 Fix bookkeeping error with max regions for a table
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-17 07:42:21 -08:00
Yi Liang
b141603e2e
HBASE-17648: HBase Table-level synchronization fails between two secured(kerberized) cluster
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-17 07:04:35 -08:00
Abhishek Singh Chouhan
4038917239
HBASE-17069 RegionServer writes invalid META entries for split daughters in some circumstances
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-16 15:36:33 +08:00
zhangduo
f835d1efc2
HBASE-17583 Add inclusive/exclusive support for startRow and endRow of scan for sync client
2017-02-15 10:18:58 +08:00
Phil Yang
0a25bf5b3f
HBASE-17639 Do not stop server if ReplicationSourceManager's waitUntilCanBePushed throws InterruptedException
2017-02-14 17:48:49 +08:00
Sean Busbey
d7c304573f
HBASE-17558 ZK dumping jsp should escape HTML.
...
Signed-off-by: Enis Soztutar <enis@apache.org>
2017-02-13 23:49:12 -05:00
rgidwani
4588bdee9f
HBASE-17609 Allow for region merging in the UI
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-09 14:06:48 -08:00
tedyu
52c51fc271
HBASE-17265 Region left unassigned in master failover when region failed to open (Allan Yang)
2017-02-09 12:43:37 -08:00
Ajay Jadhav
67fe516ec9
HBASE-17280 Add mechanism to control hbase cleaner behavior
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-09 12:18:42 -08:00
zhangduo
e9abe07629
HBASE-17599 Use mayHaveMoreCellsInRow instead of isPartial
2017-02-09 15:38:23 +08:00
Jerry He
f61b840a31
HBASE-15437 Response size calculated in RPCServer for warning tooLarge responses does NOT count CellScanner payload
2017-02-08 17:21:56 -08:00
Zach York
8f6388503b
HBASE-17437 Support specifying a WAL directory outside of the root directory (Yishan Yang and Zach York)
...
HBASE-17588 Remove unused imports brought in by HBASE-17437 (Zach York)
Signed-off-by: Enis Soztutar <enis@apache.org>
2017-02-08 15:01:59 -08:00
Enis Soztutar
753169a3af
HBASE-17105 Annotate RegionServerObserver
2017-02-08 13:35:29 -08:00
huzheng
8574934f59
HBASE-17381 ReplicationSourceWorkerThread can die due to unhandled exceptions (huzheng)
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-07 17:33:42 -08:00
tedyu
a75e5a5435
HBASE-17275 Assign timeout may cause region to be unassigned forever (Allan yang)
2017-02-07 12:57:07 -08:00
tedyu
0553290c6a
HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum - addendum resets min cost
2017-02-07 12:24:54 -08:00
tedyu
5a0020e867
HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum
2017-02-07 06:26:12 -08:00
tedyu
0a0aef345a
HBASE-17264 Processing RIT with offline state will always fail to open the first time (Allan Yang)
2017-02-06 19:48:14 -08:00
zhangduo
f708d986a0
HBASE-17597 TestMetaWithReplicas.testMetaTableReplicaAssignment is flaky
2017-02-07 09:51:46 +08:00
Enis Soztutar
7cac85b667
HBASE-17187 DoNotRetryExceptions from coprocessors should bubble up to the application
2017-02-06 13:39:09 -08:00
tedyu
35e4eb7a7a
HBASE-17601 close() in TableRecordReaderImpl assumes the split has started (Michael Axiak)
2017-02-06 10:33:05 -08:00
zhangduo
4456d22859
HBASE-17508 Unify the implementation of small scan and regular scan for sync client
2017-02-05 08:49:51 +08:00
Zach York
cd847e599c
HBASE-17587 Do not Rethrow DoNotRetryIOException as UnknownScannerException
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-02 17:09:34 -08:00
tedyu
f59cf6f02e
HBASE-16621 HBCK should have -fixHFileLinks (Janos Gub)
2017-02-02 07:31:35 -08:00
Sean Busbey
fab0b2e603
Addendum HBASE-17522 missed some branch-1 specific direct uses of MemoryMXBean
2017-02-01 11:32:13 -06:00
Sean Busbey
3d4639f34d
HBASE-17522 Handle JVM throwing runtime exceptions when we ask for details on heap usage the same as a correctly returned 'undefined'.
...
Signed-off-by: Michael Stack <stack@apache.org>
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/io/util/HeapMemorySizeUtil.java
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheConfig.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java
2017-02-01 10:38:29 -06:00
gjacoby
3aac1b6884
HBASE-17543 - Create additional ReplicationEndpoint WALEntryFilters by configuration
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-01-31 16:16:20 -08:00
Sukumar Maddineni
c937e97864
HBASE-17540 Change SASL server GSSAPI callback log line from DEBUG to TRACE in RegionServer
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-01-27 15:13:56 -08:00
tedyu
3dc03ccfb7
HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer - revert due to pending discussion
2017-01-26 10:46:03 -08:00
tedyu
a0fac0894b
HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer (Tim Brown)
2017-01-25 20:36:48 -08:00
tedyu
ed023058d2
HBASE-17519 Rollback the removed cells (ChiaPing Tsai)
2017-01-25 06:29:56 -08:00
tedyu
19f9a1a643
HBASE-17462 Use sliding window for read/write request costs in StochasticLoadBalancer (Tim Brown)
2017-01-23 14:55:40 -08:00
tedyu
50ecbf1c8a
HBASE-17510 DefaultMemStore gets the wrong heap size after rollback (ChiaPing Tsai)
2017-01-23 09:30:39 -08:00
tedyu
6e0f3f5bbc
HBASE-17504 The passed durability of Increment is ignored when syncing WAL (ChiaPing Tsai)
2017-01-22 08:44:11 -08:00
zhangduo
57409371a0
HBASE-17489 ClientScanner may send a next request to a RegionScanner which has been exhausted
2017-01-22 16:39:14 +08:00
Dave Navarro
c64236584b
HBASE-17357 FIX PerformanceEvaluation parameters parsing triggers NPE.
...
check command name is not null, if null print usage and exit
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-20 22:53:23 -08:00
Michael Stack
f7d1d25fd7
HBASE-17488 WALEdit should be lazily instantiated (ChiaPing Tsai)
2017-01-20 09:38:55 -08:00
tedyu
abc8c5edd3
HBASE-17494 Guard against cloning family of all cells if no data need be replicated (ChiaPing Tsai)
2017-01-19 16:21:17 -08:00
tedyu
0e06ade694
HBASE-17469 Properly handle empty TableName in TablePermission#readFields and #write (Manjunath Anand)
2017-01-17 09:38:50 -08:00
Michael Stack
354e213852
HBASE-17464 Fix HBaseTestingUtility.getNewDataTestDirOnTestFS to always return a unique path
2017-01-13 17:53:48 -08:00
tedyu
ee66ab8e29
HBASE-17450 TablePermission#equals throws NPE after namespace support was added (huzheng)
2017-01-13 09:39:06 -08:00
tedyu
49b5a6e803
HBASE-17452 Failed taking snapshot - region Manifest proto-message too large (huaxiang sun)
2017-01-13 09:00:15 -08:00
tedyu
56f963f4a6
HBASE-17445 Count size of serialized exceptions in checking max result size quota
2017-01-11 10:06:40 -08:00
tedyu
2f7ce65b81
HBASE-17429 HBase bulkload cannot support HDFS viewFs (shenxianqiang)
2017-01-09 18:53:39 -08:00
Michael Stack
6130ea4d54
HBASE-12148 Remove TimeRangeTracker as point of contention when many threads writing a Store (Huaxiang Sun)
2017-01-09 13:35:20 -08:00
tedyu
9b26c9ff37
HBASE-17435 Call to preCommitStoreFile() hook encounters SaslException in secure deployment
2017-01-09 08:53:17 -08:00
Ashish Singhi
e8e40d8625
HBASE-17290 Potential loss of data for replication of bulk loaded hfiles
2017-01-06 16:57:52 +05:30
rahul gidwani
667c5eb3a0
HBASE-16710 Add ZStandard Codec to Compression.java
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-01-05 10:47:12 -08:00
Jan Hentschel
a9bac6a496
HBASE-17390 Added master and backup masters to online update of configuration
...
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-01-04 22:25:22 -08:00
Josh Elser
4dcb07f996
HBASE-17409 Limit jsonp callback name to prevent xss
2017-01-04 19:36:24 -05:00
tedyu
36f16bbe10
HBASE-17387 Reduce the overhead of exception report in RegionActionResult for multi()
2016-12-29 19:23:44 -08:00
tedyu
cec40f941f
HBASE-17374 ZKPermissionWatcher crashed when grant after region close (Liu Junhong)
2016-12-29 05:46:40 -08:00
Stephen Yuan Jiang
ce33cf2d3d
HBASE-17149 Procedure V2 - Fix nonce submission to avoid unnecessary calling coprocessor multiple times (Matteo Bertozzi)
2016-12-28 15:43:50 -08:00
Stephen Yuan Jiang
d4b2627916
HBASE-17238 Wrong in-memory hbase:meta location causing SSH failure (Stephen Yuan jiang)
2016-12-28 13:53:22 -08:00
Phil Yang
29e390c808
HBASE-17314 Limit total buffered size for all replication sources
2016-12-23 12:17:39 +08:00
Phil Yang
dd0206ff31
Revert "HBASE-17314 Limit total buffered size for all replication sources"
...
This reverts commit e9444ed077
.
2016-12-22 19:08:17 +08:00
tedyu
819d32f951
HBASE-17330 SnapshotFileCache will always refresh the file cache (Jianwei Cui)
2016-12-22 02:30:41 -08:00
tedyu
f94180a3e9
HBASE-17341 Add a timeout during replication endpoint termination (Vincent Poon)
2016-12-21 08:27:45 -08:00
Phil Yang
e9444ed077
HBASE-17314 Limit total buffered size for all replication sources
2016-12-21 13:10:29 +08:00
Vincent
e79afbf0cb
HBASE-17328 Properly dispose of looped replication peers
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMasterReplication.java
2016-12-20 18:01:33 -08:00
tedyu
fa975fa382
HBASE-17347 ExportSnapshot may write snapshot info file to wrong directory when specifying target name (Jianwei Cui)
2016-12-20 15:58:28 -08:00
tedyu
0b69f59133
HBASE-17292 Add observer notification before bulk loaded hfile is moved to region directory
2016-12-20 13:23:27 -08:00
tedyu
b9689808eb
HBASE-17344 The regionserver web UIs miss the coprocessors of RegionServerCoprocessorHost (ChiaPing Tsai)
2016-12-20 08:55:07 -08:00
Guanghao Zhang
97d1ba4015
HBASE-17317 [branch-1] The updatePeerConfig method in ReplicationPeersZKImpl didn't update the table-cfs map
2016-12-20 18:51:26 +08:00
binlijin
4c7f0f2436
HBASE-17332 Replace HashMap to Array for DataBlockEncoding.idToEncoding
2016-12-20 12:28:04 +08:00
binlijin
ed39396497
HBASE-16398 optimize HRegion computeHDFSBlocksDistribution
2016-12-16 13:57:43 +08:00
tedyu
f3a3069796
HBASE-17319 Truncate table with preserve after split may cause truncation to fail (Allan Yang)
2016-12-15 13:45:11 -08:00
tedyu
ffe70158cc
HBASE-17318 Increment does not add new column if the increment amount is zero at first time writing (Guangxu Cheng)
2016-12-15 08:45:05 -08:00
Guanghao Zhang
4b3df0f926
HBASE-17296 Provide per peer throttling for replication
...
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
2016-12-15 16:13:04 +08:00
tedyu
e029c554bb
HBASE-17302 The region flush request disappeared from flushQueue (Guangxu Cheng)
2016-12-13 12:46:42 -08:00
tedyu
1f9214bee7
HBASE-17297 Single Filter in parenthesis cannot be parsed correctly (Xuesen Liang)
2016-12-12 12:09:22 -08:00
tedyu
30576991bc
HBASE-17289 Avoid adding a replication peer named "lock"
2016-12-12 09:38:55 -08:00
Josh Elser
f13283bc05
HBASE-17276 Only log stacktraces for exceptions once for updates in a batch
...
For large batches of updates, repeatedly logging WrongRegionExceptions,
FailedSanityCheckExceptions, and/or NoSuchColumnFamilyExceptions can
easily dominate the contents of a RegionServer log. After the first
occurence of logging the full exception, switch to logging only the
message on the exception.
2016-12-11 15:40:22 -05:00
tedyu
d87b05f040
HBASE-16336 Removing peers seems to be leaving spare queues (Guanghao Zhang)
2016-12-11 07:43:10 -08:00
Stephen Yuan Jiang
e51584381a
HBASE-17023 Region left unassigned due to AM and SSH each thinking others would do the assignment work (Stephen Yuan Jiang)
2016-12-10 15:05:00 -08:00
tedyu
c2801a2ea8
HBASE-17256 Rpc handler monitoring will be removed when the task queue is full (Guangxu Cheng)
2016-12-05 12:14:20 -08:00
Ashu Pachauri
cbdc9fcb8a
Addendum HBASE-16209: Add an ExponentialBackOffPolicy so that we spread out the timing of open region retries in AssignmentManager.
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-12-02 10:30:28 +08:00
Guanghao Zhang
682dd57cd6
HBASE-17205 Add a metric for the duration of region in transition
2016-12-01 10:32:24 -08:00
Jonathan M Hsieh
9da0d5d00e
HBASE-17224 Fix lots of spelling errors in HBase logging and exception messages (Grant Sohn)
2016-12-01 09:10:03 -08:00
zhangduo
c8ea82299c
HBASE-17206 FSHLog may roll a new writer successfully with unflushed entries
2016-12-01 14:20:38 +08:00
Yu Li
b3627ef51e
HBASE-17212 Should add null checker on table name in HTable and RegionServerCallable constructor (addendum)
2016-12-01 13:32:33 +08:00
Guanghao Zhang
f26b3bf5ba
HBASE-17178 Add region balance throttling
...
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
2016-11-30 18:07:02 +08:00
zhangduo
af69783128
HBASE-17167 Pass mvcc to client when scan
2016-11-30 10:02:17 +08:00
Ashu Pachauri
b8da9f83cb
HBASE-16302 age of last shipped op and age of last applied op should be histograms
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2016-11-29 13:54:28 +05:30
Guanghao Zhang
7b2673db12
HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-11-29 16:09:56 +08:00
zhangduo
be042652aa
Revert "HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count"
...
Forget to add signoff
This reverts commit 5ec218dbc2
.
2016-11-29 16:09:22 +08:00
Guanghao Zhang
5ec218dbc2
HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count
2016-11-29 16:00:37 +08:00
Stephen Yuan Jiang
cdf539a8e0
HBASE-17189 TestMasterObserver#wasModifyTableActionCalled uses wrong variables (Stephen Yuan Jiang)
2016-11-28 23:18:42 -08:00
Michael Stack
987205caf9
HBASE-17072 CPU usage starts to climb up to 90-100% when using G1GC
...
Removes ThreadLocal. Uses AtomicReference instead (based on patch
posted up in HBASE-10676 "Removing ThreadLocal of PrefetchedHeader in
HFileBlock.FSReaderV2 make higher perforamce of scan")
Signed-off-by: Michael Stack <stack@apache.org>
2016-11-28 13:41:17 -08:00
Jerry He
10c070825f
HBASE-17116 [PerformanceEvaluation] Add option to configure block size (Yi Liang)
2016-11-27 19:13:08 -08:00
Jingcheng Du
fb1ace490c
HBASE-17095 The ClientSimpleScanner keeps retrying if the hfile is corrupt or cannot found
2016-11-22 11:26:57 +08:00
binlijin
2da5ed098e
HBASE-17118 StoreScanner leaked in KeyValueHeap (addendum)
2016-11-21 20:55:52 +08:00
tedyu
e8f056935b
HBASE-17131 Avoid livelock caused by HRegion#processRowsWithLocks (ChiaPing Tsai)
2016-11-20 18:17:21 -08:00
Guanghao Zhang
3c45ff08d9
HBASE-17088 Refactor RWQueueRpcExecutor/BalancedQueueRpcExecutor/RpcExecutor
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-11-19 14:18:06 +08:00
Esteban Gutierrez
19441937ea
HBASE-17058 Lower epsilon used for jitter verification from HBASE-15324
2016-11-17 12:29:08 -08:00
tedyu
c6f1b6e624
HBASE-17112 Prevent setting timestamp of delta operations the same as previous value's (Phil Yang)
2016-11-17 09:04:39 -08:00
tedyu
d722b2aab7
HBASE-17118 StoreScanner leaked in KeyValueHeap (binlijin)
2016-11-17 08:46:11 -08:00
Andrew Purtell
e54826434e
HBASE-17044 Fix merge failed before creating merged region leaves meta inconsistent
2016-11-14 17:14:48 -08:00
tedyu
b77bfe9d3b
HBASE-17077 Don't copy the replication queue belonging to the peer which has been deleted (Guanghao Zhang)
2016-11-13 07:00:25 -08:00
tedyu
469462c850
HBASE-17062 RegionSplitter throws ClassCastException (Jeongdae Kim)
2016-11-11 07:18:22 -08:00
thiruvel
44ab659b93
HBASE-16962: Add readPoint to preCompactScannerOpen() and preFlushScannerOpen() API
...
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
2016-11-11 11:09:55 +05:30
Yu Sun
18b31fdd32
HBASE-17020 keylen in midkey() dont computed correctly
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-11 08:01:00 +08:00
Guanghao Zhang
a6397e3b0c
HBASE-16938 TableCFsUpdater maybe failed due to no write permission on peerNode
...
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-11-10 14:07:20 -08:00
binlijin
dac73eceb0
HBASE-16570 Compute region locality in parallel at startup (addendum)
...
Addendum mainly for:
1. Avoid interfering with block location cache in RegionLocationFinder
2. Avoid refreshing block lcoations during HMaster startup (or else the startup could be really slow)
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-10 16:53:39 +08:00
Guanghao Zhang
e929156f96
HBASE-16985 TestClusterId failed due to wrong hbase rootdir
...
Signed-off-by: Michael Stack <stack@apache.org>
2016-11-09 17:19:31 -08:00
tedyu
1e322e68a5
HBASE-17054 Compactor#preCreateCoprocScanner should be passed user
2016-11-09 07:00:19 -08:00
Charlie Qiangeng Xu
d248d6b0b3
HBASE-17039 SimpleLoadBalancer schedules large amount of invalid region moves
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-09 17:07:28 +08:00
Enis Soztutar
123d26ed90
HBASE-17017 Remove the current per-region latency histogram metrics
2016-11-08 18:31:12 -08:00
Michael Stack
a70f73c1e1
HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to create region directory: /tmp/... (Addendum by Guanghao Zhang)
2016-11-08 11:59:49 -08:00
tedyu
97276da9a7
HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)
2016-11-08 06:35:12 -08:00
Stephen Yuan Jiang
874cf5128f
HBASE-17042 Remove 'public' keyword from MasterObserver interface (Stephen Yuan Jiang)
2016-11-07 17:51:44 -08:00
Enis Soztutar
b99690ac6b
HBASE-17033 LogRoller makes a lot of allocations unnecessarily
2016-11-07 14:31:30 -08:00
anoopsamjohn
2fdba6521d
HBASE-16992 The usage of mutation from CP is weird. (ChiaPing Tsai)
2016-11-07 23:26:27 +05:30
tedyu
ecd4de938b
HBASE-17026 VerifyReplication log should distinguish whether good row key is result of revalidation
2016-11-07 07:41:55 -08:00
binlijin
c4132bbf30
HBASE-16840 Reuse cell's timestamp and type in ScanQueryMatcher
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-07 22:42:46 +08:00
Yu Li
a67481209f
Revert "HBASE-16840 Reuse cell's timestamp and type in ScanQueryMatcher" to update author
...
This reverts commit 4d8611fa0f
.
2016-11-07 22:42:38 +08:00
Yu Li
4d8611fa0f
HBASE-16840 Reuse cell's timestamp and type in ScanQueryMatcher
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-07 21:38:03 +08:00
Mikhail Antonov
3063943c78
HBASE-17032 CallQueueTooBigException and CallDroppedException should not be triggering PFFE
2016-11-06 21:34:11 -08:00
tedyu
8ade73c0cb
HBASE-16946 Provide Raw scan as an option in VerifyReplication (Sreekar Pallapothu)
2016-11-04 03:36:17 -07:00
binlijin
5bfec397d1
HBASE-16960 RegionServer hang when aborting
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-04 14:08:42 +08:00
Apekshit Sharma
51ba7cfde3
HBASE-17006 Give name to existing threads.
...
Having thread names in logs and thread dumps greatly improve debugability. This patch is simply adding the names to the threads we spawn.
Change-Id: I6ff22cc3804bb81147dde3a8e9ab671633c6f6ce
2016-11-03 18:31:03 -07:00
Eddie Elizondo
b4676d51ad
HBASE-14329 Report region in transition should check all regions in request
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-11-03 11:32:19 -07:00
Gary Helmling
4fe51ebaa7
HBASE-16964 Always clear successfully archived files from compacted files list
2016-11-03 09:28:22 -07:00
Yu Li
514add0086
HBASE-16972 Log more details for Scan#next request when responseTooSlow
2016-11-02 14:33:44 +08:00
Andrew Purtell
961b952171
HBASE-16980 TestRowProcessorEndpoint failing consistently (Yu Li)
2016-11-01 19:09:17 -07:00
Lars Hofhansl
6113f9a34f
HBASE-16765 New SteppingRegionSplitPolicy, avoid too aggressive spread of regions for small tables.
2016-11-01 13:07:12 -07:00