Stephen Yuan Jiang
bdd7782f05
HBASE-16008 A robust way deal with early termination of HBCK (Stephen Yuan Jiang)
2016-07-23 14:47:11 -07:00
Stephen Yuan Jiang
cd0b85e0a8
Revert HBASE-15406: Split / merge switch left disabled after early termination of hbck (HBASE-16008 will address this issue)
2016-07-22 20:09:03 -07:00
Gary Helmling
65834a1ced
HBASE-16217 Pass through the calling user in ObserverContext
2016-07-21 16:45:09 -07:00
Jerry He
70f330dc84
Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load
2016-07-19 19:53:10 -07:00
Stephen Yuan Jiang
638ca24f01
HBASE-14552 (addendum) Procedure V2: Reimplement DispatchMergingRegionHandler (add nonce support) (Stephen Yuan Jiang)
2016-07-19 08:49:23 -07:00
stack
1a62eaa89c
HBASE-16236 Typo in javadoc of InstancePending (Hiroshi Ikeda)
2016-07-18 22:26:27 -07:00
stack
c9925bcec1
HBASE-16238 It's useless to catch SESSIONEXPIRED exception and retry in RecoverableZooKeeper (Allan Yang)
2016-07-18 14:36:11 -07:00
Phil Yang
a1cc2c4bfe
HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely
...
(cherry picked from commit a8dfd8c436
)
2016-07-18 06:48:17 -05:00
Sean Busbey
a0aa017ae9
Revert "Replication queue's lock will live forever if RS acquiring the lock has died prematurely"
...
This reverts commit a8dfd8c436
.
2016-07-18 06:47:56 -05:00
tedyu
eb43f0a5d0
HBASE-16172 Unify the retry logic in ScannerCallableWithReplicas and RpcRetryingCallerWithReadReplicas
2016-07-18 03:35:10 -07:00
Phil Yang
a8dfd8c436
Replication queue's lock will live forever if RS acquiring the lock has died prematurely
2016-07-18 09:32:36 +08:00
Stephen Yuan Jiang
f04eeecffc
HBASE-14552 Procedure V2: Reimplement DispatchMergingRegionHandler (Stephen Yuan Jiang)
2016-07-15 07:06:53 -07:00
Enis Soztutar
a07892558b
HBASE-16095 Add priority to TableDescriptor and priority region open thread pool
2016-07-13 18:19:59 -07:00
Joseph Hwang
f292048ffd
HBASE-16208 Check that the row exists before attempting to remove a queue from TableBasedReplicationQueuesImpl
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-12 14:50:07 -07:00
stack
496fd9837a
HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove
...
TimeRangeTracker as point of contention when many threads reading a StoreFile
Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken
scanning because of a side effect of a clean up in HBASE-15650 to make
TimeRange construction consistent exposed a latent issue in
TimeRange#compare. See HBASE-16074 for more detail.
Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
Call through to next constructor (if minStamp was 0, we'd skip setting
allTime=true). Add asserts that timestamps are not < 0 cos it messes
us up if they are (we already were checking for < 0 on construction but
assert passed in timestamps are not < 0).
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
Add constructor override that takes a TimeRangeTracker (set when flushing
but not when compacting)
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
Add override creating an HFile in tmp that takes a TimeRangeTracker
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
Add override for HFile Writer that takes a TimeRangeTracker Take it on
construction instead of having it passed by a setter later (flags and
reference set by the setter were not volatile... could have been prob
in concurrent case)
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
Log WARN if bad initial TimeRange value (and then 'fix' it)
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 18:20:31 -07:00
tedyu
20a99b4c06
HBASE-16144 Revert - test failure in TestMultiSlaveReplication#testMultiSlaveReplication seems to be related
2016-07-05 13:19:33 -07:00
tedyu
b5cdb38dc7
HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely (Phil Yang)
2016-07-05 07:16:12 -07:00
Yu Li
7f44dfd85f
HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin)
2016-07-04 21:45:04 +08:00
zhangduo
6944a17ad4
HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted
2016-07-04 19:26:27 +08:00
tedyu
af9422c04a
HBASE-16159 OutOfMemory exception when using AsyncRpcClient with encryption to read rpc response (Colin Ma)
2016-07-01 14:26:09 -07:00
stack
2d93444cb0
HBASE-16149 Log the underlying RPC exception in RpcRetryingCallerImpl (Jerry He)
2016-06-30 05:57:50 -07:00
Jonathan M Hsieh
e1d130946b
HBASE-16117 Fix Connection leak in mapred.TableOutputFormat
2016-06-29 17:18:43 -07:00
chenheng
68c1b34dbc
HBASE-16040 Remove configuration "hbase.replication"
2016-06-24 10:41:35 +08:00
Joseph Hwang
2766e4a42e
HBASE-16083 Fix RepliationFactory config property names to match HBase naming conventions
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-22 12:49:45 -07:00
Joseph Hwang
152594560e
HBASE-16036 Made Replication Table creation non-blocking.
...
All ReplicationTableBase method's that need to access the Replication Table will block until it is created though.
Also refactored ReplicationSourceManager so that abandoned queue adoption is run in the background too so that it does not block HRegionServer initialization.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-21 13:05:50 -07:00
Ramkrishna
a9950e0001
HBASE-15783 AccessControlConstants#OP_ATTRIBUTE_ACL_STRATEGY_CELL_FIRST
...
not used any more. (Ram)
2016-06-21 10:51:42 +05:30
tedyu
76419df21d
HBASE-16054 OutOfMemory exception when using AsyncRpcClient with encryption (Colin Ma)
2016-06-20 07:29:40 -07:00
Enis Soztutar
bdb0cc8808
HBASE-15467 Remove 1.x/2.0 TableDescriptor incompatibility
2016-06-17 17:25:04 -07:00
Joseph Hwang
61ff6ced5b
HBASE-16018 Refactored the ReplicationPeers interface to clear up what some methods do and move away from a ZooKeeper-specific implementation.
...
Also added some documentation for undocumented methods.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-17 13:04:21 -07:00
Joseph Hwang
2093aadec1
HBASE-15974 Create a ReplicationQueuesClientHBaseImpl
...
Building on HBase-15958.
Provided a ReplicationQueuesClientHBaseImpl that relies on the HBase Replication Table to track WAL queues.
Refactored out a large section of ReplicationQueuesHBaseImpl into a ReplicationTableClient class that handles Replication Table operations.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-15 10:43:14 -07:00
anoopsjohn
17bcf14fea
HBASE-15525 OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts.
2016-06-14 19:03:54 +05:30
Jurriaan Mous
bd45cf3476
HBASE-16004 Update to Netty 4.1.1
...
Signed-off-by: stack <stack@apache.org>
2016-06-10 12:14:05 -07:00
Joseph Hwang
babdedc1b0
HBASE-15958 Implement ClaimQueues on top of HBase
...
Building on HBase-15883.
Now implementing the claim queues procedure within an HBase table.
Also added UnitTests to test claimQueue.
Peer tracking will still be performed by ZooKeeper though.
Also modified the queueId tracking procedure so we no longer have to perform scans over the Replication Table.
This does make our queue naming schema slightly different from ReplicationQueuesZKImpl though.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-09 15:05:54 -07:00
Ashish Singhi
9012a0b123
HBASE-15952 Bulk load data replication is not working when RS user does not have permission on hfile-refs node
2016-06-09 18:44:29 +05:30
Matteo Bertozzi
41cc215544
HBASE-15975 logic in TestHTableDescriptor#testAddCoprocessorWithSpecStr is wrong (Huaxiang Sun)
2016-06-08 22:42:50 -07:00
Matteo Bertozzi
d9463bcce0
HBASE-15989 Remove hbase.online.schema.update.enable
2016-06-08 13:09:31 -07:00
Sergey Soldatov
da88b48240
HBASE-15957 RpcClientImpl.close never ends in some circumstances
...
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-06-07 11:33:03 -07:00
Andrew Purtell
376ad0d986
HBASE-15698 Increment TimeRange not serialized to server (Ted Yu)
2016-06-06 22:17:00 -07:00
tedyu
7fd3532de6
HBASE-15803 ZooKeeperWatcher's constructor can leak a ZooKeeper instance with throwing ZooKeeperConnectionException when canCreateBaseZNode is true
2016-06-06 18:35:15 -07:00
Apekshit Sharma
15c03fd1c9
HBASE-15965
...
- Testing by executing a command will cover the exact path users will trigger, so its better then directly calling library functions in tests. Changing the tests to use @shell.command(:<command>, args) to execute them like it's a command coming from shell.
Norm change:
Commands should print the output user would like to see, but in the end, should also return the relevant value. This way:
- Tests can use returned value to check that functionality works
- Tests can capture stdout to assert particular kind of output user should see.
- We do not print the return value in interactive mode and keep the output clean. See Shell.command() function.
Bugs found due to this change:
- Uncovered bug in major_compact.rb with this approach. It was calling admin.majorCompact() which doesn't exist but our tests didn't catch it since they directly tested admin.major_compact()
- Enabled TestReplicationShell. If it's bad, flaky infra will take care of it.
Change-Id: I5d8af16bf477a79a2f526a5bf11c245b02b7d276
2016-06-06 17:50:22 -07:00
Ramkrishna
b21c56e795
HBASE-15174 Client Public API should not have PB objects in 2.0 (Ram)
2016-06-06 10:11:38 +05:30
Joseph Hwang
21e98271c3
HBASE-15883 Adding WAL files and tracking offsets in HBase.
...
Implemented ReplicationQueuesHBaseImpl that tracks WAL offsets and replication queues in an HBase table.
Only wrote the basic tracking methods, have not implemented claimQueue() or HFileRef methods yet.
Wrote a basic unit test for ReplicationQueueHBaseImpl that tests the implemented functions on a single Region Server
Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-06-03 15:23:10 -07:00
Ashish Singhi
0cbce07626
HBASE-15888 Extend HBASE-12769 for bulk load data replication
2016-06-03 18:42:00 +05:30
Yu Li
53eb27bb60
HBASE-15931 Add log for long-running tasks in AsyncProcess
2016-06-02 12:00:42 +08:00
tedyu
cbb95cd3a9
HBASE-15932 Shell test fails due to uninitialized constant
2016-06-01 10:35:00 -07:00
Jurriaan Mous
a1f0c1cbb3
HBASE-15875 Remove HTable references and HTableInterface
...
Signed-off-by: stack <stack@apache.org>
2016-05-30 19:56:54 -07:00
Jurriaan Mous
cdd532da8a
HBASE-15610 Remove deprecated HConnection for 2.0 thus removing all PB references for 2.0
...
Signed-off-by: stack <stack@apache.org>
2016-05-29 07:50:55 -07:00
Sean Mackrory
f4470af95d
HBASE-15891. Closeable resources potentially not getting closed if exception is thrown.
...
Signed-off-by: stack <stack@apache.org>
2016-05-28 21:32:22 -07:00
Sean Mackrory
3b6e6e6c25
HBASE-15889. String case conversions are locale-sensitive, used without locale
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-28 10:41:31 -07:00
Gary Helmling
da0d74cd27
HBASE-15830 SASL encryption doesn't work with AsyncRpcChannelImpl (Colin Ma)
2016-05-26 21:58:27 -07:00
Andrew Purtell
fdaf3be84f
HBASE-15854 Log the cause of SASL connection failures (Robert Yokota)
2016-05-26 14:16:20 -07:00
Mikhail Antonov
1c30ae68ec
HBASE-15880 RpcClientImpl#tracedWriteRequest incorrectly closes HTrace span
2016-05-23 12:44:48 -07:00
tedyu
ae42c65cfd
HBASE-15802 ConnectionUtils should use ThreadLocalRandom instead of Random (Matt Warhaftig)
2016-05-21 21:15:10 -07:00
Jerry He
56e4b85d06
HBASE-14818 user_permission does not list namespace permissions (li xiang)
2016-05-21 20:06:05 -07:00
Gary Helmling
b1bf622e69
HBASE-15856 Addendum Fix UnknownHostException import in MetaTableLocator
2016-05-20 20:44:56 -07:00
stack
8dc0ae6fb3
HBASE-15863 Typo in Put.java class documentation (Tamer Soliman)
2016-05-20 11:51:36 -07:00
Gary Helmling
4793988aef
HBASE-15856 Don't cache unresolved addresses for connections
2016-05-20 09:36:11 -07:00
eshcar
a27504c701
HBASE-14920: Compacting memstore
...
Signed-off-by: stack <stack@apache.org>
2016-05-20 03:41:43 -07:00
Matteo Bertozzi
5ac54e6abb
HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set
2016-05-18 12:48:26 -07:00
Phil Yang
3bd9220f0c
HBASE-15593 Time limit of scanning should be offered by client
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-05-18 19:13:15 +08:00
Ramkrishna
7b5d5394c0
HBASE-15784 Misuse core/maxPoolSize of LinkedBlockingQueue in
...
ThreadPoolExecutor (Jingcheng Du)
2016-05-18 12:40:43 +05:30
Elliott Clark
9269b8199e
HBASE-15840 WAL.proto compilation broken for cpp
2016-05-17 12:04:14 -07:00
tedyu
838c306c0a
HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig)
2016-05-17 11:01:26 -07:00
Sean Busbey
e0aff10901
HBASE-15780 Make AuthUtil public and rely on it for talking to secure HBase.
...
Signed-off-by: Gary Helmling <garyh@apache.org>
Signed-off-by: Mikhail Antonov <antonov@apache.org>
Signed-off-by: stack <stack@apache.org>
2016-05-16 00:50:14 -05:00
stack
c47511baa7
HBASE-15828 fix extant findbug NM_SAME_SIMPLE_NAME_AS_INTERFACE in Future
2016-05-15 21:11:29 -07:00
Mikhail Antonov
2482062d34
HBASE-15615 Wrong sleep time when RegionServerCallable need retry (Guanghao Zhang)
2016-05-15 20:37:26 -07:00
stack
6904430a3d
HBASE-15811 Batch Get after batch Put does not fetch all Cells We were not waiting on all executors in a batch to complete. The test for no-more-executors was damaged by the 0.99/0.98.4 fix "HBASE-11403 Fix race conditions around Object#notify"
...
It added this in AsyncProcess#waitForMaximumCurrentTasks:
synchronized (this.tasksInProgress) {
+ if (tasksInProgress.get() != oldInProgress) break;
this.tasksInProgress.wait(100);
which added a break out of our waiting loop if any change in
count of tasks; it seems that what was wanted was instead to
avoid the wait if there was movement in the count of completed
task.
Reformats waitForMaximumCurrentTasks so it is testable. Adds
test that we indeed wait on the specified parameter.
2016-05-13 17:51:27 -07:00
Jurriaan Mous
a11091c49c
HBASE-15798 Add Async RpcChannels to all RpcClients
...
Signed-off-by: stack <stack@apache.org>
2016-05-10 07:44:51 -07:00
Jurriaan Mous
9d17e3d22a
HBASE-15797 TestIPCUtil fails after HBASE-15795
...
Signed-off-by: stack <stack@apache.org>
2016-05-09 17:04:58 -07:00
Ramkrishna
97ad33c691
HBASE-15609 Remove PB references from Result, DoubleColumnInterpreter and
...
any such public facing class for 2.0 (Ram)
2016-05-09 14:56:00 +05:30
Jurriaan Mous
9ee0cbb995
HBASE-15796 TestMetaCache fails after HBASE-15745
...
Signed-off-by: stack <stack@apache.org>
2016-05-07 15:29:07 -07:00
Jurriaan Mous
fa033b6a08
HBASE-15793 Port over AsyncCall improvements
...
Signed-off-by: stack <stack@apache.org>
2016-05-07 10:38:38 -07:00
Jurriaan Mous
ac31ceb835
HBASE-15794 Fix Findbugs instanceof always true issue in
...
MultiServerCallable
Signed-off-by: stack <stack@apache.org>
2016-05-07 10:10:23 -07:00
Jurriaan Mous
e71ae601f7
HBASE-15795 Cleanup all classes in package org.apache.hadoop.hbase.ipc
...
for code style
Signed-off-by: stack <stack@apache.org>
2016-05-07 09:55:07 -07:00
Jurriaan Mous
56358a0fd3
HBASE-15745 Refactor RPC classes to better accept async changes
...
Signed-off-by: stack <stack@apache.org>
2016-05-06 13:43:45 -07:00
Ashish Singhi
34e9a6ff30
HBASE-15669 HFile size is not considered correctly in a replication request
2016-05-06 17:26:17 +05:30
Ramkrishna
bec81b1977
HBASE-15608 Remove PB references from SnapShot related Exceptions (ram)
2016-05-06 17:06:25 +05:30
Alex Moundalexis
0bf065a5d5
HBASE-15768 fix capitalization of ZooKeeper usage
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-05 15:35:44 -05:00
tedyu
8b0ce77942
HBASE-15292 Refined ZooKeeperWatcher to prevent ZooKeeper's callback while construction (Hiroshi Ikeda)
2016-05-05 11:14:32 -07:00
Gary Helmling
d23d600d76
HBASE-15741 Provide backward compatibility for HBase coprocessor service names
2016-05-04 12:09:57 -07:00
Ramkrishna
c06a976a98
HBASE-15607 Remove PB references from Admin for 2.0 (Ram)
2016-05-03 10:51:46 +05:30
Mikhail Antonov
58c4c3d174
HBASE-15703 Deadline scheduler needs to return to the client info about skipped calls, not just drop them
2016-05-02 15:23:07 -07:00
Jurriaan Mous
15631a76f5
HBASE-15744 Port over small format/text improvements from HBASE-13784
...
(Jurriaan Mous)
Signed-off-by: stack <stack@apache.org>
2016-05-01 19:48:43 -07:00
chenheng
ccd8888b4b
Revert "HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response"
...
This reverts commit 01c0448ccd
.
2016-04-30 11:37:05 +08:00
chenheng
01c0448ccd
HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response
2016-04-30 09:27:32 +08:00
Yu Li
d8e032279f
HBASE-15711 Add client side property to allow logging details for batch errors
2016-04-29 10:14:27 +08:00
tedyu
9343ef438f
HBASE-15676 FuzzyRowFilter fails and matches all the rows in the table if the mask consists of all 0s (Matt Warhaftig)
2016-04-27 21:00:11 -07:00
Gary Helmling
ce318a2906
HBASE-15658 Avoid excess meta cache clearing for RegionServerCallable
2016-04-26 22:54:13 -07:00
Phil Yang
53d7316075
HBASE-15645 hbase.rpc.timeout is not used in operations of HTable
...
Signed-off-by: stack <stack@apache.org>
2016-04-26 10:51:29 -07:00
stack
4bdd47c52c
HBASE-15710 Include issue servers information in RetriesExhaustedWithDetailsException message (Yu Li)
2016-04-26 09:15:02 -07:00
chenheng
03f3c392a3
HBASE-15674 HRegionLocator#getAllRegionLocations should put the results in cache
2016-04-21 14:19:39 +08:00
chenheng
a9f1c4a871
HBASE-15406 Split / merge switch left disabled after early termination of hbck
2016-04-15 14:09:52 +08:00
Vasudevan
a395922ad5
HBASE-15605 Remove PB references from HCD and HTD for 2.0 (Ram)
2016-04-11 14:12:07 +05:30
tedyu
e0f31ba6e6
HBASE-15507 Online modification of enabled ReplicationPeerConfig (Geoffrey Jacoby)
2016-04-08 21:26:31 -07:00
Samir Ahmic
d393603dea
HBASE-15606 Limit creating zk connection in HBaseAdmin#getCompactionState() only to case when 'hbase:meta' is checked.
...
Signed-off-by: stack <stack@apache.org>
2016-04-07 14:25:49 -07:00
Enis Soztutar
7e399883f6
HBASE-15505 ReplicationPeerConfig should be builder-style (Gabor Liptak)
2016-04-05 11:44:05 -07:00
Stephen Yuan Jiang
e1d5c3d269
HBASE-15521 Procedure V2 - RestoreSnapshot and CloneSnapshot (Stephen Yuan Jiang)
2016-03-31 21:49:13 -07:00
chenheng
7f39baf0f4
HBASE-11393 Replication TableCfs should be a PB object rather than a string
2016-03-29 10:25:29 +08:00
Enis Soztutar
0520097611
HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock
2016-03-28 17:56:32 -07:00
Mikhail Antonov
db3ba652f8
HBASE-15524 Fix NPE in client-side metrics
2016-03-23 21:23:54 -07:00
zhangduo
fd5c0934b6
HBASE-15520 Fix broken TestAsyncIPC
2016-03-24 10:46:44 +08:00
Elliott Clark
925c185969
HBASE-15475 Allow TimestampsFilter to provide a seek hint
...
Summary:
Allow TestTimestampFilterSeekHint to provide a seek next hint.
This can be incorrect as it might skip deletes. However it can
make things much much faster.
Test Plan: Added a unit test.
Differential Revision: https://reviews.facebook.net/D55617
2016-03-23 18:56:52 -07:00
Misty Stanley-Jones
b6e1f63074
HBASE-15447 Improve javadocs description for Delete methods <Wellington Chevreuil>
2016-03-22 12:56:30 -07:00
tedyu
dc6cd0bb74
HBASE-15479 No more garbage or beware of autoboxing (Vladimir Rodionov)
2016-03-19 17:22:53 -07:00
tedyu
fbf58f330b
HBASE-15325 ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests (Phil Yang)
2016-03-17 11:03:29 -07:00
Mikhail Antonov
a2c99b133f
HBASE-15390 Unnecessary MetaCache evictions cause elevated number of requests to meta (ADDENDUM)
2016-03-17 01:08:36 -07:00
Elliott Clark
ecec35ae4e
HBASE-15441 Fix WAL splitting when region has moved multiple times
...
Summary:
Currently WAL splitting is broken when a region has been opened multiple times in recent minutes.
Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail.
We need to:
It appears that the close event with a sequence id of one is coming from region warm up.
This patch fixes that by making sure the close on warm up doesn't happen. Also splitting will ignore any of the events that are already in the logs.
Test Plan: Unit tests pass
Differential Revision: https://reviews.facebook.net/D55557
2016-03-16 16:26:09 -07:00
Mikhail Antonov
3adcc750e3
HBASE-15390 Unnecessary MetaCache evictions cause elevated number of requests to meta
2016-03-16 16:22:36 -07:00
Enis Soztutar
ca816f0780
HBASE-6721 RegionServer Group based Assignment (Francis Liu)
2016-03-14 18:28:50 -07:00
anoopsjohn
eea8b38dfa
HBASE-15180 Reduce garbage created while reading Cells from Codec Decoder.
2016-03-11 13:58:41 +05:30
anoopsjohn
6628d2df11
HBASE-15322 Operations using Unsafe path broken for platforms not having sun.misc.Unsafe.
2016-03-11 09:37:00 +05:30
tedyu
ad9b91a904
HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang)
2016-03-09 09:28:54 -08:00
Mikhail Antonov
46cc3d4972
HBASE-15137 CallTimeoutException and CallQueueTooBigException should trigger PFFE
2016-03-07 20:54:54 -08:00
tedyu
ed977fd125
HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT
2016-03-07 16:15:59 -08:00
tedyu
dfc650a953
HBASE-15243 Revert due to compilation error - master branch change makes the patch stale
2016-03-07 15:59:29 -08:00
tedyu
05c1309b3c
HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT
2016-03-07 15:41:06 -08:00
Jesse Yates
ef712df944
HBASE-14703 HTable.mutateRow does not collect stats (Heng Chen)
2016-03-05 11:01:45 -08:00
tedyu
d083e4f29f
HBASE-15393 Enable table replication command will fail when parent znode is not default in peer cluster (Ashish Singhi)
2016-03-05 06:28:09 -08:00
Ashu Pachauri
27cf0c8c36
HBASE-15354 Same criteria to clear metacache across operations (Ashu Pachauri)
...
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-03-04 17:55:35 -08:00
tedyu
664575598e
HBASE-15397 Create bulk load replication znode(hfile-refs) in ZK replication queue by default (Ashish Singhi)
2016-03-04 13:43:25 -08:00
Jonathan M Hsieh
f658f3ef83
HBASE-15356 Remove unused imports (Youngjoon Kim)
2016-03-03 11:42:38 -08:00
chenheng
99955a3240
HBASE-15128 Disable region splits and merges switch in master
2016-02-27 08:36:59 +08:00
chenheng
bf4fcc30c6
Revert "HBASE-15128 Disable region splits and merges switch in master"
...
This reverts commit 24d481c580
.
2016-02-26 08:52:12 +08:00
chenheng
24d481c580
HBASE-15128 Disable region splits and merges switch in master
2016-02-26 08:11:16 +08:00
Josh Elser
a8073c4a98
HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
...
Further investigation after HBASE-15221 lead to some findings that
AsyncProcess should have been managing the contents of the region
location cache, appropriately clearing it when necessary (e.g. an
RPC to a server fails because the server doesn't host that region)
For multi() RPCs, the tableName argument is null since there is no
single table that the updates are destined to. This inadvertently
caused the existing region location cache updates to fail on 1.x
branches. AsyncProcess needs to handle when tableName is null
and perform the necessary cache evictions.
As such, much of the new retry logic in HTableMultiplexer is
unnecessary and is removed with this commit. Getters which were
added as a part of testing were left since that are mostly
harmless and should contain no negative impact.
Signed-off-by: stack <stack@apache.org>
2016-02-22 22:03:14 -08:00
anoopsjohn
2d66cd86d0
HBASE-15247 InclusiveStopFilter does not respect reverse Filter property. (Amal Joshy)
2016-02-23 09:21:37 +05:30
stack
4b1acead42
HBASE-15285 Forward-port respect for isReturnResult from HBASE-15095
2016-02-17 19:26:17 -08:00
anoopsjohn
12982d1957
HBASE-15198 RPC client not using Codec and CellBlock for puts by default-addendum.
2016-02-12 07:37:45 +05:30
anoopsjohn
29a192ef3c
HBASE-15198 RPC client not using Codec and CellBlock for puts by default.
2016-02-11 09:51:11 +05:30
tedyu
7bb68b9031
HBASE-15231 Make TableState.State private (Misty Stanley-Jones)
2016-02-08 15:21:18 -08:00
Josh Elser
dfd8a31a13
HBASE-15221 Reload the cache on re-tried puts in HTableMultiplexer and adds a close() method to HTableMultiplexer
...
When a Put fails due to a NotServingRegionException, the cached location
of that Region is never cleared. Thus, subsequent calls to resubmit
the Put will fail in the same way as the original, never determining
the new location of the Region.
If the Connection is not closed by the user before the Multiplexer
is discarded, it will leak resources and could cause resource
issues.
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2016-02-08 00:04:28 -06:00
anoopsjohn
7239056c78
HBASE-15214 Valid mutate Ops fail with RPC Codec in use and region moves across.
2016-02-06 02:40:49 +05:30
chenheng
8f20bc748d
HBASE-15197 Expose filtered read requests metric to metrics framework and Web UI (Eungsop Yoo)
2016-02-05 10:57:14 +08:00
Andrew Purtell
b80325fb1b
Amend HBASE-15200 ZooKeeper znode ACL checks should only compare the shortname
...
Fixes for newly introduced FindBugs warnings
2016-02-04 17:33:32 -08:00
Enis Soztutar
a69272efe1
HBASE-15177 Reduce garbage created under high load
2016-02-04 13:27:00 -08:00
stack
d5d26f0804
Fixup on the hbasecon banner image.. add date and location
2016-02-04 11:44:16 -08:00
Andrew Purtell
6256ce4e63
HBASE-15200 ZooKeeper znode ACL checks should only compare the shortname
2016-02-03 10:43:20 -08:00
Enis Soztutar
2f5767376f
HBASE-15129 Set default value for hbase.fs.tmp.dir rather than fully depend on hbase-default.xml (Yu Li)
2016-02-02 17:10:19 -08:00
stack
ed46591f30
HBASE-15196 HBASE-15158 Preamble 2 of 2:Add Increment tests
2016-02-02 11:27:03 -08:00
stack
2cc48e039d
HBASE-15158 HBASE-15158 Preamble 1 of 2: fix findbugs, add javadoc, change Region#getReadpoint to #getReadPoint, and some util
2016-01-31 20:21:48 -08:00
tedyu
1ee07688c8
HBASE-15173 Execute mergeRegions RPC call as the request user
2016-01-28 09:53:24 -08:00
Elliott Clark
138b754671
HBASE-15146 Don't block on Reader threads queueing to a scheduler queue
2016-01-28 07:58:43 -05:00
Devaraj Das
4681827d63
HBASE-14963. Remove Guava dependency from HBase client code
2016-01-22 13:26:54 -08:00
Mikhail Antonov
4bf6f8379d
HBASE-15139 Connection manager doesn't pass client metrics to RpcClient
2016-01-20 14:17:01 -08:00
tedyu
eb17f74b9e
HBASE-15073 Revert due to different opinion on usefulness
2016-01-18 17:51:21 -08:00
stack
76bce77326
HBASE-15115 Fix findbugs complaints in hbase-client
2016-01-15 10:25:49 -08:00
stack
300fe5e6bf
Revert "v1"
...
Bad commit message; revert
This reverts commit c516968b8c
.
2016-01-15 10:24:58 -08:00
stack
c516968b8c
v1
2016-01-15 10:15:05 -08:00
tedyu
4ac8d4ce61
HBASE-14865 Support passing multiple QOPs to SaslClient/Server via hbase.rpc.protection (Appy)
2016-01-14 16:39:52 -08:00
ramkrishna
28c2b18d30
HBASE-15027 Refactor the way the CompactedHFileDischarger threads are
...
created (Ram)
2016-01-08 11:18:39 +05:30
tedyu
d65978fceb
HBASE-15073 Finer grained control over normalization actions for RegionNormalizer
2016-01-06 17:25:41 -08:00
anoopsjohn
a9b671b31f
HBASE-12593 Tags to work with ByteBuffer.
2016-01-06 21:28:06 +05:30
stack
46303dfd75
HBASE-14888 ClusterSchema: Add Namespace Operations
2016-01-05 14:35:27 -08:00
tedyu
00656688f7
HBASE-14987 Compaction marker whose region name doesn't match current region's needs to be handled
2016-01-04 07:10:10 -08:00
stack
a82f7fc94a
Revert "HBASE-14888 ClusterSchema: Add Namespace Operations"
...
This reverts commit c5f3d17ae3
.
2016-01-03 07:15:18 -08:00
stack
c5f3d17ae3
HBASE-14888 ClusterSchema: Add Namespace Operations
2016-01-02 16:16:56 -08:00
Ashish Singhi
413d663f92
HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implementations
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-12-29 20:25:47 -06:00
tedyu
a1a19d9405
HBASE-14717 enable_table_replication command should only create specified table for a peer cluster (Ashish)
2015-12-24 11:07:49 -08:00
anoopsjohn
6fc2596ab3
HBASE-14940 Make our unsafe based ops more safe.
2015-12-24 07:54:13 +05:30
stack
04de427e57
Revert "HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implemenations (Ashish Singhi)"
...
This reverts commit e00a04df10
.
2015-12-23 15:31:10 -08:00
stack
e00a04df10
HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implemenations (Ashish Singhi)
2015-12-23 07:29:18 -08:00
chenheng
f018c371b5
HBASE-14654 Reenable TestMultiParallel#testActiveThreadsCount
2015-12-22 11:33:25 +08:00
Lars Hofhansl
86a417eead
HBASE-14822 Renewing leases of scanners doesn't work.
2015-12-19 09:55:03 -08:00
anoopsjohn
408666a06d
HBASE-13158 When client supports CellBlock, return the result Cells as controller payload for get(Get) API also.
2015-12-18 09:50:53 +05:30
anoopsjohn
cf458d3023
HBASE-14999 Remove ref to org.mortbay.log.Log.
2015-12-17 18:01:16 +05:30
Mikhail Antonov
abe30b52a8
HBASE-14534 Bump yammer/coda/dropwizard metrics dependency version
2015-12-15 12:11:27 -08:00
stack
22b95aebcd
HBASE-14946 Don't allow multi's to over run the max result size.
2015-12-10 21:25:21 -08:00
Enis Soztutar
cff664c5e2
HBASE-14960 Fallback to using default RPCControllerFactory if class cannot be loaded
2015-12-10 19:11:57 -08:00
Elliott Clark
48e217a7db
HBASE-14946 Don't allow multi's to over run the max result size.
...
Summary:
* Add VersionInfoUtil to determine if a client has a specified version or better
* Add an exception type to say that the response should be chunked
* Add on client knowledge of retry exceptions
* Add on metrics for how often this happens
Test Plan: Added a unit test
Differential Revision: https://reviews.facebook.net/D51771
2015-12-10 18:10:32 -08:00
stack
bebcc09fb3
HBASE-14769 Remove unused functions and duplicate javadocs from HBaseAdmin
2015-12-10 15:02:21 -08:00
Nate Edel
9511150bd6
HBASE-14901 Remove duplicate code to create/manage encryption keys
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2015-12-10 14:38:43 -08:00
ramkrishna
26ac60b03f
HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi)
2015-12-10 13:07:46 +05:30
Gary Helmling
c1e0fcc26d
HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection
2015-12-09 15:52:27 -08:00
stack
92e178df28
Revert "HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)"
...
Reverting. The conversation on issues to do with this patch was not done (Appy brought it to my attention).
This reverts commit 6adce67572
.
2015-12-01 11:30:39 -08:00
Apekshit(Appy) Sharma
6adce67572
HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)
...
Signed-off-by: stack <stack@apache.org>
2015-11-30 20:44:11 -08:00
Apekshit
3bac31b2a4
HBASE-14890 Fix broken checkstyle tool. Some javadocs had parsing errors because of wrongly formatted HTML tags. (Apekshit)
...
Signed-off-by: stack <stack@apache.org>
2015-11-28 21:57:52 -08:00
tedyu
2317ec583d
HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim)
2015-11-28 10:08:38 -08:00
anoopsjohn
daba867734
HBASE-13347 Deprecate FirstKeyValueMatchingQualifiersFilter. (Abhishek)
2015-11-24 09:50:56 +05:30
tedyu
9a91f5ac81
HBASE-14737 Clear cachedMaxVersions when HColumnDescriptor#setValue(VERSIONS, value) is called (Pankaj Kumar)
2015-11-23 20:13:00 -08:00
chenheng
ebe5801e00
HBASE-14782 FuzzyRowFilter skips valid rows (Vladimir Rodionov)
2015-11-19 11:28:18 +08:00
tedyu
d738aade2e
HBASE-14824 HBaseAdmin.mergeRegions should recognize both full region names and encoded region names (Eungsop Yoo)
2015-11-18 14:24:47 -08:00
Elliott Clark
d6fdf92f9e
HBASE-14812 Fix ResultBoundedCompletionService deadlock
2015-11-17 14:41:35 -08:00
Elliott Clark
a591df1073
HBASE-14708 Use copy on write Map for region location cache
...
Summary:
Create and use a copy on write map for region location.
- Create a copy on write map backed by a sorted array.
- Create a test for both comparing each with a jdk provided map.
- Change MetaCache to use the new map.
Test Plan:
- org.apache.hadoop.hbase.client.TestFromClientSide
- TestHCM
Differential Revision: https://reviews.facebook.net/D49545
2015-11-17 10:52:43 -08:00
tedyu
789f8a5a70
HBASE-14498 Revert for on-going review
2015-11-12 12:57:23 -08:00
stack
290ecbe829
HBASE-14355 Scan different TimeRange for each column family (Churro Morales)
2015-11-12 10:54:16 -10:00
tedyu
b677f2e65d
HBASE-14498 Master stuck in infinite loop when all Zookeeper servers are unreachable (Pankaj Kumar)
2015-11-12 07:21:19 -08:00
stack
32de06f663
HBASE-14787 Remove obsolete ConnectionImplementation.refCount (Appy)
2015-11-09 17:08:17 -10:00
chenheng
086bacd12d
HBASE-14693 Add client-side metrics for received pushback signals
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-11-09 18:03:30 -08:00
Apekshit(Appy) Sharma
08963189a2
HBASE-14767 - Remove deprecated functions from HBaseAdmin Deprecated in HBASE-12083 (1.0.0, 2.0.0, 0.99.2) - HBaseAdmin(Configuration)
...
Deprecated in HBASE-10479 (0.99.0, hbase-10070)
- HBaseAdmin(Connection)
Deprecated in HBASE-11826 (0.99.0, 1.0.0, 2.0.0)
- flush()
- compact()
- majorCompact()
- split()
- getCompactionState()
- Changes many declarations from HBaseAdmin to Admin
(Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-06 16:23:55 -10:00
tedyu
cfc5348b5e
HBASE-14758 Add UT case for unchecked error/exception thrown in AsyncProcess#sendMultiAction (Yu Li)
2015-11-04 07:20:59 -08:00
stack
ceddec9141
HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets
2015-11-03 20:47:20 -08:00
chenheng
6871724104
HBASE-12986 Compaction pressure based client pushback
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-11-03 18:32:08 -08:00
stack
e4bf77e2de
HBASE-14754 TestFastFailWithoutTestUtil failing on trunk now in #testPreemptiveFastFailException50Times
2015-11-03 16:20:55 -08:00
Jesse Yates
1b8b612b8b
HBASE-14715 Add javadocs to DelegatingRetryingCallable
2015-11-02 16:20:55 -08:00
stack
9630fec2d5
Revert "HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets"
...
Revert. Seems to have destabilized the build
This reverts commit 6dbb5a8052
.
2015-11-02 08:17:41 -08:00
stack
6dbb5a8052
HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets
2015-11-01 22:26:43 -08:00
Jonathan M Hsieh
4c25549e9f
HBASE-14711 Remove or annotate deprecated methods in HRegionInfo
2015-11-01 04:29:51 -08:00
Elliott Clark
ec651bfc7b
HBASE-14687 Un-synchronize BufferedMutator
...
Summary:
Use concurrent collections and atomic longs to keep track of edits in buffered mutator.
This keeps buffered mutator as thread safe but it means that shared buffered mutators are not contending on thread locking.
Test Plan: Unit Tests.
Differential Revision: https://reviews.facebook.net/D49467
2015-10-30 13:27:25 -07:00
Matteo Bertozzi
4b91a6425e
HBASE-14714 some cleanup to snapshot code
2015-10-29 13:48:59 -07:00
Jonathan M Hsieh
094d65e6f5
HBASE-14673 Exorcise deprecated Delete#delete* api
2015-10-29 11:15:34 -07:00