12588 Commits

Author SHA1 Message Date
Xiang Li
ed6939f94a
HBASE-21866 Do not move the table to null rsgroup when creating an existing table 2019-02-18 10:56:31 -08:00
lujie
322ea5456f
HBASE-21740 Fix NPE while shutting down RS 2019-02-18 02:53:46 -08:00
Andrew Purtell
afba39399a
Update CHANGES.txt for 1.5.0 RC1 1.5.0RC1 2019-02-14 14:39:21 -08:00
Andrew Purtell
493a4cde31
Revert "Update CHANGES.txt for 1.5.0 RC1"
This reverts commit 256c3d985561b0b1fb00355eb7d21511b95b49dc.

Somehow this commit has incorrect authorship attribution.
2019-02-14 14:38:07 -08:00
Sean Busbey
6296bad9cf HBASE-21884 Fix box/unbox findbugs warning in secure bulk load
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-13 07:40:07 -06:00
zhangduo
256c3d9855
Update CHANGES.txt for 1.5.0 RC1 2019-02-12 11:04:03 -08:00
zhangduo
6caf5aa195
HBASE-21838 Create a special ReplicationEndpoint just for verifying the WAL entries are fine
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/VerifyWALEntriesReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestVerifyCellsReplicationEndpoint.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-02-12 10:58:29 -08:00
Sean Busbey
5b9e0df234 HBASE-21853 update copyright notices for contributions in 2019.
Signed-off-by: Amit Virmani <avirmani@cloudera.com>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 1817725083ce98c928969a74570b9c72637bece3)
2019-02-07 14:12:07 -06:00
Andrew Purtell
1acdec96cb
Revert "HBASE-21775 The BufferedMutator doesn't ever refresh region location cache Fix server location metadata refresh in multi-actions"
This reverts commit 4e89d98d4adf24059a193efd3fb7f1143a936c90.

Several unit tests are failing after this commit.
2019-02-05 14:01:37 -08:00
Peter Somogyi
48e8675728 HBASE-21727 Simplify documentation around client timeout - ADDENDUM
Add back HBaseConfiguration#getInt with deprecation

Signed-off-by: zhangduo <zhangduo@apache.org>
2019-02-05 18:28:03 +01:00
Andrew Purtell
ce6a6014da
Update POMs and CHANGES.txt for 1.5.0 RC0 1.5.0RC0 2019-02-01 12:36:10 -08:00
Andrew Purtell
38e2dbc503
Rebase CHANGES.txt on branch-1.4 2019-02-01 11:37:58 -08:00
Andrew Purtell
dd9e7a1ce0
HBASE-21791 Upgrade thrift dependency to 0.12.0 2019-01-29 11:04:59 -08:00
Tommy Li
4e89d98d4a HBASE-21775 The BufferedMutator doesn't ever refresh region location cache Fix server location metadata refresh in multi-actions
This is a backport from branch-2 but we do not backport the test because
it uses branch-2-isms.

Signed-off-by: stack <stack@apache.org>
2019-01-26 13:46:26 -08:00
Andrew Purtell
ff0e587b8f
HBASE-21735 Port HBASE-18784 (Use of filesystem that requires hflush / hsync / append / etc should query outputstream capabilities) to branch-1
HBASE-18784 if available, query underlying outputstream capabilities where we need hflush/hsync.

* pull things that don't rely on HDFS in hbase-server/FSUtils into hbase-common/CommonFSUtils
* refactor setStoragePolicy so that it can move into hbase-common/CommonFSUtils
* refactor WALProcedureStore so that it handles its own FS interactions
* add a reflection-based lookup of stream capabilities
* call said lookup in places where we make WALs to make sure hflush/hsync is available.

HBASE-19289 Add flag to disable stream capability enforcement

HBASE-19841 Tests against hadoop3 fail with StreamLacksCapabilityException

HBASE-19947 ITU should overwrite HTU local FS

HBASE-20354 better docs for impact of proactively checking hsync support.

* Add to the quickstart guide disabling the hsync check, with a
  big warning about how we'll lose data if the check is disabled.
* Add to troubleshooting section so folks searching can get a pointer.
2019-01-24 09:23:14 -08:00
Andrew Purtell
b51c487206
HBASE-21748 Port HBASE-21738 (Remove all the CLSM#size operation in our memstore because it's an quite time consuming) to branch-1 2019-01-23 18:09:11 -08:00
Nihal Jain
c1c2bc2f0a
HBASE-21475 Put mutation (having TTL set) added via co-processor is retrieved even after TTL expires
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverForAddingMutationsFromCoprocessors.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-23 17:01:20 -08:00
Allan Yang
20759a3c7e
HBASE-20870 Wrong HBase root dir in ITBLL's Search Tool
Conflicts:
	hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-23 16:12:09 -08:00
Andrew Purtell
d3ce26101e
HBASE-21766 TestSimpleRpcScheduler is flaky (branch-1) 2019-01-23 14:55:04 -08:00
Sergey Shelukhin
7cefd8bc25 HBASE-21575 : memstore above high watermark message is logged too much 2019-01-22 16:41:43 -08:00
huzheng
3015e23c09 HBASE-21734 Some optimization in FilterListWithOR 2019-01-22 12:01:52 +08:00
xcang
acdd23ec4c
HBASE-21561 Backport HBASE-21413 (Empty meta log doesn't get split when restart whole cluster) to branch-1
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-21 18:06:48 -08:00
Nihal Jain
aa1b750899
HBASE-21749 RS UI may throw NPE and make rs-status page inaccessible with multiwal and replication
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-21 17:31:13 -08:00
Andrew Purtell
1fd76bd35a
HBASE-21680 Port HBASE-20194 (Basic Replication WebUI - Master) and HBASE-20193 (Basic Replication Web UI - Regionserver) to branch-1
HBASE-20193 Basic Replication Web UI - Regionserver

HBASE-20194 Basic Replication WebUI - Master
2019-01-21 17:25:20 -08:00
xcang
3a11028cdf
Throw DNRIOE when connection or rpc client is closed
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-17 18:02:29 -08:00
Nihal Jain
0546b77a31
HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1
Signed-off-by: Guanghao Zhang <zghao@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-17 17:48:53 -08:00
Peter Somogyi
cad3630c70
HBASE-21727 Simplify documentation around client timeout
Signed-off-by: Michael Stack <stack@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClientScanner.java
	src/main/asciidoc/_chapters/configuration.adoc
	src/main/asciidoc/_chapters/troubleshooting.adoc

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-17 16:59:12 -08:00
Pankaj
52b8978212
HBASE-21595 Print thread's information and stack traces when RS is aborting forcibly
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-17 10:40:55 -08:00
Andrew Purtell
2c0b6f8227
HBASE-21616 Port HBASE-21034 (Add new throttle type: read/write capacity unit) to branch-1
HBASE-21034 Add new throttle type: read/write capacity unit

HBASE-21578 Fix wrong throttling exception for capacity unit
2019-01-16 15:59:46 -08:00
Beluga Behr
0315c2d65d HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 3e92cd5771d20ee3bd60049ddb6d14c7fff3a647)
2019-01-16 14:50:41 -07:00
openinx
cd0645a5f6
HBASE-21675 Port HBASE-21642 (CopyTable by reading snapshot and bulkloading will save a lot of time) to branch-1
HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-16 10:03:43 -08:00
Peter Somogyi
cf87877fcf HBASE-21711 Remove references to git.apache.org/hbase.git 2019-01-16 10:05:15 +01:00
Peter Somogyi
936ff59b76 HBASE-21685 Change repository urls to Gitbox
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-01-15 10:44:45 +01:00
Guanghao Zhang
336de0aed4
HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionCoprocessorHost.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 16:07:28 -08:00
jingyuntian
18891467fa
HBASE-20986 Separate the config of block size when we do log splitting and write Hlog
Signed-off-by: Guanghao Zhang <zghao@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/FSHLogProvider.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 14:22:15 -08:00
Ashish Singhi
feb8a57a9a
HBASE-16499 slow replication for small HBase clusters
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2019-01-14 14:10:19 -08:00
Nihal Jain
a3e274cf57
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 11:24:08 -08:00
Andrew Purtell
d6a3e6b404
HBASE-21679 Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
HBASE-6028 Start/Stop compactions at region server level

Add switching on/off of compactions.

Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
2019-01-11 18:08:27 -08:00
Guanghao Zhang
e7ff91f35e
HBASE-21325 Force to terminate regionserver when abort hang in somewhere
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerAbortTimeout.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 17:56:48 -08:00
Mingliang Liu
f3f3798575
HBASE-21164 reportForDuty should do backoff rather than retry
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 16:50:45 -08:00
Saurabh Singh
231e6d56b5
HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow
HBASE-20928 Rewrite calculation of midpoint - addendum (Xu Cang)

Signed-off-by: tedyu <yuzhihong@gmail.com>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/RowIndexSeekerV1.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 14:40:51 -08:00
Chia-Ping Tsai
2f541f5710
HBASE-21208 Bytes#toShort doesn't work without unsafe
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
Signed-off-by: Reid Chan <reidchan@apache.org>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
	hbase-common/src/test/java/org/apache/hadoop/hbase/util/TestBytes.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 14:40:51 -08:00
Sahil Aggarwal
21cfff857d
HBASE-20716 Unsafe access cleanup
Changes the bytes[] conversion done in Bytes and ByteBufferUtils.
Instead of doing check unsafe_aligned available everytime, choose
the best converter at startup.

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/FuzzyRowFilter.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/util/ByteBufferUtils.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 14:40:45 -08:00
mazhenlin
582c649783
HBASE-21374 Backport HBASE-21342 to branch-1
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-10 15:44:44 -08:00
Sean Busbey
6b87541de8
HBASE-21687 Update Findbugs Maven Plugin to 3.0.4 to work with Maven 3.6.0+
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-08 10:50:02 -08:00
Peter Somogyi
f9afd92548 HBASE-21547 Precommit uses master flaky list for other branches
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-01-02 08:41:46 +01:00
BELUGA BEHR
beeb0796e5
HBASE-21492 CellCodec Written To WAL Before It's Verified
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractProtobufLogWriter.java
2018-12-31 12:29:04 -08:00
openinx
55a775b8d4 HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-25 09:49:38 +08:00
Guanghao Zhang
98640e4b2c HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 14:03:12 +08:00
xuqinya
bbf17e6149 HBASE-21592 quota.addGetResult(r) throw NPE
Signed-off-by: huzheng <openinx@gmail.com>
2018-12-18 18:56:22 +08:00