4e89d98d4a
HBASE-21775 The BufferedMutator doesn't ever refresh region location cache Fix server location metadata refresh in multi-actions
...
This is a backport from branch-2 but we do not backport the test because
it uses branch-2-isms.
Signed-off-by: stack <stack@apache.org>
2019-01-26 13:46:26 -08:00
ff0e587b8f
HBASE-21735 Port HBASE-18784 (Use of filesystem that requires hflush / hsync / append / etc should query outputstream capabilities) to branch-1
...
HBASE-18784 if available, query underlying outputstream capabilities where we need hflush/hsync.
* pull things that don't rely on HDFS in hbase-server/FSUtils into hbase-common/CommonFSUtils
* refactor setStoragePolicy so that it can move into hbase-common/CommonFSUtils
* refactor WALProcedureStore so that it handles its own FS interactions
* add a reflection-based lookup of stream capabilities
* call said lookup in places where we make WALs to make sure hflush/hsync is available.
HBASE-19289 Add flag to disable stream capability enforcement
HBASE-19841 Tests against hadoop3 fail with StreamLacksCapabilityException
HBASE-19947 ITU should overwrite HTU local FS
HBASE-20354 better docs for impact of proactively checking hsync support.
* Add to the quickstart guide disabling the hsync check, with a
big warning about how we'll lose data if the check is disabled.
* Add to troubleshooting section so folks searching can get a pointer.
2019-01-24 09:23:14 -08:00
b51c487206
HBASE-21748 Port HBASE-21738 (Remove all the CLSM#size operation in our memstore because it's an quite time consuming) to branch-1
2019-01-23 18:09:11 -08:00
c1c2bc2f0a
HBASE-21475 Put mutation (having TTL set) added via co-processor is retrieved even after TTL expires
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverForAddingMutationsFromCoprocessors.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-23 17:01:20 -08:00
20759a3c7e
HBASE-20870 Wrong HBase root dir in ITBLL's Search Tool
...
Conflicts:
hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestingUtility.java
hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-23 16:12:09 -08:00
d3ce26101e
HBASE-21766 TestSimpleRpcScheduler is flaky (branch-1)
2019-01-23 14:55:04 -08:00
7cefd8bc25
HBASE-21575 : memstore above high watermark message is logged too much
2019-01-22 16:41:43 -08:00
3015e23c09
HBASE-21734 Some optimization in FilterListWithOR
2019-01-22 12:01:52 +08:00
acdd23ec4c
HBASE-21561 Backport HBASE-21413 (Empty meta log doesn't get split when restart whole cluster) to branch-1
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-21 18:06:48 -08:00
aa1b750899
HBASE-21749 RS UI may throw NPE and make rs-status page inaccessible with multiwal and replication
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-21 17:31:13 -08:00
1fd76bd35a
HBASE-21680 Port HBASE-20194 (Basic Replication WebUI - Master) and HBASE-20193 (Basic Replication Web UI - Regionserver) to branch-1
...
HBASE-20193 Basic Replication Web UI - Regionserver
HBASE-20194 Basic Replication WebUI - Master
2019-01-21 17:25:20 -08:00
3a11028cdf
Throw DNRIOE when connection or rpc client is closed
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-17 18:02:29 -08:00
0546b77a31
HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-17 17:48:53 -08:00
cad3630c70
HBASE-21727 Simplify documentation around client timeout
...
Signed-off-by: Michael Stack <stack@apache.org>
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClientScanner.java
src/main/asciidoc/_chapters/configuration.adoc
src/main/asciidoc/_chapters/troubleshooting.adoc
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-17 16:59:12 -08:00
52b8978212
HBASE-21595 Print thread's information and stack traces when RS is aborting forcibly
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-17 10:40:55 -08:00
2c0b6f8227
HBASE-21616 Port HBASE-21034 (Add new throttle type: read/write capacity unit) to branch-1
...
HBASE-21034 Add new throttle type: read/write capacity unit
HBASE-21578 Fix wrong throttling exception for capacity unit
2019-01-16 15:59:46 -08:00
0315c2d65d
HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink
...
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 3e92cd5771
2019-01-16 14:50:41 -07:00
cd0645a5f6
HBASE-21675 Port HBASE-21642 (CopyTable by reading snapshot and bulkloading will save a lot of time) to branch-1
...
HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-16 10:03:43 -08:00
cf87877fcf
HBASE-21711 Remove references to git.apache.org/hbase.git
2019-01-16 10:05:15 +01:00
936ff59b76
HBASE-21685 Change repository urls to Gitbox
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-01-15 10:44:45 +01:00
336de0aed4
HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionCoprocessorHost.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 16:07:28 -08:00
18891467fa
HBASE-20986 Separate the config of block size when we do log splitting and write Hlog
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALUtil.java
hbase-server/src/main/java/org/apache/hadoop/hbase/wal/FSHLogProvider.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 14:22:15 -08:00
feb8a57a9a
HBASE-16499 slow replication for small HBase clusters
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2019-01-14 14:10:19 -08:00
a3e274cf57
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 11:24:08 -08:00
d6a3e6b404
HBASE-21679 Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
...
HBASE-6028 Start/Stop compactions at region server level
Add switching on/off of compactions.
Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
2019-01-11 18:08:27 -08:00
e7ff91f35e
HBASE-21325 Force to terminate regionserver when abort hang in somewhere
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerAbortTimeout.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 17:56:48 -08:00
f3f3798575
HBASE-21164 reportForDuty should do backoff rather than retry
...
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 16:50:45 -08:00
231e6d56b5
HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow
...
HBASE-20928 Rewrite calculation of midpoint - addendum (Xu Cang)
Signed-off-by: tedyu <yuzhihong@gmail.com>
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/RowIndexSeekerV1.java
hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 14:40:51 -08:00
2f541f5710
HBASE-21208 Bytes#toShort doesn't work without unsafe
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
hbase-common/src/test/java/org/apache/hadoop/hbase/util/TestBytes.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 14:40:51 -08:00
21cfff857d
HBASE-20716 Unsafe access cleanup
...
Changes the bytes[] conversion done in Bytes and ByteBufferUtils.
Instead of doing check unsafe_aligned available everytime, choose
the best converter at startup.
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/filter/FuzzyRowFilter.java
hbase-common/src/main/java/org/apache/hadoop/hbase/util/ByteBufferUtils.java
hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 14:40:45 -08:00
582c649783
HBASE-21374 Backport HBASE-21342 to branch-1
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-10 15:44:44 -08:00
6b87541de8
HBASE-21687 Update Findbugs Maven Plugin to 3.0.4 to work with Maven 3.6.0+
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-08 10:50:02 -08:00
f9afd92548
HBASE-21547 Precommit uses master flaky list for other branches
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-01-02 08:41:46 +01:00
beeb0796e5
HBASE-21492 CellCodec Written To WAL Before It's Verified
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractProtobufLogWriter.java
2018-12-31 12:29:04 -08:00
55a775b8d4
HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-25 09:49:38 +08:00
98640e4b2c
HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result
2018-12-21 14:03:12 +08:00
bbf17e6149
HBASE-21592 quota.addGetResult(r) throw NPE
...
Signed-off-by: huzheng <openinx@gmail.com>
2018-12-18 18:56:22 +08:00
049307c9a7
HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type
2018-12-15 21:08:09 +08:00
5c8c945e34
HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum)
...
(cherry picked from commit a284c493b127fbf785fbee401f0854ad1979eb26)
(cherry picked from commit aa36c3f6b6
2018-12-14 15:56:36 -06:00
4e7fc18fb6
HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit.
2018-12-13 11:55:28 -08:00
81dc223ae7
HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time
2018-12-12 21:31:36 +08:00
bd33a1ef96
HBASE-21553 schedLock not released in MasterProcedureScheduler
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-12-10 17:56:53 -08:00
19c3663119
HBASE-21567 Allow overriding configs starting up the shell
...
Adds support for -D as option to 'hbase shell'
2018-12-10 10:13:05 -08:00
e80cc3286c
HBASE-21464 Splitting blocked with meta NSRE during split transaction
...
Signed-off-by: Lars Hofhansl <larsh@apache.org>
2018-12-05 10:54:35 -08:00
333cd19728
HBASE-21546 ConnectException in TestThriftHttpServer
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-12-04 16:02:23 +01:00
547f3fc2dc
Revert "HBASE-21464 Splitting blocked with meta NSRE during split transaction"
...
This reverts commit bd87f4ebcd
2018-11-30 14:41:57 -08:00
fd175a4d48
HBASE-21359 Fix build problem against Hadoop 2.8.5
2018-11-30 12:03:56 -08:00
bd87f4ebcd
HBASE-21464 Splitting blocked with meta NSRE during split transaction
...
When looking up the locations of hbase:meta with useCache false, clear all previous
cache entries for it first
Fix Table reference leaks in MetaTableAccessor with try-with-resources
Signed-off-by: Allan Yang <allan163@apache.org>
2018-11-30 09:57:54 -08:00
f1e2f077fa
HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived.
2018-11-30 10:24:09 +08:00
003cc103aa
HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles
2018-11-25 21:48:55 -08:00
Tommy Li
Andrew Purtell
Nihal Jain
Allan Yang
Sergey Shelukhin
huzheng
xcang
Peter Somogyi
Pankaj
Beluga Behr
Guanghao Zhang
jingyuntian
Ashish Singhi
Mingliang Liu
Saurabh Singh
Chia-Ping Tsai
Sahil Aggarwal
mazhenlin
Sean Busbey
xuqinya
Lars Hofhansl
stack
Ted Yu