Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,513 Commits 95 Branches 866 Tags
Commit Graph

5260 Commits

Author SHA1 Message Date
Nihal Jain
0546b77a31
HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1 
Signed-off-by: Guanghao Zhang <zghao@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-17 17:48:53 -08:00
Pankaj
52b8978212
HBASE-21595 Print thread's information and stack traces when RS is aborting forcibly 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-01-17 10:40:55 -08:00
Andrew Purtell
2c0b6f8227
HBASE-21616 Port HBASE-21034 (Add new throttle type: read/write capacity unit) to branch-1 
HBASE-21034 Add new throttle type: read/write capacity unit

HBASE-21578 Fix wrong throttling exception for capacity unit
 2019-01-16 15:59:46 -08:00
Beluga Behr
0315c2d65d HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink 
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 3e92cd5771d20ee3bd60049ddb6d14c7fff3a647)
 2019-01-16 14:50:41 -07:00
openinx
cd0645a5f6
HBASE-21675 Port HBASE-21642 (CopyTable by reading snapshot and bulkloading will save a lot of time) to branch-1 
HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-01-16 10:03:43 -08:00
Guanghao Zhang
336de0aed4
HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor 
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionCoprocessorHost.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-14 16:07:28 -08:00
jingyuntian
18891467fa
HBASE-20986 Separate the config of block size when we do log splitting and write Hlog 
Signed-off-by: Guanghao Zhang <zghao@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/FSHLogProvider.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-14 14:22:15 -08:00
Ashish Singhi
feb8a57a9a
HBASE-16499 slow replication for small HBase clusters 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2019-01-14 14:10:19 -08:00
Nihal Jain
a3e274cf57
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-14 11:24:08 -08:00
Andrew Purtell
d6a3e6b404
HBASE-21679 Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1 
HBASE-6028 Start/Stop compactions at region server level

Add switching on/off of compactions.

Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
 2019-01-11 18:08:27 -08:00
Guanghao Zhang
e7ff91f35e
HBASE-21325 Force to terminate regionserver when abort hang in somewhere 
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerAbortTimeout.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-11 17:56:48 -08:00
Mingliang Liu
f3f3798575
HBASE-21164 reportForDuty should do backoff rather than retry 
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-11 16:50:45 -08:00
Saurabh Singh
231e6d56b5
HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow 
HBASE-20928 Rewrite calculation of midpoint - addendum (Xu Cang)

Signed-off-by: tedyu <yuzhihong@gmail.com>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/RowIndexSeekerV1.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2019-01-11 14:40:51 -08:00
mazhenlin
582c649783
HBASE-21374 Backport HBASE-21342 to branch-1 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-01-10 15:44:44 -08:00
BELUGA BEHR
beeb0796e5
HBASE-21492 CellCodec Written To WAL Before It's Verified 
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractProtobufLogWriter.java
 2018-12-31 12:29:04 -08:00
openinx
55a775b8d4 HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
 2018-12-25 09:49:38 +08:00
Guanghao Zhang
98640e4b2c HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 14:03:12 +08:00
xuqinya
bbf17e6149 HBASE-21592 quota.addGetResult(r) throw NPE 
Signed-off-by: huzheng <openinx@gmail.com>
 2018-12-18 18:56:22 +08:00
huzheng
049307c9a7 HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type 2018-12-15 21:08:09 +08:00
Sean Busbey
5c8c945e34 HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum) 
(cherry picked from commit a284c493b127fbf785fbee401f0854ad1979eb26)
(cherry picked from commit aa36c3f6b69ef47b6f53158eda4a87e1a72e4fad)
 2018-12-14 15:56:36 -06:00
Lars Hofhansl
4e7fc18fb6 HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. 2018-12-13 11:55:28 -08:00
huzheng
81dc223ae7 HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time 2018-12-12 21:31:36 +08:00
xcang
bd33a1ef96
HBASE-21553 schedLock not released in MasterProcedureScheduler 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-12-10 17:56:53 -08:00
huzheng
f1e2f077fa HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived. 2018-11-30 10:24:09 +08:00
Ted Yu
003cc103aa HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles 2018-11-25 21:48:55 -08:00
Ted Yu
a586b4b0a2 HBASE-21387 Addendum fix TestSnapshotFileCache 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-11-24 17:01:09 +08:00
huzheng
fe99ebb0ef HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files 2018-11-23 12:07:27 +08:00
huzheng
9cef4e1141 HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags 2018-11-14 23:29:25 +08:00
huzheng
814c3690dc HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS 2018-11-10 10:41:38 +08:00
Ben Lau
68c9396685
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions 
Amend HBASE-21439 Update RSGroup Test too

Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Amending-Author: Andrew Purtell <apurtell@apache.org>
 2018-11-08 14:21:51 -08:00
xcang
36178f7443
HBASE-21373 (backport from HBASE-21338) Warn if balancer is an ill-fit for cluster size 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-11-08 10:58:04 -08:00
Esteban Gutierrez
efc203a5a2
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-11-07 18:24:13 -08:00
Toshihiro Suzuki
5fcfdcdc51 HBASE-21347 Backport HBASE-21200 "Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner." to branch-1 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
 2018-11-06 14:00:34 -05:00
Allan Yang
5f5f4e82b1 HBASE-21357 RS should abort if OOM in Reader thread 2018-10-24 11:10:20 +08:00
huzheng
f73d6193e1 HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles 2018-10-22 21:26:12 +08:00
huzheng
ad79442d8a HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split 2018-10-22 11:05:56 +08:00
subrat.mishra
0128fed9dd
HBASE-21263 Mention compression algorithm along with other storefile details 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
 2018-10-16 13:39:13 -07:00
Andrew Purtell
ea90846268
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-15 14:51:24 -07:00
Tyler Mi
d385ba1a5d HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3 
Test fixes by: Taklon Wu <wutaklon@amazon.com>

Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
 2018-10-12 11:13:16 -07:00
wellington
b73aab8bc1 HBASE-21185 - WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes 2018-10-11 14:39:14 -07:00
Xu Cang
6e0ee4efa7
HBASE-18549 Add metrics for failed replication queue recovery 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-01 18:39:24 -07:00
Xu Cang
e8e4beacb0
HBASE-19275 TestSnapshotFileCache never worked properly 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-01 17:15:29 -07:00
Xu Cang
baeeaa1b21
HBASE-21117 fix table locking when moveTables, fix HBASE-20666 rsgroups issue 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-01 16:58:29 -07:00
Kiran Kumar Maturi
121fad31ce
HBASE-20857 balancer status tag in jmx metrics 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-09-28 16:04:49 -07:00
Archana Katiyar
c5cf80dc87
HBASE-21207 Add client side sorting functionality in master web UI for table and region server details 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-09-28 15:35:52 -07:00
ramie-raufdeen
3edf1154fe
HBASE-19418 configurable range of delay in PeriodicMemstoreFlusher 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-09-28 14:34:28 -07:00
xcang
f1111e6f97
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-09-28 11:50:53 -07:00
Allan Yang
0b6e2907bd HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later 2018-09-27 16:44:46 +08:00
ffernandez92
04c732e9de HBASE-20766 Typo in VerifyReplication error. 
closes #80.

Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 8f8d57177952a7dc8f3a4a6e6ad5d4f3d51744c0)
 2018-09-26 14:56:57 -07:00
Allan Yang
823b790000 HBASE-21212 Wrong flush time when update flush metric 2018-09-26 19:40:43 +08:00