Commit Graph

12788 Commits

Author SHA1 Message Date
huzheng 049307c9a7 HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type 2018-12-15 21:08:09 +08:00
Sean Busbey 5c8c945e34 HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum)
(cherry picked from commit a284c493b127fbf785fbee401f0854ad1979eb26)
(cherry picked from commit aa36c3f6b6)
2018-12-14 15:56:36 -06:00
Lars Hofhansl 4e7fc18fb6 HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. 2018-12-13 11:55:28 -08:00
huzheng 81dc223ae7 HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time 2018-12-12 21:31:36 +08:00
xcang bd33a1ef96
HBASE-21553 schedLock not released in MasterProcedureScheduler
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-12-10 17:56:53 -08:00
stack 19c3663119 HBASE-21567 Allow overriding configs starting up the shell
Adds support for -D as option to 'hbase shell'
2018-12-10 10:13:05 -08:00
Andrew Purtell e80cc3286c
HBASE-21464 Splitting blocked with meta NSRE during split transaction
Signed-off-by: Lars Hofhansl <larsh@apache.org>
2018-12-05 10:54:35 -08:00
Peter Somogyi 333cd19728 HBASE-21546 ConnectException in TestThriftHttpServer
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-12-04 16:02:23 +01:00
Andrew Purtell 547f3fc2dc
Revert "HBASE-21464 Splitting blocked with meta NSRE during split transaction"
This reverts commit bd87f4ebcd

Committed change is insufficient. Was able to reproduce the problem again.
2018-11-30 14:41:57 -08:00
Andrew Purtell fd175a4d48
HBASE-21359 Fix build problem against Hadoop 2.8.5 2018-11-30 12:03:56 -08:00
Andrew Purtell bd87f4ebcd
HBASE-21464 Splitting blocked with meta NSRE during split transaction
When looking up the locations of hbase:meta with useCache false, clear all previous
cache entries for it first

Fix Table reference leaks in MetaTableAccessor with try-with-resources

Signed-off-by: Allan Yang <allan163@apache.org>
2018-11-30 09:57:54 -08:00
huzheng f1e2f077fa HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived. 2018-11-30 10:24:09 +08:00
Ted Yu 003cc103aa HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles 2018-11-25 21:48:55 -08:00
Ted Yu a586b4b0a2 HBASE-21387 Addendum fix TestSnapshotFileCache
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-24 17:01:09 +08:00
huzheng fe99ebb0ef HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files 2018-11-23 12:07:27 +08:00
huzheng 9cef4e1141 HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags 2018-11-14 23:29:25 +08:00
huzheng 814c3690dc HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS 2018-11-10 10:41:38 +08:00
Ben Lau 68c9396685
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
Amend HBASE-21439 Update RSGroup Test too

Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-11-08 14:21:51 -08:00
xcang 36178f7443
HBASE-21373 (backport from HBASE-21338) Warn if balancer is an ill-fit for cluster size
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:58:04 -08:00
Esteban Gutierrez efc203a5a2
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-07 18:24:13 -08:00
Toshihiro Suzuki 5fcfdcdc51 HBASE-21347 Backport HBASE-21200 "Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner." to branch-1
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-11-06 14:00:34 -05:00
han.congcong f967bfdca7 HBASE-21328 add HBASE_DISABLE_HADOOP_CLASSPATH_LOOKUP switch to hbase-env.sh
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 86cbbdea9e)
2018-11-06 08:40:04 -06:00
Michael Stack 9c47c74487
HBASE-21424 Change flakies and nightlies so scheduled less often
Have flakies run every four hours instead of every hour and
nightlies every 12 hours instead of every 6.
2018-11-01 10:13:46 -07:00
Duo Zhang daaa06e6bd HBASE-21417 Pre commit build is broken due to surefire plugin crashes 2018-11-01 15:15:18 +08:00
TAK LON WU 0ec3c49c9d HBASE-21318 Make RefreshHFilesClient runnable
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-10-24 14:50:03 -07:00
Allan Yang 5f5f4e82b1 HBASE-21357 RS should abort if OOM in Reader thread 2018-10-24 11:10:20 +08:00
huzheng f73d6193e1 HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles 2018-10-22 21:26:12 +08:00
huzheng ad79442d8a HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split 2018-10-22 11:05:56 +08:00
Wellington Chevreuil b2705cc6b3 HBASE-21275 - Thrift Server (branch 1 fix) -> Disable TRACE HTTP method for thrift http server (branch 1 only) 2018-10-16 22:35:18 -07:00
subrat.mishra 0128fed9dd
HBASE-21263 Mention compression algorithm along with other storefile details
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
2018-10-16 13:39:13 -07:00
Andrew Purtell ea90846268
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-15 14:51:24 -07:00
Andrew Purtell ebad3ab8ed HBASE-21256 Improve IntegrationTestBigLinkedList for testing huge data
Backport to branch-1

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-15 10:53:34 +08:00
Tyler Mi d385ba1a5d HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
Test fixes by: Taklon Wu <wutaklon@amazon.com>

Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-10-12 11:13:16 -07:00
wellington b73aab8bc1 HBASE-21185 - WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes 2018-10-11 14:39:14 -07:00
Sean Busbey 9050402ff2 HBASE-21103 nightly job should make sure cached yetus will run.
Signed-off-by: Mike Drob <mdrob@apache.org>
(cherry picked from commit 5b6b85aed6)
2018-10-11 10:33:03 -05:00
Andrew Purtell ed7beacf98
HBASE-21283 Add new shell command 'rit' for listing regions in transition 2018-10-10 10:02:55 -07:00
Andrew Purtell 1cba67b8ba
HBASE-21000 Default limits for PressureAwareCompactionThroughputController are too low
Based on experimental results adjust default pressure-aware compaction
throughput controller settings to bring compaction time with default
settings in line with those measured on branch-1.4 and below.

hbase.hstore.compaction.throughput.lower.bound = 52428800
hbase.hstore.compaction.throughput.higher.bound = 104857600
2018-10-09 18:46:35 -07:00
Mike Drob ac94011677
HBASE-20764 build broken when latest commit is gpg signed
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-08 19:53:34 -05:00
tedyu cbc2876ac2 HBASE-21272 Re-add assertions for RS Group admin tests 2018-10-05 21:34:46 -07:00
Andrew Purtell ae606c3d7a
HBASE-21265 Split up TestRSGroups
Signed-off-by: Ted Yu <tyu@apache.org>
2018-10-04 14:13:38 -07:00
Xu Cang 6e0ee4efa7
HBASE-18549 Add metrics for failed replication queue recovery
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:39:24 -07:00
Andrew Purtell 113554ded3
HBASE-21261 Add log4j.properties for hbase-rsgroup tests 2018-10-01 18:09:40 -07:00
Xu Cang e8e4beacb0
HBASE-19275 TestSnapshotFileCache never worked properly
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 17:15:29 -07:00
Xu Cang baeeaa1b21
HBASE-21117 fix table locking when moveTables, fix HBASE-20666 rsgroups issue
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 16:58:29 -07:00
tedyu 50ae53c536
HBASE-21258 Add resetting of flags for RS Group pre/post hooks in TestRSGroups
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-10-01 16:45:44 -07:00
Andrew Purtell 81bd854f77
Revert "HBASE-21258 Add resetting of flags for RS Group pre/post hooks in TestRSGroups"
This reverts commit a8f0f1d95a.
2018-10-01 16:24:20 -07:00
tedyu a8f0f1d95a HBASE-21258 Add resetting of flags for RS Group pre/post hooks in TestRSGroups 2018-10-01 15:09:01 -07:00
tedyu 8b26882fb4 HBASE-21207 Add client side sorting functionality in master web UI for table and region server details - addendum fixes RAT complaint 2018-09-30 11:00:57 -07:00
Kiran Kumar Maturi 121fad31ce
HBASE-20857 balancer status tag in jmx metrics
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:04:49 -07:00
Archana Katiyar c5cf80dc87
HBASE-21207 Add client side sorting functionality in master web UI for table and region server details
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 15:35:52 -07:00