Commit Graph

12526 Commits

Author SHA1 Message Date
Ted Yu 003cc103aa HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles 2018-11-25 21:48:55 -08:00
Ted Yu a586b4b0a2 HBASE-21387 Addendum fix TestSnapshotFileCache
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-24 17:01:09 +08:00
huzheng fe99ebb0ef HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files 2018-11-23 12:07:27 +08:00
huzheng 9cef4e1141 HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags 2018-11-14 23:29:25 +08:00
huzheng 814c3690dc HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS 2018-11-10 10:41:38 +08:00
Ben Lau 68c9396685
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
Amend HBASE-21439 Update RSGroup Test too

Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-11-08 14:21:51 -08:00
xcang 36178f7443
HBASE-21373 (backport from HBASE-21338) Warn if balancer is an ill-fit for cluster size
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:58:04 -08:00
Esteban Gutierrez efc203a5a2
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-07 18:24:13 -08:00
Toshihiro Suzuki 5fcfdcdc51 HBASE-21347 Backport HBASE-21200 "Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner." to branch-1
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-11-06 14:00:34 -05:00
han.congcong f967bfdca7 HBASE-21328 add HBASE_DISABLE_HADOOP_CLASSPATH_LOOKUP switch to hbase-env.sh
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 86cbbdea9e)
2018-11-06 08:40:04 -06:00
Michael Stack 9c47c74487
HBASE-21424 Change flakies and nightlies so scheduled less often
Have flakies run every four hours instead of every hour and
nightlies every 12 hours instead of every 6.
2018-11-01 10:13:46 -07:00
Duo Zhang daaa06e6bd HBASE-21417 Pre commit build is broken due to surefire plugin crashes 2018-11-01 15:15:18 +08:00
TAK LON WU 0ec3c49c9d HBASE-21318 Make RefreshHFilesClient runnable
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-10-24 14:50:03 -07:00
Allan Yang 5f5f4e82b1 HBASE-21357 RS should abort if OOM in Reader thread 2018-10-24 11:10:20 +08:00
huzheng f73d6193e1 HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles 2018-10-22 21:26:12 +08:00
huzheng ad79442d8a HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split 2018-10-22 11:05:56 +08:00
Wellington Chevreuil b2705cc6b3 HBASE-21275 - Thrift Server (branch 1 fix) -> Disable TRACE HTTP method for thrift http server (branch 1 only) 2018-10-16 22:35:18 -07:00
subrat.mishra 0128fed9dd
HBASE-21263 Mention compression algorithm along with other storefile details
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
2018-10-16 13:39:13 -07:00
Andrew Purtell ea90846268
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-15 14:51:24 -07:00
Andrew Purtell ebad3ab8ed HBASE-21256 Improve IntegrationTestBigLinkedList for testing huge data
Backport to branch-1

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-15 10:53:34 +08:00
Tyler Mi d385ba1a5d HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
Test fixes by: Taklon Wu <wutaklon@amazon.com>

Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-10-12 11:13:16 -07:00
wellington b73aab8bc1 HBASE-21185 - WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes 2018-10-11 14:39:14 -07:00
Sean Busbey 9050402ff2 HBASE-21103 nightly job should make sure cached yetus will run.
Signed-off-by: Mike Drob <mdrob@apache.org>
(cherry picked from commit 5b6b85aed6)
2018-10-11 10:33:03 -05:00
Andrew Purtell ed7beacf98
HBASE-21283 Add new shell command 'rit' for listing regions in transition 2018-10-10 10:02:55 -07:00
Andrew Purtell 1cba67b8ba
HBASE-21000 Default limits for PressureAwareCompactionThroughputController are too low
Based on experimental results adjust default pressure-aware compaction
throughput controller settings to bring compaction time with default
settings in line with those measured on branch-1.4 and below.

hbase.hstore.compaction.throughput.lower.bound = 52428800
hbase.hstore.compaction.throughput.higher.bound = 104857600
2018-10-09 18:46:35 -07:00
Mike Drob ac94011677
HBASE-20764 build broken when latest commit is gpg signed
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-08 19:53:34 -05:00
tedyu cbc2876ac2 HBASE-21272 Re-add assertions for RS Group admin tests 2018-10-05 21:34:46 -07:00
Andrew Purtell ae606c3d7a
HBASE-21265 Split up TestRSGroups
Signed-off-by: Ted Yu <tyu@apache.org>
2018-10-04 14:13:38 -07:00
Xu Cang 6e0ee4efa7
HBASE-18549 Add metrics for failed replication queue recovery
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:39:24 -07:00
Andrew Purtell 113554ded3
HBASE-21261 Add log4j.properties for hbase-rsgroup tests 2018-10-01 18:09:40 -07:00
Xu Cang e8e4beacb0
HBASE-19275 TestSnapshotFileCache never worked properly
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 17:15:29 -07:00
Xu Cang baeeaa1b21
HBASE-21117 fix table locking when moveTables, fix HBASE-20666 rsgroups issue
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 16:58:29 -07:00
tedyu 50ae53c536
HBASE-21258 Add resetting of flags for RS Group pre/post hooks in TestRSGroups
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-10-01 16:45:44 -07:00
Andrew Purtell 81bd854f77
Revert "HBASE-21258 Add resetting of flags for RS Group pre/post hooks in TestRSGroups"
This reverts commit a8f0f1d95a.
2018-10-01 16:24:20 -07:00
tedyu a8f0f1d95a HBASE-21258 Add resetting of flags for RS Group pre/post hooks in TestRSGroups 2018-10-01 15:09:01 -07:00
tedyu 8b26882fb4 HBASE-21207 Add client side sorting functionality in master web UI for table and region server details - addendum fixes RAT complaint 2018-09-30 11:00:57 -07:00
Kiran Kumar Maturi 121fad31ce
HBASE-20857 balancer status tag in jmx metrics
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:04:49 -07:00
Archana Katiyar c5cf80dc87
HBASE-21207 Add client side sorting functionality in master web UI for table and region server details
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 15:35:52 -07:00
ramie-raufdeen 3edf1154fe
HBASE-19418 configurable range of delay in PeriodicMemstoreFlusher
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 14:34:28 -07:00
xcang f1111e6f97
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 11:50:53 -07:00
Allan Yang 0b6e2907bd HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later 2018-09-27 16:44:46 +08:00
ffernandez92 04c732e9de HBASE-20766 Typo in VerifyReplication error.
closes #80.

Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 8f8d571779)
2018-09-26 14:56:57 -07:00
Allan Yang 823b790000 HBASE-21212 Wrong flush time when update flush metric 2018-09-26 19:40:43 +08:00
Zach York a00adb0b45 HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:54:44 +08:00
Reid Chan c6a1334528 Revert "HBASE-20993. [Auth] IPC client fallback to simple auth allowed doesn't work"
Revert reason: It breaks phoenix client.

This reverts commit 8dbb0b0487.
2018-09-22 10:13:14 +08:00
Francis Liu 5f8de7314c
HBASE-20704 Sometimes some compacted storefiles are not archived on region close, branch-1 backport
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:12:11 -07:00
Andrew Purtell bb529b706f
HBASE-21203 TestZKMainServer#testCommandLineWorks won't pass with default 4lw whitelist
Recent versions of ZooKeeper whitelist the so-called 4-letter word admin
commands, and 'stat' is not in the default whitelist. Set system property
zookeeper.4lw.commands.whitelist=* in MiniZooKeeperCluster#setupTestEnv
as we do not need to whitelist 4-letter commands for unit tests.
2018-09-21 15:37:33 -07:00
openinx bf62e30c18 HBASE-21206 Scan with batch size may return incomplete cells 2018-09-20 22:25:40 +08:00
jackbearden 8dbb0b0487 HBASE-20993. [Auth] IPC client fallback to simple auth allowed doesn't work
Amending-Author: Reid Chan <reidchan@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-19 10:53:24 +08:00
Guangxu Cheng c458757f10 HBASE-21179 Fix the number of actions in responseTooSlow log
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
2018-09-13 15:10:19 +08:00