d6a3e6b404
HBASE-21679 Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
...
HBASE-6028 Start/Stop compactions at region server level
Add switching on/off of compactions.
Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
2019-01-11 18:08:27 -08:00
e7ff91f35e
HBASE-21325 Force to terminate regionserver when abort hang in somewhere
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerAbortTimeout.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 17:56:48 -08:00
f3f3798575
HBASE-21164 reportForDuty should do backoff rather than retry
...
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 16:50:45 -08:00
231e6d56b5
HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow
...
HBASE-20928 Rewrite calculation of midpoint - addendum (Xu Cang)
Signed-off-by: tedyu <yuzhihong@gmail.com>
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/RowIndexSeekerV1.java
hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 14:40:51 -08:00
582c649783
HBASE-21374 Backport HBASE-21342 to branch-1
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-10 15:44:44 -08:00
beeb0796e5
HBASE-21492 CellCodec Written To WAL Before It's Verified
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractProtobufLogWriter.java
2018-12-31 12:29:04 -08:00
55a775b8d4
HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-25 09:49:38 +08:00
98640e4b2c
HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result
2018-12-21 14:03:12 +08:00
bbf17e6149
HBASE-21592 quota.addGetResult(r) throw NPE
...
Signed-off-by: huzheng <openinx@gmail.com>
2018-12-18 18:56:22 +08:00
049307c9a7
HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type
2018-12-15 21:08:09 +08:00
5c8c945e34
HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum)
...
(cherry picked from commit a284c493b127fbf785fbee401f0854ad1979eb26)
(cherry picked from commit aa36c3f6b6
2018-12-14 15:56:36 -06:00
4e7fc18fb6
HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit.
2018-12-13 11:55:28 -08:00
81dc223ae7
HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time
2018-12-12 21:31:36 +08:00
bd33a1ef96
HBASE-21553 schedLock not released in MasterProcedureScheduler
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-12-10 17:56:53 -08:00
f1e2f077fa
HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived.
2018-11-30 10:24:09 +08:00
003cc103aa
HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles
2018-11-25 21:48:55 -08:00
a586b4b0a2
HBASE-21387 Addendum fix TestSnapshotFileCache
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-24 17:01:09 +08:00
fe99ebb0ef
HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files
2018-11-23 12:07:27 +08:00
9cef4e1141
HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags
2018-11-14 23:29:25 +08:00
814c3690dc
HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS
2018-11-10 10:41:38 +08:00
68c9396685
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
...
Amend HBASE-21439 Update RSGroup Test too
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-11-08 14:21:51 -08:00
36178f7443
HBASE-21373 (backport from HBASE-21338) Warn if balancer is an ill-fit for cluster size
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:58:04 -08:00
efc203a5a2
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-07 18:24:13 -08:00
5fcfdcdc51
HBASE-21347 Backport HBASE-21200 "Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner." to branch-1
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-11-06 14:00:34 -05:00
5f5f4e82b1
HBASE-21357 RS should abort if OOM in Reader thread
2018-10-24 11:10:20 +08:00
f73d6193e1
HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles
2018-10-22 21:26:12 +08:00
ad79442d8a
HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split
2018-10-22 11:05:56 +08:00
0128fed9dd
HBASE-21263 Mention compression algorithm along with other storefile details
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
2018-10-16 13:39:13 -07:00
ea90846268
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-15 14:51:24 -07:00
d385ba1a5d
HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
...
Test fixes by: Taklon Wu <wutaklon@amazon.com>
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-10-12 11:13:16 -07:00
b73aab8bc1
HBASE-21185 - WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes
2018-10-11 14:39:14 -07:00
6e0ee4efa7
HBASE-18549 Add metrics for failed replication queue recovery
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:39:24 -07:00
e8e4beacb0
HBASE-19275 TestSnapshotFileCache never worked properly
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 17:15:29 -07:00
baeeaa1b21
HBASE-21117 fix table locking when moveTables, fix HBASE-20666 rsgroups issue
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 16:58:29 -07:00
121fad31ce
HBASE-20857 balancer status tag in jmx metrics
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:04:49 -07:00
c5cf80dc87
HBASE-21207 Add client side sorting functionality in master web UI for table and region server details
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 15:35:52 -07:00
3edf1154fe
HBASE-19418 configurable range of delay in PeriodicMemstoreFlusher
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 14:34:28 -07:00
f1111e6f97
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 11:50:53 -07:00
0b6e2907bd
HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later
2018-09-27 16:44:46 +08:00
04c732e9de
HBASE-20766 Typo in VerifyReplication error.
...
closes #80 .
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 8f8d571779
2018-09-26 14:56:57 -07:00
823b790000
HBASE-21212 Wrong flush time when update flush metric
2018-09-26 19:40:43 +08:00
a00adb0b45
HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:54:44 +08:00
c6a1334528
Revert "HBASE-20993. [Auth] IPC client fallback to simple auth allowed doesn't work"
...
Revert reason: It breaks phoenix client.
This reverts commit 8dbb0b0487
2018-09-22 10:13:14 +08:00
5f8de7314c
HBASE-20704 Sometimes some compacted storefiles are not archived on region close, branch-1 backport
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:12:11 -07:00
bb529b706f
HBASE-21203 TestZKMainServer#testCommandLineWorks won't pass with default 4lw whitelist
...
Recent versions of ZooKeeper whitelist the so-called 4-letter word admin
commands, and 'stat' is not in the default whitelist. Set system property
zookeeper.4lw.commands.whitelist=* in MiniZooKeeperCluster#setupTestEnv
as we do not need to whitelist 4-letter commands for unit tests.
2018-09-21 15:37:33 -07:00
bf62e30c18
HBASE-21206 Scan with batch size may return incomplete cells
2018-09-20 22:25:40 +08:00
8dbb0b0487
HBASE-20993. [Auth] IPC client fallback to simple auth allowed doesn't work
...
Amending-Author: Reid Chan <reidchan@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-19 10:53:24 +08:00
0a2ebdce15
HBASE-21168 BloomFilterUtil uses hardcoded randomness (Mike Drob)
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-12 13:28:48 -07:00
158607bf23
HBASE-21021 Result returned by Append operation should be ordered
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 15:04:50 -07:00
895dac0819
HBASE-21173 Remove the duplicate HRegion#close in TestHRegion
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 17:46:43 +08:00
d4d0a21b55
HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 14:12:24 +08:00
0c6226b56c
HBASE-21162 Revert suspicious change to BoundedByteBufferPool and disable use of direct buffers for IPC reservoir by default
...
Revert suspicious change to BoundedByteBufferPool made on HBASE-19239 (Fix
findbugs and error-prone issues).
In addition the allocation of direct memory for the server RPC reservoir is
problematic in that tracing native memory or direct buffer leaks to a
particular class or compilation unit is difficult, so allocate the reservoir
on the heap by default instead.
2018-09-10 18:25:27 -07:00
6f4cbde103
HBASE-20307 LoadTestTool prints too much zookeeper logging (Colin Garcia)
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/util/LoadTestTool.java
2018-09-07 16:50:56 -07:00
d236a5fab8
HBASE-21166 Creating a CoprocessorHConnection re-retrieves the cluster id from ZK.
2018-09-07 15:16:54 -07:00
e03e4c9f5a
HBASE-21138 Close HRegion instance at the end of every test in TestHRegion
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-06 17:51:51 -07:00
3e45e0202b
HBASE-21061 Fix inconsistent synchronization in RpcServer
...
move variables that we don't need synchronized access to out of the critical block.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-09-05 23:13:37 -05:00
d07cab18a6
HBASE-21088 HStoreFile should be closed in HStore#hasReferences
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
2018-09-05 15:13:06 -07:00
dbb634ad1b
HBASE-21127 TableRecordReader need to handle cursor result too
2018-09-05 14:46:59 +08:00
cf198a65e8
Revert "HBASE-15728 Add Per-Table metrics back"
...
This reverts commit fb74f215b4
2018-09-04 13:12:20 -07:00
dfb1af4892
Revert "Amend HBASE-15728 Add Per-Table metrics back"
...
This reverts commit 72f29f48ea
2018-09-04 13:12:17 -07:00
72f29f48ea
Amend HBASE-15728 Add Per-Table metrics back
...
Fix a NPE surfaced by TestRegionLocationFinder
2018-09-04 12:48:10 -07:00
484a1d8049
HBASE-21126 Configurable number of allowed failures for ZooKeeper Canary
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-09-03 19:44:17 -07:00
fb74f215b4
HBASE-15728 Add Per-Table metrics back
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-29 16:36:45 -07:00
492d69daa5
Amend HBASE-20940 HStore.cansplit should not allow split to happen if it has references (Vishal Khandelwal)
...
Fix TestHBaseFsck failure
2018-08-28 11:04:08 -07:00
0840427516
HBASE-20942 Fix ArrayIndexOutOfBoundsException for RpcServer TRACE logging
...
Also makes the trace log message length configurable.
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-28 11:25:08 -04:00
3c17c8391e
HBASE-20890 PE filterScan seems to be stuck forever
2018-08-27 12:51:55 +05:30
d1ebc3d2a8
HBASE-21069 NPE in StoreScanner.updateReaders causes RS to crash
2018-08-20 15:50:47 -07:00
e2974f4b91
HBASE-21042 processor.getRowsToLock() always assumes there is some row being locked in HRegion#processRowsWithLocks
2018-08-18 11:47:23 -07:00
56c59f11e3
HBASE-20940 HStore.cansplit should not allow split to happen if it has references (Vishal Khandelwal)
2018-08-17 15:30:40 -07:00
971d48406e
HBASE-21047 Object creation of StoreFileScanner thru constructor and close may leave refCount to -1 (Vishal Khandelwal)
2018-08-16 11:43:24 -07:00
5520fa1ab3
HBASE-20469 Directory used for sidelining old recovered edits files should be made configurable
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-15 18:01:43 -07:00
1b50fe5372
HBASE-20997 rebuildUserRegions() does not build ReplicaMapping during master switchover
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Pankaj Kumar <Username: pankaj2461t>
2018-08-06 11:25:02 -07:00
0298c06b4f
HBASE-19036 Add action in Chaos Monkey to restart Active Namenode
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-02 05:04:27 -07:00
a15c445743
HBASE-20935 HStore.removeCompactedFiles should log in case it is unable to delete a file (Vishal Khandelwal)
2018-07-31 16:12:50 -07:00
ab3ec9477a
HBASE-20930 MetaScanner.metaScan should respect meta table name (Vishal Khandelwal)
2018-07-30 17:12:03 -04:00
9b5a839b99
HBASE-20974 Backport HBASE-20583 (SplitLogWorker should handle FileNotFoundException when split a wal) to branch-1 (Pankaj Kumar)
2018-07-30 12:34:45 -07:00
2d70120eb3
HBASE-20895 NPE in RpcServer#readAndProcess
...
Synchronize readAndProcess() on the Connection to avoid MT issues with
data buffer management
2018-07-27 18:07:58 -07:00
0b7081e67a
HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result
2018-07-24 10:25:43 +08:00
3a97976eae
HBASE-20744 Address FindBugs warnings in branch-1
...
minor fix
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-23 16:29:13 -07:00
dfc7ecd9ca
HBASE-20230 Incorrrect log message in RSRpcServices
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 16:01:33 -07:00
56aa9ab8a3
HBASE-20908 Infinite loop on regionserver if region replica are reduced
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 13:11:39 -07:00
2eaa24a132
HBASE-17885 Backport HBASE-15871 to branch-1
...
HBASE-15871 Memstore flush doesn't finish because of backwardseek() in memstore scanner (ramkrishna.s.vasudevan)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 12:27:52 -07:00
a7fe71da88
HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region
2018-07-23 10:04:10 -07:00
9db4a4059a
HBASE-20401 Make `MAX_WAIT` and `waitIfNotFinished` in CleanerContext configurable
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-23 17:16:08 +08:00
896b69a0fc
HBASE-20559 Backport HBASE-18083 (Make large/small file clean thread number configurable in HFileCleaner) to branch-1
...
The last port commit of HBASE-20555
Signed-off-by: Yu Li <liyu@apache.org>
2018-07-23 11:36:47 +08:00
780724b15a
HBASE-20558 Port HBASE-17854 (Use StealJobQueue in HFileCleaner after HBASE-17215) to branch-1
...
The third port commit of HBASE-20555
2018-07-20 16:11:09 -07:00
e5618a6674
HBASE-20672 New metrics ReadRequestRate and WriteRequestRate
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-19 15:36:01 -07:00
15ed2e86e1
HBASE-20855 PeerConfigTracker only supporting one listener will cause problem when there is a recovered replication queue
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-19 08:43:23 -07:00
7211d13ac8
HBASE-20889 PE scan is failing with NullPointerException
2018-07-16 09:53:47 -07:00
6edb27e1e6
HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations()
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-07-11 11:33:32 +08:00
f2dc754aa3
HBASE-20651 Master, prevents hbck or shell command to reassign the split parent region
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2018-07-10 16:07:30 -07:00
99189f284b
HBASE-20858 Port HBASE-20695 (Implement table level RegionServer replication metrics) to branch-1
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-09 12:19:21 -07:00
a52c6bf2f3
HBASE-20557 Backport HBASE-17215 to branch-1
...
The second backport of HBASE-20555
Signed-off-by: Zach York <zyork@apache.org>
2018-07-09 11:32:04 -07:00
a4db453c6d
HBASE-20806 Split style journal for flushes and compactions
2018-07-09 18:44:07 +05:30
77e5668ed2
HBASE-20808 Wrong shutdown order between Chores and ChoreService
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-07 00:32:33 +08:00
154b77307f
HBASE-20826 Truncate really long RpcServer warnings unless TRACE is on
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-05 17:21:30 -07:00
50f7894cc4
HBASE-20691 Change the default WAL storage policy back to "NONE""
...
This partially reverts HBASE-19858 and adds more doc about why we choose "NONE" as the default.
2018-07-05 15:26:56 +08:00
a25cf7bbdb
HBASE-20789 TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky
2018-07-04 09:49:07 +08:00
f94ad9d78f
HBASE-20450 Provide metrics for number of total active, priority and replication rpc handlers
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-02 11:19:19 -07:00
cc8e1cc393
HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-29 15:25:06 -07:00
2fd69cf93c
HBASE-19722 Implement a meta query statistics metrics source
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-28 17:17:50 -07:00
c81d0aff95
HBASE-20732 Shutdown scan pool when master is stopped
2018-06-28 12:36:50 +08:00
03946a389a
HBASE-20785 NPE getting metrics in PE testing scans
2018-06-27 12:04:21 -07:00
ccead1264c
HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do
...
General log cleanup; setting stuff that can flood the log to TRACE.
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-06-26 15:54:47 -07:00
4936750d3a
HBASE-20701 too much logging when balancer runs from BaseLoadBalancer
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-25 17:17:31 -07:00
6fa9f0bea9
HBASE-20723 Custom hbase.wal.dir results in data loss because we write recovered edits into a different place than where the recovering region server looks for them
2018-06-15 19:51:33 -07:00
bed3b2bbae
HBASE-20556 Backport HBASE-16490 to branch-1
...
Backport by: taklonwu@gmail.com
Signed-off-by: Zach York <zyork@apache.org>
2018-06-12 12:34:05 -07:00
c596fb6c3f
HBASE-20605 Excludes Azure's new filesystem from the SecureBulkLoadEndpoint perm check
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-06-06 16:23:51 -04:00
409531209e
HBASE-20670 NPE in HMaster#isInMaintenanceMode
2018-06-04 13:03:16 -07:00
07487cb0b1
HBASE-20667 Rename TestGlobalThrottler to TestReplicationGlobalThrottler
2018-06-01 16:47:26 -07:00
a25878cf40
HBASE-18116 Replication source in-memory accounting should not include bulk transfer hfiles
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-06-01 13:34:43 -07:00
08b7ed1656
Revert "HBASE-18116 fix replication source in-memory calculation by excluding bulk load file"
...
This reverts commit dcb5b5a012
2018-05-31 15:28:50 -07:00
dcb5b5a012
HBASE-18116 fix replication source in-memory calculation by excluding bulk load file
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-05-31 14:22:07 -07:00
f4ac15999a
Amend HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1
...
Suppress error-prone false positive
2018-05-30 13:46:46 -07:00
011989665e
HBASE-20597 Serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint
2018-05-29 11:25:25 -07:00
5a0bb1c6b8
Revert "HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint"
...
This reverts commit 1b70763b9e
2018-05-29 11:25:25 -07:00
289d588af3
HBASE-20647 Backport HBASE-20616 "TruncateTableProcedure is stuck in retry loop in TRUNCATE_TABLE_CREATE_FS_LAYOUT state" to branch-1
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-25 06:18:43 -07:00
87d4e4e4e2
HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1
2018-05-24 18:06:12 -07:00
b892be7440
HBASE-20548 Master fails to startup on large clusters, refreshing block distribution
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-24 12:27:19 -07:00
1b70763b9e
HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint
2018-05-23 16:45:55 -07:00
6d1aa2800b
HBASE-20486 Change default throughput controller to PressureAwareThroughputController
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-22 12:43:31 -07:00
2d493556f3
HBASE-20571 JMXJsonServlet generates invalid JSON if it has NaN in metrics
...
- CacheStats won't generate NaN metrics.
- JSONBean class will serialize special floating point values as
"NaN", "Infinity" or "-Infinity"
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-16 11:50:31 -07:00
2a309d71cc
HBASE-20545 Improve performance of BaseLoadBalancer.retainAssignment
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-15 18:17:52 -07:00
944a221b74
HBASE-20447 Only fail cacheBlock if block collisions aren't related to next block metadata
...
When we pread, we don't force the read to read all of the next block header.
However, when we get into a race condition where two opener threads try to
cache the same block and one thread read all of the next block header and
the other one didn't, it will fail the open process. This is especially important
in a splitting case where it will potentially fail the split process.
Instead, in the caches, we should only fail if the required blocks are different.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-14 16:09:36 -07:00
ca544a155c
HBASE-20004 Client is not able to execute REST queries in a secure cluster
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-05-10 22:49:08 +05:30
c191462ac3
HBASE-20554 "WALs outstanding" message from CleanerChore is noisy
2018-05-09 19:13:17 -07:00
5406f63332
HBASE-20204 Add locking to RefreshFileConnections in BucketCache
...
This is a follow-up to HBASE-20141 where Anoop suggested adding locking
for refreshing channels.
2018-05-09 14:15:02 -07:00
9d9d5aec0e
HBASE-20505 PE should support multi column family read and write cases
2018-05-07 18:39:18 -07:00
91f3de89ab
HBASE-20523 PE tool should support configuring client side buffering sizes
...
(Ram)
2018-05-07 14:41:08 +05:30
23b9054089
HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation
2018-05-04 17:59:28 -07:00
fd24083e26
HBASE-20517 Fix PerformanceEvaluation 'column' parameter
2018-05-04 17:24:38 -07:00
e793e7c30c
HBASE-20493 Port HBASE-19994 (Create a new class for RPC throttling exception, make it retryable) to branch-1
2018-04-26 15:38:40 -07:00
71c573239b
HBASE-20496 TestGlobalThrottler failing on branch-1 since revert of HBASE-9465
...
Temporarily disable TestGlobalThrottler on branch-1
2018-04-26 15:38:40 -07:00
eb67d4e308
HBASE-19924 hbase rpc throttling does not work for multi() with request count rater.
2018-04-26 10:43:59 -07:00
f11cf007a2
HBASE-20229 ConnectionImplementation.locateRegions() returns duplicated entries when region replication is on
2018-04-25 13:36:12 -07:00
e60189035e
HBASE-20406 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 22:45:49 -05:00
eacf3cb296
Revert "HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods"
...
This reverts commit fe84833ea2
2018-04-20 22:45:37 -05:00
fe84833ea2
HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 15:15:31 -05:00
8a244e51d7
HBASE-20006 TestRestoreSnapshotFromClientWithRegionReplicas is flakey
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClientWithRegionReplicas.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionReplayEvents.java
2018-04-20 11:34:45 -05:00
03eb3d24b6
HBASE-19850 The number of Offline Regions is wrong after restoring a snapshot
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-17 20:29:50 -07:00
ce4c243399
HBASE-20404 Fixes to CleanChore correctness and operability.
...
* Make CleanerChore less chatty: move WARN message to DEBUG when we expect non-empty dirs
* Make CleanerChore less chatty: move IOE we'll retry to INFO
* CleanerChore should treat IOE for FileStatus as a failure
* Add tests asserting assumptions in above
Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestCleanerChore.java
hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
2018-04-17 13:05:41 -05:00
a817f196a1
HBASE-15291 FileSystem not closed in secure bulkLoad
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-04-11 12:59:52 +05:30
427c95e2e5
HBASE-20352 [Chore] Backport HBASE-18309 (Support multi threads in CleanerChore) to branch-1
...
Signed-off-by: Yu Li <liyu@apache.org>
2018-04-11 14:17:51 +08:00
eacbe002e5
HBASE-19343 Restore snapshot makes split parent region online
2018-04-09 07:48:34 -07:00
2f683cd438
HBASE-20301 Remove the meaningless plus sign from table.jsp
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-04 20:10:46 +08:00
9ced0c936f
Amend HBASE-20322 CME in StoreScanner causes region server crash
...
memStoreScanners is immutable so create a new list for closing.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-04-03 13:22:43 -07:00
875a12de05
HBASE-20322 CME in StoreScanner causes region server crash
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-04-02 19:36:16 -07:00
18c54b02b1
HBASE-17631 Changed Canary interval to 60 seconds
2018-04-01 13:48:28 +02:00
9a6b6524a7
HBASE-20302 CatalogJanitor should log the reason why it is disabled (Vishal Khandelwal)
2018-03-29 10:20:34 -07:00
773af3e0ca
HBASE-20280 Fix possibility of deadlocking in refreshFileConnections
...
When prefetch on open is specified, there is a deadlocking case
where if the prefetch is cancelled, the PrefetchExecutor interrupts
the threads if necessary, when that happens in FileIOEngine, it
causes an ClosedByInterruptException which is a subclass of
ClosedChannelException. If we retry all ClosedChannelExceptions,
this will lock as this access is expected to be interrupted.
This change removes calling refreshFileConnections for
ClosedByInterruptExceptions.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-03-27 22:59:58 +00:00
caf4c4b4ee
HBASE-20261 Table page (table.jsp) in Master UI does not show replicaIds for hbase meta table
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-03-23 13:34:45 -04:00
f976b3a8af
HBASE-19024 Provide a configurable option to hsync WAL edits to the disk for better durability (Harshal Jain)
2018-03-20 17:51:59 -07:00
009295a3a6
[HBASE-20141] Fix TooManyFiles exception when RefreshingChannels
...
HBASE-19435 implements a fix for reopening file channels when they are unnexpected closed
to avoid disabling the BucketCache. However, it was missed that the the channels might not
actually be completely closed (the write or read channel might still be open
(see https://docs.oracle.com/javase/7/docs/api/java/nio/channels/ClosedChannelException.html )
This commit closes any open channels before creating a new channel.
2018-03-16 10:58:22 -07:00
a0b2141a95
HBASE-20146 Addendum Regions are stuck while opening when WAL is disabled
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-15 10:17:03 +08:00
5aeddb3051
HBASE-18864 (addendum) Fixed unit test failure TestFromClientSide#testIllegalTableDescriptor
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-03-14 13:57:08 -07:00
38471229f9
HBASE-20174 Fix TestZKLessMergeOnCluster flakiness
2018-03-12 16:57:59 -07:00
e81abb7259
HBASE-20146 Regions are stuck while opening when WAL is disabled
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-03-09 21:27:00 +08:00
41ff229a16
HBASE-20139 NPE in RSRpcServices.get() when getRegion throws an exception
2018-03-07 12:09:04 +05:30
c4401b6073
HBASE-19400 Add missing security checks in MasterRpcServices
...
- Added ADMIN permission check for following rpc calls:
normalize, setNormalizerRunning, runCatalogScan, enableCatalogJanitor, runCleanerChore,
setCleanerChoreRunning, execMasterService, execProcedure, execProcedureWithRet
- Moved authorizationEnabled check to start of AccessChecker's functions. Currently, and IDK why,
we call authManager.authorize() first and then discard its result if authorizationEnabled is false. Weird.
----
HBASE-19401 Add missing security checks in RSRpcServices
2018-02-28 11:52:16 -08:00
cdbf001d26
HBASE-19863 java.lang.IllegalStateException: isDelete failed when SingleColumnValueFilter is used
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: ramkrish86 <ramkrishna.s.vasudevan@gmail.com>
2018-02-28 13:35:43 -05:00
1be9a3d641
HBASE-20087 Periodically attempt redeploy of regions in FAILED_OPEN state
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-02-27 17:11:44 -08:00
9a7a36750f
HBASE-20102 AssignmentManager#shutdown doesn't shut down scheduled executor
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-02-27 17:11:28 -08:00
27f803f320
HBASE-19989 Addendum - temp override for tests to be added later for HBASE-20001
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-27 17:06:32 -08:00
40e0ee331c
HBASE-19989 - READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly
...
Author: Ben Lau <benlau@oath.com>
2018-02-27 12:41:48 -08:00
ece68d3c65
HBASE-20001 cleanIfNoMetaEntry() uses encoded instead of region name to lookup region
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-26 18:01:28 -08:00
a37c91bb41
HBASE-20061 HStore synchronized member variable filesCompacting should be private
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
2018-02-24 10:59:18 -06:00
343cdda9ae
HBASE-19364, Truncate_preserve fails with table when replica region > 1
2018-02-23 14:13:02 -08:00
ba7a936f74
Revert "HBASE-9465 Push entries to peer clusters serially"
...
This reverts commit 441bc050b9
2018-02-23 14:42:15 +08:00
0a284d2b76
Revert "HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)"
...
This reverts commit 97276da9a7
2018-02-23 14:42:04 +08:00
4d9589b165
HBASE-20052 TestRegionOpen#testNonExistentRegionReplica fails due to NPE
2018-02-22 12:41:13 -08:00
cadc2efd12
HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory; ADDEDNDUM to fix TestRegionOpen failure
2018-02-22 09:27:46 -08:00
af1f7cf431
HBASE-20016 TestCatalogJanitorInMemoryStates#testInMemoryForReplicaParentCleanup is flaky
2018-02-22 09:44:37 +08:00
a189674b4c
HBASE-19553, Old replica regions should be cleared from AM memory after primary region split or merge
...
Signed-off-by: Ted Yu <tedyu@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2018-02-21 16:52:40 -08:00
9e7e58d551
HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory
2018-02-21 16:25:13 -08:00
c5e692c1dc
HBASE-20027 Add test TestClusterPortAssignment
...
LocalHBaseCluster forces random port assignment for sake of concurrent unit test
execution friendliness, but we still need a positive test for RPC and info port
assignment.
2018-02-21 13:12:26 -08:00
c0bca137ff
HBASE-20008 [backport] NullPointerException when restoring a snapshot after splitting a region
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-20 20:29:08 -08:00
21f6830fe1
HBASE-20017 BufferedMutatorImpl submit the same mutation repeatedly
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-20 16:59:44 -08:00
fd8189d31d
Revert "HBASE-19970 Remove unused functions from TableAuthManager."
...
This reverts commit e6ce789b6f
2018-02-20 11:12:36 -08:00
071281cf52
Revert "HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager."
...
This reverts commit 0f79c497c5
2018-02-20 11:12:33 -08:00
7990546efe
HBASE-14897 TestTableLockManager.testReapAllTableLocks is flakey
...
(cherry picked from commit 47082579a8
2018-02-20 08:50:22 -06:00
28ebd29f0f
HBASE-18282 ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-14 17:23:23 -08:00
e65004aeea
HBASE-19996 Some nonce procs might not be cleaned up (follow up HBASE-19756)
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-14 09:17:13 -08:00
335b8a8e14
HBASE-19979 ReplicationSyncUp tool may leak Zookeeper connection (Pankaj Kumar)
2018-02-13 08:11:03 -08:00
f77b42b2af
HBASE-19876 The exception happening in converting pb mutation to hbase.mutation messes up the CellScanner
2018-02-13 21:29:01 +08:00
0f79c497c5
HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager.
2018-02-12 16:31:09 -08:00
e6ce789b6f
HBASE-19970 Remove unused functions from TableAuthManager.
...
Functions deleted: setTableUserPermissions, setTableGroupPermissions, setNamespaceUserPermissions,
setNamespaceGroupPermissions, writeTableToZooKeeper, writeNamespaceToZooKeeper
2018-02-12 16:20:36 -08:00
7ced28f099
HBASE-19972 Should rethrow the RetriesExhaustedWithDetailsException when failed to apply the batch in ReplicationSink
2018-02-11 14:58:36 +08:00
0cbb19201c
HBASE-19900 Region-level exception destroy the result of batch
2018-02-07 08:30:55 +08:00
5fa64fb72e
HBASE-19886 Display maintenance mode in shell, web UI
2018-02-06 15:59:44 -08:00
92f733db4b
HBASE-19934 HBaseSnapshotException when read replicas is enabled and online snapshot is taken after region splitting
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-06 11:19:22 -08:00
673e809250
HBASE-19528 - Major Compaction Tool
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-06 05:39:25 -08:00
bdeab93196
HBASE-19905 ReplicationSyncUp tool will not exit if a peer replication is disabled
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-02-04 18:24:32 +05:30
f35bcd2fe3
HBASE-19858 Backport HBASE-14061 (Support CF-level Storage Policy) to branch-1
...
HBASE-14061 Support CF-level Storage Policy
HBASE-14061 Support CF-level Storage Policy (addendum)
HBASE-14061 Support CF-level Storage Policy (addendum2)
HBASE-15172 Support setting storage policy in bulkload
HBASE-17538 HDFS.setStoragePolicy() logs errors on local fs
HBASE-18015 Storage class aware block placement for procedure v2 WALs
HBASE-18017 Reduce frequency of setStoragePolicy failure warnings
Default storage policy if not configured cannot be "NONE"
HBASE-19016 Coordinate storage policy property name for table schema and bulkload
Fix checkstyle warnings
Addressed additional review feedback on backport
2018-02-01 17:10:39 -08:00
e1bcf50b10
HBASE-19728 Add lock to filesCompacting in all place.
2018-01-31 17:01:58 +08:00
2c5140e151
HBASE-19756 Master NPE during completed failed proc eviction
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-01-24 16:48:54 -08:00
73ed127039
HBASE-15321 - Ability to open a HRegion from hdfs snapshot.
2018-01-22 12:22:57 -08:00
0f20c5e0fd
HBASE-19163 "Maximum lock count exceeded" from region server's batch processing
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-19 11:24:19 -08:00
779371625b
HBASE-19816 Refresh repliation sinks on UnknownHostException
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-17 16:26:25 -08:00
48025cc84b
HBASE-11409 - Add more flexibility for input directory structure to LoadIncrementalHFiles
2018-01-12 13:35:26 -08:00
b29a138ecc
HBASE-19483 Add proper privilege check for rsgroup commands addendum
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-11 11:00:07 -08:00
0ef6530aa1
HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-01-11 10:39:42 -08:00
6f1dd258b1
HBASE-19483 Add proper privilege check for rsgroup commands
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-10 02:25:47 -08:00
e6453ab84b
HBASE-19424 Fix NPE in "/metrics" servlet.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-01-08 15:09:27 -08:00
fa07c211ac
HBASE-19684 BlockCacheKey toString Performance
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-08 17:06:44 +08:00
b528cd01b7
HBASE-19708 Avoid NPE when the RPC listener's accept channel is closed
2018-01-05 09:58:03 -08:00
b5ec4d381c
HBASE-15580 Tag coprocessor limitedprivate scope to StoreFile.Reader
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-04 14:15:03 +08:00
939e016425
HBASE-19588 Additional jar dependencies needed for mapreduce
...
PerformanceEvaluation
Signed-off-by: Albert Chu <chu11@llnl.gov>
2018-01-03 21:33:25 -06:00
2c30c9bbb6
HBASE-19490 Rare failure in TestRateLimiter
2018-01-04 10:33:46 +08:00
490728ae7f
HBASE-19691 Removes Global(A) requirement for getClusterStatus
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-03 19:15:49 -05:00
fd33b3589e
HBASE-18625 Splitting of region with replica, doesn't update region list in serverHolding. A server crash leads to overlap.
...
Signed-off-by: ramkrishna.s.vasudevan<ramkrishna.s.vasudevan@intel.com>
2018-01-03 12:32:44 -08:00
6faed49ad1
HBASE-19358 Improve the stability of splitting log when do fail over
...
Signed-off-by: Yu Li <liyu@apache.org>
2018-01-02 17:25:49 +08:00
e866e837fb
HBASE-19551 hbck -boundaries doesn't work correctly (Toshihiro Suzuki)
2017-12-30 23:18:12 -08:00
528eb10826
HBASE-19545 Replace getBytes(StandardCharsets.UTF_8) with Bytes.toBytes
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 20:15:01 +08:00
64d2ebf9f3
HBASE-19514 TestJMXListener now uses random port
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2017-12-22 18:51:44 +01:00
d28732fd98
HBASE-19468 FNFE during scans and flushes (Ram)
2017-12-20 17:06:27 +05:30
08e948b188
HBASE-19546 TestMasterReplication.testCyclicReplication2 uses wrong assertion
2017-12-18 19:59:32 +08:00
ff023bcc4b
HBASE-19485 Minor improvement to TestCompactedHFilesDischarger (Ram)
2017-12-14 13:19:55 -08:00
54ca1db6bd
HBASE-19502 Make sure we have closed all StoreFileScanner if we fail to open any StoreFileScanners
2017-12-13 21:47:27 +08:00
b3167a0e50
Revert "HBASE-17425 Fixed deprecated calls in TestUpdateConfiguration"
...
This reverts commit c434cab5d1
2017-12-11 22:56:33 +01:00
c434cab5d1
HBASE-17425 Fixed deprecated calls in TestUpdateConfiguration
2017-12-09 14:44:50 +01:00
9e34d99c07
HBASE-19435 Reopen Files for ClosedChannelException in BucketCache
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-07 15:45:51 -08:00
5398d83bc7
HBASE-19446 Misspelled 'default' in SimpleRpcScheduler
2017-12-06 17:11:15 -08:00
70c7688271
HBASE-19447 INFO level logging of GetClusterStatus from HMaster is too chatty
2017-12-06 17:05:19 -08:00
f88304d162
HBASE-19442 Backport HBASE-19065 to branch-1 (HRegion#bulkLoadHFiles() should wait for concurrent Region#flush() to finish).
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-12-06 14:18:44 -08:00
6c2d51132f
HBASE-19445 PerformanceEvaluation NPE processing split policy option
2017-12-06 14:10:11 -08:00
1fe75f98d3
HBASE-19421 branch-1 does not compile against Hadoop 3.0.0
2017-12-04 15:48:38 -08:00
9d481b1c43
HBASE-19239 (addendum) Fix findbugs and error-prone warnings (branch-1)
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-12-04 10:18:53 -08:00
cb3bef3574
HBASE-19056 TestCompactionInDeadRegionServer is top of the flakies charts
2017-12-04 06:35:41 -08:00
15d16281a1
HBASE-19290 Reduce zk request when doing split log
2017-12-04 18:36:11 +08:00
4ec59d018d
HBASE-19252 Move the transform logic of FilterList into transformCell() method to avoid extra ref to question cell
2017-12-04 10:19:16 +08:00
25cc8feeb2
HBASE-19366 Backport to branch-1 HBASE-19035 Miss metrics when coprocessor use region scanner to read data
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-12-02 09:54:21 -08:00
525b2852e8
HBASE-19396 Fix flaky test TestHTableMultiplexerFlushCache
2017-12-02 19:43:32 +08:00
d2a54c98ba
HBASE-19406 Fix CompactionRequest equals and hashCode
2017-12-01 19:15:05 -08:00
ab1d5e05a8
HBASE-19395 [branch-1] TestEndToEndSplitTransaction.testMasterOpsWhileSplitting fails with NPE
2017-12-01 15:31:52 -08:00
6938720c12
HBASE-19326 Remove decommissioned servers from rsgroup
...
Signed-off-by: Michael Stack <stack@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminClient.java
hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminEndpoint.java
hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminServer.java
hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManagerImpl.java
hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroups.java
hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsBase.java
hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterCoprocessorHost.java
hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
hbase-shell/src/main/ruby/hbase/rsgroup_admin.rb
2017-12-01 12:15:43 -08:00
2f7a6f21eb
HBASE-18233 We shouldn't wait for readlock in doMiniBatchMutation in case of deadlock (Allan Yang)
...
This patch plus a sorting of the batch (HBASE-17924) fixes a regression
in Increment/CheckAndPut-style operations.
Signed-off-by: Yu Li <carp84@gmail.com>
Signed-off-by: Allan Yang <allanwin@163.com>
2017-11-30 17:10:27 -08:00
143ceb97ba
HBASE-19393 HTTP 413 FULL head while accessing HBase UI using SSL.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-11-30 17:03:32 -08:00
a4b9ac6050
HBASE-19388 - Incorrect value is being set for Compaction Pressure in RegionLoadStats object inside HRegion class
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-11-30 15:07:45 -08:00
4846300c8b
HBASE-19285 Implements table-level latency histograms
...
For a egionserver's view of a table (the regions
that belong to a table hosted on a regionserver),
this change tracks the latencies of operations that
affect the regions for this table.
Tracking at the per-table level avoids the memory bloat
and performance impact that accompanied the previous
per-region latency metrics while still providing important
details for operators to consume.
Signed-Off-By: Andrew Purtell <apurtell@apache.org>
2017-11-30 17:45:23 -05:00
1e00673047
HBASE-19385 [1.3] TestReplicator failed 1.3 nightly
2017-11-29 23:12:51 -08:00
4c413e0c50
HBASE-19376 Fix more binary compatibility problems with branch-1.4 / branch-1
2017-11-29 14:07:36 -08:00
41b4877950
HBASE-18090 Improve TableSnapshotInputFormat to allow more multiple mappers per region
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-28 14:56:38 -08:00
24d82195cb
HBASE-19348 Fix error-prone errors for branch-1
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-11-27 18:29:11 -08:00
f7f425e53e
HBASE-19300 TestMultithreadedTableMapper fails in branch-1.4
2017-11-27 11:41:46 -08:00
de16690b7a
HBASE-19325 Pass a list of server name to postClearDeadServers
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-11-28 02:39:55 +08:00
20d811121f
HBASE-19332 DumpReplicationQueues misreports total WAL size
2017-11-22 16:54:13 -08:00
d80d3fa454
HBASE-19239 Fix findbugs and error-prone issues
...
Fixes for hbase-server
2017-11-17 17:12:36 -08:00
1bde8656b1
HBASE-19276 RegionPlan should correctly implement equals and hashCode
...
Andrew's patch that adds equals and hash but revamping compare also.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-11-16 14:06:46 -08:00
641e797e02
HBASE-19245 MultiTableInputFormatBase#getSplits creates a Connection per Table
...
We make one Connection only instead of a Connection per table (Change is
just moving one line it involves right-shifting body of the function)
2017-11-14 21:48:45 -08:00
f9833a7802
HBASE-12091 Optionally ignore edits for dropped tables for replication.
2017-11-14 16:33:12 -08:00
Andrew Purtell
Guanghao Zhang
Mingliang Liu
Saurabh Singh
mazhenlin
BELUGA BEHR
openinx
xuqinya
Sean Busbey
Lars Hofhansl
xcang
Ted Yu
Ben Lau
Esteban Gutierrez
Toshihiro Suzuki
Allan Yang
subrat.mishra
Tyler Mi
wellington
Kiran Kumar Maturi
Archana Katiyar
ramie-raufdeen
ffernandez92
Zach York
Reid Chan
Francis Liu
jackbearden
Nihal Jain
Guangxu Cheng
David Manning
krish.dey
Vikas Vishwakarma
Huaxiang Sun
Monani Mihir
Josh Elser
Ankit Singhal
TAK LON WU
Ankit
jingyuntian
zhaoyuan
Huaxiang Sun
Abhishek Singh Chouhan
Yu Li
Michael Stack
Zach York
Thiruvel Thirumoolan
Balazs Meszaros
Ashish Singhi
Vasudevan
Kevin Risden
Reid Chan
Pankaj Kumar
Chia-Ping Tsai
Jan Hentschel
Sakthi
Apekshit Sharma
Sergey Soldatov
Rahul Gidwani
chenheng
binlijin
Thiruvel Thirumoolan
Scott Wilson
Rajeshbabu Chintaguntla
Peter Somogyi
ramkrish86
zhangduo
Harshal Deepakkumar Jain
libisthanks
Gary Helmling