Pankaj
52b8978212
HBASE-21595 Print thread's information and stack traces when RS is aborting forcibly
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-17 10:40:55 -08:00
Andrew Purtell
2c0b6f8227
HBASE-21616 Port HBASE-21034 (Add new throttle type: read/write capacity unit) to branch-1
...
HBASE-21034 Add new throttle type: read/write capacity unit
HBASE-21578 Fix wrong throttling exception for capacity unit
2019-01-16 15:59:46 -08:00
Beluga Behr
0315c2d65d
HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink
...
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 3e92cd5771
)
2019-01-16 14:50:41 -07:00
openinx
cd0645a5f6
HBASE-21675 Port HBASE-21642 (CopyTable by reading snapshot and bulkloading will save a lot of time) to branch-1
...
HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-16 10:03:43 -08:00
Guanghao Zhang
336de0aed4
HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionCoprocessorHost.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 16:07:28 -08:00
jingyuntian
18891467fa
HBASE-20986 Separate the config of block size when we do log splitting and write Hlog
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALUtil.java
hbase-server/src/main/java/org/apache/hadoop/hbase/wal/FSHLogProvider.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 14:22:15 -08:00
Ashish Singhi
feb8a57a9a
HBASE-16499 slow replication for small HBase clusters
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2019-01-14 14:10:19 -08:00
Nihal Jain
a3e274cf57
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRequestFutureImpl.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-14 11:24:08 -08:00
Andrew Purtell
d6a3e6b404
HBASE-21679 Port HBASE-6028 (Start/Stop compactions at region server level) to branch-1
...
HBASE-6028 Start/Stop compactions at region server level
Add switching on/off of compactions.
Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
2019-01-11 18:08:27 -08:00
Guanghao Zhang
e7ff91f35e
HBASE-21325 Force to terminate regionserver when abort hang in somewhere
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerAbortTimeout.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 17:56:48 -08:00
Mingliang Liu
f3f3798575
HBASE-21164 reportForDuty should do backoff rather than retry
...
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReportForDuty.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 16:50:45 -08:00
Saurabh Singh
231e6d56b5
HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow
...
HBASE-20928 Rewrite calculation of midpoint - addendum (Xu Cang)
Signed-off-by: tedyu <yuzhihong@gmail.com>
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/io/encoding/RowIndexSeekerV1.java
hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2019-01-11 14:40:51 -08:00
mazhenlin
582c649783
HBASE-21374 Backport HBASE-21342 to branch-1
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-10 15:44:44 -08:00
BELUGA BEHR
beeb0796e5
HBASE-21492 CellCodec Written To WAL Before It's Verified
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractProtobufLogWriter.java
2018-12-31 12:29:04 -08:00
openinx
55a775b8d4
HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-25 09:49:38 +08:00
Guanghao Zhang
98640e4b2c
HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result
2018-12-21 14:03:12 +08:00
xuqinya
bbf17e6149
HBASE-21592 quota.addGetResult(r) throw NPE
...
Signed-off-by: huzheng <openinx@gmail.com>
2018-12-18 18:56:22 +08:00
huzheng
049307c9a7
HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type
2018-12-15 21:08:09 +08:00
Sean Busbey
5c8c945e34
HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum)
...
(cherry picked from commit a284c493b127fbf785fbee401f0854ad1979eb26)
(cherry picked from commit aa36c3f6b6
)
2018-12-14 15:56:36 -06:00
Lars Hofhansl
4e7fc18fb6
HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit.
2018-12-13 11:55:28 -08:00
huzheng
81dc223ae7
HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time
2018-12-12 21:31:36 +08:00
xcang
bd33a1ef96
HBASE-21553 schedLock not released in MasterProcedureScheduler
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-12-10 17:56:53 -08:00
huzheng
f1e2f077fa
HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived.
2018-11-30 10:24:09 +08:00
Ted Yu
003cc103aa
HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles
2018-11-25 21:48:55 -08:00
Ted Yu
a586b4b0a2
HBASE-21387 Addendum fix TestSnapshotFileCache
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-24 17:01:09 +08:00
huzheng
fe99ebb0ef
HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files
2018-11-23 12:07:27 +08:00
huzheng
9cef4e1141
HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags
2018-11-14 23:29:25 +08:00
huzheng
814c3690dc
HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS
2018-11-10 10:41:38 +08:00
Ben Lau
68c9396685
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
...
Amend HBASE-21439 Update RSGroup Test too
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-11-08 14:21:51 -08:00
xcang
36178f7443
HBASE-21373 (backport from HBASE-21338) Warn if balancer is an ill-fit for cluster size
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:58:04 -08:00
Esteban Gutierrez
efc203a5a2
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-07 18:24:13 -08:00
Toshihiro Suzuki
5fcfdcdc51
HBASE-21347 Backport HBASE-21200 "Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner." to branch-1
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-11-06 14:00:34 -05:00
Allan Yang
5f5f4e82b1
HBASE-21357 RS should abort if OOM in Reader thread
2018-10-24 11:10:20 +08:00
huzheng
f73d6193e1
HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles
2018-10-22 21:26:12 +08:00
huzheng
ad79442d8a
HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split
2018-10-22 11:05:56 +08:00
subrat.mishra
0128fed9dd
HBASE-21263 Mention compression algorithm along with other storefile details
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
2018-10-16 13:39:13 -07:00
Andrew Purtell
ea90846268
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-15 14:51:24 -07:00
Tyler Mi
d385ba1a5d
HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
...
Test fixes by: Taklon Wu <wutaklon@amazon.com>
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-10-12 11:13:16 -07:00
wellington
b73aab8bc1
HBASE-21185 - WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes
2018-10-11 14:39:14 -07:00
Xu Cang
6e0ee4efa7
HBASE-18549 Add metrics for failed replication queue recovery
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:39:24 -07:00
Xu Cang
e8e4beacb0
HBASE-19275 TestSnapshotFileCache never worked properly
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 17:15:29 -07:00
Xu Cang
baeeaa1b21
HBASE-21117 fix table locking when moveTables, fix HBASE-20666 rsgroups issue
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 16:58:29 -07:00
Kiran Kumar Maturi
121fad31ce
HBASE-20857 balancer status tag in jmx metrics
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:04:49 -07:00
Archana Katiyar
c5cf80dc87
HBASE-21207 Add client side sorting functionality in master web UI for table and region server details
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 15:35:52 -07:00
ramie-raufdeen
3edf1154fe
HBASE-19418 configurable range of delay in PeriodicMemstoreFlusher
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 14:34:28 -07:00
xcang
f1111e6f97
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 11:50:53 -07:00
Allan Yang
0b6e2907bd
HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later
2018-09-27 16:44:46 +08:00
ffernandez92
04c732e9de
HBASE-20766 Typo in VerifyReplication error.
...
closes #80 .
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 8f8d571779
)
2018-09-26 14:56:57 -07:00
Allan Yang
823b790000
HBASE-21212 Wrong flush time when update flush metric
2018-09-26 19:40:43 +08:00
Zach York
a00adb0b45
HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:54:44 +08:00
Reid Chan
c6a1334528
Revert "HBASE-20993. [Auth] IPC client fallback to simple auth allowed doesn't work"
...
Revert reason: It breaks phoenix client.
This reverts commit 8dbb0b0487
.
2018-09-22 10:13:14 +08:00
Francis Liu
5f8de7314c
HBASE-20704 Sometimes some compacted storefiles are not archived on region close, branch-1 backport
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:12:11 -07:00
Andrew Purtell
bb529b706f
HBASE-21203 TestZKMainServer#testCommandLineWorks won't pass with default 4lw whitelist
...
Recent versions of ZooKeeper whitelist the so-called 4-letter word admin
commands, and 'stat' is not in the default whitelist. Set system property
zookeeper.4lw.commands.whitelist=* in MiniZooKeeperCluster#setupTestEnv
as we do not need to whitelist 4-letter commands for unit tests.
2018-09-21 15:37:33 -07:00
openinx
bf62e30c18
HBASE-21206 Scan with batch size may return incomplete cells
2018-09-20 22:25:40 +08:00
jackbearden
8dbb0b0487
HBASE-20993. [Auth] IPC client fallback to simple auth allowed doesn't work
...
Amending-Author: Reid Chan <reidchan@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-19 10:53:24 +08:00
Mingliang Liu
0a2ebdce15
HBASE-21168 BloomFilterUtil uses hardcoded randomness (Mike Drob)
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-12 13:28:48 -07:00
Nihal Jain
158607bf23
HBASE-21021 Result returned by Append operation should be ordered
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 15:04:50 -07:00
Guangxu Cheng
895dac0819
HBASE-21173 Remove the duplicate HRegion#close in TestHRegion
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 17:46:43 +08:00
Guangxu Cheng
d4d0a21b55
HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 14:12:24 +08:00
Andrew Purtell
0c6226b56c
HBASE-21162 Revert suspicious change to BoundedByteBufferPool and disable use of direct buffers for IPC reservoir by default
...
Revert suspicious change to BoundedByteBufferPool made on HBASE-19239 (Fix
findbugs and error-prone issues).
In addition the allocation of direct memory for the server RPC reservoir is
problematic in that tracing native memory or direct buffer leaks to a
particular class or compilation unit is difficult, so allocate the reservoir
on the heap by default instead.
2018-09-10 18:25:27 -07:00
Andrew Purtell
6f4cbde103
HBASE-20307 LoadTestTool prints too much zookeeper logging (Colin Garcia)
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/util/LoadTestTool.java
2018-09-07 16:50:56 -07:00
Lars Hofhansl
d236a5fab8
HBASE-21166 Creating a CoprocessorHConnection re-retrieves the cluster id from ZK.
2018-09-07 15:16:54 -07:00
Mingliang Liu
e03e4c9f5a
HBASE-21138 Close HRegion instance at the end of every test in TestHRegion
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-06 17:51:51 -07:00
Sean Busbey
3e45e0202b
HBASE-21061 Fix inconsistent synchronization in RpcServer
...
move variables that we don't need synchronized access to out of the critical block.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-09-05 23:13:37 -05:00
tedyu
d07cab18a6
HBASE-21088 HStoreFile should be closed in HStore#hasReferences
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
2018-09-05 15:13:06 -07:00
Guanghao Zhang
dbb634ad1b
HBASE-21127 TableRecordReader need to handle cursor result too
2018-09-05 14:46:59 +08:00
Andrew Purtell
cf198a65e8
Revert "HBASE-15728 Add Per-Table metrics back"
...
This reverts commit fb74f215b4
.
2018-09-04 13:12:20 -07:00
Andrew Purtell
dfb1af4892
Revert "Amend HBASE-15728 Add Per-Table metrics back"
...
This reverts commit 72f29f48ea
.
2018-09-04 13:12:17 -07:00
Andrew Purtell
72f29f48ea
Amend HBASE-15728 Add Per-Table metrics back
...
Fix a NPE surfaced by TestRegionLocationFinder
2018-09-04 12:48:10 -07:00
David Manning
484a1d8049
HBASE-21126 Configurable number of allowed failures for ZooKeeper Canary
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-09-03 19:44:17 -07:00
Xu Cang
fb74f215b4
HBASE-15728 Add Per-Table metrics back
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-29 16:36:45 -07:00
Andrew Purtell
492d69daa5
Amend HBASE-20940 HStore.cansplit should not allow split to happen if it has references (Vishal Khandelwal)
...
Fix TestHBaseFsck failure
2018-08-28 11:04:08 -07:00
krish.dey
0840427516
HBASE-20942 Fix ArrayIndexOutOfBoundsException for RpcServer TRACE logging
...
Also makes the trace log message length configurable.
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-28 11:25:08 -04:00
Vikas Vishwakarma
3c17c8391e
HBASE-20890 PE filterScan seems to be stuck forever
2018-08-27 12:51:55 +05:30
Andrew Purtell
d1ebc3d2a8
HBASE-21069 NPE in StoreScanner.updateReaders causes RS to crash
2018-08-20 15:50:47 -07:00
tedyu
e2974f4b91
HBASE-21042 processor.getRowsToLock() always assumes there is some row being locked in HRegion#processRowsWithLocks
2018-08-18 11:47:23 -07:00
Andrew Purtell
56c59f11e3
HBASE-20940 HStore.cansplit should not allow split to happen if it has references (Vishal Khandelwal)
2018-08-17 15:30:40 -07:00
Andrew Purtell
971d48406e
HBASE-21047 Object creation of StoreFileScanner thru constructor and close may leave refCount to -1 (Vishal Khandelwal)
2018-08-16 11:43:24 -07:00
Nihal Jain
5520fa1ab3
HBASE-20469 Directory used for sidelining old recovered edits files should be made configurable
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-15 18:01:43 -07:00
Huaxiang Sun
1b50fe5372
HBASE-20997 rebuildUserRegions() does not build ReplicaMapping during master switchover
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Pankaj Kumar <Username: pankaj2461t>
2018-08-06 11:25:02 -07:00
Monani Mihir
0298c06b4f
HBASE-19036 Add action in Chaos Monkey to restart Active Namenode
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-02 05:04:27 -07:00
Andrew Purtell
a15c445743
HBASE-20935 HStore.removeCompactedFiles should log in case it is unable to delete a file (Vishal Khandelwal)
2018-07-31 16:12:50 -07:00
Josh Elser
ab3ec9477a
HBASE-20930 MetaScanner.metaScan should respect meta table name (Vishal Khandelwal)
2018-07-30 17:12:03 -04:00
Andrew Purtell
9b5a839b99
HBASE-20974 Backport HBASE-20583 (SplitLogWorker should handle FileNotFoundException when split a wal) to branch-1 (Pankaj Kumar)
2018-07-30 12:34:45 -07:00
Andrew Purtell
2d70120eb3
HBASE-20895 NPE in RpcServer#readAndProcess
...
Synchronize readAndProcess() on the Connection to avoid MT issues with
data buffer management
2018-07-27 18:07:58 -07:00
huzheng
0b7081e67a
HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result
2018-07-24 10:25:43 +08:00
Xu Cang
3a97976eae
HBASE-20744 Address FindBugs warnings in branch-1
...
minor fix
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-23 16:29:13 -07:00
Xu Cang
dfc7ecd9ca
HBASE-20230 Incorrrect log message in RSRpcServices
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 16:01:33 -07:00
Ankit Singhal
56aa9ab8a3
HBASE-20908 Infinite loop on regionserver if region replica are reduced
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 13:11:39 -07:00
Toshihiro Suzuki
2eaa24a132
HBASE-17885 Backport HBASE-15871 to branch-1
...
HBASE-15871 Memstore flush doesn't finish because of backwardseek() in memstore scanner (ramkrishna.s.vasudevan)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 12:27:52 -07:00
tedyu
a7fe71da88
HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region
2018-07-23 10:04:10 -07:00
TAK LON WU
9db4a4059a
HBASE-20401 Make `MAX_WAIT` and `waitIfNotFinished` in CleanerContext configurable
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-23 17:16:08 +08:00
TAK LON WU
896b69a0fc
HBASE-20559 Backport HBASE-18083 (Make large/small file clean thread number configurable in HFileCleaner) to branch-1
...
The last port commit of HBASE-20555
Signed-off-by: Yu Li <liyu@apache.org>
2018-07-23 11:36:47 +08:00
TAK LON WU
780724b15a
HBASE-20558 Port HBASE-17854 (Use StealJobQueue in HFileCleaner after HBASE-17215) to branch-1
...
The third port commit of HBASE-20555
2018-07-20 16:11:09 -07:00
Ankit
e5618a6674
HBASE-20672 New metrics ReadRequestRate and WriteRequestRate
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-19 15:36:01 -07:00
jingyuntian
15ed2e86e1
HBASE-20855 PeerConfigTracker only supporting one listener will cause problem when there is a recovered replication queue
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-19 08:43:23 -07:00
tedyu
7211d13ac8
HBASE-20889 PE scan is failing with NullPointerException
2018-07-16 09:53:47 -07:00
zhaoyuan
6edb27e1e6
HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations()
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-07-11 11:33:32 +08:00
Huaxiang Sun
f2dc754aa3
HBASE-20651 Master, prevents hbck or shell command to reassign the split parent region
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2018-07-10 16:07:30 -07:00
Xu Cang
99189f284b
HBASE-20858 Port HBASE-20695 (Implement table level RegionServer replication metrics) to branch-1
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-09 12:19:21 -07:00
TAK LON WU
a52c6bf2f3
HBASE-20557 Backport HBASE-17215 to branch-1
...
The second backport of HBASE-20555
Signed-off-by: Zach York <zyork@apache.org>
2018-07-09 11:32:04 -07:00
Abhishek Singh Chouhan
a4db453c6d
HBASE-20806 Split style journal for flushes and compactions
2018-07-09 18:44:07 +05:30
Nihal Jain
77e5668ed2
HBASE-20808 Wrong shutdown order between Chores and ChoreService
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-07 00:32:33 +08:00
Josh Elser
154b77307f
HBASE-20826 Truncate really long RpcServer warnings unless TRACE is on
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-05 17:21:30 -07:00
Yu Li
50f7894cc4
HBASE-20691 Change the default WAL storage policy back to "NONE""
...
This partially reverts HBASE-19858 and adds more doc about why we choose "NONE" as the default.
2018-07-05 15:26:56 +08:00
huzheng
a25cf7bbdb
HBASE-20789 TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky
2018-07-04 09:49:07 +08:00
Nihal Jain
f94ad9d78f
HBASE-20450 Provide metrics for number of total active, priority and replication rpc handlers
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-02 11:19:19 -07:00
jingyuntian
cc8e1cc393
HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-29 15:25:06 -07:00
Xu Cang
2fd69cf93c
HBASE-19722 Implement a meta query statistics metrics source
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-28 17:17:50 -07:00
Reid Chan
c81d0aff95
HBASE-20732 Shutdown scan pool when master is stopped
2018-06-28 12:36:50 +08:00
Michael Stack
03946a389a
HBASE-20785 NPE getting metrics in PE testing scans
2018-06-27 12:04:21 -07:00
Michael Stack
ccead1264c
HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do
...
General log cleanup; setting stuff that can flood the log to TRACE.
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-06-26 15:54:47 -07:00
Monani Mihir
4936750d3a
HBASE-20701 too much logging when balancer runs from BaseLoadBalancer
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-25 17:17:31 -07:00
tedyu
6fa9f0bea9
HBASE-20723 Custom hbase.wal.dir results in data loss because we write recovered edits into a different place than where the recovering region server looks for them
2018-06-15 19:51:33 -07:00
Zach York
bed3b2bbae
HBASE-20556 Backport HBASE-16490 to branch-1
...
Backport by: taklonwu@gmail.com
Signed-off-by: Zach York <zyork@apache.org>
2018-06-12 12:34:05 -07:00
Josh Elser
c596fb6c3f
HBASE-20605 Excludes Azure's new filesystem from the SecureBulkLoadEndpoint perm check
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-06-06 16:23:51 -04:00
Andrew Purtell
409531209e
HBASE-20670 NPE in HMaster#isInMaintenanceMode
2018-06-04 13:03:16 -07:00
Andrew Purtell
07487cb0b1
HBASE-20667 Rename TestGlobalThrottler to TestReplicationGlobalThrottler
2018-06-01 16:47:26 -07:00
Xu Cang
a25878cf40
HBASE-18116 Replication source in-memory accounting should not include bulk transfer hfiles
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-06-01 13:34:43 -07:00
Andrew Purtell
08b7ed1656
Revert "HBASE-18116 fix replication source in-memory calculation by excluding bulk load file"
...
This reverts commit dcb5b5a012
.
2018-05-31 15:28:50 -07:00
Xu Cang
dcb5b5a012
HBASE-18116 fix replication source in-memory calculation by excluding bulk load file
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-05-31 14:22:07 -07:00
Andrew Purtell
f4ac15999a
Amend HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1
...
Suppress error-prone false positive
2018-05-30 13:46:46 -07:00
Andrew Purtell
011989665e
HBASE-20597 Serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint
2018-05-29 11:25:25 -07:00
Andrew Purtell
5a0bb1c6b8
Revert "HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint"
...
This reverts commit 1b70763b9e
.
2018-05-29 11:25:25 -07:00
Toshihiro Suzuki
289d588af3
HBASE-20647 Backport HBASE-20616 "TruncateTableProcedure is stuck in retry loop in TRUNCATE_TABLE_CREATE_FS_LAYOUT state" to branch-1
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-25 06:18:43 -07:00
Andrew Purtell
87d4e4e4e2
HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1
2018-05-24 18:06:12 -07:00
Thiruvel Thirumoolan
b892be7440
HBASE-20548 Master fails to startup on large clusters, refreshing block distribution
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-24 12:27:19 -07:00
Andrew Purtell
1b70763b9e
HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint
2018-05-23 16:45:55 -07:00
Xu Cang
6d1aa2800b
HBASE-20486 Change default throughput controller to PressureAwareThroughputController
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-22 12:43:31 -07:00
Balazs Meszaros
2d493556f3
HBASE-20571 JMXJsonServlet generates invalid JSON if it has NaN in metrics
...
- CacheStats won't generate NaN metrics.
- JSONBean class will serialize special floating point values as
"NaN", "Infinity" or "-Infinity"
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-16 11:50:31 -07:00
Thiruvel Thirumoolan
2a309d71cc
HBASE-20545 Improve performance of BaseLoadBalancer.retainAssignment
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-15 18:17:52 -07:00
Zach York
944a221b74
HBASE-20447 Only fail cacheBlock if block collisions aren't related to next block metadata
...
When we pread, we don't force the read to read all of the next block header.
However, when we get into a race condition where two opener threads try to
cache the same block and one thread read all of the next block header and
the other one didn't, it will fail the open process. This is especially important
in a splitting case where it will potentially fail the split process.
Instead, in the caches, we should only fail if the required blocks are different.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-14 16:09:36 -07:00
Ashish Singhi
ca544a155c
HBASE-20004 Client is not able to execute REST queries in a secure cluster
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-05-10 22:49:08 +05:30
Andrew Purtell
c191462ac3
HBASE-20554 "WALs outstanding" message from CleanerChore is noisy
2018-05-09 19:13:17 -07:00
Zach York
5406f63332
HBASE-20204 Add locking to RefreshFileConnections in BucketCache
...
This is a follow-up to HBASE-20141 where Anoop suggested adding locking
for refreshing channels.
2018-05-09 14:15:02 -07:00
Andrew Purtell
9d9d5aec0e
HBASE-20505 PE should support multi column family read and write cases
2018-05-07 18:39:18 -07:00
Vasudevan
91f3de89ab
HBASE-20523 PE tool should support configuring client side buffering sizes
...
(Ram)
2018-05-07 14:41:08 +05:30
Andrew Purtell
23b9054089
HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation
2018-05-04 17:59:28 -07:00
Andrew Purtell
fd24083e26
HBASE-20517 Fix PerformanceEvaluation 'column' parameter
2018-05-04 17:24:38 -07:00
Andrew Purtell
e793e7c30c
HBASE-20493 Port HBASE-19994 (Create a new class for RPC throttling exception, make it retryable) to branch-1
2018-04-26 15:38:40 -07:00
Andrew Purtell
71c573239b
HBASE-20496 TestGlobalThrottler failing on branch-1 since revert of HBASE-9465
...
Temporarily disable TestGlobalThrottler on branch-1
2018-04-26 15:38:40 -07:00
Huaxiang Sun
eb67d4e308
HBASE-19924 hbase rpc throttling does not work for multi() with request count rater.
2018-04-26 10:43:59 -07:00
Toshihiro Suzuki
f11cf007a2
HBASE-20229 ConnectionImplementation.locateRegions() returns duplicated entries when region replication is on
2018-04-25 13:36:12 -07:00
Kevin Risden
e60189035e
HBASE-20406 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 22:45:49 -05:00
Sean Busbey
eacf3cb296
Revert "HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods"
...
This reverts commit fe84833ea2
.
missing jira key
2018-04-20 22:45:37 -05:00
Kevin Risden
fe84833ea2
HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 15:15:31 -05:00
Toshihiro Suzuki
8a244e51d7
HBASE-20006 TestRestoreSnapshotFromClientWithRegionReplicas is flakey
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClientWithRegionReplicas.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionReplayEvents.java
2018-04-20 11:34:45 -05:00
Toshihiro Suzuki
03eb3d24b6
HBASE-19850 The number of Offline Regions is wrong after restoring a snapshot
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-17 20:29:50 -07:00
Sean Busbey
ce4c243399
HBASE-20404 Fixes to CleanChore correctness and operability.
...
* Make CleanerChore less chatty: move WARN message to DEBUG when we expect non-empty dirs
* Make CleanerChore less chatty: move IOE we'll retry to INFO
* CleanerChore should treat IOE for FileStatus as a failure
* Add tests asserting assumptions in above
Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestCleanerChore.java
hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
2018-04-17 13:05:41 -05:00
Ashish Singhi
a817f196a1
HBASE-15291 FileSystem not closed in secure bulkLoad
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-04-11 12:59:52 +05:30
Reid Chan
427c95e2e5
HBASE-20352 [Chore] Backport HBASE-18309 (Support multi threads in CleanerChore) to branch-1
...
Signed-off-by: Yu Li <liyu@apache.org>
2018-04-11 14:17:51 +08:00
Pankaj Kumar
eacbe002e5
HBASE-19343 Restore snapshot makes split parent region online
2018-04-09 07:48:34 -07:00
Chia-Ping Tsai
2f683cd438
HBASE-20301 Remove the meaningless plus sign from table.jsp
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-04 20:10:46 +08:00
Thiruvel Thirumoolan
9ced0c936f
Amend HBASE-20322 CME in StoreScanner causes region server crash
...
memStoreScanners is immutable so create a new list for closing.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-04-03 13:22:43 -07:00
Thiruvel Thirumoolan
875a12de05
HBASE-20322 CME in StoreScanner causes region server crash
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-04-02 19:36:16 -07:00
Jan Hentschel
18c54b02b1
HBASE-17631 Changed Canary interval to 60 seconds
2018-04-01 13:48:28 +02:00
Andrew Purtell
9a6b6524a7
HBASE-20302 CatalogJanitor should log the reason why it is disabled (Vishal Khandelwal)
2018-03-29 10:20:34 -07:00
Zach York
773af3e0ca
HBASE-20280 Fix possibility of deadlocking in refreshFileConnections
...
When prefetch on open is specified, there is a deadlocking case
where if the prefetch is cancelled, the PrefetchExecutor interrupts
the threads if necessary, when that happens in FileIOEngine, it
causes an ClosedByInterruptException which is a subclass of
ClosedChannelException. If we retry all ClosedChannelExceptions,
this will lock as this access is expected to be interrupted.
This change removes calling refreshFileConnections for
ClosedByInterruptExceptions.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-03-27 22:59:58 +00:00
Toshihiro Suzuki
caf4c4b4ee
HBASE-20261 Table page (table.jsp) in Master UI does not show replicaIds for hbase meta table
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-03-23 13:34:45 -04:00
Andrew Purtell
f976b3a8af
HBASE-19024 Provide a configurable option to hsync WAL edits to the disk for better durability (Harshal Jain)
2018-03-20 17:51:59 -07:00
Zach York
009295a3a6
[HBASE-20141] Fix TooManyFiles exception when RefreshingChannels
...
HBASE-19435 implements a fix for reopening file channels when they are unnexpected closed
to avoid disabling the BucketCache. However, it was missed that the the channels might not
actually be completely closed (the write or read channel might still be open
(see https://docs.oracle.com/javase/7/docs/api/java/nio/channels/ClosedChannelException.html )
This commit closes any open channels before creating a new channel.
2018-03-16 10:58:22 -07:00
Ashish Singhi
a0b2141a95
HBASE-20146 Addendum Regions are stuck while opening when WAL is disabled
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-15 10:17:03 +08:00
Sakthi
5aeddb3051
HBASE-18864 (addendum) Fixed unit test failure TestFromClientSide#testIllegalTableDescriptor
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-03-14 13:57:08 -07:00
Francis Liu
38471229f9
HBASE-20174 Fix TestZKLessMergeOnCluster flakiness
2018-03-12 16:57:59 -07:00
Ashish Singhi
e81abb7259
HBASE-20146 Regions are stuck while opening when WAL is disabled
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-03-09 21:27:00 +08:00
Abhishek Singh Chouhan
41ff229a16
HBASE-20139 NPE in RSRpcServices.get() when getRegion throws an exception
2018-03-07 12:09:04 +05:30
Apekshit Sharma
c4401b6073
HBASE-19400 Add missing security checks in MasterRpcServices
...
- Added ADMIN permission check for following rpc calls:
normalize, setNormalizerRunning, runCatalogScan, enableCatalogJanitor, runCleanerChore,
setCleanerChoreRunning, execMasterService, execProcedure, execProcedureWithRet
- Moved authorizationEnabled check to start of AccessChecker's functions. Currently, and IDK why,
we call authManager.authorize() first and then discard its result if authorizationEnabled is false. Weird.
----
HBASE-19401 Add missing security checks in RSRpcServices
2018-02-28 11:52:16 -08:00
Sergey Soldatov
cdbf001d26
HBASE-19863 java.lang.IllegalStateException: isDelete failed when SingleColumnValueFilter is used
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: ramkrish86 <ramkrishna.s.vasudevan@gmail.com>
2018-02-28 13:35:43 -05:00
Andrew Purtell
1be9a3d641
HBASE-20087 Periodically attempt redeploy of regions in FAILED_OPEN state
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-02-27 17:11:44 -08:00
Andrew Purtell
9a7a36750f
HBASE-20102 AssignmentManager#shutdown doesn't shut down scheduled executor
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-02-27 17:11:28 -08:00
Ben Lau
27f803f320
HBASE-19989 Addendum - temp override for tests to be added later for HBASE-20001
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-27 17:06:32 -08:00
Rahul Gidwani
40e0ee331c
HBASE-19989 - READY_TO_MERGE and READY_TO_SPLIT do not update region state correctly
...
Author: Ben Lau <benlau@oath.com>
2018-02-27 12:41:48 -08:00
Thiruvel Thirumoolan
ece68d3c65
HBASE-20001 cleanIfNoMetaEntry() uses encoded instead of region name to lookup region
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-26 18:01:28 -08:00
Sean Busbey
a37c91bb41
HBASE-20061 HStore synchronized member variable filesCompacting should be private
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
2018-02-24 10:59:18 -06:00
Pankaj Kumar
343cdda9ae
HBASE-19364, Truncate_preserve fails with table when replica region > 1
2018-02-23 14:13:02 -08:00
Sean Busbey
ba7a936f74
Revert "HBASE-9465 Push entries to peer clusters serially"
...
This reverts commit 441bc050b9
.
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/WALProtos.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/Replication.java
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-23 14:42:15 +08:00
Sean Busbey
0a284d2b76
Revert "HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)"
...
This reverts commit 97276da9a7
.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-23 14:42:04 +08:00
tedyu
4d9589b165
HBASE-20052 TestRegionOpen#testNonExistentRegionReplica fails due to NPE
2018-02-22 12:41:13 -08:00
Michael Stack
cadc2efd12
HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory; ADDEDNDUM to fix TestRegionOpen failure
2018-02-22 09:27:46 -08:00
Chia-Ping Tsai
af1f7cf431
HBASE-20016 TestCatalogJanitorInMemoryStates#testInMemoryForReplicaParentCleanup is flaky
2018-02-22 09:44:37 +08:00
Pankaj Kumar
a189674b4c
HBASE-19553, Old replica regions should be cleared from AM memory after primary region split or merge
...
Signed-off-by: Ted Yu <tedyu@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2018-02-21 16:52:40 -08:00
Esteban Gutierrez
9e7e58d551
HBASE-19391 Calling HRegion#initializeRegionInternals from a region replica can still re-create a region directory
2018-02-21 16:25:13 -08:00
Andrew Purtell
c5e692c1dc
HBASE-20027 Add test TestClusterPortAssignment
...
LocalHBaseCluster forces random port assignment for sake of concurrent unit test
execution friendliness, but we still need a positive test for RPC and info port
assignment.
2018-02-21 13:12:26 -08:00
Toshihiro Suzuki
c0bca137ff
HBASE-20008 [backport] NullPointerException when restoring a snapshot after splitting a region
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-20 20:29:08 -08:00
Chia-Ping Tsai
21f6830fe1
HBASE-20017 BufferedMutatorImpl submit the same mutation repeatedly
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-20 16:59:44 -08:00
Michael Stack
fd8189d31d
Revert "HBASE-19970 Remove unused functions from TableAuthManager."
...
This reverts commit e6ce789b6f
.
2018-02-20 11:12:36 -08:00
Michael Stack
071281cf52
Revert "HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager."
...
This reverts commit 0f79c497c5
.
2018-02-20 11:12:33 -08:00
chenheng
7990546efe
HBASE-14897 TestTableLockManager.testReapAllTableLocks is flakey
...
(cherry picked from commit 47082579a8
)
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-02-20 08:50:22 -06:00
Ben Lau
28ebd29f0f
HBASE-18282 ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-14 17:23:23 -08:00
Thiruvel Thirumoolan
e65004aeea
HBASE-19996 Some nonce procs might not be cleaned up (follow up HBASE-19756)
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-14 09:17:13 -08:00
tedyu
335b8a8e14
HBASE-19979 ReplicationSyncUp tool may leak Zookeeper connection (Pankaj Kumar)
2018-02-13 08:11:03 -08:00
Chia-Ping Tsai
f77b42b2af
HBASE-19876 The exception happening in converting pb mutation to hbase.mutation messes up the CellScanner
2018-02-13 21:29:01 +08:00
Apekshit Sharma
0f79c497c5
HBASE-19970 (addendum for 1.x only) Remove unused functions from TableAuthManager.
2018-02-12 16:31:09 -08:00
Apekshit Sharma
e6ce789b6f
HBASE-19970 Remove unused functions from TableAuthManager.
...
Functions deleted: setTableUserPermissions, setTableGroupPermissions, setNamespaceUserPermissions,
setNamespaceGroupPermissions, writeTableToZooKeeper, writeNamespaceToZooKeeper
2018-02-12 16:20:36 -08:00
huzheng
7ced28f099
HBASE-19972 Should rethrow the RetriesExhaustedWithDetailsException when failed to apply the batch in ReplicationSink
2018-02-11 14:58:36 +08:00
Chia-Ping Tsai
0cbb19201c
HBASE-19900 Region-level exception destroy the result of batch
2018-02-07 08:30:55 +08:00
Balazs Meszaros
5fa64fb72e
HBASE-19886 Display maintenance mode in shell, web UI
2018-02-06 15:59:44 -08:00
Toshihiro Suzuki
92f733db4b
HBASE-19934 HBaseSnapshotException when read replicas is enabled and online snapshot is taken after region splitting
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-06 11:19:22 -08:00
Rahul Gidwani
673e809250
HBASE-19528 - Major Compaction Tool
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-06 05:39:25 -08:00
Ashish Singhi
bdeab93196
HBASE-19905 ReplicationSyncUp tool will not exit if a peer replication is disabled
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-02-04 18:24:32 +05:30
Andrew Purtell
f35bcd2fe3
HBASE-19858 Backport HBASE-14061 (Support CF-level Storage Policy) to branch-1
...
HBASE-14061 Support CF-level Storage Policy
HBASE-14061 Support CF-level Storage Policy (addendum)
HBASE-14061 Support CF-level Storage Policy (addendum2)
HBASE-15172 Support setting storage policy in bulkload
HBASE-17538 HDFS.setStoragePolicy() logs errors on local fs
HBASE-18015 Storage class aware block placement for procedure v2 WALs
HBASE-18017 Reduce frequency of setStoragePolicy failure warnings
Default storage policy if not configured cannot be "NONE"
HBASE-19016 Coordinate storage policy property name for table schema and bulkload
Fix checkstyle warnings
Addressed additional review feedback on backport
2018-02-01 17:10:39 -08:00
binlijin
e1bcf50b10
HBASE-19728 Add lock to filesCompacting in all place.
2018-01-31 17:01:58 +08:00
Thiruvel Thirumoolan
2c5140e151
HBASE-19756 Master NPE during completed failed proc eviction
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-01-24 16:48:54 -08:00
Rahul Gidwani
73ed127039
HBASE-15321 - Ability to open a HRegion from hdfs snapshot.
2018-01-22 12:22:57 -08:00
huaxiangsun
0f20c5e0fd
HBASE-19163 "Maximum lock count exceeded" from region server's batch processing
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-19 11:24:19 -08:00
Scott Wilson
779371625b
HBASE-19816 Refresh repliation sinks on UnknownHostException
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-17 16:26:25 -08:00
Rahul Gidwani
48025cc84b
HBASE-11409 - Add more flexibility for input directory structure to LoadIncrementalHFiles
2018-01-12 13:35:26 -08:00
Guangxu Cheng
b29a138ecc
HBASE-19483 Add proper privilege check for rsgroup commands addendum
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-11 11:00:07 -08:00
Chia-Ping Tsai
0ef6530aa1
HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-01-11 10:39:42 -08:00
Guangxu Cheng
6f1dd258b1
HBASE-19483 Add proper privilege check for rsgroup commands
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-10 02:25:47 -08:00
Toshihiro Suzuki
e6453ab84b
HBASE-19424 Fix NPE in "/metrics" servlet.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-01-08 15:09:27 -08:00
BELUGA BEHR
fa07c211ac
HBASE-19684 BlockCacheKey toString Performance
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-08 17:06:44 +08:00
Andrew Purtell
b528cd01b7
HBASE-19708 Avoid NPE when the RPC listener's accept channel is closed
2018-01-05 09:58:03 -08:00
Rajeshbabu Chintaguntla
b5ec4d381c
HBASE-15580 Tag coprocessor limitedprivate scope to StoreFile.Reader
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-04 14:15:03 +08:00
Michael Stack
939e016425
HBASE-19588 Additional jar dependencies needed for mapreduce
...
PerformanceEvaluation
Signed-off-by: Albert Chu <chu11@llnl.gov>
2018-01-03 21:33:25 -06:00
Chia-Ping Tsai
2c30c9bbb6
HBASE-19490 Rare failure in TestRateLimiter
2018-01-04 10:33:46 +08:00
Josh Elser
490728ae7f
HBASE-19691 Removes Global(A) requirement for getClusterStatus
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-03 19:15:49 -05:00
huaxiang sun
fd33b3589e
HBASE-18625 Splitting of region with replica, doesn't update region list in serverHolding. A server crash leads to overlap.
...
Signed-off-by: ramkrishna.s.vasudevan<ramkrishna.s.vasudevan@intel.com>
2018-01-03 12:32:44 -08:00
Jingyun Tian
6faed49ad1
HBASE-19358 Improve the stability of splitting log when do fail over
...
Signed-off-by: Yu Li <liyu@apache.org>
2018-01-02 17:25:49 +08:00
tedyu
e866e837fb
HBASE-19551 hbck -boundaries doesn't work correctly (Toshihiro Suzuki)
2017-12-30 23:18:12 -08:00
Peter Somogyi
528eb10826
HBASE-19545 Replace getBytes(StandardCharsets.UTF_8) with Bytes.toBytes
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 20:15:01 +08:00
tedyu
64d2ebf9f3
HBASE-19514 TestJMXListener now uses random port
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2017-12-22 18:51:44 +01:00
ramkrish86
d28732fd98
HBASE-19468 FNFE during scans and flushes (Ram)
2017-12-20 17:06:27 +05:30
zhangduo
08e948b188
HBASE-19546 TestMasterReplication.testCyclicReplication2 uses wrong assertion
2017-12-18 19:59:32 +08:00
ramkrish86
ff023bcc4b
HBASE-19485 Minor improvement to TestCompactedHFilesDischarger (Ram)
2017-12-14 13:19:55 -08:00
Chia-Ping Tsai
54ca1db6bd
HBASE-19502 Make sure we have closed all StoreFileScanner if we fail to open any StoreFileScanners
2017-12-13 21:47:27 +08:00
Jan Hentschel
b3167a0e50
Revert "HBASE-17425 Fixed deprecated calls in TestUpdateConfiguration"
...
This reverts commit c434cab5d1
.
2017-12-11 22:56:33 +01:00
Jan Hentschel
c434cab5d1
HBASE-17425 Fixed deprecated calls in TestUpdateConfiguration
2017-12-09 14:44:50 +01:00
Andrew Purtell
bae3b0b966
HBASE-19465 Required httpcore and httpclient jars not included in binary distribution
2017-12-08 15:02:10 -08:00
Zach York
9e34d99c07
HBASE-19435 Reopen Files for ClosedChannelException in BucketCache
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-07 15:45:51 -08:00
Andrew Purtell
5398d83bc7
HBASE-19446 Misspelled 'default' in SimpleRpcScheduler
2017-12-06 17:11:15 -08:00
Andrew Purtell
70c7688271
HBASE-19447 INFO level logging of GetClusterStatus from HMaster is too chatty
2017-12-06 17:05:19 -08:00
Pankaj Kumar
f88304d162
HBASE-19442 Backport HBASE-19065 to branch-1 (HRegion#bulkLoadHFiles() should wait for concurrent Region#flush() to finish).
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-12-06 14:18:44 -08:00
Andrew Purtell
6c2d51132f
HBASE-19445 PerformanceEvaluation NPE processing split policy option
2017-12-06 14:10:11 -08:00
Andrew Purtell
1fe75f98d3
HBASE-19421 branch-1 does not compile against Hadoop 3.0.0
2017-12-04 15:48:38 -08:00
Guanghao Zhang
9d481b1c43
HBASE-19239 (addendum) Fix findbugs and error-prone warnings (branch-1)
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-12-04 10:18:53 -08:00
tedyu
cb3bef3574
HBASE-19056 TestCompactionInDeadRegionServer is top of the flakies charts
2017-12-04 06:35:41 -08:00
binlijin
15d16281a1
HBASE-19290 Reduce zk request when doing split log
2017-12-04 18:36:11 +08:00
huzheng
4ec59d018d
HBASE-19252 Move the transform logic of FilterList into transformCell() method to avoid extra ref to question cell
2017-12-04 10:19:16 +08:00
Guanghao Zhang
25cc8feeb2
HBASE-19366 Backport to branch-1 HBASE-19035 Miss metrics when coprocessor use region scanner to read data
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-12-02 09:54:21 -08:00
Guanghao Zhang
525b2852e8
HBASE-19396 Fix flaky test TestHTableMultiplexerFlushCache
2017-12-02 19:43:32 +08:00
Andrew Purtell
d2a54c98ba
HBASE-19406 Fix CompactionRequest equals and hashCode
2017-12-01 19:15:05 -08:00
Andrew Purtell
ab1d5e05a8
HBASE-19395 [branch-1] TestEndToEndSplitTransaction.testMasterOpsWhileSplitting fails with NPE
2017-12-01 15:31:52 -08:00
Guangxu Cheng
6938720c12
HBASE-19326 Remove decommissioned servers from rsgroup
...
Signed-off-by: Michael Stack <stack@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminClient.java
hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminEndpoint.java
hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminServer.java
hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManagerImpl.java
hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroups.java
hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsBase.java
hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterCoprocessorHost.java
hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
hbase-shell/src/main/ruby/hbase/rsgroup_admin.rb
2017-12-01 12:15:43 -08:00
Michael Stack
2f7a6f21eb
HBASE-18233 We shouldn't wait for readlock in doMiniBatchMutation in case of deadlock (Allan Yang)
...
This patch plus a sorting of the batch (HBASE-17924) fixes a regression
in Increment/CheckAndPut-style operations.
Signed-off-by: Yu Li <carp84@gmail.com>
Signed-off-by: Allan Yang <allanwin@163.com>
2017-11-30 17:10:27 -08:00
Sergey Soldatov
143ceb97ba
HBASE-19393 HTTP 413 FULL head while accessing HBase UI using SSL.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-11-30 17:03:32 -08:00
Harshal Deepakkumar Jain
a4b9ac6050
HBASE-19388 - Incorrect value is being set for Compaction Pressure in RegionLoadStats object inside HRegion class
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-11-30 15:07:45 -08:00
Josh Elser
4846300c8b
HBASE-19285 Implements table-level latency histograms
...
For a egionserver's view of a table (the regions
that belong to a table hosted on a regionserver),
this change tracks the latencies of operations that
affect the regions for this table.
Tracking at the per-table level avoids the memory bloat
and performance impact that accompanied the previous
per-region latency metrics while still providing important
details for operators to consume.
Signed-Off-By: Andrew Purtell <apurtell@apache.org>
2017-11-30 17:45:23 -05:00
Michael Stack
1e00673047
HBASE-19385 [1.3] TestReplicator failed 1.3 nightly
2017-11-29 23:12:51 -08:00
Andrew Purtell
4c413e0c50
HBASE-19376 Fix more binary compatibility problems with branch-1.4 / branch-1
2017-11-29 14:07:36 -08:00