Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,101 Commits 95 Branches 866 Tags
Commit Graph

7868 Commits

Author SHA1 Message Date
binlijin
9ff2507303
HBASE-23613 ProcedureExecutor check StuckWorkers blocked by DeadServe… (#960) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-12-25 09:56:48 +08:00
BukrosSzabolcs
ee19008b12 HBASE-23589: FlushDescriptor contains non-matching family/output combinations (#949) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
 2019-12-24 19:37:06 +08:00
Toshihiro Suzuki
00bb0f20d4 HBASE-23581 Creating table gets stuck when specifying an invalid split policy as METADATA (#942) 
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apacher.org>
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-12-24 19:16:31 +08:00
stack
4b6ce0fcbf HBASE-23572 In 'HBCK Report', distringush between live, dead, and unknown servers 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-12-20 10:54:28 -08:00
binlijin
ab40b9648b
HBASE-23564 RegionStates may has some expired serverinfo and make regions do not balance. (#930) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-12-20 15:00:27 +08:00
Duo Zhang
f4860d8d2f
HBASE-23594 Procedure stuck due to region happen to recorded on two servers. (#953) 
Signed-off-by: stack <stack@apache.org>
 2019-12-20 13:40:39 +08:00
Duo Zhang
80ba354e2e
HBASE-20461 Implement fsync for AsyncFSWAL (#947) 
Signed-off-by: stack <stack@apache.org>
 2019-12-19 13:30:15 +08:00
Sean Busbey
bc2f162749 HBASE-23239 Reporting on status of backing MOB files from client-facing cells (#785) 
* Adds a new MapReduce job that builds a report of health of mob files
* Also builds background information on mob system use
* add a basic mob architecture in the ref guide to explain how mob takes the reference hfile value and finds the actual cell contents
* add a troubleshooting mob section to the ref guide to explain how to do a mob reference scan.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-12-16 12:48:17 -06:00
Bharath Vissapragada
b38446c017 HBASE-23575 Remove dead code in AsyncRegistry (addendum) 
Additions to MiniHBaseCluster needed for branch-2.

Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
 2019-12-16 10:32:44 -06:00
Ankit Singhal
29d1a97482 HBASE-23065 [hbtop] Top-N heavy hitter user and client drill downs 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-12-16 23:44:05 +09:00
ramkrish86
eee9480cb4
HBASE-23066 Allow cache on write during compactions when prefetching … (#935) 
* HBASE-23066 Allow cache on write during compactions when prefetching is enabled

* Fix checkstyle issues - recommit
 2019-12-16 15:20:30 +05:30
David Mollitor
3be8ae2167 HBASE-23380 General cleanup of FSUtil (#912) 
* Clean up JavaDocs
* Clean up logging and error messages
* Remove superfluous code
* Replace static code with library call
* Do not swallow Interrupted Exceptions
* Use try-with-resources
* User multi-Exception catches to reduce code size

Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-12-13 16:32:18 -06:00
Bharath Vissapragada
efa4fe901a HBASE-23575 Remove dead code in AsyncRegistry (#929) 
Removes a bunch of dead code and fixes some checkstyle nits.

Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-12-13 13:26:03 -06:00
meiyi
85a081925b HBASE-23555 TestQuotaThrottle is broken (#924) 2019-12-11 12:23:13 -08:00
stack
b0233a294f HBASE-23554 Encoded regionname to regionname utility (#923); ADDENDUM 2019-12-11 11:02:59 -08:00
Michael Stack
8742265d85 HBASE-23554 Encoded regionname to regionname utility (#923) 
Adds shell command regioninfo:

  hbase(main):001:0>  regioninfo '0e6aa5c19ae2b2627649dc7708ce27d0'
  {ENCODED => 0e6aa5c19ae2b2627649dc7708ce27d0, NAME => 'TestTable,,1575941375972.0e6aa5c19ae2b2627649dc7708ce27d0.', STARTKEY => '', ENDKEY => '00000000000000000000299441'}
  Took 0.4737 seconds

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-12-11 08:57:59 -08:00
Sean Busbey
ec9bd20ec8 Revert "HBASE-23066 Allow cache on write during compactions when prefetching is (#919)" 
TestCacheOnWrite failing all the time.

This reverts commit d561130e82c5956f0dd9fff5c6f6240a686d3d6a.
 2019-12-11 10:17:46 -06:00
meiyi
fc816ac1b1
HBASE-23553 Snapshot referenced data files are deleted in some case (#922) 2019-12-11 09:31:11 +08:00
belugabehr
c39339c004 HBASE-23379 Clean Up FSUtil getRegionLocalityMappingFromFS 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-12-10 21:56:53 +01:00
ramkrish86
d561130e82
HBASE-23066 Allow cache on write during compactions when prefetching is (#919) 
Contributed by : Jacob LeBlanc
 2019-12-10 22:52:59 +05:30
binlijin
f87428e704
HBASE-23377 Balancer should skip disabled tables's regions (#908) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: GuangxuCheng  <guangxucheng@gmail.com>
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2019-12-10 19:28:42 +08:00
binlijin
dff7fffe85
HBASE-22280 Separate read/write handler for priority request(especial… (#202) 
Signed-off-by: Yu Li <liyu@apache.org>
 2019-12-09 16:11:35 +08:00
Sandeep Pal
60d9430195 HBASE-23309: Adding the flexibility to ChainWalEntryFilter to filter the whole entry if all cells get filtered (#837) 
HBASE-23309: Adding the flexibility to ChainWalEntryFilter to filter the whole entry if all cells get filtered
 2019-12-06 15:41:09 -08:00
Lars Hofhansl
9c82a65b29 HBASE-23364 HRegionServer sometimes does not shut down. 2019-12-05 18:25:41 -08:00
Wellington Ramos Chevreuil
6d251efa04
HBASE-23367 Remove unused constructor from WALPrettyPrinter (#901) 
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-12-05 10:29:36 +00:00
Karthik Palanisamy
3e21bcf6d4 HBASE-23361 Limit two decimals in total average load (#897) 
Signed-off-by: GuangxuCheng  <guangxucheng@gmail.com>
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-12-05 10:19:06 +08:00
binlijin
bc8f1210ff
HBASE-23365 Minor change MemStoreFlusher's log (#900) 
Signed-off-by: GuangxuCheng  <guangxucheng@gmail.com>
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-12-05 10:12:34 +08:00
Junegunn Choi
5e34a59d90 HBASE-22529 Add sanity check for in-memory compaction policy 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
 2019-12-04 21:01:22 +09:00
Bharath Vissapragada
570cc3c4a4 HBASE-23362: [WalPrettyPrinter] print/filter by table name. (#898) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-12-04 10:03:33 +00:00
binlijin
580d65ee4d
HBASE-23356 When construct StoreScanner throw exceptions it is possible to left some KeyValueScanner not closed. (#891) 
Signed-off-by: GuangxuCheng  <guangxucheng@gmail.com>
 2019-12-04 10:34:07 +08:00
Toshihiro Suzuki
0f166edc3d
HBASE-22096 /storeFile.jsp shows CorruptHFileException when the storeFile is a reference file (#888) 
Signed-off-by: Lijin Bin <binlijin@apache.org>
 2019-12-03 15:15:40 +09:00
XinSun
27cfe1bb27 HBASE-23345 Table need to replication unless all of cfs are excluded (#881) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-12-03 13:35:23 +08:00
Viraj Jasani
ad607a1d76 HBASE-23335 : Improving cost functions array copy in StochasticLoadBalancer (#874) 2019-12-01 21:42:27 -08:00
Guanghao Zhang
f7839f5eb6
HBASE-23298 Refactor LogRecoveredEditsOutputSink and BoundedLogWriterCreationOutputSink (#832) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-12-02 13:30:47 +08:00
Wellington Ramos Chevreuil
636fa2c6b0
HBASE-23313 [hbck2] setRegionState should update Master in-memory sta… (#864) 
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: stack <stack@apache.org>
 2019-11-27 08:41:23 +00:00
Sandeep Pal
0d7a6b9725 HBASE-23117: Bad enum in hbase:meta info:state column can fail loadMeta and stop startup (#867) 
* Handling the BAD value in info:state columns in hbase:meta

* Adding a unit test and region encoded name in the LOG

* Adding a null check for region state to complete the test scenario and fixing the nit

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: GuangxuCheng  <guangxucheng@gmail.com>
Signed-off-by: stack <stack@apache.org>
 2019-11-26 10:11:02 -08:00
chenxu14
17468efb88 HBASE-23293 [REPLICATION] make ship edits timeout configurable (#825) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-11-26 19:05:53 +08:00
Wellington Ramos Chevreuil
b08697ae4a
HBASE-23197 'IllegalArgumentException: Wrong FS' on edits replay when… (#740) 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-11-23 15:03:56 +00:00
Peter Somogyi
ee730c8c79 HBASE-22969 A new binary component comparator(BinaryComponentComparator) to perform comparison of arbitrary length and position; ADDENDUM (#869) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-11-22 13:42:27 -06:00
Michael Stack
8e52339cb8 HBASE-23307 Add running of ReplicationBarrierCleaner to hbck2 fixMeta invocation (#859) 
Signed-off-by: Lijin Bin <binlijin@apache.org>
 2019-11-22 08:35:55 -08:00
xuqinya1
ca6059f4db HBASE-23325 [UI]rsgoup average load keep two decimals (#860) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
 2019-11-22 14:29:45 +08:00
Karthik Palanisamy
0b49e3a174 HBASE-23237 Prevent Negative values in metrics requestsPerSecond 
Closes #834

Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-11-21 22:13:58 -05:00
bsglz
4ea792246f HBASE-23223 Support the offsetLock of bucketCache to use strong ref (#764) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-11-21 08:39:58 +00:00
stack
77b4e8c972 HBASE-23322 [hbck2] Simplification on HBCKSCP scheduling 
Signed-off-by: Lijin Bin <binlijin@apache.org>
 2019-11-20 21:27:04 -08:00
Bharath Vissapragada
834ccb4bf6 HBASE-23259: Populate master address end points in cluster/rs configs (#807) 
All the clients need to know the master RPC end points while using master
based registry for creating cluster connections. This patch amends the
test cluster utility to populate these configs in the base configuration
object used to spin up the cluster.

The config key added here ("hbase.master.addrs") is used in the subsequent
patches for HBASE-18095.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2019-11-20 10:15:43 -08:00
stack
bcd2aa9a9e HBASE-23321 [hbck2] fixHoles of fixMeta doesn't update in-memory state 2019-11-20 09:06:58 -08:00
belugabehr
33bedf8d4d HBASE-23308: Review of NullPointerExceptions (#836) 
Signed-off-by: stack <stack@apache.org>
 2019-11-19 13:51:11 -08:00
stack
ca6e67a6de HBASE-23315 Miscellaneous HBCK Report page cleanup 
* Add a bit of javadoc around SerialReplicationChecker.
 * Miniscule edit to the profiler jsp page and then a bit of doc on how to make it work that might help.
 * Add some detail if NPE getting BitSetNode to help w/ debug.
 * Change HbckChore to log region names instead of encoded names; helps doing diagnostics; can take region name and query in shell to find out all about the region according to hbase:meta.
 * Add some fix-it help inline in the HBCK Report page – how to fix.
 * Add counts in procedures page so can see if making progress; move listing of WALs to end of the page.
 2019-11-19 07:34:24 -08:00
Baiqiang Zhao
e83bb205f4 HBASE-23278 Add a table-level compaction progress display on the UI (#816) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
 2019-11-19 16:21:36 +08:00
stack
f8f9a26cb3 HBASE-23282 HBCKServerCrashProcedure for 'Unknown Servers' 
Have the existing scheduleRecoveries launch a new HBCKSCP
instead of SCP. It gets regions to recover from Master
in-memory context AND from a scan of hbase:meta. This
new HBCKSCP is For processing 'Unknown Servers', servers that
are 'dead' and purged but still have references in
hbase:meta. Rare occurance but needs tooling to address.
Later have catalogjanitor take care of these deviations
between Master in-memory and hbase:meta content (usually
because of overdriven cluster with failed RPCs to hbase:meta,
etc)

Changed expireServers in ServerManager so could pass in
custom reaction to expired server.... This is how we
run our custom HBCKSCP while keeping all other aspects
of expiring services (rather than try replicate it
externally).
 2019-11-18 14:28:55 -08:00