Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,597 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

17597 Commits

Author SHA1 Message Date
bitterfox 150e02ee58
HBASE-25671 Backport HBASE-25608 to branch-2 (#3058) 
Signed-off-by: stack <stack@apache.org>
 2021-03-18 12:00:25 -07:00
Catalin Luca c9b81c3f82 HBASE-25674 - RegionInfo.parseFrom(DataInputStream) sometimes fails to read the protobuf magic marker (#3062) 
Co-authored-by: Catalin Luca <luca@adobe.com>
Signed-off-by: stack <stack@apache.org>
 2021-03-18 11:56:34 -07:00
Michael Stack 75e2e7c83d HBASE-25677 Server+table counters on each scan #nextRaw invocation becomes a bottleneck when heavy load (#3061) 
Don't have every handler update regionserver metrics on each
scan#nextRaw; instead, do a batch update just before Scan
returns. Otherwise, all running handlers end up contending
on metrics update.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 Update of regionserver metrics counters moved out to caller where
 can be done as a batch update instead of per-next.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServer.java
 Class doc to encourage batch updating metrics.
 Remove the single update as unused anymore.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
 Count calls to nextRaw. Update regionserver count in finally block when
 scan is done rather than per nextRaw call. Move all metrics updates to
 finally.

Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Baiqiang Zhao <ZhaoBQ>
 2021-03-18 11:40:42 -07:00
Anoop Sam John 97e02732b4 HBASE-25673 Wrong log regarding current active master at ZKLeaderManager#waitToBecomeLeader (#3057) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-18 21:21:46 +05:30
Sandeep Pal 72496272aa
HBASE-25627: HBase replication should have a metric to represent if the source is stuck getting initialized (#3018) 
Introduces a new metric that tracks number of replication sources that are stuck in initialization.

Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
(cherry picked from commit ff3821814a)
 2021-03-17 10:30:26 -07:00
bitterfox a61e9b963d HBASE-25665 Option to use hostname instead of canonical hostname for secure HBase cluster connection (#3051) 2021-03-16 21:05:23 -07:00
stack f0c5e68a0d HBASE-25667 Remove RSGroup test addition made in parent; depends on functionality not in old branches 2021-03-16 13:17:13 -07:00
Javier 3135b7a42f HBASE-25594 graceful_stop.sh fails to unload regions when ran at localhost 
Signed-off-by: stack <stack@apache.org>
 2021-03-15 21:42:14 -07:00
stack 4b2cab3e5d Revert "HBASE-25663 Make graceful_stop localhostname compare match even if fqdn (#3048)" 
This reverts commit f4e1ab7b1d.
 2021-03-15 21:29:35 -07:00
Pankaj 1ca85017f7 HBASE-25374 Make REST Client connection and socket time out configurable (#2752) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: stack <stack@apache.org>
 2021-03-15 16:46:04 -07:00
Baiqiang Zhao a93b0cd3ca HBASE-25597 Add row info in Exception when cell size exceeds maxCellSize (#2976) 
Signed-off-by: stack <stack@apache.org>
 2021-03-15 15:50:22 -07:00
haxiaolin 6c224b8640 HBASE-25621 Balancer should check region plan source to avoid misplace region groups (#3002) 
Signed-off-by: stack <stack@duboce.net>
 2021-03-15 14:48:35 -07:00
haxiaolin 13574de156 HBASE-25595 TestLruBlockCache.testBackgroundEvictionThread is flaky (#2974) 
Signed-off-by: stack <stack@apache.org>
 2021-03-15 14:26:06 -07:00
Michael Stack 763de9a085
HBASE-25561 Added ignored test for async connection that runs retries just so can check how long it takes and that retrying is happening (#2942) 2021-03-15 14:14:41 -07:00
Michael Stack 3bf2ef4259
HBASE-25660 Print split policy in use on Region open (as well as split policy vitals) (#3044) 
Add a toString to all split policy implementations listing name and
 vitals. Use this toString in the Region open message. Ditto for flush
 policy for the Region.

 Signed-off-by: Huaxiang Sun<huaxiangsun@apache.org>
 2021-03-15 14:10:37 -07:00
Michael Stack 754300ac71 HBASE-25663 Make graceful_stop localhostname compare match even if fqdn (#3048) 2021-03-15 13:25:50 -07:00
Duo Zhang 4c8de44bf9 HBASE-25662 Fix spotbugs warning in RoundRobinTableInputFormat (#3050) 2021-03-15 08:16:18 -07:00
haxiaolin 95e8ee5ca5 HBASE-25635 CandidateGenerator may miss some region balance actions (#3024) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-03-15 21:33:46 +08:00
Duo Zhang aafbbc2456 HBASE-25657 Fix spotbugs warnings after upgrading spotbugs to 4.x (#3041) 
Signed-off-by: meiyi <myimeiyi@gmail.com>
Signed-off-by: stack <stack@apache.org>
 2021-03-12 14:37:17 +08:00
shahrs87 bb4d8b9cf7 HBASE-25622 Result#compareResults should compare tags. (#3026) 
Signed-off-by: stack <stack@apache.org>
 2021-03-11 21:52:11 -08:00
Michael Stack 45b3280497 HBASE-25570 On largish cluster, "CleanerChore: Could not delete dir..." makes master log unreadable (#2949) 
Turn down the amount we log. If you want to see the full exception
enable TRACE-level logging.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: shahrs87
 2021-03-11 21:36:31 -08:00
sudhir-reddy 40d7e024c7 HBASE-25566 RoundRobinTableInputFormat (#2947) 
Co-authored-by: stack <stack@apache.org>
Co-authored-by: sudhir-reddy <sudhir-reddy>
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.org>
 2021-03-11 20:54:56 -08:00
Peter Somogyi af8dc2e4df HBASE-25587 [hbck2] Schedule SCP for all unknown servers (#2978) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-11 17:22:08 +01:00
meiyi b5fc5e17e2 HBASE-25636 Expose HBCK report as metrics (#3031) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2021-03-11 15:15:23 +08:00
Duo Zhang d546c8e77c HBASE-25629 Reimplement TestCurrentHourProvider to not depend on unstable TZs (#3013) 
Signed-off-by: XinSun <ddupgs@gmail.com>
 2021-03-10 23:53:59 +08:00
Wellington Ramos Chevreuil 7adc00044c HBASE-25548 Optionally allow snapshots to preserve cluster's max file… (#2923) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 373dc7788d)
 2021-03-10 10:35:58 +00:00
Anoop Sam John 29d771fab9
HBASE-25582 Support setting scan ReadType to be STREAM at cluster level (#3040) 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-10 13:23:15 +05:30
Duo Zhang e33858828c HBASE-25604 Upgrade spotbugs to 4.x (#3029) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-03-10 14:54:04 +08:00
Narges Shadab 884cb0bd2c
HBASE-25646: Possible Resource Leak in CatalogJanitor #3036 
Close the stream using a try-with-resources block.

Reviewed-by: Aman Poonia <aman.poonia.29@gmail.com>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
(cherry picked from commit 573daed419)
 2021-03-09 09:11:02 -08:00
Bharath Vissapragada 321b5c7979
HBASE-25547: Thread pools should release unused resources (#3037) 
* HBASE-25547: Thread pools should release unused resources (#2922)

Plumbs the configuration needed to enable core thread timeout on non-critical thread pools.
Currently only enabled for thread pools with op-codes RS_LOG_REPLAY_OPS, RS_PARALLEL_SEEK, MASTER_SNAPSHOT_OPERATIONS, MASTER_MERGE_OPERATIONS. Others can be added later as
needed.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 618236dd90)

* HBASE-25547 (addendum): Roll ExecutorType into ExecutorConfig

Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 4c822d7463)
 2021-03-09 09:03:16 -08:00
Anoop Sam John f2c52e4176 HBASE-25644 Scan#setSmall blindly sets ReadType as PREAD 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
 2021-03-08 13:10:52 +05:30
申胜利 e81ef34c68 HBASE-25609 There is a problem with the SPLITS_FILE in the HBase shell statement(#2992) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-03-07 22:05:44 +08:00
Duo Zhang f1dfd3b0fe HBASE-23578 [UI] Master UI shows long stack traces when table is broken (#3014) 
Co-authored-by: Shuhei Yamasaki <yamasakisua@oss.nttdata.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-07 21:36:24 +08:00
niuyulin 88b9e98a7d HBASE-25637 Rename method completeCompaction to refreshStoreSizeAndTotalBytes (#3023) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-03-06 18:43:47 +08:00
Mohammad Arshad 0487760829
HBASE-25492: Create table with RSGroup (#2883) 
Added new interface in TableDescriptor which allows user to define RSGroup name while creating or modifying a table.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-03-06 10:44:19 +05:30
Narges Shadab c9d0ec903d
HBASE-25626 Possible Resource Leak in HeterogeneousRegionCountCostFunction 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by shahrs87 <shahrs87@gmail.com>
 2021-03-05 08:56:12 +05:30
Rahul Kumar e57c73a137
HBASE-25460 : Expose drainingServers as cluster metric (#2994) (#2995) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-04 12:48:57 +05:30
Andrew Purtell dce639ae81 HBASE-25385 TestCurrentHourProvider fails if the latest timezone changes are not present (#3012) 
Disable this problematic test for now. May be removed after additional
discussion.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-03-03 18:16:20 -08:00
niuyulin 621edfe1da HBASE-25603 Add switch for compaction after bulkload (#2982) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-04 10:11:19 +08:00
Sandeep Pal 80b835927c
HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#3008) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-03-03 11:38:46 -08:00
Akshay Sudheer 63f2c1cdac HBASE-25367 Sort broken after Change 'State time' in UI (#2964) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit 5d9a6ed1fe)
 2021-03-03 14:00:05 +05:30
lidingshengHHU acf2bd9c2d HBASE-25421 There is no limit on the column length when creating a table (#2796) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-03-03 14:43:37 +08:00
Mohammad Arshad 1cd8638508 HBASE-25371: When openRegion fails during initial verification(before… (#2785) 
Signed-off-by: stack <stack@apache.org>
 2021-03-03 08:28:21 +08:00
Andrew Purtell 0849fae730 Revert "HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#2990)" 
This reverts commit d724d0576f.
 2021-03-02 12:26:23 -08:00
Duo Zhang 0988f408e4 Revert "HBASE-25604 Upgrade spotbugs to 4.x (#2986)" 
This reverts commit cb40b81217.
 2021-03-02 21:26:42 +08:00
Peter Somogyi c1cc8469dc HBASE-25611 ExportSnapshot chmod flag uses value as decimal (#3003) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-02 11:25:58 +01:00
Duo Zhang cb40b81217 HBASE-25604 Upgrade spotbugs to 4.x (#2986) 
Signed-off-by: XinSun <ddupgs@gmail.com>
 2021-03-02 15:55:36 +08:00
Duo Zhang d6161dfb8a HBASE-25620 Increase timeout value for pre commit (#3000) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2021-03-01 14:14:26 +08:00
Duo Zhang f268677082 HBASE-25615 Upgrade java version in pre commit docker file (#2997) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-02-27 21:19:50 +08:00
Balazs Meszaros f2f4b3f3ad HBASE-25586 Fix HBASE-22492 on branch-2 (SASL GapToken) (#2961) 
ServerCall.java: calling wrapWithSasl() was moved to getResponse(), so
the SASL wrapping is delayed until the reply is sent back to the client.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-02-26 14:09:24 +01:00