Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,798 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

17798 Commits

Author SHA1 Message Date
Javier Akira Luca de Tena 9e701bb1d3 HBOPS-25594 Make easier to use graceful_stop on localhost mode (#3054) 
Co-authored-by: Javier <javier.lucadetena@linecorp.com>
 2021-03-18 12:05:26 -07:00
bitterfox 150e02ee58
HBASE-25671 Backport HBASE-25608 to branch-2 (#3058) 
Signed-off-by: stack <stack@apache.org>
 2021-03-18 12:00:25 -07:00
Catalin Luca c9b81c3f82 HBASE-25674 - RegionInfo.parseFrom(DataInputStream) sometimes fails to read the protobuf magic marker (#3062) 
Co-authored-by: Catalin Luca <luca@adobe.com>
Signed-off-by: stack <stack@apache.org>
 2021-03-18 11:56:34 -07:00
Michael Stack 75e2e7c83d HBASE-25677 Server+table counters on each scan #nextRaw invocation becomes a bottleneck when heavy load (#3061) 
Don't have every handler update regionserver metrics on each
scan#nextRaw; instead, do a batch update just before Scan
returns. Otherwise, all running handlers end up contending
on metrics update.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 Update of regionserver metrics counters moved out to caller where
 can be done as a batch update instead of per-next.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServer.java
 Class doc to encourage batch updating metrics.
 Remove the single update as unused anymore.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
 Count calls to nextRaw. Update regionserver count in finally block when
 scan is done rather than per nextRaw call. Move all metrics updates to
 finally.

Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Baiqiang Zhao <ZhaoBQ>
 2021-03-18 11:40:42 -07:00
Anoop Sam John 97e02732b4 HBASE-25673 Wrong log regarding current active master at ZKLeaderManager#waitToBecomeLeader (#3057) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-18 21:21:46 +05:30
Sandeep Pal 72496272aa
HBASE-25627: HBase replication should have a metric to represent if the source is stuck getting initialized (#3018) 
Introduces a new metric that tracks number of replication sources that are stuck in initialization.

Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
(cherry picked from commit ff3821814a)
 2021-03-17 10:30:26 -07:00
bitterfox a61e9b963d HBASE-25665 Option to use hostname instead of canonical hostname for secure HBase cluster connection (#3051) 2021-03-16 21:05:23 -07:00
stack f0c5e68a0d HBASE-25667 Remove RSGroup test addition made in parent; depends on functionality not in old branches 2021-03-16 13:17:13 -07:00
Javier 3135b7a42f HBASE-25594 graceful_stop.sh fails to unload regions when ran at localhost 
Signed-off-by: stack <stack@apache.org>
 2021-03-15 21:42:14 -07:00
stack 4b2cab3e5d Revert "HBASE-25663 Make graceful_stop localhostname compare match even if fqdn (#3048)" 
This reverts commit f4e1ab7b1d.
 2021-03-15 21:29:35 -07:00
Pankaj 1ca85017f7 HBASE-25374 Make REST Client connection and socket time out configurable (#2752) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: stack <stack@apache.org>
 2021-03-15 16:46:04 -07:00
Baiqiang Zhao a93b0cd3ca HBASE-25597 Add row info in Exception when cell size exceeds maxCellSize (#2976) 
Signed-off-by: stack <stack@apache.org>
 2021-03-15 15:50:22 -07:00
haxiaolin 6c224b8640 HBASE-25621 Balancer should check region plan source to avoid misplace region groups (#3002) 
Signed-off-by: stack <stack@duboce.net>
 2021-03-15 14:48:35 -07:00
haxiaolin 13574de156 HBASE-25595 TestLruBlockCache.testBackgroundEvictionThread is flaky (#2974) 
Signed-off-by: stack <stack@apache.org>
 2021-03-15 14:26:06 -07:00
Michael Stack 763de9a085
HBASE-25561 Added ignored test for async connection that runs retries just so can check how long it takes and that retrying is happening (#2942) 2021-03-15 14:14:41 -07:00
Michael Stack 3bf2ef4259
HBASE-25660 Print split policy in use on Region open (as well as split policy vitals) (#3044) 
Add a toString to all split policy implementations listing name and
 vitals. Use this toString in the Region open message. Ditto for flush
 policy for the Region.

 Signed-off-by: Huaxiang Sun<huaxiangsun@apache.org>
 2021-03-15 14:10:37 -07:00
Michael Stack 754300ac71 HBASE-25663 Make graceful_stop localhostname compare match even if fqdn (#3048) 2021-03-15 13:25:50 -07:00
Duo Zhang 4c8de44bf9 HBASE-25662 Fix spotbugs warning in RoundRobinTableInputFormat (#3050) 2021-03-15 08:16:18 -07:00
haxiaolin 95e8ee5ca5 HBASE-25635 CandidateGenerator may miss some region balance actions (#3024) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-03-15 21:33:46 +08:00
Duo Zhang aafbbc2456 HBASE-25657 Fix spotbugs warnings after upgrading spotbugs to 4.x (#3041) 
Signed-off-by: meiyi <myimeiyi@gmail.com>
Signed-off-by: stack <stack@apache.org>
 2021-03-12 14:37:17 +08:00
shahrs87 bb4d8b9cf7 HBASE-25622 Result#compareResults should compare tags. (#3026) 
Signed-off-by: stack <stack@apache.org>
 2021-03-11 21:52:11 -08:00
Michael Stack 45b3280497 HBASE-25570 On largish cluster, "CleanerChore: Could not delete dir..." makes master log unreadable (#2949) 
Turn down the amount we log. If you want to see the full exception
enable TRACE-level logging.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: shahrs87
 2021-03-11 21:36:31 -08:00
sudhir-reddy 40d7e024c7 HBASE-25566 RoundRobinTableInputFormat (#2947) 
Co-authored-by: stack <stack@apache.org>
Co-authored-by: sudhir-reddy <sudhir-reddy>
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.org>
 2021-03-11 20:54:56 -08:00
Peter Somogyi af8dc2e4df HBASE-25587 [hbck2] Schedule SCP for all unknown servers (#2978) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-11 17:22:08 +01:00
meiyi b5fc5e17e2 HBASE-25636 Expose HBCK report as metrics (#3031) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2021-03-11 15:15:23 +08:00
Duo Zhang d546c8e77c HBASE-25629 Reimplement TestCurrentHourProvider to not depend on unstable TZs (#3013) 
Signed-off-by: XinSun <ddupgs@gmail.com>
 2021-03-10 23:53:59 +08:00
Wellington Ramos Chevreuil 7adc00044c HBASE-25548 Optionally allow snapshots to preserve cluster's max file… (#2923) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 373dc7788d)
 2021-03-10 10:35:58 +00:00
Anoop Sam John 29d771fab9
HBASE-25582 Support setting scan ReadType to be STREAM at cluster level (#3040) 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-10 13:23:15 +05:30
Duo Zhang e33858828c HBASE-25604 Upgrade spotbugs to 4.x (#3029) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-03-10 14:54:04 +08:00
Narges Shadab 884cb0bd2c
HBASE-25646: Possible Resource Leak in CatalogJanitor #3036 
Close the stream using a try-with-resources block.

Reviewed-by: Aman Poonia <aman.poonia.29@gmail.com>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
(cherry picked from commit 573daed419)
 2021-03-09 09:11:02 -08:00
Bharath Vissapragada 321b5c7979
HBASE-25547: Thread pools should release unused resources (#3037) 
* HBASE-25547: Thread pools should release unused resources (#2922)

Plumbs the configuration needed to enable core thread timeout on non-critical thread pools.
Currently only enabled for thread pools with op-codes RS_LOG_REPLAY_OPS, RS_PARALLEL_SEEK, MASTER_SNAPSHOT_OPERATIONS, MASTER_MERGE_OPERATIONS. Others can be added later as
needed.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 618236dd90)

* HBASE-25547 (addendum): Roll ExecutorType into ExecutorConfig

Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 4c822d7463)
 2021-03-09 09:03:16 -08:00
Anoop Sam John f2c52e4176 HBASE-25644 Scan#setSmall blindly sets ReadType as PREAD 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
 2021-03-08 13:10:52 +05:30
申胜利 e81ef34c68 HBASE-25609 There is a problem with the SPLITS_FILE in the HBase shell statement(#2992) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-03-07 22:05:44 +08:00
Duo Zhang f1dfd3b0fe HBASE-23578 [UI] Master UI shows long stack traces when table is broken (#3014) 
Co-authored-by: Shuhei Yamasaki <yamasakisua@oss.nttdata.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-07 21:36:24 +08:00
niuyulin 88b9e98a7d HBASE-25637 Rename method completeCompaction to refreshStoreSizeAndTotalBytes (#3023) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-03-06 18:43:47 +08:00
Mohammad Arshad 0487760829
HBASE-25492: Create table with RSGroup (#2883) 
Added new interface in TableDescriptor which allows user to define RSGroup name while creating or modifying a table.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-03-06 10:44:19 +05:30
Narges Shadab c9d0ec903d
HBASE-25626 Possible Resource Leak in HeterogeneousRegionCountCostFunction 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by shahrs87 <shahrs87@gmail.com>
 2021-03-05 08:56:12 +05:30
Rahul Kumar e57c73a137
HBASE-25460 : Expose drainingServers as cluster metric (#2994) (#2995) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-04 12:48:57 +05:30
Andrew Purtell dce639ae81 HBASE-25385 TestCurrentHourProvider fails if the latest timezone changes are not present (#3012) 
Disable this problematic test for now. May be removed after additional
discussion.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-03-03 18:16:20 -08:00
niuyulin 621edfe1da HBASE-25603 Add switch for compaction after bulkload (#2982) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-04 10:11:19 +08:00
Sandeep Pal 80b835927c
HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#3008) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-03-03 11:38:46 -08:00
Akshay Sudheer 63f2c1cdac HBASE-25367 Sort broken after Change 'State time' in UI (#2964) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit 5d9a6ed1fe)
 2021-03-03 14:00:05 +05:30
lidingshengHHU acf2bd9c2d HBASE-25421 There is no limit on the column length when creating a table (#2796) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-03-03 14:43:37 +08:00
Mohammad Arshad 1cd8638508 HBASE-25371: When openRegion fails during initial verification(before… (#2785) 
Signed-off-by: stack <stack@apache.org>
 2021-03-03 08:28:21 +08:00
Andrew Purtell 0849fae730 Revert "HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#2990)" 
This reverts commit d724d0576f.
 2021-03-02 12:26:23 -08:00
Duo Zhang 0988f408e4 Revert "HBASE-25604 Upgrade spotbugs to 4.x (#2986)" 
This reverts commit cb40b81217.
 2021-03-02 21:26:42 +08:00
Peter Somogyi c1cc8469dc HBASE-25611 ExportSnapshot chmod flag uses value as decimal (#3003) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-02 11:25:58 +01:00
Duo Zhang cb40b81217 HBASE-25604 Upgrade spotbugs to 4.x (#2986) 
Signed-off-by: XinSun <ddupgs@gmail.com>
 2021-03-02 15:55:36 +08:00
Duo Zhang d6161dfb8a HBASE-25620 Increase timeout value for pre commit (#3000) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2021-03-01 14:14:26 +08:00
Duo Zhang f268677082 HBASE-25615 Upgrade java version in pre commit docker file (#2997) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-02-27 21:19:50 +08:00