f5df7693c5
HBASE-27395 Adding description to Prometheus metrics ( #4807 )
...
Signed-off-by: Tamas Payer <payert@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2022-10-07 11:32:26 +02:00
5cab4be075
HBASE-27401 Clean up current broken 'n's in our javadoc ( #4812 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f0
2022-10-06 22:13:14 +08:00
94ed02d7ed
HBASE-27407 Fixing check for "description" request param in JMXJsonServlet.java ( #4816 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-10-06 10:51:16 +01:00
f27a12a2ae
HBASE-27320 hide some sensitive configuration information in the UI ( #4723 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b4e5875dd9
2022-08-24 14:27:50 +08:00
c04edf7835
HBASE-20904 Prometheus /metrics http endpoint for monitoring ( #4691 )
...
Co-authored-by: Luca Kovacs <kovacs.luca.agota@gmail.com>
Co-authored-by: Madhusoodan P <akshayapataki123@gmail.com>
Co-authored-by: Luca Kovacs <lkovacs@cloudera.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f9ea7ee0d6
2022-08-24 11:31:16 +08:00
2941b8e583
HBASE-27240 Clean up error-prone findings in hbase-http ( #4653 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5eaeff5fcd
2022-08-11 14:44:14 +08:00
99f2ab5aa8
HBASE-27220 Apply the spotless format change in HBASE-27208 to our code base
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-19 10:00:31 +08:00
b570d2e81d
HBASE-27141 Upgrade hbase-thirdparty dependency to 4.1.1 ( #4552 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
(cherry picked from commit 9bae50f83c
2022-06-22 22:42:52 +08:00
a6b1c7e234
HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory ( #4425 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1be2c83b3d
2022-05-22 11:35:45 +08:00
1a5b1b266c
HBASE-26899 Run spotless:apply
2022-05-01 22:41:49 +08:00
e9c9418d1d
HBASE-26943 HMaster page style display confusion ( #4369 )
...
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-29 15:59:53 +08:00
cdabd6a1ad
HBASE-25895 Implement a Cluster Metrics JSON endpoint
...
Publishes a set of JSON endpoints following a RESTful structure, which expose a subset of the
`o.a.h.h.ClusterMetrics` object tree. The URI structure is as follows
/api/v1/admin/cluster_metrics
/api/v1/admin/cluster_metrics/live_servers
/api/v1/admin/cluster_metrics/dead_servers
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 17:26:20 +01:00
340cc6c6f1
HBASE-26802 Backport the log4j2 changes to branch-2 ( #4166 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-11 11:17:43 -08:00
300f9b9576
HBASE-26582 Prune use of Random and SecureRandom objects ( #4118 )
...
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.
Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.
Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-08 15:22:00 -08:00
d020cba795
HBASE-26745: Include balancer cost metrics in jmx endpoint ( #4140 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-02 17:39:49 -08:00
7f30aa8b63
HBASE-23303 Add default security headers if SSL is enabled ( #4128 )
...
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2022-03-02 15:28:45 +01:00
d747da6985
HBASE-26709 Ban the usage of junit 3 TestCase ( #4065 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-02-10 01:06:06 +08:00
de84082391
HBASE-26657 ProfileServlet should move the output location to hbase specific directory ( #4022 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2022-01-11 16:01:38 +05:30
e53712ae99
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 ( #3988 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:10:08 +08:00
be00c452aa
HBASE-26554 Introduce a new parameter in jmx servlet to exclude the specific mbean ( #3930 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-14 22:52:46 +08:00
a24956d5ed
HBASE-26160: Configurable disallowlist for live editing of loglevels ( #3559 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-08-05 09:49:25 +08:00
1542b50b00
HBASE-25993 Make excluded SSL cipher suites configurable for all Web UIs ( #3375 )
...
When starting a jetty http server, one can explicitly exclude certain (unsecure)
SSL cipher suites. This can be especially important, when the HBase cluster
needs to be compliant with security regulations (e.g. FIPS).
Currently it is possible to set the excluded ciphers for the ThriftServer
("hbase.thrift.ssl.exclude.cipher.suites") or for the RestServer
("hbase.rest.ssl.exclude.cipher.suites"), but one can not configure it for the
regular InfoServer started by e.g. the master or region servers.
In this commit I want to introduce a new configuration
"ssl.server.exclude.cipher.list" to configure the excluded cipher suites for the
http server started by the InfoServer. This parameter has the same name and will
work in the same way, as it was already implemented in hadoop (e.g. for hdfs/yarn).
See: HADOOP-12668, HADOOP-14341
Co-authored-by: Mate Szalay-Beko <symat@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-06-10 16:48:51 +02:00
a4e8ee183e
HBASE-25911 Replace calls to System.currentTimeMillis with EnvironmentEdgeManager.currentTime ( #3302 )
...
We introduced EnvironmentEdgeManager as a way to inject alternate clocks
for unit tests. In order for this to be effective, all callers that would
otherwise use System.currentTimeMillis() must call
EnvironmentEdgeManager.currentTime() instead, except the implementers of
EnvironmentEdge.
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Conflicts:
hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
hbase-backup/src/test/java/org/apache/hadoop/hbase/backup/TestBackupBase.java
hbase-backup/src/test/java/org/apache/hadoop/hbase/backup/TestBackupManager.java
hbase-backup/src/test/java/org/apache/hadoop/hbase/backup/TestBackupSystemTable.java
hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncConnectionTracing.java
hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncRegionLocatorTracing.java
hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestBackupRestore.java
hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestManyRegions.java
hbase-it/src/test/java/org/apache/hadoop/hbase/chaos/actions/MoveRegionsOfTableAction.java
hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestWALRecordReader.java
hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/replication/TestVerifyReplicationCrossDiffHdfs.java
hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/snapshot/TestExportSnapshotV1NoCluster.java
hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestEnableRSGroups.java
hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsAdmin2.java
hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/CallRunner.java
hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcServer.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionStateStore.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/SimpleLoadBalancer.java
hbase-server/src/main/java/org/apache/hadoop/hbase/wal/AbstractWALRoller.java
hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
hbase-server/src/test/java/org/apache/hadoop/hbase/MiniHBaseCluster.java
hbase-server/src/test/java/org/apache/hadoop/hbase/TestMetaTableAccessor.java
hbase-server/src/test/java/org/apache/hadoop/hbase/TestMetaUpdatesGoToPriorityQueue.java
hbase-server/src/test/java/org/apache/hadoop/hbase/TestSerialization.java
hbase-server/src/test/java/org/apache/hadoop/hbase/backup/TestHFileArchiving.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/RestoreSnapshotFromClientSimpleTestBase.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin2.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestConnection.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide3.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMobCloneSnapshotFromClientCloneLinksAfterDelete.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMutationGetCellBuilder.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestSnapshotMetadata.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestActiveMasterManager.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterMetricsWrapper.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMetaAssignmentWithStopMaster.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/assignment/TestRegionStateStore.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestLogsCleaner.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestReplicationHFileCleaner.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/janitor/TestCatalogJanitor.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/procedure/MasterProcedureSchedulerPerformanceEvaluation.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/procedure/TestCloneSnapshotProcedure.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/procedure/TestRestoreSnapshotProcedure.java
hbase-server/src/test/java/org/apache/hadoop/hbase/procedure2/store/region/RegionProcedureStorePerformanceEvaluation.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionServerBulkLoad.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHStoreFile.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMajorCompaction.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionOpen.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestSimpleTimeRangeTracker.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestWideScanner.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/compactions/TestCloseChecker.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/AbstractTestProtobufLog.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/AbstractTestWALReplay.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestCombinedAsyncWriter.java
hbase-server/src/test/java/org/apache/hadoop/hbase/replication/master/TestRecoverStandbyProcedure.java
hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestFlushSnapshotFromClient.java
hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSyncReplicationWALProvider.java
hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftServer.java
hbase-zookeeper/src/main/java/org/apache/hadoop/hbase/zookeeper/MiniZooKeeperCluster.java
2021-06-01 12:41:15 -07:00
32207cd478
HBASE-25770 Http InfoServers should honor gzip encoding when requested ( #3159 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-04-15 13:46:53 -07:00
c8c043a413
HBASE-25685 asyncprofiler2.0 no longer supports svg; wants html ( #3079 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-03-22 21:24:58 -07:00
7ff1d14959
HBASE-25688 Use CustomRequestLog instead of Slf4jRequestLog for jetty ( #3075 )
...
Signed-off-by: stack <stack@apache.org>
2021-03-23 11:19:38 +08:00
b53f52dcd5
Revert "HBASE-25685 asyncprofiler2.0 no longer supports svg; wants html"
...
This reverts commit ddfedb08f1
2021-03-22 12:48:06 -07:00
ddfedb08f1
HBASE-25685 asyncprofiler2.0 no longer supports svg; wants html
...
For branch-2 and master, make HTML the default.
2021-03-22 12:46:26 -07:00
9325a775fe
HBASE-25452 Use MatcherAssert.assertThat instead of org.junit.Assert.assertThat ( #2826 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-12-30 10:03:39 +08:00
1b6399a480
HBASE-24640 [branch-2] Purge use of VisibleForTesting ( #2696 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-11-25 14:15:32 -08:00
5ce3e3e12c
HBASE-24268 REST and Thrift server do not handle the "doAs" parameter case insensitively
...
Closes #1843
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-11-24 12:25:46 -05:00
873bef1d7e
HBASE-25267 Add SSL keystore type and truststore related configs for HBase RESTServer ( #2642 )
...
HBASE-25267 Make SSL keystore type configurable in HBase RESTServer
In this patch I want to introduce the hbase.rest.ssl.keystore.type parameter,
enabling us to customize the keystore type for the REST server. If the
parameter is not provided, then we should fall-back to the current behaviour
(which assumes keystore type JKS).
This is similar to how we already configure the InfoServer objects with the
ssl.server.keystore.type parameter to set up HTTPS for the various admin UIs.
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-11-12 12:43:58 +01:00
1de1ec176f
HBASE-24054 To be safe, jetty's version number should be blocked.
2020-10-05 17:37:21 -07:00
3cb4b29fa3
HBASE-25002 Create simple pattern matching query for retrieving metri… ( #2370 ) ( #2398 )
...
* HBASE-25002 Create simple pattern matching query for retrieving metrics matching the pattern
* Address review comments
* Final set of comments addressed
* Address checkstyle comments
2020-09-14 19:44:00 +05:30
800a4d9868
HBASE-19352 Port HADOOP-10379: Protect authentication cookies with the HttpOnly and Secure flags
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-09-03 16:18:33 -05:00
4455856e9c
HBASE-23834 HBase fails to run on Hadoop 3.3.0/3.2.2/3.1.4 due to jetty version mismatch ( #2222 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2020-08-25 15:02:55 +08:00
8f31b12ba4
HBASE-24777 InfoServer support ipv6 host and port
...
Closes #2147
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-27 20:46:49 +05:30
25e929bdf0
HBASE-24657 add unit test for JSONBean.java
...
Closes #2004
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-02 18:51:13 +05:30
941cef71c2
HBASE-24190 : Make kerberos value of hbase.security.authentication property case insensitive ( #1687 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-14 11:46:33 +05:30
b78f4367f7
Revert "Make kerberos value of hbase.security.authentication property case insensitive ( #1687 )"
...
This reverts commit c03ec837e7
2020-05-14 11:45:23 +05:30
dc2146069c
HBASE-24309 Avoid introducing log4j and slf4j-log4j dependencies for … ( #1697 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-13 17:59:21 +08:00
c03ec837e7
Make kerberos value of hbase.security.authentication property case insensitive ( #1687 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-11 11:10:29 +05:30
ec333922ce
HBASE-24310 Use Slf4jRequestLog for hbase-http ( #1634 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-08 11:22:18 +08:00
528e9d6454
HBASE-24307 [Flakey Tests] krb server for secure thrift tests throws BindException ( #1656 )
...
Move the random free port generate back into hbasecommontestingutility
from hbasetestingutility.
Add a create simple kdc server utility that will start a kdc server and
if a bindexception, create a new one on a new random port in hbase-common.
Add new BoundSocketMaker helpful when trying to manufacture
BindExceptions because of port clash.
Change thrift and http kdc tests to use this new utility (removes
code duplication around kdc server setup).
2020-05-05 21:08:09 -07:00
8eb2f6752c
HBASE-24252 Implement proxyuser/doAs mechanism for hbase-http
...
copy ProxyUserAuthenticationFilter from Hadoop
add hbase.security.authentication.spnego.kerberos.proxyuser.enable parameter (default false)
wire ProxyUserAuthenticationFilter into HttpServer
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2020-04-27 13:15:34 -04:00
ec266a0743
HBASE-24197 TestHttpServer.testBindAddress failure with latest jetty ( #1524 )
...
use the findPort logic even if the BindException is wrapped in an IOException
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2020-04-16 11:52:35 +02:00
33cb9fc932
HBASE-23829 Get `-PrunSmallTests` passing on JDK11
...
Signed-off-by: stack <stack@apache.org>
2020-03-17 09:01:02 -07:00
e385fd97e0
HBASE-23783: Address tests writing and reading SSL/Security files in a common location. ( #1116 )
...
This is causing me issues with parallel test runs.
Also allow setting the surefire reports and temp directories via command line.
Signed-off-by: stack <stack@apache.org>
2020-02-04 14:40:52 -08:00
12f4e0977c
HBASE-23780 Edit of test classifications ( #1109 )
...
These classifications come of running at various fork counts.. A test
may complete quick if low fork count but if it is accessing disk, it
will run much slower if fork count is high. This edit accommodates
some of this phenomenon.
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
2020-02-03 09:16:47 -08:00
5fc1141f63
HBASE-17115 Define UI admins via an ACL
...
The Hadoop AccessControlList allows us to specify admins of the webUI
via a list of users and/or groups. Admins of the WebUI can mutate the
system, potentially seeing sensitive data or modifying the system.
hbase.security.authentication.spnego.admin.users is a comma-separated
list of users who are admins.
hbase.security.authentication.spnego.admin.groups is a comma-separated
list of groups whose membership are admins. Either of these
configuration properties may also contain an asterisk (*) which denotes
"any entity" (e.g user, group).
Previously, when a user was denied from some endpoint that was
designated for admins, they received an HTTP/401. In this case, it is
more correct to return HTTP/403 as they were correctly authenticated,
but they were disallowed from fetching the given resource. This commit
incorporates this change.
hbase.security.authentication.ui.config.protected also exists for users
who have sensitive information stored in the Hadoop service
configuration and want to limit access to this endpoint. By default,
the Hadoop configuration endpoint is not protected and any
authenticated user can access it.
The test is based off of work by Nihal Jain in HBASE-20472.
Co-authored-by: Nihal Jain <nihaljain.cs@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-01-29 16:45:25 -05:00
Luca Kovács
Duo Zhang
Ruanhui
Andrew Purtell
bitterfox
LiangJun He
Nick Dimiduk
Bri Augenreich
Andor Molnár
Viraj Jasani
Bryan Beaudreault
Mate Szalay-Beko
Michael Stack
stack
Richard Antal
申胜利
ramkrish86
Esteban Gutierrez
YeChao Chen
David Manning
shahrs87
Josh Elser
Istvan Toth
Mark Robert Miller