Commit Graph

248 Commits

Author SHA1 Message Date
Nick Dimiduk 22164147d0 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum)
Make use of `%notEmpty` pattern with MDC logging. Will function as expected once we upgrade to
Log4J 2.21.0+.
2023-04-24 17:55:18 +02:00
Nick Dimiduk 63471efa25
HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-17 14:22:04 +02:00
Nick Dimiduk a238ed2785
HBASE-27182 Rework tracing configuration
* Take advantage of the fact that OpenTelemetry can read its configuration from environment
  variables and make use of this where possible, only falling back to passing properties into the
  process launch configuration when it's necessary. DRY up tracing configuration and make it
  easier to manage in a container environment.
* Replace `HBASE_TRACE_OPTS`, which used to act as both a feature flag and a baseline for
  configuration shared across processes. Instead, use `HBASE_OTEL_TRACING_ENABLED` as a feature
  flag, and let configuration reuse be handled via the environment variables that otel supports
  naively.
* Add further explanation for how to write your configuration for our different deployment
  modes (standalone, pseudo-distributed, fully distributed) and in different environments.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 14:37:05 +02:00
Tak Lon (Stephen) Wu 194f8c2c41
HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode (#4452)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-24 09:27:15 -07:00
Duo Zhang 9c8c9e7fbf HBASE-26899 Run spotless:apply
Closes #4312
2022-05-01 22:15:09 +08:00
Duo Zhang 4bea1e8c37
HBASE-26723 Switch to use log4j2.properties file to configure log4j2 (#4096)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-02 21:08:32 +08:00
Nick Dimiduk e782ec03f6 HBASE-26363 OpenTelemetry configuration support for per-process service names
Exposes process-specific tracing arguments for most of the commands that we can launch from
`bin/hbase`. In addition to serving as an on/off flag, `HBASE_TRACE_OPTS` acts as the site-wide
configuration setting. Additional variables are provided for each applicable command, giving
operators fine-grain control over which processes participate in the tracing system, and to what
degree.

Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-11-04 11:38:54 -07:00
Nick Dimiduk cadac1889a HBASE-26361 Enable OpenTelemetry to be used from developer sandbox
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-18 15:20:56 -07:00
Nick Dimiduk fe47557f4c HBASE-25841 Add basic jshell support
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-19 11:37:10 -07:00
Duo Zhang 8df9bebdd3 HBASE-25732 Change the command line argument for tracing after upgrading opentelemtry to 1.0.0 (#3123)
Signed-off-by: Michael Stack <stack@apache.org>
2021-04-25 09:23:23 +08:00
Duo Zhang 57960fa8fa HBASE-25424 Find a way to config OpenTelemetry tracing without direct… (#2808)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2021-04-25 09:23:23 +08:00
Duo Zhang 8e08952499
HBASE-25716 The configured loggers in log4j2.xml will always be created (#3111)
Signed-off-by: Michael Stack <stack@apache.org>
2021-04-09 11:48:15 +08:00
Duo Zhang b8a03d7ebc
HBASE-25689 Nightly client integration test is failing after upgrading to log4j2 (#3077)
Signed-off-by: stack <stack@apache.org>
2021-03-22 23:59:26 +08:00
Duo Zhang ba3610d097
HBASE-19577 Use log4j2 instead of log4j for logging (#1708)
Signed-off-by: stack <stack@apache.org>
2021-03-20 09:21:25 +08:00
Nick Dimiduk 78fce0f333 HBASE-24343 Document how to configure the http request log
Signed-off-by: Michael Stack <stack@apache.org>
2020-05-29 16:50:16 -07:00
Nick Dimiduk 7e295e767f HBASE-24271 Set values in `conf/hbase-site.xml` that enable running on `LocalFileSystem` out of the box
Simplify the new user experience shipping a configuration that enables
a fresh checkout or tarball distribution to run in standalone mode
without direct user configuration. This change restores the behavior
we had when running on Hadoop 2.8 and earlier.

Patch for master includes an update to the book. This change will be
omitted when backporting to earlier branches.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-14 13:18:43 -07:00
Duo Zhang fddb2dd65c
HBASE-24310 Use Slf4jRequestLog for hbase-http (#1634)
Signed-off-by: stack <stack@apache.org>
2020-05-08 11:16:18 +08:00
Nick Dimiduk 7f6672eb9e
HBASE-24143 [JDK11] Switch default garbage collector from CMS ; Addendum (#1594)
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-04-27 09:24:46 -07:00
Nick Dimiduk 52245e9f7c HBASE-24143 [JDK11] Switch default garbage collector from CMS
Per comments in Jira, be explicit about what collector we
use. Existing code simply hard-codes HBASE_OPTS in
`conf/hbase-env.sh`. We now need to be a little more clever than this,
so moves the definition into `bin/hbase`. Also consolidates logic
around JVM version detection into a reusable function.

This change also changes how we set `HBASE_OPTS`. Before, we would
accept an operator's value, but always append our GC
prescription. After this change, we defer entirely to the operator's
choice, only applying our values when they've not specified their
intentions.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-04-17 13:51:08 -07:00
Toshihiro Suzuki 79e799ab7b
HBASE-23165 [hbtop] Some modifications from HBASE-22988 (#987)
Signed-off-by: stack <stack@apache.org>
2020-01-11 21:06:07 +09:00
Toshihiro Suzuki 78bae9e3d0
HBASE-11062 hbtop (#476)
Signed-off-by: Stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-09-07 14:02:52 +09:00
Sergey Shelukhin caa05356a1 HBASE-22145 windows hbase-env causes hbase cli/etc to ignore HBASE_OPTS 2019-07-31 09:58:35 +02:00
Pankaj 5ca1b64be5 HBASE-21612, Add developer debug options in HBase Config for REST server 2019-01-15 21:50:56 -08:00
han.congcong 86cbbdea9e HBASE-21328 add HBASE_DISABLE_HADOOP_CLASSPATH_LOOKUP switch to hbase-env.sh
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-11-06 08:38:55 -06:00
Jan Hentschel 8377873d22 HBASE-12882 Log level now configurable from outside Log4j configuration 2018-06-02 11:21:15 +02:00
Michael Stack 70377babd0 HBASE-20059 Make sure documentation is updated for the offheap Bucket cache usage 2018-04-19 16:19:53 -07:00
Nihal Jain f3ec230936 HBASE-20394 HBase over rides the value of HBASE_OPTS (if any) set by client
Signed-off-by: Josh Elser <elserj@apache.org>
2018-04-12 11:43:56 -04:00
Apekshit Sharma 330b0d05b9 HBASE-19114 Split out o.a.h.h.zookeeper from hbase-server and hbase-client
- Moved DrainingServerTracker and RegionServerTracker to hbase-server:o.a.h.h.master.
- Moved SplitOrMergeTracker to oahh.master (because it depends on a PB)
- Moving hbase-client:oahh.zookeeper.*  to hbase-zookeeper module.  After HBASE-19200, hbase-client doesn't need them anymore (except 3 classes).
- Renamed some classes to use a consistent naming for classes - ZK instead of mix of ZK, Zk , ZooKeeper. Couldn't rename following public classes: MiniZooKeeperCluster, ZooKeeperConnectionException. Left RecoverableZooKeeper for lack of better name. (suggestions?)
- Sadly, can't move tests out because they depend on HBaseTestingUtility (which defeats part of the purpose - trimming down hbase-server tests. We need to promote more use of mocks in our tests)
2017-11-17 13:20:18 -08:00
Vikas Vishwakarma b653d1bf05 HBASE-18517 limit max log message width in log4j
Signed-off-by: Michael Stack <stack@apache.org>
2017-08-08 12:11:13 +08:00
Andrew Purtell 404a2883f2 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging 2017-03-03 12:40:06 -08:00
Andrew Purtell be1cdc7376 HBASE-16188 Add EventCounter information to log4j properties file (Gopi Krishnan Nambiar) 2017-02-27 15:56:55 -08:00
Umesh Agashe 1f1a13f2e2 HBASE-16753 There is a mismatch between suggested Java version in hbase-env.sh
Signed-off-by: Dima Spivak <dimaspivak@apache.org>
2016-10-05 10:16:41 -07:00
Jerry He 2765b9d9d9 HBASE-16667 Building with JDK 8: ignoring option MaxPermSize=256m (Niels Basjes) 2016-09-24 16:07:25 -07:00
Elliott Clark 65a8d77433 HBASE-16061 Allow logging to a buffered console 2016-06-17 17:06:12 -07:00
Alex Moundalexis 0bf065a5d5 HBASE-15768 fix capitalization of ZooKeeper usage
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-05 15:35:44 -05:00
Misty Stanley-Jones c575e18ab8 HBASE-14481 Deprecate HBase Wiki
We have an awesome community resource in our online book. It's maintained and looked after with
diligence. We also have an HBase section on the hadoop wiki that hasn't been updated since 2012.
Let's sift through the pages of the wiki, bring over any content that's still relevant and
not already present in the book, and kill the wiki.
2015-11-04 09:09:02 +10:00
stack 950050e9d6 Revert "HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan)"
Revert because I overcommitted, included files from another patch.

This reverts commit 47659200ac.
2015-11-02 08:06:34 -08:00
stack 47659200ac HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan) 2015-11-01 22:22:59 -08:00
Sean Busbey 4ce6f486d0 HBASE-14087 Ensure correct ASF headers for docs/code
* adds missing headers
* corrects some old-form headers to current
* restores proper header for guava copied LimitInputStream
* adds proper header for protobuf copied read/writeRawVarint
2015-07-29 14:25:43 -05:00
Enis Soztutar 19242fa1d1 HBASE-13516 Increase PermSize to 128MB 2015-04-27 21:14:23 -07:00
Mikhail Antonov 578df6dfc0 HBASE-13252 Get rid of managed connections and connection caching
Signed-off-by: stack <stack@apache.org>
2015-04-02 12:00:42 -07:00
Andrey Stepachev e26c4e4e67 HBASE-5238 Add a log4j category for all edits to META/ROOT 2015-03-25 23:03:18 +00:00
stack f57dca5e1b HBASE-13198 Remove HConnectionManager (Mikhail Antonov) 2015-03-20 09:41:48 -07:00
Lars George fa299bfa80 HBASE-13165 Fix docs and scripts for default max heaps size after HBASE-11804 (code) 2015-03-11 11:20:25 +01:00
Andrey Stepachev 948746ce4e HBASE-12990 MetaScanner should be replaced by MetaTableAccessor 2015-03-09 10:39:59 +00:00
Ashish Singhi 070e2dd89a HBASE-12831 Changing the set of vis labels a user has access to doesn't generate an audit log event
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-01-28 16:29:45 -06:00
Patrick White f2be914f73 HBASE-12569 Update scripts to control MaxDirectMemorySize via env vars
Signed-off-by: stack <stack@apache.org>
2014-11-24 23:57:46 -08:00
Jimmy Xiang 683f3b3d50 HBASE-12034 If I kill single RS in branch-1, all regions end up on Master! 2014-09-29 13:50:59 -07:00
Ted Yu b158900b68 HBASE-11666 Enforce JDK7 javac for builds on branch-1 and master (Sean Busbey) 2014-08-05 15:00:37 +00:00
Jimmy Xiang cc61cc3081 HBASE-11575 Pseudo distributed mode does not work as documented 2014-07-24 10:04:35 -07:00