Commit Graph

73 Commits

Author SHA1 Message Date
Karthik Palanisamy 090780c5bd HBASE-23208 Unit formatting in Master & RS UI
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 257ccad31c)
(cherry picked from commit fe23e3fd5b)
2019-10-29 11:00:28 -05:00
Andrew Purtell ff0e587b8f
HBASE-21735 Port HBASE-18784 (Use of filesystem that requires hflush / hsync / append / etc should query outputstream capabilities) to branch-1
HBASE-18784 if available, query underlying outputstream capabilities where we need hflush/hsync.

* pull things that don't rely on HDFS in hbase-server/FSUtils into hbase-common/CommonFSUtils
* refactor setStoragePolicy so that it can move into hbase-common/CommonFSUtils
* refactor WALProcedureStore so that it handles its own FS interactions
* add a reflection-based lookup of stream capabilities
* call said lookup in places where we make WALs to make sure hflush/hsync is available.

HBASE-19289 Add flag to disable stream capability enforcement

HBASE-19841 Tests against hadoop3 fail with StreamLacksCapabilityException

HBASE-19947 ITU should overwrite HTU local FS

HBASE-20354 better docs for impact of proactively checking hsync support.

* Add to the quickstart guide disabling the hsync check, with a
  big warning about how we'll lose data if the check is disabled.
* Add to troubleshooting section so folks searching can get a pointer.
2019-01-24 09:23:14 -08:00
Michael Stack 02089f20b4
HBASE-21190 Log files and count of entries in each as we load from the MasterProcWAL store
Conflicts:
	hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/ProcedureWALFormatReader.java
2018-09-12 13:34:01 -07:00
Thiruvel Thirumoolan e65004aeea HBASE-19996 Some nonce procs might not be cleaned up (follow up HBASE-19756)
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-14 09:17:13 -08:00
Thiruvel Thirumoolan 2c5140e151 HBASE-19756 Master NPE during completed failed proc eviction
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-01-24 16:48:54 -08:00
Andrew Purtell 5b7411290b HBASE-19239 Fix findbugs and error-prone issues
Fixes for hbase-procedure
2017-11-17 17:12:35 -08:00
Andrew Purtell 844596e09e Revert "HBASE-18216 [AMv2] Workaround for HBASE-18152, corrupt procedure WAL including ADDENDUM"
This reverts commit 8ce3f49f80.
See HBASE-18340
2017-07-10 19:25:09 -07:00
Michael Stack 8ce3f49f80 HBASE-18216 [AMv2] Workaround for HBASE-18152, corrupt procedure WAL including ADDENDUM 2017-06-30 15:31:30 -07:00
Andrew Purtell ccf1f17d78 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging
Conflicts:
	hbase-spark/src/test/resources/log4j.properties
2017-03-03 12:35:21 -08:00
Zach York 8f6388503b HBASE-17437 Support specifying a WAL directory outside of the root directory (Yishan Yang and Zach York)
HBASE-17588 Remove unused imports brought in by HBASE-17437 (Zach York)

Signed-off-by: Enis Soztutar <enis@apache.org>
2017-02-08 15:01:59 -08:00
Stephen Yuan Jiang ce33cf2d3d HBASE-17149 Procedure V2 - Fix nonce submission to avoid unnecessary calling coprocessor multiple times (Matteo Bertozzi) 2016-12-28 15:43:50 -08:00
Matteo Bertozzi 08e44919cc HBASE-16639 TestProcedureInMemoryChore#testChoreAddAndRemove occasionally fails 2016-09-15 18:32:53 -07:00
tedyu 76a0760269 HBASE-16640 TimeoutBlockingQueue#remove() should return whether the entry is removed 2016-09-15 17:35:59 -07:00
Apekshit Sharma 4147dcb81a HBASE-16101 addendum. Fixes runtime ClassCastException of Future<Integer> in ProcedureWALPerformanceEvaluation.
Change-Id: Ibe4f3a001b4f50e8598e367cc8648aeae129eee8
2016-09-01 17:47:21 -07:00
Matteo Bertozzi aeecd4df83 HBASE-16533 Procedure v2 - Extract chore from the executor 2016-08-30 19:02:31 -07:00
Apekshit Sharma e46a073ed2 HBASE-16101 Tool to microbenchmark procedure WAL performance.
Change-Id: I8ec158319395d2ec8e36641a3beab2694f7b6aef
2016-08-30 13:32:42 -07:00
Matteo Bertozzi 73818646be HBASE-16451 Procedure v2 - Test WAL protobuf entry size limit 2016-08-23 20:52:40 -07:00
Matteo Bertozzi 1e15fa57df HBASE-16485 Procedure v2 - Add support to addChildProcedure() as last "step" in StateMachineProcedure 2016-08-23 16:54:22 -07:00
Matteo Bertozzi a857a60ccb HBASE-16452 Procedure v2 - Make ProcedureWALPrettyPrinter extend Tool 2016-08-19 09:59:22 -07:00
Matteo Bertozzi 1765988609 HBASE-16092 Procedure v2 - complete child procedure support 2016-07-12 11:05:36 -07:00
Matteo Bertozzi cf65772a34 Revert "HBASE-16092 Procedure v2 - complete child procedure support"
This reverts commit 1c6b02c08c.
2016-06-24 14:37:54 -07:00
Matteo Bertozzi 1c6b02c08c HBASE-16092 Procedure v2 - complete child procedure support 2016-06-24 05:05:00 -07:00
Matteo Bertozzi 339cb81747 HBASE-16068 Procedure v2 - use consts for conf properties in tests 2016-06-22 23:08:13 -07:00
Matteo Bertozzi fb9a8a09f7 HBASE-16056 Procedure v2 - fix master crash for FileNotFound 2016-06-17 13:11:07 -07:00
Matteo Bertozzi 341ee15ed6 HBASE-16034 Fix ProcedureTestingUtility#LoadCounter.setMaxProcId() 2016-06-15 12:43:46 -07:00
Matteo Bertozzi 0acd49ddfe HBASE-15872 Split TestWALProcedureStore 2016-05-20 13:18:12 -07:00
tedyu 08da949f83 HBASE-15639 Unguarded access to stackIndexes in Procedure#toStringDetails() 2016-04-13 08:44:10 -07:00
Jerry He 0727d0f414 HBASE-15592 Print Procedure WAL content 2016-04-06 22:00:52 -07:00
Matteo Bertozzi 46bf3c3275 HBASE-15113 Procedure v2 - Speedup eviction of sys operation results 2016-03-08 11:08:05 -08:00
Matteo Bertozzi c60da69612 HBASE-15422 Procedure v2 - Avoid double yield 2016-03-08 11:08:05 -08:00
Stephen Yuan Jiang d0c818630b HBASE-15371: Procedure V2 - Completed support parent-child procedure (Stephen Yuan Jiang) 2016-03-01 19:38:38 -08:00
Samir Ahmic 210ed97688 HBASE-15144 Procedure v2 - Web UI displaying Store state 2016-02-25 10:50:16 -08:00
Matteo Bertozzi 931e1b03ab HBASE-15100 Master WALProcs are deleted out of order ending up with older wals not removed 2016-01-22 16:15:58 -08:00
Matteo Bertozzi 3c2229a9a8 HBASE-14837 Procedure v2 - Procedure Queue Improvement 2016-01-14 09:25:06 -08:00
Matteo Bertozzi bf7c36fcca HBASE-14947 WALProcedureStore improvements 2015-12-15 12:52:57 -08:00
Vrishal Kulkarni 2e5499ed6c HBASE-14719 Add metrics for master WAL count (numMasterWALs). Metric numMasterWALs appears as follows in metrics dump
{
    "name" : "Hadoop:service=HBase,name=Master,sub=Procedure",
    "modelerType" : "Master,sub=Procedure",
    "tag.Context" : "master",
    "tag.Hostname" : "vrishal-mbp",
    "numMasterWALs" : 1
},

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-07 11:15:25 -08:00
tedyu 66adeb3048 HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:10:27 -08:00
Matteo Bertozzi da48ddb7ba HBASE-14843 TestWALProcedureStore.testLoad is flakey (addendum) 2015-11-23 23:35:37 -08:00
Matteo Bertozzi 221ae58555 HBASE-14843 TestWALProcedureStore.testLoad is flakey 2015-11-23 09:58:48 -08:00
Matteo Bertozzi 599589b45b HBASE-14863 Add missing test/resources/log4j files in hbase modules 2015-11-22 07:33:26 -08:00
Matteo Bertozzi 1d29d8c004 HBASE-14786 TestProcedureAdmin hangs 2015-11-10 13:17:58 -08:00
Matteo Bertozzi fd754631aa HBASE-14712 Increase MasterProcWALs clean up granularity 2015-11-09 09:37:18 -08:00
stack 51f5412a92 Revert "HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets"
Reverting. It seems to have destabilized the build.

This reverts commit aaaa813225.
2015-11-02 08:16:59 -08:00
stack aaaa813225 HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets 2015-11-01 22:55:59 -08:00
Stephen Yuan Jiang a6d90bcc97 HBASE-14432 Procedure V2 - enforce ACL on procedure admin tasks (Stephen Yuan Jiang) 2015-10-06 09:11:38 -07:00
Stephen Yuan Jiang e38fd84d3f HBASE-14107 Administrative Task: Provide an API to List all procedures (Stephen Yuan Jiang) 2015-09-24 07:17:23 -07:00
Stephen Yuan Jiang 90b8a3c894 HBASE-14108 Procedure V2 - Administrative Task: provide an API to abort a procedure (Stephen Yuan Jiang) 2015-09-03 07:01:30 -07:00
tedyu 354255340a HBASE-14234 Exception encountered in WALProcedureStore#rollWriter() should be properly handled 2015-08-18 09:01:19 -07:00
Matteo Bertozzi 9135ad1bed HBASE-14106 TestProcedureRecovery is flaky 2015-07-17 10:37:06 -07:00
stack d887e4cf1a HBASE-14109 NPE if we don't load fully before we are shutdown 2015-07-17 06:27:14 -07:00