Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,669 Commits 95 Branches 866 Tags
Commit Graph

47 Commits

Author SHA1 Message Date
Andrew Purtell
ff0e587b8f
HBASE-21735 Port HBASE-18784 (Use of filesystem that requires hflush / hsync / append / etc should query outputstream capabilities) to branch-1 
HBASE-18784 if available, query underlying outputstream capabilities where we need hflush/hsync.

* pull things that don't rely on HDFS in hbase-server/FSUtils into hbase-common/CommonFSUtils
* refactor setStoragePolicy so that it can move into hbase-common/CommonFSUtils
* refactor WALProcedureStore so that it handles its own FS interactions
* add a reflection-based lookup of stream capabilities
* call said lookup in places where we make WALs to make sure hflush/hsync is available.

HBASE-19289 Add flag to disable stream capability enforcement

HBASE-19841 Tests against hadoop3 fail with StreamLacksCapabilityException

HBASE-19947 ITU should overwrite HTU local FS

HBASE-20354 better docs for impact of proactively checking hsync support.

* Add to the quickstart guide disabling the hsync check, with a
  big warning about how we'll lose data if the check is disabled.
* Add to troubleshooting section so folks searching can get a pointer.
 2019-01-24 09:23:14 -08:00
Andrew Purtell
5b7411290b HBASE-19239 Fix findbugs and error-prone issues 
Fixes for hbase-procedure
 2017-11-17 17:12:35 -08:00
Andrew Purtell
ccf1f17d78 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging 
Conflicts:
	hbase-spark/src/test/resources/log4j.properties
 2017-03-03 12:35:21 -08:00
Zach York
8f6388503b HBASE-17437 Support specifying a WAL directory outside of the root directory (Yishan Yang and Zach York) 
HBASE-17588 Remove unused imports brought in by HBASE-17437 (Zach York)

Signed-off-by: Enis Soztutar <enis@apache.org>
 2017-02-08 15:01:59 -08:00
Stephen Yuan Jiang
ce33cf2d3d HBASE-17149 Procedure V2 - Fix nonce submission to avoid unnecessary calling coprocessor multiple times (Matteo Bertozzi) 2016-12-28 15:43:50 -08:00
Matteo Bertozzi
08e44919cc HBASE-16639 TestProcedureInMemoryChore#testChoreAddAndRemove occasionally fails 2016-09-15 18:32:53 -07:00
tedyu
76a0760269 HBASE-16640 TimeoutBlockingQueue#remove() should return whether the entry is removed 2016-09-15 17:35:59 -07:00
Apekshit Sharma
4147dcb81a HBASE-16101 addendum. Fixes runtime ClassCastException of Future<Integer> in ProcedureWALPerformanceEvaluation. 
Change-Id: Ibe4f3a001b4f50e8598e367cc8648aeae129eee8
 2016-09-01 17:47:21 -07:00
Matteo Bertozzi
aeecd4df83 HBASE-16533 Procedure v2 - Extract chore from the executor 2016-08-30 19:02:31 -07:00
Apekshit Sharma
e46a073ed2 HBASE-16101 Tool to microbenchmark procedure WAL performance. 
Change-Id: I8ec158319395d2ec8e36641a3beab2694f7b6aef
 2016-08-30 13:32:42 -07:00
Matteo Bertozzi
73818646be HBASE-16451 Procedure v2 - Test WAL protobuf entry size limit 2016-08-23 20:52:40 -07:00
Matteo Bertozzi
1e15fa57df HBASE-16485 Procedure v2 - Add support to addChildProcedure() as last "step" in StateMachineProcedure 2016-08-23 16:54:22 -07:00
Matteo Bertozzi
1765988609 HBASE-16092 Procedure v2 - complete child procedure support 2016-07-12 11:05:36 -07:00
Matteo Bertozzi
cf65772a34 Revert "HBASE-16092 Procedure v2 - complete child procedure support" 
This reverts commit 1c6b02c08c5e3f8610b5896a01a9107178875063.
 2016-06-24 14:37:54 -07:00
Matteo Bertozzi
1c6b02c08c HBASE-16092 Procedure v2 - complete child procedure support 2016-06-24 05:05:00 -07:00
Matteo Bertozzi
339cb81747 HBASE-16068 Procedure v2 - use consts for conf properties in tests 2016-06-22 23:08:13 -07:00
Matteo Bertozzi
fb9a8a09f7 HBASE-16056 Procedure v2 - fix master crash for FileNotFound 2016-06-17 13:11:07 -07:00
Matteo Bertozzi
341ee15ed6 HBASE-16034 Fix ProcedureTestingUtility#LoadCounter.setMaxProcId() 2016-06-15 12:43:46 -07:00
Matteo Bertozzi
0acd49ddfe HBASE-15872 Split TestWALProcedureStore 2016-05-20 13:18:12 -07:00
Matteo Bertozzi
c60da69612 HBASE-15422 Procedure v2 - Avoid double yield 2016-03-08 11:08:05 -08:00
Stephen Yuan Jiang
d0c818630b HBASE-15371: Procedure V2 - Completed support parent-child procedure (Stephen Yuan Jiang) 2016-03-01 19:38:38 -08:00
Matteo Bertozzi
931e1b03ab HBASE-15100 Master WALProcs are deleted out of order ending up with older wals not removed 2016-01-22 16:15:58 -08:00
Matteo Bertozzi
3c2229a9a8 HBASE-14837 Procedure v2 - Procedure Queue Improvement 2016-01-14 09:25:06 -08:00
Matteo Bertozzi
bf7c36fcca HBASE-14947 WALProcedureStore improvements 2015-12-15 12:52:57 -08:00
tedyu
66adeb3048 HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:10:27 -08:00
Matteo Bertozzi
da48ddb7ba HBASE-14843 TestWALProcedureStore.testLoad is flakey (addendum) 2015-11-23 23:35:37 -08:00
Matteo Bertozzi
221ae58555 HBASE-14843 TestWALProcedureStore.testLoad is flakey 2015-11-23 09:58:48 -08:00
Matteo Bertozzi
599589b45b HBASE-14863 Add missing test/resources/log4j files in hbase modules 2015-11-22 07:33:26 -08:00
Matteo Bertozzi
fd754631aa HBASE-14712 Increase MasterProcWALs clean up granularity 2015-11-09 09:37:18 -08:00
stack
51f5412a92 Revert "HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets" 
Reverting. It seems to have destabilized the build.

This reverts commit aaaa813225fa071ae84044cc18041fcc10700ace.
 2015-11-02 08:16:59 -08:00
stack
aaaa813225 HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets 2015-11-01 22:55:59 -08:00
Stephen Yuan Jiang
e38fd84d3f HBASE-14107 Administrative Task: Provide an API to List all procedures (Stephen Yuan Jiang) 2015-09-24 07:17:23 -07:00
Stephen Yuan Jiang
90b8a3c894 HBASE-14108 Procedure V2 - Administrative Task: provide an API to abort a procedure (Stephen Yuan Jiang) 2015-09-03 07:01:30 -07:00
Matteo Bertozzi
9135ad1bed HBASE-14106 TestProcedureRecovery is flaky 2015-07-17 10:37:06 -07:00
Matteo Bertozzi
b62f134545 HBASE-13415 Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2015-07-13 11:19:02 -05:00
Sean Busbey
88ff206c57 Revert "Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang)" 
This reverts commit 4eb84651a2b6d02d2074143308cef5d0f4b856a3.
 2015-07-13 11:16:21 -05:00
Enis Soztutar
2c076a30e5 HBASE-13993 WALProcedureStore fencing is not effective if new WAL rolls 2015-07-10 13:44:32 -07:00
Matteo Bertozzi
22f0f3026f HBASE-13832 Procedure v2: try to roll the WAL master on sync failure before aborting 2015-07-09 08:55:56 -07:00
Matteo Bertozzi
4eb84651a2 Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang) 2015-07-09 08:13:32 -07:00
stack
7b1f0b841b HBASE-14015 Allow setting a richer state value when toString a pv2 -- ADDENDUM on branch-1 and derivatives 2015-07-03 10:26:08 -07:00
stack
72cc3baa91 HBASE-14015 Allow setting a richer state value when toString a pv2 2015-07-02 17:16:12 -07:00
Matteo Bertozzi
b7a82d8311 HBASE-13950 Add a NoopProcedureStore for testing 2015-06-25 16:46:22 -07:00
Matteo Bertozzi
c4ac2ebbdb HBASE-13759 Procedure v2 - Improve procedure yielding 2015-05-29 19:28:17 +01:00
Matteo Bertozzi
24ef755f83 HBASE-13476 Procedure v2 - Add Replay Order logic for child procedures 2015-05-28 19:42:42 +01:00
Matteo Bertozzi
0b86c75220 HBASE-13529 Procedure v2 - WAL Improvements 2015-04-24 09:46:43 +01:00
Matteo Bertozzi
a8432fbd5a HBASE-13202 Procedure v2 - core framework (addendum) 2015-04-18 09:52:10 +01:00
Matteo Bertozzi
bea57f2377 HBASE-13202 Procedure v2 - core framework 2015-04-15 11:00:44 +01:00