Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,143 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

5483 Commits

Author SHA1 Message Date
Balazs Meszaros 81956aa446 HBASE-17197 hfile does not work in 2.0 
Files can be specified with -f option or without it.

Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-31 22:37:31 -08:00
Balazs Meszaros ccd5b9f873 HBASE-3462 Fix table.jsp in regards to splitting a region/table with an optional splitkey 
Now compact/split requires row keys instead of region names (as UI suggests).

Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-31 16:34:41 -08:00
tedyu 34ffca1357 HBASE-16621 HBCK should have -fixHFileLinks (Janos Gub) 2017-01-31 14:32:45 -08:00
Geoffrey 5ebaadf1a6 HBASE-17543 - Create additional ReplicationEndpoint WALEntryFilters by configuration 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-01-31 12:58:37 -08:00
Zach York ae21797305 HBASE-17437 Support specifying a WAL directory outside of the root directory (Yishan Yang and Zach York) 
Signed-off-by: Enis Soztutar <enis@apache.org>
 2017-01-31 11:43:33 -08:00
Thiruvel Thirumoolan bd7c9581f2 HBASE-17198 Remove redundant FN updates to merged region 
Signed-off-by: Francis Liu <toffer@apache.org>
 2017-01-31 11:17:58 -08:00
Thiruvel Thirumoolan 680289d67d HBASE-17101: FavoredNodes should not apply to system tables 
Signed-off-by: Francis Liu <toffer@apache.org>
 2017-01-31 10:58:50 -08:00
Sean Busbey 6791828698 HBASE-17522 Handle JVM throwing runtime exceptions when we ask for details on heap usage the same as a correctly returned 'undefined'. 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-31 09:56:45 -06:00
Jingcheng Du 47ce72d78c HBASE-16812 Clean up the locks in MOB 2017-01-31 12:15:09 +08:00
Balazs Meszaros e68ab09d5e HBASE-17566 Jetty upgrade fixes 
Fix issues caused by HBASE-12894 Upgrade Jetty to 9.2.6 commit.

- removed Jetty 6.x dependencies (org.mortbay.jetty.*)
- corrected @Ignore-d unit tests

Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-30 11:56:21 -08:00
Michael Stack ffe7dac53d Revert "Revert "HBASE-12894 Upgrade to Jetty 9 for REST / Info Server / Thrift Http Server"" 
This reverts commit 0ac5d4a717.
This is a revert of a revert; i.e. a reapplication!
Fixes for breakage that comes in with this patch is in a follow-on.
 2017-01-30 11:54:54 -08:00
Michael Stack 52ad310c80 HBASE-17471 Region Seqid will be out of order in WAL if using mvccPreAssign (Allan Yang) 2017-01-30 09:19:38 -08:00
Jan Hentschel aff8de8397 HBASE-17555 Changed calls to deprecated getHBaseAdmin to getAdmin 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-28 21:41:25 -08:00
Yu Li 3693d1306d HBASE-17526 Procedure v2 - cleanup isSuspended from MasterProcedureScheduler#Queue (addendum) 2017-01-29 00:14:29 +08:00
Michael Stack c725d4d334 HBASE-17538 HDFS.setStoragePolicy() logs errors on local fs Policy is set in a number of places each with its own 'implementation'. 
A setStoragePolicy was added by:

    commit 629b04f44f
    Author: Yu Li <liyu@apache.org>
    Date:   Fri Jan 6 18:35:38 2017 +0800

      HBASE-15172 Support setting storage policy in bulkload

..for hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat2.java

And in *FileSystem files and StoreFileWriter by

    commit f92a14ade6
    Author: Yu Li <liyu@apache.org>
    Date:   Mon Jan 9 09:52:58 2017 +0800

      HBASE-14061 Support CF-level Storage Policy

This patch has all instances call the FSUtils#setStoragePolicy added here:

    commit eafc07a06d
    Author: tedyu <yuzhihong@gmail.com>
    Date:   Thu Jan 15 08:52:30 2015 -0800

      HBASE-12848 Utilize Flash storage for WAL

It does right thing when local vs distributed calling setStoragePolicy.

Fixed bug in the above FSUtils#setStoragePolicy where the check for a
distributed filesystem was failing when passed an HFileSystem -- though
it was backed by a DistributedFileSystem.

Cleanups.
 2017-01-27 23:01:42 -08:00
Sukumar Maddineni bd8a4d5fad HBASE-17540 Change SASL server GSSAPI callback log line from DEBUG to TRACE in RegionServer 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-01-27 15:14:00 -08:00
tedyu 07c175b10a HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer (Tim Brown) 2017-01-26 11:04:49 -08:00
tedyu e8979c67aa HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer - revert due to pending discussion 2017-01-26 10:44:54 -08:00
Michael Stack 0ac5d4a717 Revert "HBASE-12894 Upgrade to Jetty 9 for REST / Info Server / Thrift Http Server" 
This reverts commit 59fd6eb7f6.
 2017-01-25 22:55:18 -08:00
tedyu a8bb27b2e0 HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer (Tim Brown) 2017-01-25 17:59:55 -08:00
Apekshit Sharma 4254d7edf3 HBASE-17526 Queue#setSuspended() is not used anywhere, probably because when queue wait/wakes on an event, it gets removed or added back to the fairq. 
Removing state, functions, and uses of isSuspended().

Change-Id: Id56eba81eaa66518bb0cba98070f0b78f8941c4f
 2017-01-25 12:00:54 -08:00
Enis Soztutar c64a1d1994 HBASE-9774 HBase native metrics and metric collection for coprocessors 2017-01-25 11:47:35 -08:00
Yang Guang 59fd6eb7f6 HBASE-12894 Upgrade to Jetty 9 for REST / Info Server / Thrift Http Server 2017-01-24 23:37:12 -08:00
Guanghao Zhang 8aea84d723 HBASE-17500 Implement getTable/creatTable/deleteTable/truncateTable methods 2017-01-25 11:30:11 +08:00
zhangduo 85d701892e HBASE-17045 Unify the implementation of small scan and regular scan 2017-01-25 09:53:06 +08:00
Guanghao Zhang 843ba9e545 HBASE-17443 Move listReplicated/enableTableRep/disableTableRep methods from ReplicationAdmin to Admin 2017-01-24 13:40:29 +08:00
anastas aa5d9a9ad3 HBASE-17492 Fix the compacting memstore part in hbase shell ruby script 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-23 21:27:44 -08:00
Michael Stack 980c8c2047 HBASE-17067 Procedure v2 - remove zklock/tryLock and use wait/wake (Matteo Bertozzi) 
This is an amalgam of https://reviews.apache.org/r/54435/ and
9c14863594

Removes notion of suspend/resume from procedure. Instead have the below lock states
and just unschedule if lock is not yet available

 LOCK_ACQUIRED should be returned when the proc has the lock and the proc is ready to execute.
 LOCK_YIELD_WAIT should be returned when the proc has not the lock and the framework
   should take care of readding the procedure back to the runnable set for retry
 LOCK_EVENT_WAIT should be returned when the proc has not the lock and someone will take care of
  readding the procedure back to the runnable set when the lock is available.

Side benefit is being able to undo a bunch of synchronization around
procedure management.

Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-23 09:29:16 -08:00
Yu Li ba4a926b62 HBASE-17367 Make HTable#getBufferedMutator thread safe 2017-01-23 18:23:24 +08:00
tedyu 7754a9620e HBASE-17462 Use sliding window for read/write request costs in StochasticLoadBalancer (Tim Brown) 2017-01-22 18:35:38 -08:00
eshcar f254e278ec HBASE-17407: Correct update of maxFlushedSeqId in HRegion 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2017-01-23 09:22:51 +08:00
zhangduo 3abd13dacb HBASE-17489 ClientScanner may send a next request to a RegionScanner which has been exhausted 2017-01-22 16:39:00 +08:00
Jan Hentschel 55a1aa1e73 HBASE-10699 Set capacity on ArrayList where possible and use isEmpty instead of size() == 0 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-20 22:58:20 -08:00
Dave Navarro c74cf12925 HBASE-17357 FIX PerformanceEvaluation parameters parsing triggers NPE. 
check command name is not null, if null print usage and exit

Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-20 22:51:57 -08:00
Guanghao Zhang 79018056f5 HBASE-17498 Implement listTables and listTableNames methods 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-20 14:12:13 -08:00
Michael Stack 2285c57a35 HBASE-17488 WALEdit should be lazily instantiated (ChiaPing Tsai) 2017-01-20 09:37:48 -08:00
Guanghao Zhang 2ee3c73f76 HBASE-17497 Add first async MetaTableAccessor impl and Implement tableExists method 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-20 09:24:06 -08:00
Michael Stack 4fdd6ff9ae HBASE-16831 Procedure V2 - Remove org.apache.hadoop.hbase.zookeeper.lock 
(Appy)
 2017-01-19 16:51:44 -08:00
Apekshit Sharma 558a6bb9d7 HBASE-16867 Procedure V2 - Check ACLs for MasterRpcServices' queueLock() and lockHeartbeat(). 
Change-Id: I03773059c169022318cf7953110bb022b6ad216d

Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-19 16:42:57 -08:00
Michael Stack 76dc957f64 HBASE-16786 Procedure V2 - Move ZK-lock's uses to Procedure framework locks (LockProcedure) - Matteo Bertozzi 
Locks are no longer hosted up in zookeeper but instead by the Master.
 2017-01-19 09:34:17 -08:00
Stephen Yuan Jiang bff7c4f1fd HBASE-17480 Remove split region code from Region Server (Stephen Yuan Jiang) 2017-01-19 09:05:19 -08:00
Guanghao Zhang cb9ce2ceaf HBASE-17396 Add first async admin impl and implement balance methods 2017-01-19 10:15:12 +08:00
tedyu 6cbc375aa4 HBASE-17482 mvcc mechanism fails when using mvccPreAssign (Allan Yang) 2017-01-18 07:50:41 -08:00
Ramkrishna b779143fdc HBASE-17081 Flush the entire CompactingMemStore content to disk - recommit 
(Anastasia)
 2017-01-18 14:40:47 +05:30
Stephen Yuan Jiang 805d39fca6 HBASE-17470 Remove merge region code from region server (Stephen Yuan Jiang) 2017-01-17 15:39:51 -08:00
Yu Li 287f95a579 HBASE-17474 Reduce frequency of NoSuchMethodException when calling setStoragePolicy() 2017-01-18 07:30:21 +08:00
tedyu faa9f735ca HBASE-17469 Properly handle empty TableName in TablePermission#readFields and #write (Manjunath Anand) 2017-01-17 09:36:59 -08:00
zhangduo 4ab95ebbce HBASE-17372 Make AsyncTable thread safe 2017-01-17 14:33:28 +08:00
Michael Stack 4cb09a494c HBASE-16744 Procedure V2 - Lock procedures to allow clients to acquire 
locks on tables/namespaces/regions (Matteo Bertozzi)

Incorporates review comments from
    https://reviews.apache.org/r/52589/
    https://reviews.apache.org/r/54388/

M hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncTableBase.java
 Fix for eclipse complaint (from Duo Zhang)

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java
M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
 Log formatting

M hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/ProcedureTestingUtility.java
 Added wait procedures utility.

A hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/LockServiceProtos.java
A hbase-protocol-shaded/src/main/protobuf/LockService.proto b/hbase-protocol-shaded/src/main/protobuf/LockService.proto
 Implement new locking CP overrides.

A hbase-server/src/main/java/org/apache/hadoop/hbase/client/locking/EntityLock.java
 New hbase entity lock (ns, table, or regions)

A hbase-server/src/main/java/org/apache/hadoop/hbase/client/locking/LockServiceClient.java
 Client that can use the new internal locking service.
 2017-01-13 21:07:03 -08:00
Zach York 9fd5dab1a8 HBASE-17464 Fix getNewDataTestDirOnTestFS to always return a unique path 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-13 17:48:22 -08:00
tedyu cdee1a7034 HBASE-17450 TablePermission#equals throws NPE after namespace support was added (huzheng) 2017-01-13 09:37:08 -08:00
tedyu 6d98c48699 HBASE-17452 Failed taking snapshot - region Manifest proto-message too large (huaxiang sun) 2017-01-13 07:59:31 -08:00
eshcar 2f8ddf6fc5 HBASE-17434: New synchronization scheme for compaction pipeline 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-12 06:35:58 -08:00
Mike Grimes f7d0f15c99 HBASE-17165 Add retry to LoadIncrementalHFiles tool 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-11 15:20:48 -08:00
tedyu 471cf13b1a HBASE-17445 Count size of serialized exceptions in checking max result size quota 2017-01-11 07:00:27 -08:00
Yu Li 953416eb34 HBASE-14061 Support CF-level Storage Policy (addendum2) 
Resolve TestPartitionedMobCompactor UT failure
 2017-01-11 18:23:37 +08:00
Yu Li 36eeb2c569 HBASE-14061 Support CF-level Storage Policy (addendum) 
Addendum to resolve compatible issue with Hadoop 2.8.0+ / 3.0.0-alpha1+, meantime added
a util method in ReflectionUtils for invoking method with reflection
 2017-01-11 10:14:55 +08:00
Guanghao Zhang ac3b1c9aa9 HBASE-17337 list replication peers request should be routed through master 2017-01-10 08:57:26 +08:00
Michael Stack bd157ffe9a Revert "HBASE-17434 New Synchronization Scheme for Compaction Pipeline (Eshcar Hillel)" 
Undo premature commit

This reverts commit 1576269123.
 2017-01-09 15:40:01 -08:00
tedyu 8dd35631ca HBASE-17429 HBase bulkload cannot support HDFS viewFs (shenxianqiang) 2017-01-09 14:48:51 -08:00
Michael Stack dd1ae37148 HBASE-12148 Remove TimeRangeTracker as point of contention when many threads writing a Store (Huaxiang Sun) 2017-01-09 13:24:53 -08:00
Michael Stack 1576269123 HBASE-17434 New Synchronization Scheme for Compaction Pipeline (Eshcar Hillel) 2017-01-09 10:46:34 -08:00
tedyu 9cbeba6c3d HBASE-17435 Call to preCommitStoreFile() hook encounters SaslException in secure deployment 2017-01-09 08:51:00 -08:00
Ramkrishna f65a439f01 HBASE-17291 Remove ImmutableSegment#getKeyValueScanner (Ram) 2017-01-09 12:06:25 +05:30
Yu Li f92a14ade6 HBASE-14061 Support CF-level Storage Policy 2017-01-09 09:52:58 +08:00
tedyu b2a9be02ac HBASE-17408 Introduce per request limit by number of mutations (ChiaPing Tsai) 2017-01-06 13:07:15 -08:00
Ashish Singhi 5f631b9653 HBASE-17290 Potential loss of data for replication of bulk loaded hfiles 2017-01-06 16:18:20 +05:30
Yu Li 629b04f44f HBASE-15172 Support setting storage policy in bulkload 2017-01-06 18:35:38 +08:00
Guanghao Zhang e02ae7724d HBASE-17388 Move ReplicationPeer and other replication related PB messages to the replication.proto 2017-01-06 10:01:22 +08:00
rahul gidwani 0f6c79eb12 HBASE-16710 Add ZStandard Codec to Compression.java 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-01-05 10:46:55 -08:00
Jan Hentschel dba103e1b6 HBASE-17390 Added master and backup masters to online update of configuration 
Signed-off-by: Jerry He <jerryjch@apache.org>
 2017-01-04 22:08:05 -08:00
Josh Elser 20a7ae2865 HBASE-17409 Limit jsonp callback name to prevent xss 2017-01-04 17:05:07 -05:00
tedyu 63bd8be576 HBASE-17403 ClientAsyncPrefetchScanner doesn’t load any data if the MaxResultSize is too small (ChiaPing Tsai) 2017-01-04 08:21:25 -08:00
eshcar 69ce5967fd HBASE-17373: Fixing bug in moving segments from compaction pipeline to snapshot 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-03 19:13:52 -08:00
Guanghao Zhang 0e48665641 HBASE-17336 get/update replication peer config requests should be routed through master 2016-12-30 10:12:47 +08:00
tedyu 1c477b2df9 HBASE-17387 Reduce the overhead of exception report in RegionActionResult for multi() 2016-12-29 17:54:02 -08:00
Jan Hentschel 7572e96e3a HBASE-17385 Change usage documentation from bin/hbase to hbase in various tools 
Signed-off-by: Enis Soztutar <enis@apache.org>
 2016-12-29 15:20:43 -08:00
tedyu 001a26d404 HBASE-17374 ZKPermissionWatcher crashed when grant after region close (Liu Junhong) 2016-12-28 19:54:01 -08:00
zhangduo 05b1d918b0 HBASE-17320 Add inclusive/exclusive support for startRow and endRow of scan 2016-12-29 09:43:31 +08:00
Michael Stack a3e0e0df0d HBASE-17149 Procedure V2 - Fix nonce submission to avoid unnecessary calling coprocessor multiple times; ADDENDUM by Stephen Yuan Jiang 2016-12-28 11:10:19 -08:00
tedyu 79e5efd35c HBASE-17081 Flush the entire CompactingMemStore content to disk - revert due to failure in TestHRegionWithInMemoryFlush 2016-12-28 10:53:07 -08:00
Michael Stack 306ef83c9c HBASE-17068 Procedure v2 - inherit region locks (Matteo Bertozzi) 2016-12-27 16:17:45 -08:00
tedyu e18e9a22da HBASE-17376 ClientAsyncPrefetchScanner may fail due to too many rows (ChiaPing Tsai) 2016-12-26 15:55:22 -08:00
Ramkrishna 463ffa792a HBASE-17081 [Recommit]Flush the entire CompactingMemStore content to disk 
(Anastasia)
 2016-12-26 22:05:13 +05:30
zhangduo 8fa5b0b946 HBASE-17345 Implement batch 2016-12-25 20:36:52 +08:00
ChiaPing Tsai 8cb55c4080 HBASE-17174 Refactor the AsyncProcess, BufferedMutatorImpl, and HTable 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2016-12-24 12:02:05 +08:00
Jerry He 992e5717d4 HBASE-16010 Put draining function through Admin API (Matt Warhaftig) 2016-12-23 13:41:36 -08:00
Phil Yang 8fb9a91d44 HBASE-17314 Limit total buffered size for all replication sources 2016-12-23 11:48:06 +08:00
Guanghao Zhang b3f2bec099 HBASE-17335 enable/disable replication peer requests should be routed through master 2016-12-23 09:27:12 +08:00
zhangduo 09bb428763 HBASE-17334 Add locate row before/after support for AsyncRegionLocator 2016-12-22 20:39:01 +08:00
tedyu 66781864aa HBASE-17330 SnapshotFileCache will always refresh the file cache (Jianwei Cui) 2016-12-22 02:29:27 -08:00
binlijin fc93de51af HBASE-17262 Refactor RpcServer so as to make it extendable and/or pluggable 2016-12-22 14:49:56 +08:00
Michael Stack d787155fd2 HBASE-5401 PerformanceEvaluation generates 10x the number of expected mappers (Yi Liang) 2016-12-21 11:55:48 -08:00
Michael Stack a1d2ff4646 Revert "HBASE-17314 Limit total buffered size for all replication sources" 
This reverts commit 3826e63967.
 2016-12-21 11:17:28 -08:00
tedyu cac0904c16 HBASE-17341 Add a timeout during replication endpoint termination (Vincent Poon) 2016-12-21 08:26:22 -08:00
Guanghao Zhang e1f4aaeacd HBASE-11392 add/remove peer requests should be routed through master 2016-12-21 13:27:13 +08:00
Phil Yang 3826e63967 HBASE-17314 Limit total buffered size for all replication sources 2016-12-21 13:16:17 +08:00
Thiruvel Thirumoolan 3599716dff HBASE-17107: FN info should be cleaned up on region/table cleanup 
Signed-off-by: Francis Liu <toffer@apache.org>
 2016-12-20 18:52:49 -08:00
Vincent f8474c8d4d HBASE-17328 Properly dispose of looped replication peers 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2016-12-20 18:03:11 -08:00
tedyu 5ebb25d601 HBASE-17347 ExportSnapshot may write snapshot info file to wrong directory when specifying target name (Jianwei Cui) 2016-12-20 13:02:51 -08:00