Commit Graph

13037 Commits

Author SHA1 Message Date
Michael Stack 616f4801b0 HBASE-17067 Procedure v2 - remove tryAcquire*Lock and use wait/wake to make; ADDENDUM Address review comment by Stephen Yuan Jiang
framework event based
2017-01-23 22:57:45 -08:00
Guanghao Zhang 843ba9e545 HBASE-17443 Move listReplicated/enableTableRep/disableTableRep methods from ReplicationAdmin to Admin 2017-01-24 13:40:29 +08:00
anastas aa5d9a9ad3 HBASE-17492 Fix the compacting memstore part in hbase shell ruby script
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-23 21:27:44 -08:00
Michael Stack 980c8c2047 HBASE-17067 Procedure v2 - remove zklock/tryLock and use wait/wake (Matteo Bertozzi)
This is an amalgam of https://reviews.apache.org/r/54435/ and
9c14863594

Removes notion of suspend/resume from procedure. Instead have the below lock states
and just unschedule if lock is not yet available

 LOCK_ACQUIRED should be returned when the proc has the lock and the proc is ready to execute.
 LOCK_YIELD_WAIT should be returned when the proc has not the lock and the framework
   should take care of readding the procedure back to the runnable set for retry
 LOCK_EVENT_WAIT should be returned when the proc has not the lock and someone will take care of
  readding the procedure back to the runnable set when the lock is available.

Side benefit is being able to undo a bunch of synchronization around
procedure management.

Signed-off-by: Michael Stack <stack@apache.org>
2017-01-23 09:29:16 -08:00
Yu Li ba4a926b62 HBASE-17367 Make HTable#getBufferedMutator thread safe 2017-01-23 18:23:24 +08:00
Yu Li 07e0a30efa HBASE-17491 Remove all setters from HTable interface and introduce a TableBuilder to build Table instance 2017-01-23 13:57:01 +08:00
tedyu 7754a9620e HBASE-17462 Use sliding window for read/write request costs in StochasticLoadBalancer (Tim Brown) 2017-01-22 18:35:38 -08:00
eshcar f254e278ec HBASE-17407: Correct update of maxFlushedSeqId in HRegion
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-01-23 09:22:51 +08:00
zhangduo 3abd13dacb HBASE-17489 ClientScanner may send a next request to a RegionScanner which has been exhausted 2017-01-22 16:39:00 +08:00
Jerry He 9a9e3df856 HBASE-17502 Document hadoop pre-2.6.1 and Java 1.8 Kerberos problem in our hadoop support matrix 2017-01-21 13:24:33 -08:00
Michael Stack fb8f9247d0 HBASE-17404 Replace explicit type with diamond operator in hbase-annotations (Jan Hentschel) 2017-01-20 23:03:56 -08:00
Jan Hentschel 55a1aa1e73 HBASE-10699 Set capacity on ArrayList where possible and use isEmpty instead of size() == 0
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-20 22:58:20 -08:00
Dave Navarro c74cf12925 HBASE-17357 FIX PerformanceEvaluation parameters parsing triggers NPE.
check command name is not null, if null print usage and exit

Signed-off-by: Michael Stack <stack@apache.org>
2017-01-20 22:51:57 -08:00
Guanghao Zhang 79018056f5 HBASE-17498 Implement listTables and listTableNames methods
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-20 14:12:13 -08:00
Michael Stack 2285c57a35 HBASE-17488 WALEdit should be lazily instantiated (ChiaPing Tsai) 2017-01-20 09:37:48 -08:00
Guanghao Zhang 2ee3c73f76 HBASE-17497 Add first async MetaTableAccessor impl and Implement tableExists method
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-20 09:24:06 -08:00
Michael Stack 31f3e8f833 HBASE-17496 RSGroup shell commands:get_server_rsgroup don't work and commands display an incorrect result size (Guangxu Cheng) 2017-01-20 09:20:31 -08:00
Michael Stack 4fdd6ff9ae HBASE-16831 Procedure V2 - Remove org.apache.hadoop.hbase.zookeeper.lock
(Appy)
2017-01-19 16:51:44 -08:00
Apekshit Sharma 558a6bb9d7 HBASE-16867 Procedure V2 - Check ACLs for MasterRpcServices' queueLock() and lockHeartbeat().
Change-Id: I03773059c169022318cf7953110bb022b6ad216d

Signed-off-by: Michael Stack <stack@apache.org>
2017-01-19 16:42:57 -08:00
Michael Stack 76dc957f64 HBASE-16786 Procedure V2 - Move ZK-lock's uses to Procedure framework locks (LockProcedure) - Matteo Bertozzi
Locks are no longer hosted up in zookeeper but instead by the Master.
2017-01-19 09:34:17 -08:00
Stephen Yuan Jiang bff7c4f1fd HBASE-17480 Remove split region code from Region Server (Stephen Yuan Jiang) 2017-01-19 09:05:19 -08:00
Guanghao Zhang cb9ce2ceaf HBASE-17396 Add first async admin impl and implement balance methods 2017-01-19 10:15:12 +08:00
Michael Stack 8f1d0a2b84 HBASE-17486 Tighten the contract for batch client methods (Michael Axiak) 2017-01-18 15:16:52 -08:00
tedyu 6cbc375aa4 HBASE-17482 mvcc mechanism fails when using mvccPreAssign (Allan Yang) 2017-01-18 07:50:41 -08:00
Ramkrishna 406f66a4e8 HBASE-17483 Add equals/hashcode for OffheapKeyValue (Ram) 2017-01-18 17:00:57 +05:30
Ramkrishna b779143fdc HBASE-17081 Flush the entire CompactingMemStore content to disk - recommit
(Anastasia)
2017-01-18 14:40:47 +05:30
Stephen Yuan Jiang 805d39fca6 HBASE-17470 Remove merge region code from region server (Stephen Yuan Jiang) 2017-01-17 15:39:51 -08:00
Yu Li 287f95a579 HBASE-17474 Reduce frequency of NoSuchMethodException when calling setStoragePolicy() 2017-01-18 07:30:21 +08:00
tedyu faa9f735ca HBASE-17469 Properly handle empty TableName in TablePermission#readFields and #write (Manjunath Anand) 2017-01-17 09:36:59 -08:00
Allan Yang 9b38c1a33c HBASE-17475 Stack overflow in AsyncProcess if retry too much
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-01-17 15:45:48 +08:00
zhangduo 4ab95ebbce HBASE-17372 Make AsyncTable thread safe 2017-01-17 14:33:28 +08:00
Michael Stack 4cb09a494c HBASE-16744 Procedure V2 - Lock procedures to allow clients to acquire
locks on tables/namespaces/regions (Matteo Bertozzi)

Incorporates review comments from
    https://reviews.apache.org/r/52589/
    https://reviews.apache.org/r/54388/

M hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncTableBase.java
 Fix for eclipse complaint (from Duo Zhang)

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java
M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
 Log formatting

M hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/ProcedureTestingUtility.java
 Added wait procedures utility.

A hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/LockServiceProtos.java
A hbase-protocol-shaded/src/main/protobuf/LockService.proto b/hbase-protocol-shaded/src/main/protobuf/LockService.proto
 Implement new locking CP overrides.

A hbase-server/src/main/java/org/apache/hadoop/hbase/client/locking/EntityLock.java
 New hbase entity lock (ns, table, or regions)

A hbase-server/src/main/java/org/apache/hadoop/hbase/client/locking/LockServiceClient.java
 Client that can use the new internal locking service.
2017-01-13 21:07:03 -08:00
Zach York 9fd5dab1a8 HBASE-17464 Fix getNewDataTestDirOnTestFS to always return a unique path
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-13 17:48:22 -08:00
tedyu cdee1a7034 HBASE-17450 TablePermission#equals throws NPE after namespace support was added (huzheng) 2017-01-13 09:37:08 -08:00
Jan Hentschel 7794c530bd HBASE-17416 Changed size() == 0 to isEmpty in hbase-protocol-shaded
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-13 08:38:58 -08:00
tedyu 6d98c48699 HBASE-17452 Failed taking snapshot - region Manifest proto-message too large (huaxiang sun) 2017-01-13 07:59:31 -08:00
eshcar 2f8ddf6fc5 HBASE-17434: New synchronization scheme for compaction pipeline
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-12 06:35:58 -08:00
Mike Grimes f7d0f15c99 HBASE-17165 Add retry to LoadIncrementalHFiles tool
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-11 15:20:48 -08:00
tedyu 471cf13b1a HBASE-17445 Count size of serialized exceptions in checking max result size quota 2017-01-11 07:00:27 -08:00
Yu Li 953416eb34 HBASE-14061 Support CF-level Storage Policy (addendum2)
Resolve TestPartitionedMobCompactor UT failure
2017-01-11 18:23:37 +08:00
Yu Li 36eeb2c569 HBASE-14061 Support CF-level Storage Policy (addendum)
Addendum to resolve compatible issue with Hadoop 2.8.0+ / 3.0.0-alpha1+, meantime added
a util method in ReflectionUtils for invoking method with reflection
2017-01-11 10:14:55 +08:00
Guanghao Zhang ac3b1c9aa9 HBASE-17337 list replication peers request should be routed through master 2017-01-10 08:57:26 +08:00
Michael Stack bd157ffe9a Revert "HBASE-17434 New Synchronization Scheme for Compaction Pipeline (Eshcar Hillel)"
Undo premature commit

This reverts commit 1576269123.
2017-01-09 15:40:01 -08:00
tedyu 8dd35631ca HBASE-17429 HBase bulkload cannot support HDFS viewFs (shenxianqiang) 2017-01-09 14:48:51 -08:00
Michael Stack dd1ae37148 HBASE-12148 Remove TimeRangeTracker as point of contention when many threads writing a Store (Huaxiang Sun) 2017-01-09 13:24:53 -08:00
Michael Stack 1576269123 HBASE-17434 New Synchronization Scheme for Compaction Pipeline (Eshcar Hillel) 2017-01-09 10:46:34 -08:00
tedyu 9cbeba6c3d HBASE-17435 Call to preCommitStoreFile() hook encounters SaslException in secure deployment 2017-01-09 08:51:00 -08:00
Ramkrishna f65a439f01 HBASE-17291 Remove ImmutableSegment#getKeyValueScanner (Ram) 2017-01-09 12:06:25 +05:30
Jan Hentschel 97fd9051f4 HBASE-17430 Changed link from Google search to a direct link in docs
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-01-08 20:39:44 -08:00
Yu Li f92a14ade6 HBASE-14061 Support CF-level Storage Policy 2017-01-09 09:52:58 +08:00