Commit Graph

5248 Commits

Author SHA1 Message Date
Matteo Bertozzi efe0a0eead HBASE-16865 Procedure v2 - Inherit lock from root proc 2016-11-04 13:17:40 -07:00
anoopsamjohn 05ee54f665 HBASE-17013 Add constructor to RowMutations for initializing the capacity of internal list. (ChiaPing Tsai) 2016-11-04 10:34:20 +05:30
Apekshit Sharma bb0fc6b602 HBASE-17006 Give name to existing threads.
Having thread names in logs and thread dumps greatly improve debugability. This patch is simply adding the names to the threads we spawn.

Change-Id: I6ff22cc3804bb81147dde3a8e9ab671633c6f6ce
2016-11-03 18:28:19 -07:00
Eddie Elizondo f61ae6f06d HBASE-14329 Report region in transition should check all regions in request
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-11-03 11:16:57 -07:00
Umesh Agashe 281bf9a222 HBASE-17014 Added clearly marked log messages for start and shutdown of services HMaster, HRegionServer, ThriftServer, RESTServer. Also changed the log level for RPCServer responder starting log message to debug.
Signed-off-by: Michael Stack <stack@apache.org>
2016-11-03 11:09:55 -07:00
Gary Helmling e820e64272 HBASE-16964 Always clear successfully archived files from compacted files list 2016-11-03 09:09:08 -07:00
tedyu c82fc6e0b2 HBASE-16975 Disable two subtests of TestSerialReplication (Phil Yang) 2016-11-03 01:55:26 -07:00
Yu Li b1d1dc8569 HBASE-16972 Log more details for Scan#next request when responseTooSlow 2016-11-02 15:02:07 +08:00
binlijin 6b957b69a7 HBASE-16960 RegionServer hang when aborting
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-02 11:59:51 +08:00
Lars Hofhansl b7293bf5ad HBASE-16765 New SteppingRegionSplitPolicy, avoid too aggressive spread of regions for small tables. 2016-11-01 13:12:21 -07:00
Lars Hofhansl 1c07d1d591 Revert "New SteppingRegionSplitPolicy, avoid too aggressive spread of regions for small tables."
This reverts commit 791052c50a.
2016-11-01 13:11:31 -07:00
Lars Hofhansl 791052c50a New SteppingRegionSplitPolicy, avoid too aggressive spread of regions for small tables. 2016-11-01 12:21:51 -07:00
Michael Stack 26cbe44337 HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to
create region directory: /tmp/...
2016-10-31 21:57:48 -07:00
zhangduo 6cf9333e97 HBASE-16945 Implement AsyncRegionLocator 2016-11-01 10:18:55 +08:00
zhangduo 45a2594249 HBASE-16968 Refactor FanOutOneBlockAsyncDFSOutput 2016-11-01 09:19:02 +08:00
Michael Stack d0be36deb7 HBASE-16966 Re-enable TestSimpleRpcScheduler#testCoDelScheduling in master branch 2016-10-31 14:40:51 -07:00
Michael Stack fe47ec81f9 HBASE-16969 RegionCoprocessorServiceExec should override the toString() for debugging (ChiaPing Tsai) 2016-10-31 14:32:59 -07:00
tedyu 861880b86b HBASE-16971 The passed durability of Append/Increment isn't used in wal sync (ChiaPing Tsai) 2016-10-31 09:50:47 -07:00
tedyu c3bb3b35c5 HBASE-16946 Provide Raw scan as an option in VerifyReplication (Sreekar Pallapothu) 2016-10-31 09:08:36 -07:00
anoopsamjohn 79073cd40c HBASE-16747 Track memstore data size and heap overhead separately - Addendum to fix TestIOFencing. 2016-10-31 11:05:36 +05:30
daoye.ch 6ce05d44e5 HBASE-16954 Unify HTable#checkAndDelete with AP (ChiaPing Tsai) 2016-10-31 09:15:29 +08:00
anoopsamjohn ba6d952324 HBASE-16747 Track memstore data size and heap overhead separately. 2016-10-30 12:20:46 +05:30
zhangduo 6127753b65 HBASE-16891 Try copying to the Netty ByteBuf directly from the WALEdit 2016-10-29 23:30:52 +08:00
Mikhail Antonov 17dfa34cfb HBASE-16743 TestSimpleRpcScheduler#testCoDelScheduling is broke 2016-10-28 16:47:10 -07:00
zhangduo 3283bc7c91 HBASE-16835 Revisit the zookeeper usage at client side 2016-10-28 13:27:41 +08:00
Stephen Yuan Jiang e108a4f815 HBASE-14551 Procedure v2 - Reimplement split (Stephen Yuan Jiang) 2016-10-27 21:45:41 -07:00
Guanghao Zhang 7b74dd0374 HBASE-16947 Some improvements for DumpReplicationQueues tool
Signed-off-by: Michael Stack <stack@apache.org>
2016-10-27 10:12:26 -07:00
tedyu d35b65883c HBASE-16886 hbase-client: scanner with reversed=true and small=true gets no result (huzheng) 2016-10-27 06:54:13 -07:00
Apekshit Sharma a3f1490601 HBASE-16950 Print raw stats in the end of proc performance tools for parsing results from scripts.
Change-Id: I45d77e838689dde7ec596de26ae98bd62e1b727e
2016-10-27 00:04:24 -07:00
Michael Stack 8d9b9dc6b7 HBASE-16948 Fix inconsistency between HRegion and Region javadoc on getRowLock 2016-10-26 16:09:43 -07:00
zhangduo cd3dd6e018 HBASE-16932 Implement small scan 2016-10-26 17:26:58 +08:00
zhangduo 5cee6a39c2 Revert "Implement small scan" due to miss issue number
This reverts commit c7c45f2c85.
2016-10-26 17:22:50 +08:00
Ramkrishna 1eae9aeeac HBASE-16783 Use ByteBufferPool for the header and message during Rpc
response (Ram)
2016-10-26 14:33:49 +05:30
zhangduo c7c45f2c85 Implement small scan 2016-10-26 15:45:02 +08:00
Michael Stack bbe88d942e HBASE-16944 Fix findbugs warning in hbase-server HRegion UL_UNRELEASED_LOCK 2016-10-25 14:44:11 -07:00
Guanghao Zhang c4be87d050 HBASE-16939 ExportSnapshot: set owner and permission on right directory
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-10-25 14:08:44 -07:00
zhangduo caa1a8494a HBASE-15709 Handle large edits for asynchronous WAL 2016-10-25 13:46:01 +08:00
Michael Stack 4533bb63cf Revert "Revert "HBASE-15789 PB related changes to work with offheap""
Restore this change but with a clean of the generated dirs first so
that we avoid trying to apply a patch on top of an already patched src.

This reverts commit 0f384158fc.
2016-10-24 16:51:50 -07:00
anoopsamjohn 988d1f9bc9 HBASE-16608 Introducing the ability to merge ImmutableSegments without copy-compaction or SQM usage. (Anastasia) 2016-10-24 23:09:48 +05:30
tedyu 1b12a60392 HBASE-16930 AssignmentManager#checkWals() function can recur infinitely (Umesh Agashe) 2016-10-24 10:10:03 -07:00
binlijin fa3cbd1d80 HBASE-16931 Setting cell's seqId to zero in compaction flow might cause RS down.
Signed-off-by: Yu Li <liyu@apache.org>
2016-10-24 23:32:38 +08:00
Ramkrishna 3584537b07 HBASE-16463 Improve transparent table/CF encryption with Commons Crypto
(Dapeng Sun)
2016-10-24 16:22:30 +05:30
tedyu 97cb1d71bc HBASE-16929 Move default method of shipped to Shipper interface - revert pending finding cause for Phoenix compilation error 2016-10-24 01:39:02 -07:00
zhangduo 2f4c91e41a HBASE-15684 Fix the broken log file size accounting 2016-10-22 17:42:09 +08:00
tedyu ac415f85f3 HBASE-16929 Move default method of shipped to Shipper interface 2016-10-21 17:23:07 -07:00
Guanghao Zhang 6415137574 HBASE-16815 Low scan ratio in RPC queue tuning triggers divide by zero exception
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-10-21 16:59:55 -07:00
tedyu e223639671 HBASE-16910 Avoid NPE when starting StochasticLoadBalancer (Guanghao Zhang) 2016-10-21 10:25:42 -07:00
Ramkrishna 0ae211eb39 HBASE-16414 Improve performance for RPC encryption with Apache Common
Crypto (Colin Ma)
2016-10-21 16:02:39 +05:30
Ashu Pachauri f1691e3d0d HBASE-16752 addendum. Do not retry large request for client versions less than 1.3
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-20 10:34:01 -07:00
Guanghao Zhang 59857a41ea HBASE-16870 ADDENDUM fix failed TestReplicationSmallTests 2016-10-20 20:02:12 +08:00
zhangduo b2a7f31a06 Revert "HBASE-16870 ADDENDUM fix failed TestReplicationSmallTests"
This reverts commit c02b672e83.
2016-10-20 16:14:34 +08:00
Guanghao Zhang c02b672e83 HBASE-16870 ADDENDUM fix failed TestReplicationSmallTests
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-10-20 14:36:23 +08:00
zhangduo ddc84356dd HBASE-16872 Implement mutateRow and checkAndMutate 2016-10-20 09:40:05 +08:00
Ashu Pachauri ee1123b069 HBASE-16752 Return error back to rpc client on exceeding rpc request size limit.
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-19 15:09:51 -07:00
tedyu 674511875d HBASE-16870 Add the metrics of replication sources which were transformed from other dead rs to ReplicationLoad (Guanghao Zhang) 2016-10-19 14:54:35 -07:00
Huaxiang Sun 72db953886 HBASE-16345 RpcRetryingCallerWithReadReplicas#call() should catch some RegionServer Exceptions
Fix logic for
1). how to handle exception while waiting for reply from the primary replica.
2). handle exception from replicas while waiting for a correct response.

Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2016-10-19 13:55:43 -07:00
Matteo Bertozzi d9ee25e82a HBASE-16874 Fix TestMasterFailoverWithProcedures and ensure single proc-executor for kill/restart tests 2016-10-19 13:25:17 -07:00
Jingcheng Du 67f1ac1f8e HBASE-16578 Mob data loss after mob compaction and normal compaction 2016-10-19 13:58:54 +08:00
zhangduo acc606571b HBASE-16837 Implement checkAndPut and checkAndDelete 2016-10-19 13:32:24 +08:00
Enis Soztutar ef8c65e542 HBASE-16824 Writer.flush() can be called on already closed streams in WAL roll 2016-10-18 18:46:02 -07:00
tedyu bb6cc4d43e HBASE-16854 Refactor the org.apache.hadoop.hbase.client.Action (ChiaPing Tsai) 2016-10-18 09:47:25 -07:00
Gary Helmling 317136e272 HBASE-16754 All WALSplitter OutputSinks should process compaction events 2016-10-18 09:37:37 -07:00
Esteban Gutierrez 5bc518b387 HBASE-16774 [shell] Add coverage to TestShell when ZooKeeper is not reachable 2016-10-18 09:08:33 -07:00
Michael Stack 0d40a52ee8 Revert "Revert "HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload; ADDENDUM. Fix findbugs""
This reverts commit f555b5be9c.

A revert of a revert
2016-10-18 08:35:45 -07:00
Michael Stack ec1adb7baa Revert "Revert "HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload""
This reverts commit 13baf4d37a.

This is a revert of a revert.
2016-10-18 08:34:29 -07:00
zhangduo b4f6ebde24 HBASE-16836 Implement increment and append 2016-10-18 22:34:14 +08:00
tedyu 10840a51e8 HBASE-16145 MultiRowRangeFilter constructor shouldn't throw IOException (Konstantin Ryakhovskiy) 2016-10-17 16:06:10 -07:00
tedyu 0c304a049b HBASE-16283 Batch Append/Increment will always fail if set ReturnResults to false (Allan Yang) 2016-10-17 15:42:06 -07:00
Matteo Bertozzi c6e9dabe62 HBASE-16846 Procedure v2 - executor cleanup 2016-10-17 10:30:59 -07:00
tedyu 2786253120 HBASE-16856 Exception message in SyncRunner.run() should print currentSequence (Allan Yang) 2016-10-17 07:19:49 -07:00
Ramkrishna 1e3d8c8226 HBASE-16792 Reuse KeyValue.KeyOnlyKeyValue in
BufferedDataBlockEncoder.SeekerState (Binlijin)
2016-10-17 12:26:36 +05:30
Ramkrishna bda5fd5a11 HBASE-16792 - reverting to change commit message 2016-10-17 12:25:13 +05:30
zhangduo 3a0dbf71a9 HBASE-16834 Add AsyncConnection support for ConnectionFactory 2016-10-17 13:08:43 +08:00
tedyu 109db38b6a HBASE-16853 Regions are assigned to Region Servers in /hbase/draining after HBase Master failover (David Pope) 2016-10-16 19:59:38 -07:00
Michael Stack 0f384158fc Revert "HBASE-15789 PB related changes to work with offheap"
This reverts commit fb15e3d4f5.
Breaks the build
2016-10-15 18:44:00 -07:00
Michael Stack fb15e3d4f5 HBASE-15789 PB related changes to work with offheap
Adds means of patching our shaded protobuf. Does it using
the Anoop patch attached to HBASE-15789 that adds ByteInput
to protobuf. This patch gets applied after protobuf has been
downloaded, relocated, and then unpacked over src/main/java.

Also fixes a few small build WARNINGs because of duplicate
mentions of dependencies.
2016-10-15 10:02:23 -07:00
Stephen Yuan Jiang b972839ca1 HBASE-16844 Procedure V2: DispatchMergingRegionsProcedure to use base class StateMachineProcedure for abort and rollback (Stephen Yuan Jiang) 2016-10-14 14:09:35 -07:00
Matteo Bertozzi 62c84115ec HBASE-16839 Procedure v2 - Move all protobuf handling to ProcedureUtil 2016-10-14 11:32:28 -07:00
Michael Stack 13baf4d37a Revert "HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload"
Premature commit. Revert while discussion still ongoing.

This reverts commit 9b13514483.
2016-10-14 11:27:05 -07:00
Michael Stack f555b5be9c Revert "HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload; ADDENDUM. Fix findbugs"
Premature commit. Revert while discussion ongoing

This reverts commit e1923b7c0c.
2016-10-14 11:26:33 -07:00
Ramkrishna 635ea05b9a HBASE-16729 Define the behavior of (default) empty FilterList(ChiaPing
Tsai)
2016-10-14 23:14:33 +05:30
anoopsamjohn 5f75fa0c4f HBASE-16799 CP exposed Store should not expose unwanted APIs. 2016-10-14 22:16:54 +05:30
tedyu 39d43ab779 HBASE-16821 Enhance LoadIncrementalHFiles API to convey missing hfiles if any 2016-10-14 09:07:38 -07:00
zhangduo 3fe7508295 HBASE-15921 Add first AsyncTable impl and create TableImpl based on it 2016-10-14 22:52:52 +08:00
Ramkrishna 4127fd2a7c iHBASE-16792 Reuse KeyValue.KeyOnlyKeyValue in
BufferedDataBlockEncoder.SeekerState (Binlijin)
2016-10-14 17:52:24 +05:30
Michael Stack e1923b7c0c HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload; ADDENDUM. Fix findbugs 2016-10-13 17:16:47 -07:00
Michael Stack 9b13514483 HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload 2016-10-13 09:25:23 -07:00
Pankaj Kumar c9c67d1a94 HBASE-16724 Snapshot owner can't clone
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2016-10-13 17:20:52 +05:30
Pankaj Kumar 90d83d5b38 HBASE-16807, RegionServer will fail to report new active Hmaster until HMaster/RegionServer failover.
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-13 18:00:57 +08:00
Phil Yang 88ff71b91b HBASE-16664 Timeout logic in AsyncProcess is broken
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-13 16:15:43 +08:00
Matteo Bertozzi 92ef234486 HBASE-16813 Procedure v2 - Move ProcedureEvent to hbase-procedure module 2016-10-12 16:33:25 -07:00
Michael Stack dfb2a800c4 HBASE-16746 The log of “region close” should differ from “region move” (ChiaPing Tsai) 2016-10-12 16:08:25 -07:00
tedyu f4bdab8bac HBASE-16810 HBase Balancer throws ArrayIndexOutOfBoundsException when regionservers are in /hbase/draining znode and unloaded (David Pope) 2016-10-12 13:23:06 -07:00
Phil Yang b8173a548c HBASE-16505 Pass deadline to HRegion operations
Signed-off-by: Michael Stack <stack@apache.org>
2016-10-12 12:16:18 -07:00
Matteo Bertozzi e868d9586f HBASE-16735 Procedure v2 - Fix yield while holding locks 2016-10-12 12:14:36 -07:00
Michael Stack a46134bffc HBASE-16731 Inconsistent results from the Get/Scan if we use the empty FilterList (ChiaPing Tsai) 2016-10-12 12:13:41 -07:00
tedyu 996d631c62 HBASE-16801 The Append/Increment may return the data from future - addendum (ChiaPing Tsai) 2016-10-12 10:06:51 -07:00
anoopsamjohn f77ff9f96f HBASE-16809 Save one cell length calculation in HeapMemStoreLAB#copyCellInto. (binlijin) 2016-10-12 09:57:23 +05:30
Pankaj Kumar 0af10f8942 HBASE-16663 JMX ConnectorServer stopped when unauthorized user try to stop HM/RS/cluster
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-10-11 17:54:19 -07:00
Apekshit Sharma eb52e26822 HBASE-16811 Remove mob sweep job.
Change-Id: If849fdcafb8af4a9765be1eb80da77f8b3f29a1a
2016-10-11 16:37:47 -07:00