Commit Graph

13274 Commits

Author SHA1 Message Date
Yu Li aace02a230 HBASE-17782 Extend IdReadWriteLock to support using both weak and soft reference 2017-03-15 11:07:42 +08:00
Andrew Purtell 14fb57cab2 HBASE-17780 BoundedByteBufferPool "At capacity" messages are not actionable 2017-03-14 13:23:11 -07:00
tedyu 777fea552e HBASE-17779 disable_table_replication returns misleading message and does not turn off replication (Janos Gub) 2017-03-14 12:13:34 -07:00
Yu Li 44b255889c HBASE-17747 Support both weak and soft object pool 2017-03-14 11:07:52 +08:00
James Moore 201c838250 guard against NPE while reading FileTrailer and HFileBlock
guard against NPE from FSInputStream#seek

Signed-off-by: Michael Stack <stack@apache.org>
2017-03-13 14:53:35 -07:00
Jerry He 35d7a0cd07 HBASE-15597 Clean up configuration keys used in hbase-spark module (Yi Liang) 2017-03-13 12:02:07 -07:00
Tom Tsuruhara fee67bcf14 HBASE-17773 VerifyReplication tool wrongly emits Invalid arguments error
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-03-13 17:46:58 +08:00
Chia-Ping Tsai 31bc94ae60 HBASE-17746 TestSimpleRpcScheduler.testCoDelScheduling is broken
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-03-13 10:13:42 +08:00
Michael Stack 4b541d6380 HBASE-17772 IntegrationTestRSGroup won't run 2017-03-10 19:50:53 -08:00
zhangduo e0365df9d6 HBASE-17712 Addendum modify log message 2017-03-10 16:01:35 +08:00
zhangduo ed6e5d6999 HBASE-17763 IPCUtil.wrapException will wrap DoNotRetryIOException with IOException 2017-03-10 15:37:59 +08:00
anoopsamjohn ab5970773a HBASE-17338 Treat Cell data size under global memstore heap size only when that Cell can not be copied to MSLAB. 2017-03-10 11:12:59 +05:30
Yu Li c63a871176 HBASE-17745 Support short circuit connection for master services 2017-03-10 09:15:04 +08:00
Andrew Purtell 7da0feea8d HBASE-17731 Fractional latency reporting in MultiThreadedAction 2017-03-09 16:54:23 -08:00
CHIA-PING TSAI 26928ff912 HBASE-17736 Some options can't be configured by the shell
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-03-09 16:53:34 -08:00
Ashu Pachauri d4cbff58cc HBASE-16977 VerifyReplication should log a printable representation of the row keys
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-09 16:31:02 -08:00
Esteban Gutierrez 1160315e2f HBASE-15941 HBCK repair should not unsplit healthy splitted region
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-08 22:02:14 -08:00
Umesh Agashe 2b89748432 HBASE-17761: Test TestRemoveRegionMetrics.testMoveRegion fails intermittently because of race condition
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-03-08 21:18:05 -08:00
Guanghao Zhang 4ff838df13 HBASE-17600 Implement get/create/modify/delete/list namespace admin operations 2017-03-09 10:32:46 +08:00
tedyu 9214ad69af HBASE-17707 New More Accurate Table Skew cost function/generator - revert due to test failure 2017-03-08 16:09:34 -08:00
tedyu 2304e7eced HBASE-17760 HDFS Balancer doc is misleading (Harsh J) 2017-03-08 15:59:30 -08:00
Andrew Purtell 1b5afc3395 HBASE-17729 Missing shortcuts for some useful HCD options 2017-03-08 10:05:05 -08:00
Michael Stack 6a57050c24 HBASE-17718 Difference between RS's servername and its ephemeral node cause SSH stop working; AMENDMENT.
Make test tighter by extending ServerListener so can find when Master
is in the waiting-on-regionservers state and making more assertions
about state.

Fix error where I would move on from waiting-on-regionservers if
we had waited max time.
2017-03-08 08:14:24 -08:00
chenyechao e239e8d2d3 HBASE-17737 Thrift2 proxy should support scan timeRange per column family
--
 .../hadoop/hbase/thrift2/ThriftUtilities.java      |  11 +
 .../hadoop/hbase/thrift2/generated/TScan.java      | 234 ++++++++++++++++++---
 .../org/apache/hadoop/hbase/thrift2/hbase.thrift   |   3 +-
 .../thrift2/TestThriftHBaseServiceHandler.java     |  63 ++++++
 4 files changed, 279 insertions(+), 32 deletions(-)

Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-08 07:05:44 -08:00
zhangduo 58c76192bd HBASE-17712 Remove/Simplify the logic of RegionScannerImpl.handleFileNotFound 2017-03-08 14:39:29 +08:00
tedyu c42a0665b9 HBASE-17460 enable_table_replication can not perform cyclic replication of a table - addendum removes replication check (Janos Gub) 2017-03-07 19:42:26 -08:00
Kahlil Oppenheimer ee1549cc97 HBASE-17707 New More Accurate Table Skew cost function/generator - adendum ensure testTableSkewConvergesToZero finishes before timeout
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-07 12:37:16 -08:00
Jan Hentschel b53f354763 HBASE-17532 Replaced explicit type with diamond operator
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-07 11:22:51 -08:00
Karan Mehta fee86ebd7b HBASE-17716 Formalize Scan Metric names
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-07 07:41:54 -08:00
Phil Yang b635414e83 HBASE-15484 Correct the semantic of batch and partial - amend to fix bug and revise the JavaDoc for related APIs. 2017-03-07 22:23:56 +08:00
Kahlil Oppenheimer 93b0cdeaaf HBASE-17707 New More Accurate Table Skew cost function/generator
This reverts commit 3b914df949.

Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-06 20:27:48 -08:00
tedyu dfc6cf3076 HBASE-17707 New More Accurate Table Skew cost function/generator - revert due to missing JIRA number 2017-03-06 20:26:59 -08:00
Phil Yang 0d3e986f7e HBASE-15484 Correct the semantic of batch and partial 2017-03-07 11:52:04 +08:00
ChiaPing Tsai 81cb298014 HBASE-17734 Guard against possibly copying the qualifier in the ScanDeleteTracker
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-06 18:01:06 -08:00
Michael Stack 4beae9a56e Javadoc on what BLOCKSIZE means (related to HBASE-15248) 2017-03-06 15:53:13 -08:00
Michael Stack 7fa7156f2c HBASE-17718 Difference between RS's servername and its ephemeral node cause SSH stop working
This patch reverts HBASE-9593 -- i.e. registering in zk before we
register with master putting it back to how it was where we register
in zk AFTER we report for duty with the master (because then we'll
register in zk with the name the master gave us). It then fixes the
problem reported in HBASE-9593 in an alternate fashion by checking
for a RS znode if we failed a connect on assign; if none found, we
remove a server from online servers list.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Make move method available to tests.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
 Correct method name changing moveFromOnelineToDeadServers to
 moveFromOnlineToDeadServers

 Add actual fix which is call to checkForRSznode if exception trying to
 open a region; if none found, call expire on the server so it gets
 removed from the list of online servers.

 This patch exposes sloppyness in the waitForRegionServers around our
 current case where Master is hosting regions but ONLY hbase:meta;
 in this case we need to wait on at least another server to report
 in beyond Master (we weren't but stuff was 'working' because of the
 early registration of RS nodes in zk).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 Make 'killed' available to tests.

 Put registry of ephemeral node back to where it was originally,
 so it is AFTER we get response from Master on registering for duty
 so we can put our znode up in zk with the name the Master gave us
 rather than local name (which could be unknown to the Master).
   private boolean stopping = false;

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRSKilledWhenInitializing.java
 Cleanup and test of new cleanup.
2017-03-06 13:14:23 -08:00
Kahlil Oppenheimer de25fcbd93 Fixed flaky test failure for TestStochasticLoadBalancer
This reverts commit 3b914df949.

Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-06 12:15:33 -08:00
tedyu d2349c6f98 HBASE-17736 Some options can't be configured by the shell - revert premature commit 2017-03-05 16:38:13 -08:00
tedyu 3b914df949 HBASE-17707 New More Accurate Table Skew cost function/generator - revert due to TestDefaultLoadBalancer failure 2017-03-05 15:03:29 -08:00
CHIA-PING TSAI 9d8dd6c474 HBASE-17736 Some options can't be configured by the shell
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-05 11:07:11 -08:00
Jerry He 6bb5938226 HBASE-14375 Define public API for spark integration module 2017-03-04 14:10:34 -08:00
Jerry He a95570cfa0 Revert "Define public API for spark integration module" for missing JIRA number.
This reverts commit 58b6d9759e.
2017-03-04 14:08:38 -08:00
Jerry He 58b6d9759e Define public API for spark integration module 2017-03-04 12:53:21 -08:00
Andrew Purtell 404a2883f2 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging 2017-03-03 12:40:06 -08:00
Jan Hentschel d3bf246421 HBASE-17703 Added random infoport to TestThriftServerCmdLine
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-03 12:38:21 -08:00
Michael Stack 678ad0ea73 Update sample unit test; the categorybasedtimer section was stale 2017-03-02 22:34:24 -08:00
Josh Elser 5645684ec9 HBASE-17717 Explicitly use "sasl" ACL scheme for hbase superuser
The special "auth" ZK ACL scheme will always set the ACL's id (the
user who is allowed) to be the authenticated user of the ZK connection.
This results in the HBase superuser not actually receiving the
permissions as the ZKUtil intends to do. Since we know we have security
enabled, we can instead explicitly list "sasl" as the ACL scheme
instead.
2017-03-02 15:46:33 -05:00
tedyu 06e984b086 HBASE-17707 New More Accurate Table Skew cost function/generator (Kahlil Oppenheimer) 2017-03-02 09:46:38 -08:00
tedyu 0b3ecc5ee7 HBASE-17710 HBase in standalone mode creates directories with 777 permission 2017-03-02 08:11:53 -08:00
huzheng 697a55a878 HBASE-17646: Implement Async getRegion method
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-03-02 11:52:05 +08:00