Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,428 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

5205 Commits

Author SHA1 Message Date
Biju Nair 7dc0a63c06 HBASE-18641 Include block content verification logic used in lruCache in bucketCache 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-16 06:12:43 -07:00
Andrew Purtell e5f80f36e2 Amend HBASE-18813 TestCanaryTool fails on branch-1 / branch-1.4 
Disable units where argument matching is intermittently failing
 2017-09-15 10:42:04 -07:00
Andrew Purtell 469d6bf457 Revert "Amend HBASE-18813 TestCanaryTool fails on branch-1 / branch-1.4" 
This reverts commit aa7c93c659.
 2017-09-15 10:42:04 -07:00
Reid Chan 862a717e37 HBASE-18801 Bulk load cleanup may falsely deem file deletion successful 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-15 02:15:06 -07:00
Andrew Purtell aa7c93c659 Amend HBASE-18813 TestCanaryTool fails on branch-1 / branch-1.4 
Skip tests where mocking with custom matchers fails unexpectedly on
older JREs.
 2017-09-14 14:38:56 -07:00
Michael Stack 91422357f2 HBASE-18818 TestConnectionImplemenation fails 2017-09-14 12:31:01 -07:00
Andrew Purtell 0621486620 HBASE-18346 TestRSKilledWhenInitializing failing on branch-1 (branch-1.4) 
Temporarily disabled flaky test TestRSKilledWhenInitializing
 2017-09-13 14:48:36 -07:00
Andrew Purtell 3f785a83b2 Revert "HBASE-16488 Starting namespace and quota services in master startup asynchronizely (Stephen Yuan Jiang)" 
This reverts commit af359d03b5.
 2017-09-13 13:24:58 -07:00
Guangxu Cheng a8ac84f1a6 HBASE-18789 Displays the reporting interval of each RS on the Master page 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-13 09:39:09 -07:00
Abhishek Singh Chouhan 432ca7e3fb HBASE-18771 Incorrect StoreFileRefresh leading to split and compaction failures 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-09-12 18:08:50 -07:00
tedyu b6a12c843e HBASE-18652 Expose individual cache stats in a CombinedCache through JMX - revert due to test failure 2017-09-08 14:21:30 -07:00
tedyu ab8a667c45 HBASE-18641 Include block content verification logic used in lruCache in bucketCache - revert due to test failure 2017-09-08 12:45:47 -07:00
Biju Nair a6dbeba22a HBASE-18641 Include block content verification logic used in lruCache in bucketCache 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-08 12:07:02 -07:00
Biju Nair 5bfe1da984 HBASE-18652 Expose individual cache stats in a CombinedCache through JMX 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-06 13:30:44 -07:00
Biju Nair 5de4a7d898 HBASE-18737 Display configured max size of cache on RS UI 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-06 11:06:27 -07:00
Zach York 4733aa4655 HBASE-18757 Fix improper bitwise & in bucketcache offset calculation 
This correctly casts the operand to a long to avoid negative offsets created by sign extending the integer operand.

Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-09-05 15:10:08 -07:00
Chun-Hao Tang 8eacd32beb HBASE-18746 Throw exception with job.getStatus().getFailureInfo() when ExportSnapshot fails 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-09-05 02:04:09 +08:00
tedyu d5033fd350 HBASE-18743 HFiles in use by a table which has the same name and namespace with a default table cloned from snapshot may be deleted when that snapshot and default table are deleted (wenbang) 2017-09-04 07:52:57 -07:00
Cesar Delgado 8178305d4e HBASE-18675 Making {max,min}SessionTimeout configurable for MiniZooKeeperCluster 
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-08-30 14:32:37 -07:00
Sean Mackrory aec4bf6bae HBASE-15947 Classes used only for tests included in main code base 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-08-30 10:53:31 +08:00
Vikas Vishwakarma f071e56a9e HBASE-18633 Add more info to understand the source/scenario of large batch requests exceeding threshold 2017-08-28 15:30:40 +05:30
Ajay Jadhav 7d605fe9c2 HBASE-18448 Added refresh HFiles coprocessor endpoint 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-08-24 16:05:04 -07:00
Mike Drob 362a2924d2 HBASE-18628 Fix event pre-emption in ZKPermWatcher 
Instead of using an Atomic Reference to data and aborting when we detect
that new data comes in, use the native cancellation/pre-emption features
of Java Future.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-08-23 16:42:33 -07:00
Biju Nair 19a80c8234 HBASE-18532 Improve cache related stats rendered on RS UI 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-23 13:26:10 -07:00
Biju Nair ad22437d05 HBASE-18614 Setting BUCKET_CACHE_COMBINED_KEY to false disables stats on RS UI 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-23 10:51:27 -07:00
Michael Stack 338232f81f Revert "HBASE-14498 Master stuck in infinite loop when all Zookeeper servers are unreachable" 
Lots of tests timing out. Revert for now.

This reverts commit 7a96682643.
 2017-08-22 08:31:55 -07:00
Michael Stack b8857b0a7b HBASE-16615 Fix flaky TestScannerHeartbeatMessages (Duo Zhang) 2017-08-21 16:01:26 -07:00
Andrew Purtell 19fffacd3a HBASE-18623 Frequent failed to parse at EOF warnings from WALEntryStream 2017-08-21 09:29:20 -07:00
Pankaj Kumar 7a96682643 HBASE-14498 Master stuck in infinite loop when all Zookeeper servers are unreachable 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-08-18 14:23:59 -07:00
Chia-Ping Tsai f61f09cdf2 HBASE-18471 The DeleteFamily cell is skipped when StoreScanner seeks to next column 2017-08-19 02:14:37 +08:00
Chia-Ping Tsai 10d65ee37f HBASE-18572 Delete can't remove the cells which have no visibility label 2017-08-19 01:56:29 +08:00
tedyu 64bef67558 HBASE-18617 FuzzyRowKeyFilter should not modify the filter pairs (vinisha) 2017-08-18 10:02:06 -07:00
Pankaj Kumar deeda60c69 HBASE-17617 Backport HBASE-16731 (Inconsistent results from the Get/Scan if we use the empty FilterList) to branch-1 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-08-17 18:31:57 +08:00
Zach York 1f1ab8c873 HBASE-18587 Fix flaky TestFileIOEngine 
This short circuits reads and writes with 0 length and also removes flakiness in TestFileIOEngine

Signed-off-by: Michael Stack <stack@apache.org>
 2017-08-16 14:50:11 -07:00
Andrew Purtell 3feb87b005 HBASE-18431 Mitigate compatibility concerns between branch-1.3 and branch-1.4 
- Refactor TableName into its own proto module and fix up users

- Move SnapshotDescription from Snapshot.proto back to HBase.proto

- Restore FastLongHistogram and TestFastLongHistogram;
  deprecate FastLongHistogram

- Move DeleteQueryTracker back to o.a.h.h.regionserver
 2017-08-16 11:34:18 -07:00
Ramkrishna 6255dc7001 HBASE-18251 Remove unnecessary traversing to the first and last keys in 
the CellSet (Toshihoro Suzuki)
 2017-08-16 10:50:58 -07:00
Ashish Singhi a49d43bfbf HBASE-18437 Revoke access permissions of a user from a table does not work as expected 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessControlLists.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController.java
 2017-08-15 18:59:21 -07:00
Pankaj Kumar d7c6a0bf43 HBASE-18512, Region Server will abort with IllegalStateException if HDFS umask has limited scope 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-15 13:26:28 -07:00
tedyu 3ed765257e HBASE-18526 FIFOCompactionPolicy pre-check uses wrong scope (Vladimir Rodionov) 2017-08-15 11:09:55 -07:00
Zach York d6a781cf08 HBASE-18533 Expose BucketCache values to be configured 
Before this commit, BucketCache always used the default values.
This commit adds the ability to configure these values.

Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-14 13:28:42 -07:00
Jerry He 9078a034c4 HBASE-18522 Add RowMutations support to Batch 2017-08-14 09:21:53 -07:00
Esteban Gutierrez 578e29f96b HBASE-18025 CatalogJanitor should collect outdated RegionStates from the AM 2017-08-11 14:39:16 -05:00
Jan Hentschel b181f172ef HBASE-18197 Avoided to call job.waitForCompletion(true) two times 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-08-12 02:47:25 +08:00
Yu Li a03c2036e9 HBASE-18469 Correct RegionServer metric of totalRequestCount 2017-08-11 14:53:23 +08:00
Esteban Gutierrez 15bad3c036 HBASE-18024 HRegion#initializeRegionInternals should not re-create .hregioninfo file when the region directory no longer exists 2017-08-10 18:54:01 -05:00
Ashu Pachauri cab492d34f HBASE-18398: Snapshot operation fails with FileNotFoundException 2017-08-10 14:49:59 -07:00
Andrew Purtell 685ab19064 HBASE-18248 Warn if monitored RPC task has been tied up beyond a configurable threshold 2017-08-09 18:17:21 -07:00
Zach York 036fce3cf8 HBASE-18520 Add jmx value to determine true Master Start time; amendment 
This is to determine how long it took in total for the master to start and finish initializing.

Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-08 15:56:56 +08:00
Michael Stack b5a24b6696 Revert "HBASE-18520 Add jmx value to determine true Master Start time" 
This reverts commit 1ba949e030.
 2017-08-08 15:43:58 +08:00
Zach York 3b49e60e17 HBASE-18520 Add jmx value to determine true Master Start time 
This is to determine how long it took in total for the master to start and finish initializing.

Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-08 15:27:19 +08:00
Michael Stack ce91ab4871 Revert "HBASE-18520 Add jmx value to determine true Master Start time" 
This reverts commit 1ba949e030.
 2017-08-08 15:25:07 +08:00
Zach York 1ba949e030 HBASE-18520 Add jmx value to determine true Master Start time 
This is to determine how long it took in total for the master to start and finish initializing.

Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-08 15:02:58 +08:00
Zach York cad3d55892 HBASE-18520 Add jmx value to determine true Master Start time 
This is to determine how long it took in total for the master to start and finish initializing.

Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-05 22:34:26 -07:00
Chia-Ping Tsai a35dc0dddf HBASE-18480 The cost of BaseLoadBalancer.cluster is changed even if the rollback is done 2017-08-02 08:41:53 +08:00
James Taylor 80b85a857c HBASE-18487 Minor fixes in row lock implementation 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-08-01 11:28:28 -07:00
Abhishek Singh Chouhan abb9d88dce HBASE-18374 RegionServer Metrics improvements 2017-07-31 12:47:11 +05:30
Guanghao Zhang 59cad7d3e3 HBASE-18481 The autoFlush flag was not used in PE tool 2017-07-31 11:12:33 +08:00
Abhishek Singh Chouhan 9278037108 HBASE-15134 Add visibility into Flush and Compaction queues 2017-07-28 13:21:04 +05:30
Esteban Gutierrez e662d04321 HBASE-18362 hbck should not report split replica parent region from meta as errors (Huaxiang Sun) 
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
 2017-07-27 15:59:07 -05:00
Mike Drob aca8a124c0 HBASE-17922 Clean TestRegionServerHostname for hadoop3. 
Change-Id: I6f1514b1bc301be553912539e6a4192c2ccc782b
Signed-off-by: Apekshit Sharma <appy@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerHostname.java
 2017-07-26 15:27:58 -07:00
Andrew Purtell a4e1af1fcc HBASE-18054 log when we add/remove failed servers in client (Ali) 
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/FailedServers.java
 2017-07-25 18:53:01 -07:00
huaxiang sun 9427d6c73c HBASE-18247 Hbck to fix the case that replica region shows as key in the meta table 
Change-Id: I2169290ec5a97a63747bc93ee37f36729c3ac916
 2017-07-25 17:08:53 -07:00
Josh Elser c7e1d67df7 HBASE-18023 Update row threshold warning from 1k to 5k (addendum) 2017-07-25 18:39:44 -04:00
rgidwani 26247996d2 HBASE-15816 Provide client with ability to set priority on Operations 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-07-21 17:12:25 -07:00
anoopsamjohn 9036556a33 HBASE-16993 BucketCache throw java.io.IOException: Invalid HFile block magic when configuring hbase.bucketcache.bucket.sizes. 2017-07-20 23:00:48 +05:30
Andrew Purtell cfd5b6b59f HBASE-18330 NPE in ReplicationZKLockCleanerChore 2017-07-19 15:46:45 -07:00
Chia-Ping Tsai 2da5b432a1 HBASE-18308 Eliminate the findbugs warnings for hbase-server 2017-07-20 00:36:16 +08:00
Phil Yang 980209579b HBASE-18390 Sleep too long when finding region location failed 2017-07-19 12:05:21 +08:00
Stephen Yuan Jiang af359d03b5 HBASE-16488 Starting namespace and quota services in master startup asynchronizely (Stephen Yuan Jiang) 2017-07-18 06:58:29 -07:00
tedyu 5a28437a74 HBASE-18377 Error handling for FileNotFoundException should consider RemoteException in openReader() 2017-07-18 06:50:02 -07:00
tedyu e1bf966f93 HBASE-18358 Backport HBASE-18099 'FlushSnapshotSubprocedure should wait for concurrent Region#flush() to finish' 2017-07-11 18:12:15 -07:00
Chia-Ping Tsai bec34ae432 HBASE-18295 The result contains the cells across different rows 2017-07-12 02:46:13 +08:00
Chia-Ping Tsai 44651e52d8 HBASE-18267 The result from the postAppend is ignored 2017-07-11 10:31:21 +08:00
tedyu 5d710bbe7f HBASE-18312 Ineffective handling of FileNotFoundException in FileLink.tryOpen() 2017-07-05 21:02:28 -07:00
Andrew Purtell 3dd55fa0c0 Set versions on branch-1 to 1.5.0-SNAPSHOT 2017-07-03 18:01:15 -07:00
Phil Yang 3381c6c453 HBASE-17931 Assign system tables to servers with highest version 2017-07-03 11:35:31 +08:00
David Harju 743f454d25 HBASE-18023 Log multi-* requests for more than threshold number of rows 
Signed-off-by: Josh Elser <elserj@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
 2017-06-30 18:45:36 -07:00
Sean Busbey 9264e8fb17 HBASE-17995 improve log messages during snapshot tests. 
Signed-off-by: Michael Stack <stack@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TableSnapshotInputFormatTestBase.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/SnapshotTestingUtils.java
 2017-06-30 10:16:05 -05:00
zhangduo 67b61e6d5a HBASE-16585 Rewrite the delegation token tests with Parameterized pattern 2017-06-30 16:26:34 +08:00
Kahlil Oppenheimer bb181ff50b HBASE-18164 Fast locality computation in balancer - addendum handles NaN 
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-06-27 13:33:48 -05:00
Sean Busbey 386a6e87fe Revert "HBASE-18164 Fast locality computation in balancer - addendum handles NaN" 
This reverts commit 74e9d31474.

early commit missed some review feedback.
 2017-06-27 13:33:23 -05:00
Kahlil Oppenheimer 74e9d31474 HBASE-18164 Fast locality computation in balancer - addendum handles NaN 
-Added new LocalityCostFunction and LocalityCandidateGenerator that
cache localities of every region/rack combination and mappings of every
region to its most local server and to its most local rack.

-Made LocalityCostFunction incremental so that it only computes locality
based on most recent region moves/swaps, rather than recomputing the
locality of every region in the cluster at every iteration of the
balancer

-Changed locality cost function to reflect the ratio of:
(Current locality) / (Best locality possible given current cluster)

Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-06-26 12:40:30 -07:00
Pankaj Kumar d5bba50794 HBASE-18167 OfflineMetaRepair tool may cause HMaster to abort always 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-06-22 02:11:07 -07:00
tedyu 3d9c544428 HBASE-18167 OfflineMetaRepair tool may cause HMaster to abort always - revert wrong version of patch 2017-06-22 02:10:25 -07:00
tedyu 940f4107b0 HBASE-18226 Disable reverse DNS lookup at HMaster and use the hostname provided by RegionServer (Duo Xu) 2017-06-21 18:23:30 -07:00
Stephen Yuan Jiang 105c5c36e6 HBASE-15691 ConcurrentModificationException in BucketAllocator 2017-06-21 15:23:59 -07:00
QilinCao 7b977695aa HBASE-18252 Resolve BaseLoadBalancer bad practice warnings 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-06-21 10:13:18 -07:00
Pankaj Kumar 01027f805b HBASE-18167 OfflineMetaRepair tool may cause HMaster to abort always 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-06-21 08:22:30 -07:00
Stephen Yuan Jiang 532e0dda16 HBASE-18036 Data locality is not maintained after cluster restart or SSH (Stephen Yuan Jiang) 2017-06-20 13:07:19 -07:00
Ashish Singhi dead08d668 HBASE-18212 reduce log level for unbuffer warning. 
In Standalone mode with local filesystem HBase logs Warning message:Failed to invoke 'unbuffer' method in class org.apache.hadoop.fs.FSDataInputStream

Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-06-20 02:18:44 -05:00
Kahlil Oppenheimer 4a2f475ed3 HBASE-18164 Fast locality computation in balancer 
-Added new LocalityCostFunction and LocalityCandidateGenerator that
cache localities of every region/rack combination and mappings of every
region to its most local server and to its most local rack.

-Made LocalityCostFunction incremental so that it only computes locality
based on most recent region moves/swaps, rather than recomputing the
locality of every region in the cluster at every iteration of the
balancer

-Changed locality cost function to reflect the ratio of:
(Current locality) / (Best locality possible given current cluster)

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
 2017-06-20 02:18:43 -05:00
Pankaj Kumar d5749bf8ed HBASE-18180 Possible connection leak while closing BufferedMutator in TableOutputFormat 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-06-19 06:39:27 -07:00
Andrew Purtell 316e02e3d8 HBASE-18219 Fix typo in constant HConstants.HBASE_CLIENT_MEAT_REPLICA_SCAN_TIMEOUT 2017-06-14 16:03:54 -07:00
huzheng 256fc63007 HBASE-17678 FilterList with MUST_PASS_ONE may lead to redundant cells returned 
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
 2017-06-13 20:28:04 +08:00
zhangduo d6e85b0511 Revert "FilterList with MUST_PASS_ONE may lead to redundant cells returned" miss issue number 
This reverts commit c71da858ad.
 2017-06-13 20:27:28 +08:00
huzheng c71da858ad FilterList with MUST_PASS_ONE may lead to redundant cells returned 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-06-12 23:55:25 -07:00
Vincent 650ef5cf59 HBASE-18137 Replication gets stuck for empty WALs 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-06-10 11:29:51 -07:00
Ashu Pachauri 6e3da5a39a HBASE-18192: Replication drops recovered queues on region server shutdown 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-06-09 19:54:17 -07:00
Ashu Pachauri 961337aadc HBASE-18092: Removing a peer does not properly clean up the ReplicationSourceManager state and metrics 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-06-09 11:14:40 -07:00
Gary Helmling 6c4980161b HBASE-18141 Regionserver fails to shutdown when abort triggered during RPC call 2017-06-08 18:33:19 -07:00
Alex Araujo ba3a816663 HBASE-18184 Add hbase-hadoop2-compat jar as MapReduce dependency 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-06-07 14:26:08 -07:00
Phil Yang 381c89b5cc HBASE-15576 Scanning cursor to prevent blocking long time on ResultScanner.next() 2017-06-07 11:37:22 +08:00
Chia-Ping Tsai 9cb57ae35e HBASE-18145 The flush may cause the corrupt data for reading 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-06-06 18:03:02 -07:00
Andrew Purtell e0dbafd7cc HBASE-18132 Low replication should be checked in period in case of datanode rolling upgrade (Allan Yang) 2017-06-06 17:21:11 -07:00
huzheng 9c1efc9f9d HBASE-18066: Get with closest_row_before on hbase:meta can return empty Cell during region merge/split 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-06-06 17:13:16 -07:00
Enis Soztutar ea3075e7fd HBASE-15160 Put back HFile's HDFS op latency sampling code and add metrics for monitoring (Yu Li and Enis Soztutar) 2017-06-06 14:41:02 -07:00
Ashish Singhi 356d4e9187 HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-06-06 12:59:19 -07:00
tedyu 39e8e2fb58 HBASE-18005 read replica: handle the case that region server hosting both primary replica and meta region is down (huaxiang sun) 2017-06-06 09:07:17 -07:00
Xiang Li 69d3e332f1 HBASE-18150: Do not call FSUtils.setVersion() and FSUtils.checkVersion() when using checkRootDir() to check hbase.wal.dir 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-06-06 05:44:29 -07:00
anoopsamjohn 8252fe4fbb HBASE-18030 Per Cell TTL tags may get duplicated with increments/Append causing tags length overflow. 2017-06-06 12:26:21 +05:30
Vincent 3cf4433260 HBASE-15995 Separate replication WAL reading from shipping 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-06-03 09:48:57 -07:00
Guanghao Zhang b66a478e73 HBASE-18111 Replication stuck when cluster connection is closed 
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/HBaseInterClusterReplicationEndpoint.java

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-06-01 15:18:04 -07:00
Chinmay Kulkarni 46ee6e0fcc HBASE 17959 Canary timeout should be configurable on a per-table basis 
For branch-1: Added support for configuring read/write timeouts on a per-table basis
when in region mode.
Added unit test for per-table timeout checks.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-05-31 17:58:09 -07:00
Phil Yang e670be690f HBASE-18122 Scanner id should include ServerName of region server 2017-05-31 14:01:58 +08:00
Andrew Purtell 140c559a3a HBASE-18027 HBaseInterClusterReplicationEndpoint should respect RPC limits when batching edits 2017-05-30 14:25:36 -07:00
zhangduo 1a37f3be82 HBASE-18042 Client Compatibility breaks between versions 1.2 and 1.3 2017-05-27 17:56:05 +08:00
huzheng d8c1e0e004 HBASE-16011 TableSnapshotScanner and TableSnapshotInputFormat can produce duplicate rows if split table. 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-05-26 07:31:05 -07:00
tedyu 109e0d5485 HBASE-18099 FlushSnapshotSubprocedure should wait for concurrent Region#flush() to finish 2017-05-25 07:56:13 -07:00
Vincent a3c3f1012d HBASE-18060 Backport to branch-1 HBASE-9774 HBase native metrics and metric collection for coprocessors 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-05-24 13:20:44 -07:00
Balazs Meszaros f2ba52ac45 HBASE-18096 Limit HFileUtil visibility and add missing annotations 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-05-24 16:34:27 +08:00
Stephen Yuan Jiang 50708d9524 HBASE-18093 Overloading the meaning of 'enabled' in Quota Manager to indicate either quota disabled or quota manager not ready is not good (Stephen Yuan Jiang) 2017-05-23 13:10:07 -07:00
Guanghao Zhang 4249a1f3d9 HBASE-18069 Fix flaky test TestReplicationAdminWithClusters#testDisableAndEnableReplication 2017-05-22 17:31:01 +08:00
zhangduo affd6ddf32 HBASE-18081 The way we process connection preamble in SimpleRpcServer is broken 2017-05-21 22:00:27 +08:00
tedyu c03f003f4f HBASE-18035 Meta replica does not give any primaryOperationTimeout to primary meta region (huaxiang sun) 2017-05-21 06:39:33 -07:00
huzheng f9dc4cad63 HBASE-11013 Clone Snapshots on Secure Cluster Should provide option to apply Retained User Permissions 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2017-05-18 17:54:53 +08:00
Andrew Purtell 292226690a HBASE-18043 Institute a hard limit for individual cell size that cannot be overridden by clients 2017-05-15 18:03:24 -07:00
Andrew Purtell 0a4528225c HBASE-18014 A case of Region remain unassigned when table enabled (Allan Yang) 2017-05-12 16:59:38 -07:00
Chia-Ping Tsai f81486445c HBASE-17887 Row-level consistency is broken for read 2017-05-12 19:44:16 +08:00
Andrew Purtell 9bf5bc1986 Amend HBASE-18000 Make sure we always return the scanner id with ScanResponse (Karan Mehta and Duo Zhang) 
Move getRegionScanner() call below builder.setScannerId() to handle a
corner case.
 2017-05-11 14:38:28 -07:00
Roman Nikitchenko ea89047abf HBASE-8758 Error in RegionCoprocessorHost class preScanner method documentation 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-05-10 11:34:18 +08:00
Andrew Purtell 0f6a2c4113 HBASE-17924 Consider sorting the row order when processing multi() ops before taking rowlocks 
(Allan Yang)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
 2017-05-08 17:04:50 -07:00
Allan Yang 9a97e28bdf HBASE-17471 Region Seqid will be out of order in WAL if using mvccPreAssign 
Signed-off-by: Yu Li <liyu@apache.org>
 2017-05-06 23:29:49 +08:00
zhangduo 408645c4ef HBASE-18000 Make sure we always return the scanner id with ScanResponse 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-05-05 11:49:07 -07:00
tedyu dd321c4a35 HBASE-17991 Add more details about compaction queue on /dump (Guangxu Cheng) 2017-05-04 08:28:02 -07:00
Jingyun Tian a5f52360f6 HBASE-17993 Delete useless info log in RpcServer.processResponse 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2017-05-04 20:59:10 +08:00
Chinmay Kulkarni e08277ac8f Addendum patch for HBASE-12870. Added check for null pointer. 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-05-03 14:03:27 -07:00
Guanghao Zhang 9f25836d99 HBASE-17958 Avoid passing unexpected cell to ScanQueryMatcher when optimize SEEK to SKIP 2017-05-03 21:39:30 +08:00
ckulkarni d2fcfd74d9 HBASE-12870 "Major compaction triggered" and "Skipping major compaction" messages lack the region information 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-05-02 10:54:37 -07:00
Allan Yang 262c66f614 HBASE-17757 Unify blocksize after encoding to decrease memory fragment 
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
 2017-05-02 10:06:33 +05:30
QilinCao 9a71bacdf0 HBASE-17835 Spelling mistakes in the Java source 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-04-28 11:40:47 -05:00
Steen Manniche 0f5932b059 HBASE-17817 add table name to output (if available) when removing coprocessors 
Amending-Author: Sean Busbey <busbey@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-04-28 11:39:54 -05:00
huaxiang sun cdda1d0302 HBASE-17904 Get runs into NoSuchElementException when using Read Replica, with hbase. ipc.client.specificThreadForWriting to be true and hbase.rpc.client.impl to be org.apache.hadoop.hbase.ipc.RpcClientImpl 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2017-04-28 06:53:37 +08:00
Guanghao Zhang aca4eb8d5c HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (addendum for branch-1) 2017-04-27 17:08:21 +08:00
Karan Mehta 78c64c360f HBASE-17965 Canary tool should print the regionserver name on failure 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestCanaryTool.java
 2017-04-26 18:25:31 -07:00
zhangduo cbae657632 HBASE-17956 Raw scan should ignore TTL 2017-04-26 15:34:14 +08:00
tedyu 5f1691d06e HBASE-17302 The region flush request disappeared from flushQueue - addendum (Guangxu Cheng) 2017-04-22 15:09:29 -07:00
Abhishek Singh Chouhan d69a6366f6 HBASE-17937 Memstore size becomes negative in case of expensive postPut/Delete Coprocessor call 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2017-04-21 08:50:53 +08:00
zhangduo c8c2e07aa1 HBASE-17930 Avoid using Canary.sniff in HBaseTestingUtility 2017-04-18 18:17:38 +08:00
gjacoby a26de9b51e HBASE-17912 - Avoid major compactions on region server startup 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-04-17 19:43:03 -07:00
Xiang Li cb2f2a7d1b HBASE-17916 Error message not clear when the permission of staging dir 
is not as expected

Signed-off-by: Michael Stack <stack@apache.org>
 2017-04-14 08:12:09 -07:00
qgxiaozhan 1afb86a1c1 HBASE-17816 HRegion#mutateRowWithLocks should update writeRequestCount metric 
Signed-off-by: Jerry He <jerryjch@apache.org>
 2017-04-11 18:08:06 -07:00
Nemo Chen 4030facc99 HBASE-16469 Several log refactoring/improvement suggestions 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-04-11 14:28:47 -05:00
Tomu Tsuruhara a6e9de3a0e HBASE-17871 scan#setBatch(int) call leads wrong result of VerifyReplication 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-04-06 07:00:36 -07:00
Yi Liang 4057a6c89c HBASE-17861: Regionserver down when checking the permission of staging dir if hbase.rootdir is on S3 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-04-04 07:22:31 -07:00
Karan Mehta 19e4e4d49a HBASE-17698 ReplicationEndpoint choosing sinks 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-03-31 16:31:29 -07:00
Ramkrishna 589a0e2efb HBASE-17837 Backport HBASE-15314 to branch-1.3 (Chunhui shen & Ram)) 2017-03-30 17:03:36 +05:30
tedyu d0139a8777 HBASE-17287 Master becomes a zombie if filesystem object closes 2017-03-29 04:50:49 -07:00
Ashu Pachauri babb857940 HBASE-16755 Honor flush policy under global memstore pressure 
Signed-off-by: Gary Helmling <garyh@apache.org>
 2017-03-27 11:48:17 -07:00
Chia-Ping Tsai 006bfc7054 HBASE-17623 Reuse the bytes array when building the hfile block 2017-03-25 23:51:14 +08:00
zhangduo 849ab5ff29 HBASE-17595 addendum fix the problem for mayHaveMoreCellsInRow 2017-03-23 20:35:12 +08:00
tedyu 9726c71681 HBASE-17798 RpcServer.Listener.Reader can abort due to CancelledKeyException (Guangxu Cheng) 2017-03-21 08:06:56 -07:00
zhangduo b973d3fd46 HBASE-17584 Expose ScanMetrics with ResultScanner rather than Scan 2017-03-20 16:32:20 +08:00
Chia-Ping Tsai 02d9bf0c57 HBASE-17803 PE always re-creates table when we specify the split policy 2017-03-19 19:10:24 +08:00
Michael Stack d1ea718e43 HBASE-17501 Revert "Revert "guard against NPE while reading FileTrailer and HFileBlock"" 
This reverts commit e92a147e19.

This is a revert of a revert -- i.e. a restore -- just so I can change
the commit message to add the JIRA number.
 2017-03-16 14:56:04 -07:00
Michael Stack e92a147e19 Revert "guard against NPE while reading FileTrailer and HFileBlock" 
This reverts commit c97905a962.

This is a revert just so I can add the JIRA number to the commit
message.
 2017-03-16 14:55:41 -07:00
zhangduo 094e9a311b HBASE-16584 Backport the new ipc implementation in HBASE-16432 to branch-1 2017-03-16 23:00:30 +08:00
tedyu 318298047b HBASE-17779 disable_table_replication returns misleading message and does not turn off replication (Janos Gub) 2017-03-14 12:34:04 -07:00
James Moore c97905a962 guard against NPE while reading FileTrailer and HFileBlock 
guard against NPE from FSInputStream#seek

Signed-off-by: Michael Stack <stack@apache.org>
 2017-03-13 14:53:57 -07:00
Guanghao Zhang 759d63b15c HBASE-17773 VerifyReplication tool wrongly emits Invalid arguments error (Tom Tsuruhara) 2017-03-13 17:53:43 +08:00
Guanghao Zhang 531598d67f HBASE-17746 TestSimpleRpcScheduler.testCoDelScheduling is broken 2017-03-13 11:10:33 +08:00
zhangduo dc84c7b9a7 HBASE-17712 Addendum modify log message 2017-03-10 16:01:45 +08:00
Stephen Yuan Jiang 7dfb3b3194 HBASE-17764 Solve TestMultiSlaveReplication flakiness (Stephen Yuan Jiang) 2017-03-09 18:38:57 -08:00
Ashu Pachauri 20cb390529 HBASE-15429 Add split policy for busy regions 
Signed-off-by: Gary Helmling <garyh@apache.org>
 2017-03-09 17:33:53 -08:00
Andrew Purtell 0bc9ad0628 HBASE-17731 Fractional latency reporting in MultiThreadedAction 2017-03-09 16:54:38 -08:00
Ashu Pachauri 598dd9bb0e HBASE-16977 VerifyReplication should log a printable representation of the row keys 
Signed-off-by: Gary Helmling <garyh@apache.org>
 2017-03-09 16:36:10 -08:00
Umesh Agashe 3d9520b140 HBASE-17761: Test TestRemoveRegionMetrics.testMoveRegion fails intermittently because of race condition 
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
 2017-03-09 14:26:10 -08:00
Esteban Gutierrez c70769ea89 HBASE-15941 HBCK repair should not unsplit healthy splitted region 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-03-08 22:03:47 -08:00
Michael Stack ca5b8a44a4 HBASE-17718 Difference between RS's servername and its ephemeral node cause SSH stop working 
This patch reverts HBASE-9593 -- i.e. registering in zk before we
register with master putting it back to how it was where we register
in zk AFTER we report for duty with the master (because then we'll
register in zk with the name the master gave us). It then fixes the
problem reported in HBASE-9593 in an alternate fashion by checking
for a RS znode if we failed a connect on assign; if none found, we
remove a server from online servers list.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Make move method available to tests.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
 Correct method name changing moveFromOnelineToDeadServers to
 moveFromOnlineToDeadServers

 Add actual fix which is call to checkForRSznode if exception trying to
 open a region; if none found, call expire on the server so it gets
 removed from the list of online servers.

 This patch exposes sloppyness in the waitForRegionServers around our
 current case where Master is hosting regions but ONLY hbase:meta;
 in this case we need to wait on at least another server to report
 in beyond Master (we weren't but stuff was 'working' because of the
 early registration of RS nodes in zk).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 Make 'killed' available to tests.

 Put registry of ephemeral node back to where it was originally,
 so it is AFTER we get response from Master on registering for duty
 so we can put our znode up in zk with the name the Master gave us
 rather than local name (which could be unknown to the Master).
   private boolean stopping = false;

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRSKilledWhenInitializing.java
 Cleanup and test of new cleanup.
 2017-03-08 10:47:53 -08:00
tedyu f34709e1b7 HBASE-17460 enable_table_replication can not perform cyclic replication of a table (Janos Gub) 2017-03-08 01:27:35 -08:00
zhangduo dcaa9bd715 HBASE-17712 Remove/Simplify the logic of RegionScannerImpl.handleFileNotFound 2017-03-08 14:51:11 +08:00
Karan Mehta 5f630935bb HBASE-17716 Formalize Scan Metric names 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-03-07 07:42:40 -08:00
Phil Yang f45d261902 HBASE-15484 Correct the semantic of batch and partial - amend to fix bug and revise the JavaDoc for related APIs. 2017-03-07 22:42:58 +08:00
Phil Yang 6afe696e53 HBASE-15484 Correct the semantic of batch and partial 2017-03-07 12:04:09 +08:00
Andrew Purtell ccf1f17d78 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging 
Conflicts:
	hbase-spark/src/test/resources/log4j.properties
 2017-03-03 12:35:21 -08:00
tedyu 88f909cf1f HBASE-17710 HBase in standalone mode creates directories with 777 permission 2017-03-02 11:33:36 -08:00
dvdreddy f64a52a0c2 HBASE-16630 Fragmentation in long running Bucket Cache 
Bug Fix : Added Memory block type also to the list of
evictions that need to happen when there is a needForExtra

Improvement : Inorder to fix the non availabilty of Buckets and force
the movement of buckets to transformed sizes, whenever we encounter a
situation where an allocation cant be made for a BucketSize, we will
forcefully free the entire buckets that have least occupancy ratio. This
is the same strategy used by MemCached when they encounter a similar
issue going by the name 'Slab Calcification'. Only improvement is that
we use a heuristic to evict from the buckets that are least occupied
and also avoid the BucketSizes where there is a single Bucket

Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
 2017-03-01 18:10:54 +05:30
Ramkrishna bef27396e5 Revert "HBASE-16630 Handle Fragmentation in bucket cache" 
This reverts commit 779f9cb07f.
 2017-03-01 11:41:02 +05:30
dvdreddy 779f9cb07f HBASE-16630 Handle Fragmentation in bucket cache 
Currently whenever a compaction/bulkload happen and the
blocks are evicted from theirs buckets the buckets become
fragmented and are not available to be used by other
BucketSizes

Bug Fix : Added Memory block type also to the list of
evictions that need to happen when there is a needForExtra

Improvement : Inorder to fix the non availabilty of Buckets and force
the movement of buckets to transformed sizes, whenever we encounter a
situation where an allocation cant be made for a BucketSize, we will
forcefully free the entire buckets that have least occupancy ratio. This
is the same strategy used by MemCached when they encounter a similar
issue going by the name 'Slab Calcification'. Only improvement is that
we use a heuristic to evict from the buckets that are least occupied
and also avoid the BucketSizes where there is a single Bucket

Change-Id: I9e3b4deb8d893953003ddf5f1e66312ed97ea9cb

Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
 2017-03-01 10:37:22 +05:30
tedyu 7d38e6126a HBASE-17673 Monitored RPC Handler not shown in the WebUI (Allan Yang) 2017-02-28 07:44:35 -08:00
Jingcheng Du 2131c79552 HBASE-17688 MultiRowRangeFilter not working correctly if given same start and stop RowKey 2017-02-28 12:15:38 +08:00
Jan Hentschel ec84118c97 HBASE-17634 Cleaned up the usage of Result.isPartial 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2017-02-27 20:45:58 +08:00
tedyu 8528e82875 HBASE-17674 Major compaction may be cancelled in CompactionChecker (Guangxu Cheng) 2017-02-25 16:33:34 -08:00
Ashu Pachauri 4b8195f22c HBASE-17057 Minor compactions should also drop page cache (Ashu Pachauri) 
Signed-off-by: Gary Helmling <garyh@apache.org>
 2017-02-24 15:31:36 -08:00
Abhishek Singh Chouhan b0780bdc63 HBASE-17682 Region stuck in merging_new state indefinitely 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-02-23 15:19:13 -08:00
zhangduo 3e2a6784c7 HBASE-17595 Add partial result support for small/limited scan 2017-02-23 16:10:10 +08:00
Sean Busbey 7917314477 HBASE-17677 Just the new tests from 'ServerName parsing from directory name should be more robust to errors.' 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-02-22 21:23:11 -06:00
Ashu Pachauri a373445730 HBASE-17590 Drop cache hint should work on store file write path (Ashu Pachauri) 
Signed-off-by: Gary Helmling <garyh@apache.org>
 2017-02-22 13:37:12 -08:00
Sean Busbey a404bfa0c2 HBASE-17561 table status page should escape values that may contain arbitrary characters. 
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
 2017-02-21 23:22:55 -06:00
Joao Girao e7efa23d07 HBASE-13718 added columns schema to table description in web view 
Summary:
 * added a new table "Table Schema" on the table description page
 * per column, list all the key/values on the column description

Test Plan:
 * mvn test # and wait..
 * create a new table using hbase shell:
   * create 'mytesttable', {NAME=>'CF1'}, {NAME=>'CF2'}
 * open http://localhost:16010/table.jsp?name=mytesttable
 * check the "Table Schema" appears and lists the columns correctly

Reviewers: eclark, vicka.dudin

Differential Revision: https://reviews.facebook.net/D38649

Signed-off-by: Elliott Clark <eclark@apache.org>
 2017-02-21 23:22:55 -06:00
Phil Yang f5ae21ea32 HBASE-17210 Set timeout on trying rowlock according to client's RPC timeout 2017-02-22 11:43:47 +08:00
rgidwani 27a8aa99d9 HBASE-17675 ReplicationEndpoint should choose new sinks if a SaslException occurs 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-02-21 18:45:15 -08:00
Sean Busbey cdb38830d7 HBASE-15328 sanity check the redirect used to send master info requests to the embedded regionserver. 
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
 2017-02-21 09:05:31 -06:00
huzheng 45357c078d HBASE-17472: Correct the semantic of permission grant 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2017-02-20 20:24:09 +08:00
ChiaPing Tsai 964e17f7b0 HBASE-17661 fix the queue length passed to FastPathBalancedQueueRpcExecutor 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-02-19 13:26:24 -08:00
Tim Brown 6b96b0ce85 HBASE-17658 Fix bookkeeping error with max regions for a table 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-02-17 07:42:21 -08:00
Yi Liang b141603e2e HBASE-17648: HBase Table-level synchronization fails between two secured(kerberized) cluster 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-02-17 07:04:35 -08:00
Abhishek Singh Chouhan 4038917239 HBASE-17069 RegionServer writes invalid META entries for split daughters in some circumstances 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2017-02-16 15:36:33 +08:00
zhangduo f835d1efc2 HBASE-17583 Add inclusive/exclusive support for startRow and endRow of scan for sync client 2017-02-15 10:18:58 +08:00
Phil Yang 0a25bf5b3f HBASE-17639 Do not stop server if ReplicationSourceManager's waitUntilCanBePushed throws InterruptedException 2017-02-14 17:48:49 +08:00
Sean Busbey d7c304573f HBASE-17558 ZK dumping jsp should escape HTML. 
Signed-off-by: Enis Soztutar <enis@apache.org>
 2017-02-13 23:49:12 -05:00
rgidwani 4588bdee9f HBASE-17609 Allow for region merging in the UI 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-02-09 14:06:48 -08:00
tedyu 52c51fc271 HBASE-17265 Region left unassigned in master failover when region failed to open (Allan Yang) 2017-02-09 12:43:37 -08:00
Ajay Jadhav 67fe516ec9 HBASE-17280 Add mechanism to control hbase cleaner behavior 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-02-09 12:18:42 -08:00
zhangduo e9abe07629 HBASE-17599 Use mayHaveMoreCellsInRow instead of isPartial 2017-02-09 15:38:23 +08:00
Jerry He f61b840a31 HBASE-15437 Response size calculated in RPCServer for warning tooLarge responses does NOT count CellScanner payload 2017-02-08 17:21:56 -08:00
Zach York 8f6388503b HBASE-17437 Support specifying a WAL directory outside of the root directory (Yishan Yang and Zach York) 
HBASE-17588 Remove unused imports brought in by HBASE-17437 (Zach York)

Signed-off-by: Enis Soztutar <enis@apache.org>
 2017-02-08 15:01:59 -08:00
Enis Soztutar 753169a3af HBASE-17105 Annotate RegionServerObserver 2017-02-08 13:35:29 -08:00
huzheng 8574934f59 HBASE-17381 ReplicationSourceWorkerThread can die due to unhandled exceptions (huzheng) 
Signed-off-by: Gary Helmling <garyh@apache.org>
 2017-02-07 17:33:42 -08:00
tedyu a75e5a5435 HBASE-17275 Assign timeout may cause region to be unassigned forever (Allan yang) 2017-02-07 12:57:07 -08:00
tedyu 0553290c6a HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum - addendum resets min cost 2017-02-07 12:24:54 -08:00
tedyu 5a0020e867 HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum 2017-02-07 06:26:12 -08:00
tedyu 0a0aef345a HBASE-17264 Processing RIT with offline state will always fail to open the first time (Allan Yang) 2017-02-06 19:48:14 -08:00
zhangduo f708d986a0 HBASE-17597 TestMetaWithReplicas.testMetaTableReplicaAssignment is flaky 2017-02-07 09:51:46 +08:00
Enis Soztutar 7cac85b667 HBASE-17187 DoNotRetryExceptions from coprocessors should bubble up to the application 2017-02-06 13:39:09 -08:00
tedyu 35e4eb7a7a HBASE-17601 close() in TableRecordReaderImpl assumes the split has started (Michael Axiak) 2017-02-06 10:33:05 -08:00
zhangduo 4456d22859 HBASE-17508 Unify the implementation of small scan and regular scan for sync client 2017-02-05 08:49:51 +08:00
Zach York cd847e599c HBASE-17587 Do not Rethrow DoNotRetryIOException as UnknownScannerException 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-02-02 17:09:34 -08:00
tedyu f59cf6f02e HBASE-16621 HBCK should have -fixHFileLinks (Janos Gub) 2017-02-02 07:31:35 -08:00
Sean Busbey fab0b2e603 Addendum HBASE-17522 missed some branch-1 specific direct uses of MemoryMXBean 2017-02-01 11:32:13 -06:00
Sean Busbey 3d4639f34d HBASE-17522 Handle JVM throwing runtime exceptions when we ask for details on heap usage the same as a correctly returned 'undefined'. 
Signed-off-by: Michael Stack <stack@apache.org>

 Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/io/util/HeapMemorySizeUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheConfig.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java
 2017-02-01 10:38:29 -06:00
gjacoby 3aac1b6884 HBASE-17543 - Create additional ReplicationEndpoint WALEntryFilters by configuration 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-01-31 16:16:20 -08:00
Sukumar Maddineni c937e97864 HBASE-17540 Change SASL server GSSAPI callback log line from DEBUG to TRACE in RegionServer 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-01-27 15:13:56 -08:00
tedyu 3dc03ccfb7 HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer - revert due to pending discussion 2017-01-26 10:46:03 -08:00
tedyu a0fac0894b HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer (Tim Brown) 2017-01-25 20:36:48 -08:00
tedyu ed023058d2 HBASE-17519 Rollback the removed cells (ChiaPing Tsai) 2017-01-25 06:29:56 -08:00
tedyu 19f9a1a643 HBASE-17462 Use sliding window for read/write request costs in StochasticLoadBalancer (Tim Brown) 2017-01-23 14:55:40 -08:00
tedyu 50ecbf1c8a HBASE-17510 DefaultMemStore gets the wrong heap size after rollback (ChiaPing Tsai) 2017-01-23 09:30:39 -08:00
tedyu 6e0f3f5bbc HBASE-17504 The passed durability of Increment is ignored when syncing WAL (ChiaPing Tsai) 2017-01-22 08:44:11 -08:00
zhangduo 57409371a0 HBASE-17489 ClientScanner may send a next request to a RegionScanner which has been exhausted 2017-01-22 16:39:14 +08:00
Dave Navarro c64236584b HBASE-17357 FIX PerformanceEvaluation parameters parsing triggers NPE. 
check command name is not null, if null print usage and exit

Signed-off-by: Michael Stack <stack@apache.org>
 2017-01-20 22:53:23 -08:00
Michael Stack f7d1d25fd7 HBASE-17488 WALEdit should be lazily instantiated (ChiaPing Tsai) 2017-01-20 09:38:55 -08:00
tedyu abc8c5edd3 HBASE-17494 Guard against cloning family of all cells if no data need be replicated (ChiaPing Tsai) 2017-01-19 16:21:17 -08:00
tedyu 0e06ade694 HBASE-17469 Properly handle empty TableName in TablePermission#readFields and #write (Manjunath Anand) 2017-01-17 09:38:50 -08:00
Michael Stack 354e213852 HBASE-17464 Fix HBaseTestingUtility.getNewDataTestDirOnTestFS to always return a unique path 2017-01-13 17:53:48 -08:00
tedyu ee66ab8e29 HBASE-17450 TablePermission#equals throws NPE after namespace support was added (huzheng) 2017-01-13 09:39:06 -08:00
tedyu 49b5a6e803 HBASE-17452 Failed taking snapshot - region Manifest proto-message too large (huaxiang sun) 2017-01-13 09:00:15 -08:00
tedyu 56f963f4a6 HBASE-17445 Count size of serialized exceptions in checking max result size quota 2017-01-11 10:06:40 -08:00
tedyu 2f7ce65b81 HBASE-17429 HBase bulkload cannot support HDFS viewFs (shenxianqiang) 2017-01-09 18:53:39 -08:00
Michael Stack 6130ea4d54 HBASE-12148 Remove TimeRangeTracker as point of contention when many threads writing a Store (Huaxiang Sun) 2017-01-09 13:35:20 -08:00
tedyu 9b26c9ff37 HBASE-17435 Call to preCommitStoreFile() hook encounters SaslException in secure deployment 2017-01-09 08:53:17 -08:00
Ashish Singhi e8e40d8625 HBASE-17290 Potential loss of data for replication of bulk loaded hfiles 2017-01-06 16:57:52 +05:30
rahul gidwani 667c5eb3a0 HBASE-16710 Add ZStandard Codec to Compression.java 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-01-05 10:47:12 -08:00
Jan Hentschel a9bac6a496 HBASE-17390 Added master and backup masters to online update of configuration 
Signed-off-by: Jerry He <jerryjch@apache.org>
 2017-01-04 22:25:22 -08:00
Josh Elser 4dcb07f996 HBASE-17409 Limit jsonp callback name to prevent xss 2017-01-04 19:36:24 -05:00
tedyu 36f16bbe10 HBASE-17387 Reduce the overhead of exception report in RegionActionResult for multi() 2016-12-29 19:23:44 -08:00
tedyu cec40f941f HBASE-17374 ZKPermissionWatcher crashed when grant after region close (Liu Junhong) 2016-12-29 05:46:40 -08:00
Stephen Yuan Jiang ce33cf2d3d HBASE-17149 Procedure V2 - Fix nonce submission to avoid unnecessary calling coprocessor multiple times (Matteo Bertozzi) 2016-12-28 15:43:50 -08:00
Stephen Yuan Jiang d4b2627916 HBASE-17238 Wrong in-memory hbase:meta location causing SSH failure (Stephen Yuan jiang) 2016-12-28 13:53:22 -08:00
Phil Yang 29e390c808 HBASE-17314 Limit total buffered size for all replication sources 2016-12-23 12:17:39 +08:00
Phil Yang dd0206ff31 Revert "HBASE-17314 Limit total buffered size for all replication sources" 
This reverts commit e9444ed077.
 2016-12-22 19:08:17 +08:00
tedyu 819d32f951 HBASE-17330 SnapshotFileCache will always refresh the file cache (Jianwei Cui) 2016-12-22 02:30:41 -08:00
tedyu f94180a3e9 HBASE-17341 Add a timeout during replication endpoint termination (Vincent Poon) 2016-12-21 08:27:45 -08:00
Phil Yang e9444ed077 HBASE-17314 Limit total buffered size for all replication sources 2016-12-21 13:10:29 +08:00
Vincent e79afbf0cb HBASE-17328 Properly dispose of looped replication peers 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMasterReplication.java
 2016-12-20 18:01:33 -08:00
tedyu fa975fa382 HBASE-17347 ExportSnapshot may write snapshot info file to wrong directory when specifying target name (Jianwei Cui) 2016-12-20 15:58:28 -08:00
tedyu 0b69f59133 HBASE-17292 Add observer notification before bulk loaded hfile is moved to region directory 2016-12-20 13:23:27 -08:00
tedyu b9689808eb HBASE-17344 The regionserver web UIs miss the coprocessors of RegionServerCoprocessorHost (ChiaPing Tsai) 2016-12-20 08:55:07 -08:00
Guanghao Zhang 97d1ba4015 HBASE-17317 [branch-1] The updatePeerConfig method in ReplicationPeersZKImpl didn't update the table-cfs map 2016-12-20 18:51:26 +08:00
binlijin 4c7f0f2436 HBASE-17332 Replace HashMap to Array for DataBlockEncoding.idToEncoding 2016-12-20 12:28:04 +08:00
binlijin ed39396497 HBASE-16398 optimize HRegion computeHDFSBlocksDistribution 2016-12-16 13:57:43 +08:00
tedyu f3a3069796 HBASE-17319 Truncate table with preserve after split may cause truncation to fail (Allan Yang) 2016-12-15 13:45:11 -08:00
tedyu ffe70158cc HBASE-17318 Increment does not add new column if the increment amount is zero at first time writing (Guangxu Cheng) 2016-12-15 08:45:05 -08:00
Guanghao Zhang 4b3df0f926 HBASE-17296 Provide per peer throttling for replication 
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
 2016-12-15 16:13:04 +08:00
tedyu e029c554bb HBASE-17302 The region flush request disappeared from flushQueue (Guangxu Cheng) 2016-12-13 12:46:42 -08:00
tedyu 1f9214bee7 HBASE-17297 Single Filter in parenthesis cannot be parsed correctly (Xuesen Liang) 2016-12-12 12:09:22 -08:00
tedyu 30576991bc HBASE-17289 Avoid adding a replication peer named "lock" 2016-12-12 09:38:55 -08:00
Josh Elser f13283bc05 HBASE-17276 Only log stacktraces for exceptions once for updates in a batch 
For large batches of updates, repeatedly logging WrongRegionExceptions,
FailedSanityCheckExceptions, and/or NoSuchColumnFamilyExceptions can
easily dominate the contents of a RegionServer log. After the first
occurence of logging the full exception, switch to logging only the
message on the exception.
 2016-12-11 15:40:22 -05:00
tedyu d87b05f040 HBASE-16336 Removing peers seems to be leaving spare queues (Guanghao Zhang) 2016-12-11 07:43:10 -08:00
Stephen Yuan Jiang e51584381a HBASE-17023 Region left unassigned due to AM and SSH each thinking others would do the assignment work (Stephen Yuan Jiang) 2016-12-10 15:05:00 -08:00
tedyu c2801a2ea8 HBASE-17256 Rpc handler monitoring will be removed when the task queue is full (Guangxu Cheng) 2016-12-05 12:14:20 -08:00
Ashu Pachauri cbdc9fcb8a Addendum HBASE-16209: Add an ExponentialBackOffPolicy so that we spread out the timing of open region retries in AssignmentManager. 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2016-12-02 10:30:28 +08:00
Guanghao Zhang 682dd57cd6 HBASE-17205 Add a metric for the duration of region in transition 2016-12-01 10:32:24 -08:00
Jonathan M Hsieh 9da0d5d00e HBASE-17224 Fix lots of spelling errors in HBase logging and exception messages (Grant Sohn) 2016-12-01 09:10:03 -08:00
zhangduo c8ea82299c HBASE-17206 FSHLog may roll a new writer successfully with unflushed entries 2016-12-01 14:20:38 +08:00
Yu Li b3627ef51e HBASE-17212 Should add null checker on table name in HTable and RegionServerCallable constructor (addendum) 2016-12-01 13:32:33 +08:00
Guanghao Zhang f26b3bf5ba HBASE-17178 Add region balance throttling 
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
 2016-11-30 18:07:02 +08:00
zhangduo af69783128 HBASE-17167 Pass mvcc to client when scan 2016-11-30 10:02:17 +08:00
Ashu Pachauri b8da9f83cb HBASE-16302 age of last shipped op and age of last applied op should be histograms 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2016-11-29 13:54:28 +05:30
Guanghao Zhang 7b2673db12 HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2016-11-29 16:09:56 +08:00
zhangduo be042652aa Revert "HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count" 
Forget to add signoff

This reverts commit 5ec218dbc2.
 2016-11-29 16:09:22 +08:00
Guanghao Zhang 5ec218dbc2 HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count 2016-11-29 16:00:37 +08:00
Stephen Yuan Jiang cdf539a8e0 HBASE-17189 TestMasterObserver#wasModifyTableActionCalled uses wrong variables (Stephen Yuan Jiang) 2016-11-28 23:18:42 -08:00
Michael Stack 987205caf9 HBASE-17072 CPU usage starts to climb up to 90-100% when using G1GC 
Removes ThreadLocal. Uses AtomicReference instead (based on patch
posted up in HBASE-10676 "Removing ThreadLocal of PrefetchedHeader in
HFileBlock.FSReaderV2 make higher perforamce of scan")

Signed-off-by: Michael Stack <stack@apache.org>
 2016-11-28 13:41:17 -08:00
Jerry He 10c070825f HBASE-17116 [PerformanceEvaluation] Add option to configure block size (Yi Liang) 2016-11-27 19:13:08 -08:00
Jingcheng Du fb1ace490c HBASE-17095 The ClientSimpleScanner keeps retrying if the hfile is corrupt or cannot found 2016-11-22 11:26:57 +08:00
binlijin 2da5ed098e HBASE-17118 StoreScanner leaked in KeyValueHeap (addendum) 2016-11-21 20:55:52 +08:00
tedyu e8f056935b HBASE-17131 Avoid livelock caused by HRegion#processRowsWithLocks (ChiaPing Tsai) 2016-11-20 18:17:21 -08:00
Guanghao Zhang 3c45ff08d9 HBASE-17088 Refactor RWQueueRpcExecutor/BalancedQueueRpcExecutor/RpcExecutor 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2016-11-19 14:18:06 +08:00
Esteban Gutierrez 19441937ea HBASE-17058 Lower epsilon used for jitter verification from HBASE-15324 2016-11-17 12:29:08 -08:00
tedyu c6f1b6e624 HBASE-17112 Prevent setting timestamp of delta operations the same as previous value's (Phil Yang) 2016-11-17 09:04:39 -08:00