Commit Graph

4596 Commits

Author SHA1 Message Date
Andrew Purtell 52963b3428 HBASE-16589 Adjust log level for FATAL messages from HBaseReplicationEndpoint that are not fatal 2016-09-08 13:03:49 -07:00
tedyu 354706a7d8 HBASE-16572 Sync method in RecoverableZooKeeper failed to pass callback function in (Allan Yang) 2016-09-07 11:36:18 -07:00
tedyu b694b63ed7 HBASE-16460 Can't rebuild the BucketAllocator's data structures when BucketCache uses FileIOEngine (Guanghao Zhang) 2016-09-05 06:52:03 -07:00
tedyu e1aab356b3 HBASE-16556 The read/write timeout are not used in HTable.delete(List), HTable.get(List), and HTable.existsAll(List) (ChiaPing Tsai) 2016-09-04 21:15:10 -07:00
Matteo Bertozzi fa7731de6e HBASE-16552 MiniHBaseCluster#getServerWith() does not ignore stopped RSs 2016-09-02 16:52:57 -07:00
Andrew Purtell 8691520e33 HBASE-16399 Provide an API to get list of failed regions and servername in Canary (Vishal Khandelwal) 2016-09-02 10:43:20 -07:00
Jerry He 8be6f95f99 HBASE-16311 Audit log for delete snapshot operation is missing in case of snapshot owner deleting the same (Yi Liang) 2016-09-02 10:09:44 -07:00
Loknath Priyatham Teja Singamsetty 84b2431472 HBASE-16375 Mapreduce mini cluster using HBaseTestingUtility not setting correct resourcemanager and jobhistory webapp address of MapReduceTestingShim
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestHBaseTestingUtility.java
2016-09-01 15:57:18 -07:00
tedyu a034a2bdcb HBASE-16527 IOExceptions from DFS client still can cause CatalogJanitor to delete referenced files (Vladimir Rodionov) 2016-09-01 12:39:08 -07:00
Stephen Yuan Jiang d91edc2ac4 HBASE-16528 Procedure-V2: ServerCrashProcedure misses owner information (Stephen Yuan Jiang)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
2016-08-31 09:51:52 -07:00
tedyu 9907a7e2a2 HBASE-16502 Reduce garbage in BufferedDataBlockEncoder - addendum adopts Hiroshi's suggestion (binlijin) 2016-08-30 18:06:24 -07:00
Matteo Bertozzi 57c6384b09 HBASE-16522 Procedure v2 - Cache system user and avoid IOException 2016-08-30 15:35:08 -07:00
chenheng ce9b6c0abf HBASE-16224 Reduce the number of RPCs for the large PUTs (ChiaPing Tsai) 2016-08-30 13:30:23 +08:00
anoopsamjohn c899897bc8 HBASE-16213 A new HFileBlock structure for fast random get. (binlijin) 2016-08-29 12:11:46 +05:30
Matteo Bertozzi 35fa341913 HBASE-16508 Move UnexpectedStateException to common 2016-08-26 18:37:59 -07:00
tedyu b59f18c2af HBASE-16502 Reduce garbage in BufferedDataBlockEncoder (binlijin) 2016-08-25 20:39:42 -07:00
tedyu c78a5fd650 HBASE-16409 Addendum fixes the case where delimiter is not specified by user 2016-08-25 11:54:42 -07:00
Stephen Yuan Jiang 86d570b959 HBASE-16486 Unify system table creation using the same createSystemTable API (Stephen Yuan Jiang) 2016-08-24 21:59:33 -07:00
tedyu f9490aaf43 HBASE-16304 HRegion#RegionScannerImpl#handleFileNotFoundException may lead to deadlock when trying to obtain write lock on updatesLock 2016-08-24 10:57:14 -07:00
Enis Soztutar f0385b4b83 HBASE-16270 Handle duplicate clearing of snapshot in region replicas (Robert Yokota) 2016-08-24 06:43:19 -07:00
Ashish Singhi 3606b890f8 HBASE-16471 Region Server metrics context will be wrong when machine hostname contain "master" word (Pankaj Kumar) 2016-08-24 19:01:58 +05:30
chenheng de2f653caf HBASE-16464 archive folder grows bigger and bigger due to corrupt snapshot under tmp dir 2016-08-24 13:43:18 +08:00
Geoffrey 6e9b49cac7 HBASE-16448 Custom metrics for custom replication endpoints
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-08-23 17:17:42 -07:00
Matteo Bertozzi a1e57d942e HBASE-16360 TableMapReduceUtil addHBaseDependencyJars has the wrong class name for PrefixTreeCodec (Jing Pu Chen) 2016-08-23 14:31:58 -07:00
Apekshit Sharma a8909f5cba HBASE-16467 Move AbstractHBaseTool to hbase-common.
Change-Id: Ifb81c15b89b308f53e6ee8a76e18189b5b526cd3
2016-08-22 16:32:46 -07:00
tedyu 2a35019a31 HBASE-16455 Provide API for obtaining all the WAL files 2016-08-22 06:56:14 -07:00
tedyu d260108e39 HBASE-16409 Row key for bad row should be properly delimited in VerifyReplication 2016-08-20 17:18:27 -07:00
Yu Li e05b002ed5 HBASE-16429 FSHLog: deadlock if rollWriter called when ring buffer filled with appends 2016-08-18 10:03:46 +08:00
chenheng 3d7bcd020e HBASE-15635 Mean age of Blocks in cache (seconds) on webUI should be greater than zero
Signed-off-by: stack <stack@apache.org>
2016-08-17 10:59:58 -07:00
tedyu a944a19879 HBASE-16419 check REPLICATION_SCOPE's value more stringently (Guangxu Cheng) 2016-08-17 09:01:54 -07:00
stack 6976a7b312 HBASE-16341 Missing bit on "Regression: Random Read/WorkloadC slower in 1.x than 0.98" 2016-08-15 13:29:36 -07:00
Phil Yang e51df6723c HBASE-16368 test*WhenRegionMove in TestPartialResultsFromClientSide is flaky
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-10 18:13:20 +08:00
Phil Yang 38044ada32 HBASE-16285 Drop RPC requests if it must be considered as timeout at client
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-10 16:16:15 +08:00
Phil Yang 441bc050b9 HBASE-9465 Push entries to peer clusters serially
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-09 15:26:15 +08:00
stack 25c4ff5404 HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (Guanghao Zhang) 2016-08-08 21:44:37 -07:00
tedyu 0a1a0a6883 HBASE-16367 Race between master and region server initialization may lead to premature server abort - addendum shortens the waiting duration 2016-08-08 10:41:14 -07:00
tedyu 225383d321 HBASE-16367 Race between master and region server initialization may lead to premature server abort 2016-08-08 08:42:05 -07:00
Phil Yang 0354dbf1ec HBASE-12770 Don't transfer all the queued hlogs of a dead server to the same alive server
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-08 16:32:43 +08:00
Vivek ec99838b9c HBASE-15866 Split hbase.rpc.timeout into *.read.timeout and *.write.timeout
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncProcess.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Table.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/client/HTableWrapper.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestHCM.java
2016-08-06 10:38:41 -07:00
Sean Busbey 6b233c4332 HBASE-8386 deprecate TableMapReduce.addDependencyJars(Configuration, class<?> ...)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
2016-08-05 14:08:50 -05:00
Sean Busbey a5f98c3f9e HBASE-16321 ensure no findbugs-jsr305
Signed-off-by: Esteban Gutierrez <esteban@apache.org>

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-rsgroup/pom.xml
	hbase-server/pom.xml
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/ObserverContext.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSTableDescriptors.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-spark/pom.xml
	src/main/asciidoc/_chapters/developer.adoc
2016-08-05 14:08:50 -05:00
tedyu b1c60940da HBASE-16359 Addendum fixes TestZKBasedOpenCloseRegion 2016-08-05 10:54:20 -07:00
tedyu 00f6af2e85 HBASE-16359 NullPointerException in RSRpcServices.openRegion() 2016-08-05 03:21:23 -07:00
Ramkrishna 6278ece8b6 HBASE-16303 FilterList with MUST_PASS_ONE optimization (Ram) 2016-08-05 10:59:19 +05:30
chenheng 9c8cbd44ed HBASE-16287 LruBlockCache size should not exceed acceptableSize too many(Yu Sun) 2016-08-04 21:23:27 +08:00
Lim Chee Hau 96cce2dcc5 HBASE-15574 Fix typo in HRegionServerCommandLine
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-03 23:45:55 -05:00
Nick Dimiduk 92b2973b62 HBASE-16317 revert all ESAPI changes
Revert "HBASE-15270 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon."

This reverts commit ab1b2c6603.

Revert "HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic)"

This reverts commit 29ce46a67f.

 Conflicts:
	hbase-server/pom.xml
2016-08-03 20:53:46 -07:00
Enis Soztutar d14ec71323 HBASE-16350 Undo server abort from HBASE-14968 2016-08-03 19:38:04 -07:00
Enis Soztutar 12549de43c HBASE-16301 Trigger flush without waiting when compaction is disabled on a table (huaxiang sun)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactSplitThread.java
2016-08-03 10:55:08 -07:00
Andrew Purtell b06119edef HBASE-16319 Fix TestCacheOnWrite after HBASE-16288 2016-08-02 16:53:27 -07:00
Deokwoo Han 1b5f8c7123 HBASE-16284 Unauthorized client can shutdown the cluster 2016-08-02 11:37:56 -07:00
zhangduo dc56aa2d4f HBASE-16225 Refactor ScanQueryMatcher 2016-08-02 14:04:49 +08:00
Andrew Purtell c8903cc20a HBASE-16296 Reverse scan performance degrades when using filter lists (Ted Yu) 2016-08-01 17:41:06 -07:00
Enis Soztutar 1983126216 HBASE-16288 HFile intermediate block level indexes might recurse forever creating multi TB files 2016-08-01 11:06:27 -07:00
zhangduo 1b303ad75d HBASE-16209 addendum fix region move delay 2016-08-01 15:57:28 +08:00
zhangduo 51c8c1891a Revert "HBASE-16209 addendum fix region move delay"
This reverts commit c46f56b382.
2016-08-01 15:52:25 +08:00
zhangduo c46f56b382 HBASE-16209 addendum fix region move delay 2016-08-01 11:29:50 +08:00
Joseph Hwang 39153b8824 HBASE-16209 Removed unnecessary method and method calls from AssignmentManager and AssignmentManager UI (addendum)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-07-29 15:55:11 -07:00
Joseph Hwang 7c97acf6e3 Back port HBASE-16209 Provide an exponential back off policy in reattempting failed region opens
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-29 09:47:30 -07:00
Yu Sun 08b9e6bee0 HBASE-16300 LruBlockCache.CACHE_FIXED_OVERHEAD should calculate LruBlockCache size correctly
Signed-off-by: Yu Li <liyu@apache.org>
2016-07-29 14:29:39 +08:00
Joseph Hwang d597e29ec5 HBASE-16096 Backport. Cleanly remove replication peers from ZooKeeper.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-28 11:30:20 -07:00
Matteo Bertozzi 7983d2f45b HBASE-16275 Change ServerManager#onlineServers from ConcurrentHashMap to ConcurrentSkipListMap (Huaxiang Sun) 2016-07-28 11:19:06 -07:00
Matteo Bertozzi 968e464aed HBASE-16293 TestSnapshotFromMaster#testSnapshotHFileArchiving flakey (Huaxiang Sun) 2016-07-28 10:42:58 -07:00
Joseph Hwang d349f642c0 HBASE-16262 Backport HBASE-13839: Fix AssgnmentManagerTmpl.jamon issues (coloring, content …etc). Ignoring UI changes provided by HBASE-11344.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-27 13:09:28 -07:00
zhangduo e06bbe4804 HBASE-16280 Use hash based map in SequenceIdAccounting 2016-07-26 16:36:46 +08:00
Phil Yang 7e5b931096 HBASE-16281 TestMasterReplication is flaky
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-07-26 11:00:43 +08:00
Phil Yang f35b2c45d4 HBASE-16266 Do not throw ScannerTimeoutException when catch UnknownScannerException
Signed-off-by: zhangduo <zhangduo@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannerTimeout.java
2016-07-25 22:37:59 +08:00
Stephen Yuan Jiang a8dd359d7e HBASE-16008 A robust way deal with early termination of HBCK (Stephen Yuan Jiang) 2016-07-23 20:21:32 -07:00
Joseph Hwang 276acdb0b0 HBASE-16221 Have ThriftScanner update the ConnectionCache's last used time overtime getScannerRow() to keep the connection alive for long lived scanners
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-22 17:58:56 -07:00
Matteo Bertozzi 24a3d6952c HBASE-16272 Overflow in ServerName's compareTo method (Huaxiang Sun) 2016-07-22 15:29:19 -07:00
Mikhail Antonov ce651f5c6d HBASE-16024 Revert HBASE-15406 from branch-1.3 2016-07-22 14:50:32 -07:00
tedyu 2e537bc4ad HBASE-15291 Revert due to race condition resulting in closed FileSystem 2016-07-21 03:38:22 -07:00
Enis Soztutar d86f8a4943 HBASE-16244 LocalHBaseCluster start timeout should be configurable (Siddharth Wagle) 2016-07-19 14:12:54 -07:00
Ramkrishna cfc22ec1ec HBASE-16189 [Rolling Upgrade] 2.0 hfiles cannot be opened by 1.x servers
(Ram)
2016-07-18 10:16:23 +05:30
Phil Yang 1e3bce943b HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely 2016-07-18 09:34:45 +08:00
tedyu 40204eb0c1 HBASE-16235 TestSnapshotFromMaster#testSnapshotHFileArchiving will fail if there are too many hfiles (ChiaPing Tsai) 2016-07-16 16:36:55 -07:00
Enis Soztutar 09c7b1e962 HBASE-16095 Add priority to TableDescriptor and priority region open thread pool
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2016-07-13 18:23:05 -07:00
Yu Li 95d141f382 HBASE-16195 Should not add chunk into chunkQueue if not using chunk pool in HeapMemStoreLAB 2016-07-13 09:34:34 +08:00
Andrew Purtell 7c4c51f2c7 HBASE-16220 Demote log level for "HRegionFileSystem - No StoreFiles for" messages to TRACE 2016-07-12 17:00:09 -07:00
Matteo Bertozzi 36a48a3cf9 HBASE-16207 can't restore snapshot without "Admin" permission 2016-07-12 05:55:07 -07:00
Joseph Hwang 7fa311a940 HBASE-16081 Wait for Replication Tasks to complete before killing the ThreadPoolExecutor inside of HBaseInterClusterReplicationEndpoint
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-07-11 17:54:24 -07:00
Gary Helmling 3ff6f45851 HBASE-16160 Support RPC encryption with direct ByteBuffers (Colin Ma via garyh) 2016-07-11 10:45:05 -07:00
Yu Li e03d4fbb0a HBASE-16194 Should count in MSLAB chunk allocation into heap size change when adding duplicate cells 2016-07-11 21:40:30 +08:00
stack 9563ab4ca1 HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken scanning because of a side effect of a clean up in HBASE-15650 to make TimeRange construction consistent exposed a latent issue in TimeRange#compare. See HBASE-16074 for more detail.
Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
 Call through to next constructor (if minStamp was 0, we'd skip setting
 allTime=true). Add asserts that timestamps are not < 0 cos it messes
 us up if they are (we already were checking for < 0 on construction but
 assert passed in timestamps are not < 0).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
 Add constructor override that takes a TimeRangeTracker (set when flushing
 but not when compacting)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
 Add override creating an HFile in tmp that takes a TimeRangeTracker

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
 Add override for HFile Writer that takes a TimeRangeTracker Take it on
 construction instead of having it passed by a setter later (flags and
 reference set by the setter were not volatile... could have been prob
 in concurrent case)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
 Log WARN if bad initial TimeRange value (and then 'fix' it)

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
 A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
 Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
 Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 14:23:23 -07:00
Yu Li 09d9dc4b59 HBASE-16201 NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication 2016-07-09 02:04:54 +08:00
Yu Li 44d2a9bc1c Revert "NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication"
This reverts commit b6d4fc955f.
2016-07-09 02:04:01 +08:00
Yu Li b6d4fc955f NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication 2016-07-09 01:06:55 +08:00
stack 37040bfc42 HBASE-15775 Canary launches two AuthUtil Chores 2016-07-08 09:36:17 -07:00
stack 2d6cdfb10a HBASE-16180 Fix ST_WRITE_TO_STATIC_FROM_INSTANCE_METHOD findbugs introduced by parent 2016-07-06 09:12:00 -07:00
tedyu 368c32e322 HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai) 2016-07-05 13:54:59 -07:00
Elliott Clark ff8c2fcac0 HBASE-16087 Replication shouldn't start on a master if if only hosts system tables 2016-07-05 13:47:49 -07:00
Andrew Purtell 8efc6148b9 HBASE-16091 Canary takes lot more time when there are delete markers in the table (Vishal Khandelwal)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-07-05 10:34:27 -07:00
Yu Li 84dd9cbcb6 HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin) 2016-07-04 21:46:19 +08:00
zhangduo 4807836304 HBASE-16135 addendum format comments 2016-07-04 20:41:06 +08:00
zhangduo 721c5b7128 HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted 2016-07-04 19:52:28 +08:00
chenheng f18ac8157b HBASE-15844 We should respect hfile.block.index.cacheonwrite when write intermediate index Block 2016-07-02 09:09:51 +08:00
tedyu a345aa8707 HBASE-16108 RowCounter should support multiple key ranges (Konstantin Ryakhovskiy) 2016-07-01 09:32:43 -07:00
tedyu 5bc0655529 HBASE-16114 Get regionLocation of required regions only for MR jobs (Thiruvel Thirumoolan) 2016-07-01 03:14:51 -07:00
stack f4d7cd5f58 HBASE-16150 Remove ConcurrentIndex (Hiroshi Ikeda) 2016-06-30 15:04:36 -07:00
Jonathan M Hsieh 9aa40424fe HBASE-16140 bump owasp.esapi from 2.1.0 to 2.1.0.1 2016-06-29 08:58:25 -07:00