Commit Graph

5483 Commits

Author SHA1 Message Date
tedyu f3fee82ac4 HBASE-15812 HttpServer fails to come up against hadoop trunk 2016-05-11 09:00:27 -07:00
Jurriaan Mous a11091c49c HBASE-15798 Add Async RpcChannels to all RpcClients
Signed-off-by: stack <stack@apache.org>
2016-05-10 07:44:51 -07:00
Matteo Bertozzi 8604f9eebb HBASE-15415 Improve Master WebUI snapshot information (huaxiang sun) 2016-05-09 20:20:49 -07:00
Apekshit 11740570c1 HBASE-15236 Inconsistent cell reads over multiple bulk-loaded HFiles. In KeyValueHeap, if two cells are same i.e. have same key and timestamp, then instead of directly using seq id to determine newer one, we should use StoreFile.Comparater.SEQ_ID because that's what is used to determine order of hfiles. In this patch, we assign each scanner an order based on it's index in storefiles list, which is then used in KeyValueHeap to disambiguate between same cells. Changes the getSequenceId() in KeyValueScanner class to getScannerOrder(). Testing: Adds unit test to TestKeyValueHeap. Manual testing: Three cases (Tables t, t2, t3 in the jira description), single region, 2 hfiles with same seq id, timestamps and duplicate KVs. Made sure that returned kv was same for get and scan. (Apekshit)
Change-Id: I22600c91c0a51fb63eb17db73472839d2f13957c

Signed-off-by: stack <stack@apache.org>
2016-05-09 16:57:06 -07:00
Esteban Gutierrez a6e29676db HBASE-15612: Minor improvements to CellCounter and RowCounter documentation
Signed-off-by: stack <stack@apache.org>
2016-05-09 14:12:43 -07:00
Enis Soztutar b75b226804 HBASE-15740 Replication source.shippedKBs metric is undercounting because it is in KB 2016-05-09 10:25:49 -07:00
zhangduo 05378cbf69 HBASE-15609 Addendum fix compilation error 2016-05-09 20:45:04 +08:00
Ramkrishna 97ad33c691 HBASE-15609 Remove PB references from Result, DoubleColumnInterpreter and
any such public facing class for 2.0 (Ram)
2016-05-09 14:56:00 +05:30
Apekshit 48b77dbcbc HBASE-11625 - Verifies data before building HFileBlock. - Adds HFileBlock.Header class which contains information about location of fields. Testing: Adds CorruptedFSReaderImpl to TestChecksum.
Change-Id: I107e9636b28abb6b15ec329e885f1e31b1b1b988

Signed-off-by: stack <stack@apache.org>
2016-05-08 17:33:04 -07:00
Matteo Bertozzi 99e2deb86f HBASE-15778 replace master.am and master.sm direct access with getter calls 2016-05-07 05:19:15 -07:00
Matteo Bertozzi 513ca3483f HBASE-15776 Replace master.am.getTableStateManager() with the direct master.getTableStateManager() 2016-05-06 19:30:45 -07:00
Gary Helmling 86ca09e0e5 HBASE-15773 Improvements to CellCounter job 2016-05-06 11:08:18 -07:00
Matteo Bertozzi d90f0571e6 HBASE-15781 Remove unused TableEventHandler and TotesHRegionInfo 2016-05-06 10:05:42 -07:00
Ashish Singhi 34e9a6ff30 HBASE-15669 HFile size is not considered correctly in a replication request 2016-05-06 17:26:17 +05:30
Ramkrishna bec81b1977 HBASE-15608 Remove PB references from SnapShot related Exceptions (ram) 2016-05-06 17:06:25 +05:30
zhangduo 0d252918f6 HBASE-15743 Add Transparent Data Encryption support for FanOutOneBlockAsyncDFSOutput 2016-05-06 08:55:58 +08:00
tedyu 532b914f08 HBASE-15759 RegionObserver.preStoreScannerOpen() doesn't have acces to current readpoint 2016-05-05 15:20:37 -07:00
tedyu c716a75416 HBASE-15767 upgrade httpclient to 4.3.6
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-05 15:41:26 -05:00
Alex Moundalexis 0bf065a5d5 HBASE-15768 fix capitalization of ZooKeeper usage
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-05 15:35:44 -05:00
Stephen Yuan Jiang b7ce55f001 HBASE-15575 Rename table DDL *Handler methods in MasterObserver to more meaningful names (Stephen Yuan Jiang) 2016-05-05 11:44:22 -07:00
tedyu efcf94def7 HBASE-15563 'counter' may overflow in BoundedGroupingStrategy (Matt Warhaftig) 2016-05-05 10:28:33 -07:00
Matteo Bertozzi c0ce47d1cb HBASE-15755 SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface audience marked 2016-05-05 07:24:29 -07:00
Gary Helmling d23d600d76 HBASE-15741 Provide backward compatibility for HBase coprocessor service names 2016-05-04 12:09:57 -07:00
Enis Soztutar 29eb3e8bcc HBASE-15613 TestNamespaceCommand times out 2016-05-04 11:37:03 -07:00
Ramkrishna 809ed326f0 HBASE-15760 TestBlockEvictionFromClient#testParallelGetsAndScanWithWrappedRegionScanner
fails in master branch (Ram)
2016-05-04 22:07:11 +05:30
Matteo Bertozzi a8a2c516a0 HBASE-15763 Isolate Wal related stuff from MasterFileSystem 2016-05-04 07:59:44 -07:00
zhangduo 6abe1879dd HBASE-15754 Add testcase for AES encryption 2016-05-04 09:40:57 +08:00
Yu Li 082d193455 HBASE-15675 Add more details about region on table.jsp 2016-05-03 20:18:48 +08:00
tedyu c77a153001 HBASE-15752 ClassNotFoundException is encountered when custom WAL codec is not found in WALPlayer job 2016-05-03 01:57:25 -07:00
Ramkrishna c06a976a98 HBASE-15607 Remove PB references from Admin for 2.0 (Ram) 2016-05-03 10:51:46 +05:30
chenheng d77972ff16 HBASE-15714 We are calling checkRow() twice in doMiniBatchMutation() 2016-05-03 09:42:41 +10:00
Mikhail Antonov 58c4c3d174 HBASE-15703 Deadline scheduler needs to return to the client info about skipped calls, not just drop them 2016-05-02 15:23:07 -07:00
Mikhail Antonov bbc7b90335 HBASE-15281 Allow the FileSystem inside HFileSystem to be wrapped (Rajesh Nishtala) 2016-05-02 13:24:51 -07:00
anoopsjohn d1130582d5 HBASE-15735 Tightening of the CP contract. 2016-05-02 09:48:51 +05:30
Jurriaan Mous 15631a76f5 HBASE-15744 Port over small format/text improvements from HBASE-13784
(Jurriaan Mous)

Signed-off-by: stack <stack@apache.org>
2016-05-01 19:48:43 -07:00
chenheng ccd8888b4b Revert "HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response"
This reverts commit 01c0448ccd.
2016-04-30 11:37:05 +08:00
chenheng 01c0448ccd HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response 2016-04-30 09:27:32 +08:00
tedyu c236409c3b HBASE-15357 TableInputFormatBase getSplitKey does not handle signed bytes correctly (Nathan Schile) 2016-04-29 17:08:25 -07:00
Mikhail Antonov 730b077666 HBASE-15551 Make call queue too big exception use servername 2016-04-29 10:25:29 -07:00
anoopsjohn 4706303186 HBASE-15706 HFilePrettyPrinter should print out nicely formatted tags. (huaxiang sun) 2016-04-29 09:23:57 +05:30
tedyu 8a28c23431 HBASE-15686 Add override mechanism for the exempt classes when dynamically loading table coprocessor 2016-04-28 09:19:12 -07:00
Ramkrishna 889d89a74c HBASE-15697 Excessive TestHRegion running time on branch-1 (Ram) 2016-04-28 14:24:39 +05:30
tedyu 9343ef438f HBASE-15676 FuzzyRowFilter fails and matches all the rows in the table if the mask consists of all 0s (Matt Warhaftig) 2016-04-27 21:00:11 -07:00
chenheng e8b37422c3 HBASE-15720 Print row locks at the debug dump page 2016-04-28 11:40:29 +08:00
Gary Helmling ce318a2906 HBASE-15658 Avoid excess meta cache clearing for RegionServerCallable 2016-04-26 22:54:13 -07:00
tedyu ebb5d421f9 HBASE-15707 ImportTSV bulk output does not support tags with hfile.format.version=3 (huaxiang sun) 2016-04-26 11:21:29 -07:00
Phil Yang 53d7316075 HBASE-15645 hbase.rpc.timeout is not used in operations of HTable
Signed-off-by: stack <stack@apache.org>
2016-04-26 10:51:29 -07:00
tedyu dce59294ff HBASE-15634 TestDateTieredCompactionPolicy#negativeForMajor is flaky (Duo Zhang and Ted Yu) 2016-04-26 09:23:54 -07:00
tedyu 793d976d87 HBASE-14252 RegionServers fail to start when setting hbase.ipc.server.callqueue.scan.ratio to 0 (Yubao Liu and Ted Yu) 2016-04-25 13:26:47 -07:00
zhangduo 1eac103ead HBASE-15628 Implement an AsyncOutputStream which can work with any FileSystem implementation 2016-04-25 22:20:27 +08:00
zhangduo 3cfe363f13 HBASE-15699 Can not sync AsyncFSWAL if no edit is appended 2016-04-25 13:17:26 +08:00
Enis Soztutar 106fe99a9a HBASE-15670 Add missing Snapshot.proto to the maven profile for compiling protobuf 2016-04-22 11:34:49 -07:00
Matteo Bertozzi 1ecb10ce07 HBASE-15688 Use MasterServices directly instead of casting to HMaster when possible 2016-04-22 10:15:58 -07:00
Enis Soztutar 4c0587134a HBASE-15671 Add per-table metrics on memstore, storefile and regionsize (Alicia Ying Shu) 2016-04-21 13:33:26 -07:00
chenheng 03f3c392a3 HBASE-15674 HRegionLocator#getAllRegionLocations should put the results in cache 2016-04-21 14:19:39 +08:00
zhangduo 58f175f0ea HBASE-15368 Add pluggable window support 2016-04-21 12:02:16 +08:00
Andrew Purtell 2c26fe37ac HBASE-15614 Report metrics from JvmPauseMonitor 2016-04-20 17:37:34 -07:00
Enis Soztutar 18d70bc680 HBASE-15518 Add Per-Table metrics back (Alicia Ying Shu) 2016-04-20 14:35:45 -07:00
stack 6dd938c20b HBASE-15640 L1 cache doesn't give fair warning that it is showing partial stats only when it hits limit 2016-04-20 14:14:37 -07:00
stack fa215a67e2 HBASE-15385 PREFETCH_BLOCKS_ON_OPEN in HColumnDescriptor is ignored 2016-04-20 09:38:30 -07:00
tedyu 3e1bdccc53 HBASE-15679 Assertion on wrong variable in TestReplicationThrottler#testThrottling 2016-04-20 07:11:17 -07:00
stack 954a41790c HBASE-15672 hadoop.hbase.security.visibility.TestVisibilityLabelsWithDeletes fails (Anoop Sam John) 2016-04-19 17:10:48 -07:00
Apekshit 501030d204 HBASE-15673 Fix latency metrics for multiGet. - Also fixes some stuff in help text. (Apekshit)
Change-Id: I49d76896d5cc070b9f60dadf6746865e98fbbbd0

Signed-off-by: stack <stack@apache.org>
2016-04-19 16:12:43 -07:00
zhangduo bd3b9753a9 HBASE-15665 Support using different StoreFileComparators for different CompactionPolicies 2016-04-19 19:35:17 +08:00
Gábor Lipták 6d7a7fa3aa HBASE-13372 Add unit tests for SplitTransaction and RegionMergeTransaction listeners
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-04-18 17:04:56 -07:00
Ashish Singhi 70687c18bb HBASE-15668 HFileReplicator fails to replicate other hfiles in the request when a hfile in not found in FS anywhere 2016-04-18 22:17:02 +05:30
zhangduo f2e0aca2b6 HBASE-15664 Use Long.MAX_VALUE instead of HConstants.FOREVER in CompactionPolicy 2016-04-18 20:10:31 +08:00
tedyu e9211e415a HBASE-15287 mapreduce.RowCounter returns incorrect result with binary row key inputs (Matt Warhaftig) 2016-04-16 12:46:21 -07:00
stack d815211f5a HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile
Refactor so we use the immutable, unsynchronized TimeRange when doing
    time-based checks at read time rather than use heavily synchronized
    TimeRangeTracker; let TimeRangeTracker be for write-time only.

    While in here, changed the Segment stuff so that when an immutable
    segment, it uses TimeRange rather than TimeRangeTracker too.

    M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
      Make allTime final.
      Add a includesTimeRange method copied from TimeRangeTracker.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
      Change name of a few methods so they match TimeRange methods that do
      same thing.
      (getTimeRangeTracker, getTimeRange, toTimeRange) add utility methods

    M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ImmutableSegment.java
      Change ImmutableSegment so it uses a TimeRange rather than
      TimeRangeTracker.. it is read-only. Redo shouldSeek, getMinTimestamp,
      updateMetaInfo, and getTimeRangeTracker so we use TimeRange-based
      implementations instead of TimeRangeTracker implementations.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MutableSegment.java
      Implement shouldSeek, getMinTimestamp, updateMetaInfo, and
      getTimeRangeTracker using TimeRangeTracker.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Segment.java
      Make methods that were using TimeRangeTracker abstract and instead
      have the implementations do these methods how they want either using
      TimeRangeTracker when a mutable segment or TimeRange when an immutable
      segment.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
      Change Reader to use TimeRange-based checks instead of
      TimeRangeTracker.

    Signed-off-by: stack <stack@apache.org>
2016-04-15 10:13:42 -07:00
Matteo Bertozzi 3e42f82600 HBASE-15622 Superusers does not consider the keytab credentials 2016-04-15 08:28:39 -07:00
chenheng a9f1c4a871 HBASE-15406 Split / merge switch left disabled after early termination of hbck 2016-04-15 14:09:52 +08:00
Apekshit 7efb9edecb HBASE-15296 Break out writer and reader from StoreFile. Done using Intellij15 Refactor > Move. (Apekshit)
Change-Id: Ie719569cc3393e0b5361e9d462c3cf125ad5144e

Signed-off-by: stack <stack@apache.org>
2016-04-13 22:43:03 -07:00
Elliott Clark 5a7c8dcb68 HBASE-15504 Fix Balancer in 1.3 not moving regions off overloaded regionserver 2016-04-13 18:07:00 -07:00
Apekshit 8f9e46a640 HBASE-15405 Fix PE logging and wrong defaults in help message. (Apekshit)
Change-Id: Ib3007fae8d05e651b62bf4c15352ed43ea79e739
2016-04-13 12:10:33 -07:00
Matteo Bertozzi ae7e5e29f9 HBASE-15481 Add pre/post roll to WALObserver
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-04-13 00:43:51 -05:00
Stephen Yuan Jiang 543e7081f5 HBASE-15636 hard coded wait time out value in HBaseTestingUtility#waitUntilAllRegionsAssigned might cause test failure (Stephen Yuan Jiang) 2016-04-12 16:46:39 -07:00
Matteo Bertozzi d03cdc795c HBASE-15621 Suppress Hbase SnapshotHFile cleaner error messages when a snaphot is going on (Huaxiang Sun) 2016-04-12 12:17:55 -07:00
Matteo Bertozzi 0f23e61ec5 HBASE-15632 Undo the checking of lastStoreFlushTimeMap.isEmpty() introduced in HBASE-13145 (Huaxiang Sun) 2016-04-12 11:35:18 -07:00
tedyu ff9c92e168 HBASE-14985 TimeRange constructors should set allTime when appropriate (Geoffrey Jacoby) 2016-04-11 16:59:45 -07:00
Matteo Bertozzi 8964573394 HBASE-15627 Miss space and closing quote in AccessController#checkSystemOrSuperUser (Huaxiang Sun) 2016-04-11 08:28:26 -07:00
tedyu 8541fe4ad1 HBASE-15093 Replication can report incorrect size of log queue for the global source when multiwal is enabled (Ashu Pachauri) 2016-04-11 08:17:20 -07:00
Vasudevan a395922ad5 HBASE-15605 Remove PB references from HCD and HTD for 2.0 (Ram) 2016-04-11 14:12:07 +05:30
Jerry He 80df1cb7b6 HBASE-15591 ServerCrashProcedure not yielding 2016-04-10 17:02:39 -07:00
zhangduo f7d44e929f HBASE-15527 Refactor Compactor related classes 2016-04-10 09:26:28 +08:00
tedyu e0f31ba6e6 HBASE-15507 Online modification of enabled ReplicationPeerConfig (Geoffrey Jacoby) 2016-04-08 21:26:31 -07:00
zhangduo 6ea4994569 HBASE-15407 Add SASL support for fan out OutputStream 2016-04-08 21:46:47 +08:00
stack e450d94a2c HBASE-15380 Purge rollback support in Store etc. 2016-04-07 22:35:23 -07:00
zhangduo 394b89d153 HBASE-15537 Make multi WAL work with WALs other than FSHLog 2016-04-08 10:36:16 +08:00
Enis Soztutar 2dcd08bc3d HBASE-15586 Unify human readable numbers in the web UI 2016-04-07 17:07:33 -07:00
tedyu a146a71a33 HBASE-15400 Use DateTieredCompactor for Date Tiered Compaction - drop TestDateTieredCompaction.java 2016-04-07 15:01:00 -07:00
tedyu f60fc9d1a0 HBASE-15400 Use DateTieredCompactor for Date Tiered Compaction (Clara Xiong) 2016-04-07 14:58:59 -07:00
tedyu 3826894f89 HBASE-15369 Handle NPE in region.jsp (Samir Ahmic) 2016-04-06 06:52:51 -07:00
Enis Soztutar c93cffb95c HBASE-15587 FSTableDescriptors.getDescriptor() logs stack trace erronously 2016-04-05 18:13:40 -07:00
tedyu a93a8878fe HBASE-15485 Filter.reset() should not be called between batches (Phil Yang) 2016-04-04 12:52:24 -07:00
Ashish Singhi 33396c3629 HBASE-15578 Handle HBASE-15234 for ReplicationHFileCleaner 2016-04-04 15:02:19 +05:30
Matteo Bertozzi 79868bd394 HBASE-15582 SnapshotManifestV1 too verbose when there are no regions 2016-04-01 20:55:21 -07:00
Ashish Singhi 25419d8b18 HBASE-15424 Add bulk load hfile-refs for replication in ZK after the event is appended in the WAL 2016-04-01 15:40:36 +05:30
tedyu 5d79790c55 HBASE-15293 Handle TableNotFound and IllegalArgument exceptions in table.jsp (Samir Ahmic) 2016-04-01 02:13:18 -07:00
Stephen Yuan Jiang 89d750166d HBASE-15568 Procedure V2 - Remove CreateTableHandler in HBase Apache 2.0 release (Stephen Yuan Jiang) 2016-04-01 01:31:09 -07:00
Gary Helmling 2d8e0a0477 HBASE-15234 Don't abort ReplicationLogCleaner on ZooKeeper errors 2016-03-31 22:28:18 -07:00
Stephen Yuan Jiang e1d5c3d269 HBASE-15521 Procedure V2 - RestoreSnapshot and CloneSnapshot (Stephen Yuan Jiang) 2016-03-31 21:49:13 -07:00
Harsh J 7d3a89ce8e HBASE-15396 Enhance mapreduce.TableSplit to add encoded region name
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-03-31 22:59:43 -05:00
tedyu 8c7f044efb HBASE-15571 Make MasterProcedureManagerHost accessible through MasterServices 2016-03-31 15:45:46 -07:00
zhangduo d6fd859451 HBASE-15538 Implement secure async protobuf wal writer 2016-03-31 10:33:35 +08:00
stack 9d56105eec HBASE-15324 Jitter may cause desiredMaxFileSize overflow in ConstantSizeRegionSplitPolicy and trigger unexpected split (Yu Li) 2016-03-30 13:31:09 -07:00
stack 21301a8a95 HBASE-15566 Add timeouts on TestMobFlushSnapshotFromClient and TestRegionMergeTransactionOnCluster 2016-03-30 13:23:20 -07:00
Elliott Clark a71ce6e738 HBASE-14983 Create metrics for per block type hit/miss ratios
Summary: Missing a root index block is worse than missing a data block. We should know the difference

Test Plan: Tested on a local instance. All numbers looked reasonable.

Differential Revision: https://reviews.facebook.net/D55563
2016-03-30 11:41:11 -07:00
Elliott Clark b18de5ef45 HBASE-15559 Fix BaseMasterAndRegionObserver doesn't implement all the methods 2016-03-30 11:17:08 -07:00
tedyu 31aee19f28 HBASE-15327 Canary will always invoke admin.balancer() in each sniffing period when writeSniffing is enabled (Jianwei Cui) 2016-03-30 08:58:42 -07:00
Enis Soztutar afdfd1bd9c HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock - ADDENDUM for failing test 2016-03-29 15:02:18 -07:00
chenheng 7f39baf0f4 HBASE-11393 Replication TableCfs should be a PB object rather than a string 2016-03-29 10:25:29 +08:00
Enis Soztutar 0520097611 HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock 2016-03-28 17:56:32 -07:00
tedyu cbf9c1e116 HBASE-15191 CopyTable and VerifyReplication - Option to specify batch size, versions (Parth Shah) 2016-03-28 17:25:00 -07:00
tedyu 7793bc54c2 HBASE-15548 SyncTable: sourceHashDir is supposed to be optional but won't work without (Dave Latham) 2016-03-28 16:52:44 -07:00
zhangduo c96b642f15 HBASE-15265 Implement an asynchronous FSHLog 2016-03-26 15:41:27 +08:00
tedyu b865fb9434 HBASE-15496 Throw RowTooBigException only for user scan/get (Guanghao Zhang) 2016-03-25 18:18:35 -07:00
zhangduo 11d11d3fcc HBASE-15389 Write out multiple files when compaction 2016-03-25 15:07:54 +08:00
chenheng e9c4f12856 HBASE-15384 Avoid using '/tmp' directory in TestBulkLoad 2016-03-25 12:06:55 +08:00
tedyu 07c597c8a2 HBASE-15526 Make SnapshotManager accessible through MasterServices 2016-03-24 15:59:46 -07:00
tedyu ad3feaa448 HBASE-15515 Improve LocalityBasedCandidateGenerator in Balancer (Guanghao Zhang) 2016-03-24 11:10:58 -07:00
Jerry He 7c93098210 HBASE-14256 Flush task message may be confusing when region is recovered (Gabor Liptak) 2016-03-24 10:06:38 -07:00
Elliott Clark e71bc71c84 HBASE-15475 Addendum 2016-03-24 09:11:19 -07:00
zhangduo fd5c0934b6 HBASE-15520 Fix broken TestAsyncIPC 2016-03-24 10:46:44 +08:00
Elliott Clark 925c185969 HBASE-15475 Allow TimestampsFilter to provide a seek hint
Summary:
Allow TestTimestampFilterSeekHint to provide a seek next hint.
This can be incorrect as it might skip deletes. However it can
make things much much faster.

Test Plan: Added a unit test.

Differential Revision: https://reviews.facebook.net/D55617
2016-03-23 18:56:52 -07:00
stack d7a4499dfc HBASE-15392 Single Cell Get reads two HFileBlocks
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
moreRowsMayExistAfterCell Exploit the fact a Scan is a Get Scan. Also save compares
if no non-default stopRow.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java
optimize Add doc on what is being optimized. Also, if a Get Scan, do not
optimize else we'll keep going after our row is DONE.
Another place to make use of the Get Scan fact is when we are DONE.. if
Get Scan, we can close out the scan.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreScanner.java
Add tests for Get Scans and optimize around block loading.
2016-03-23 14:37:14 -07:00
Matteo Bertozzi 7177e4be64 HBASE-15508 Add command for exporting snapshot in hbase command script (Yufeng Jiang) 2016-03-23 10:26:32 -07:00
zhangduo 5fcadb86ab HBASE-15495 Connection leak in FanOutOneBlockAsyncDFSOutputHelper 2016-03-23 09:56:40 +08:00
stack 12f66e3060 HBASE-15477 Purge 'next block header' from cached blocks
When we read from HDFS, we overread to pick up the next blocks header.
Doing this saves a seek as we move through the hfile; we save having to
do an explicit seek just to read the block header every time we need to
read the body.  We used to read in the next header as part of the
current blocks buffer. This buffer was then what got persisted to
blockcache; so we were over-persisting: our block plus the next blocks'
header (33 bytes).

This patch undoes this over-persisting.

Removes support for version 1 blocks (0.2 was added in hbase-0.92.0).
Not needed any more.

There is an open question on whether checksums should be persisted
when caching. The code seems to say no but if cache is SSD backed or
backed by anything that does not do error correction, we'll want
checksums.

Adds loads of documentation.

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
  (write) Add writing from a ByteBuff.

M hbase-common/src/main/java/org/apache/hadoop/hbase/nio/ByteBuff.java
  (toString) Add one so ByteBuff looks like ByteBuffer when you click on
  it in IDE

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
  Remove support for version 1 blocks.

  Cleaned up handling of metadata added when we serialize a block to
  caches. Metadata is smaller now.

  When we serialize (used when caching), do not persist the next blocks
  header if present.

  Removed a bunch of methods, a few of which had overlapping
  functionality and others that exposed too much of our internals.
  Also removed a bunch of constructors and unified the constructors we
  had left over making them share a common init method.
  Shutdown access to defines that should only be used internally here.

  Renamed all to do w/ 'EXTRA' and 'extraSerialization' to instead talk
  about metadata saved to caches; was unclear previously what EXTRA was
  about.

  Renamed static final declarations as all uppercase.

  (readBlockDataInternal): Redid. Couldn't make sense of it previously.
  Undid heavy-duty parse of header by constructing HFileBlock. Other
  cleanups. Its 1/3rd the length it used to be. More to do in here.
2016-03-22 18:45:17 -07:00
stack a13d6e000d Revert "HBASE-15392 Single Cell Get reads two HFileBlocks M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java moreRowsMayExistAfterCell Exploit the fact a Scan is a Get Scan. Also save compares if no non-default stopRow."
Revert mistaken commit

This reverts commit 7073f69993.
2016-03-22 18:39:22 -07:00
stack c49d0caf53 Revert "HBASE-15477 Purge 'next block header' from cached blocks"
Overcommit. Revert.

This reverts commit ef94b55239.
2016-03-22 18:38:29 -07:00
stack 54a543de22 Revert "HBASE-15477 Purge 'next block header' from cached blocks"
Overcommit. Revert to fix.

This reverts commit 000117ad9f.
2016-03-22 18:37:25 -07:00
Enis Soztutar 3f3613a234 HBASE-15212 RRCServer should enforce max request size 2016-03-22 16:23:15 -07:00
stack 8af9ed7433 HBASE-15416 TestHFileBackedByBucketCache is flakey since it went in 2016-03-22 15:44:25 -07:00
Enis Soztutar b3fe4ed16c HBASE-15412 Add average region size metric (Alicia Ying Shu) 2016-03-22 14:46:27 -07:00
zhangduo 2348478506 HBASE-15360 addendum fix testCoDelScheduling
Signed-off-by: stack <stack@apache.org>
2016-03-22 13:52:26 -07:00
stack 000117ad9f HBASE-15477 Purge 'next block header' from cached blocks
When we read from HDFS, we overread to pick up the next blocks header.
Doing this saves a seek as we move through the hfile; we save having to
do an explicit seek just to read the block header every time we need to
read the body.  We used to read in the next header as part of the
current blocks buffer. This buffer was then what got persisted to
blockcache; so we were over-persisting: our block plus the next blocks'
header (33 bytes).

This patch undoes this over-persisting.

Removes support for version 1 blocks (0.2 was added in hbase-0.92.0).
Not needed any more.

There is an open question on whether checksums should be persisted
when caching. The code seems to say no but if cache is SSD backed or
backed by anything that does not do error correction, we'll want
checksums.

Adds loads of documentation.

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
  (write) Add writing from a ByteBuff.

M hbase-common/src/main/java/org/apache/hadoop/hbase/nio/ByteBuff.java
  (toString) Add one so ByteBuff looks like ByteBuffer when you click on
  it in IDE

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
  Remove support for version 1 blocks.

  Cleaned up handling of metadata added when we serialize a block to
  caches. Metadata is smaller now.

  When we serialize (used when caching), do not persist the next blocks
  header if present.

  Removed a bunch of methods, a few of which had overlapping
  functionality and others that exposed too much of our internals.
  Also removed a bunch of constructors and unified the constructors we
  had left over making them share a common init method.
  Shutdown access to defines that should only be used internally here.

  Renamed all to do w/ 'EXTRA' and 'extraSerialization' to instead talk
  about metadata saved to caches; was unclear previously what EXTRA was
  about.

  Renamed static final declarations as all uppercase.

  (readBlockDataInternal): Redid. Couldn't make sense of it previously.
  Undid heavy-duty parse of header by constructing HFileBlock. Other
  cleanups. Its 1/3rd the length it used to be. More to do in here.
2016-03-22 13:42:38 -07:00
stack ef94b55239 HBASE-15477 Purge 'next block header' from cached blocks
When we read from HDFS, we overread to pick up the next blocks header.
Doing this saves a seek as we move through the hfile; we save having to
do an explicit seek just to read the block header every time we need to
read the body.  We used to read in the next header as part of the
current blocks buffer. This buffer was then what got persisted to
blockcache; so we were over-persisting: our block plus the next blocks'
header (33 bytes).

This patch undoes this over-persisting.

Removes support for version 1 blocks (0.2 was added in hbase-0.92.0).
Not needed any more.

There is an open question on whether checksums should be persisted
when caching. The code seems to say no but if cache is SSD backed or
backed by anything that does not do error correction, we'll want
checksums.

Adds loads of documentation.

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
  (write) Add writing from a ByteBuff.

M hbase-common/src/main/java/org/apache/hadoop/hbase/nio/ByteBuff.java
  (toString) Add one so ByteBuff looks like ByteBuffer when you click on
  it in IDE

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
  Remove support for version 1 blocks.

  Cleaned up handling of metadata added when we serialize a block to
  caches. Metadata is smaller now.

  When we serialize (used when caching), do not persist the next blocks
  header if present.

  Removed a bunch of methods, a few of which had overlapping
  functionality and others that exposed too much of our internals.
  Also removed a bunch of constructors and unified the constructors we
  had left over making them share a common init method.
  Shutdown access to defines that should only be used internally here.

  Renamed all to do w/ 'EXTRA' and 'extraSerialization' to instead talk
  about metadata saved to caches; was unclear previously what EXTRA was
  about.

  Renamed static final declarations as all uppercase.

  (readBlockDataInternal): Redid. Couldn't make sense of it previously.
  Undid heavy-duty parse of header by constructing HFileBlock. Other
  cleanups. Its 1/3rd the length it used to be. More to do in here.
2016-03-22 13:34:51 -07:00
stack 891569bbd9 Add javadoc on how BBIOEngine works (by Anoop Sam John) 2016-03-22 13:01:13 -07:00
stack 7073f69993 HBASE-15392 Single Cell Get reads two HFileBlocks M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java moreRowsMayExistAfterCell Exploit the fact a Scan is a Get Scan. Also save compares if no non-default stopRow.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java
optimize Add doc on what is being optimized. Also, if a Get Scan, do not
optimize else we'll keep going after our row is DONE.
Another place to make use of the Get Scan fact is when we are DONE.. if
Get Scan, we can close out the scan.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreScanner.java
Add tests for Get Scans and optimize around block loading.
2016-03-22 13:00:41 -07:00
tedyu 47471c35e3 HBASE-15488 Add ACL for setting split merge switch 2016-03-22 10:38:13 -07:00
Enis Soztutar 797562e6c3 HBASE-15464 Flush / Compaction metrics revisited 2016-03-21 17:50:02 -07:00
tedyu f1d453599a HBASE-15433 SnapshotManager#restoreSnapshot not update table and region count quota correctly when encountering exception (Jianwei Cui) 2016-03-21 03:46:23 -07:00
Sean Busbey f48c92d143 HBASE-15478 add comments to syncRunnerIndex handling explaining constraints on possible values.
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-03-21 00:28:15 -05:00
Yu Li d2d8058ab3 HBASE-15451 Remove unnecessary wait in MVCC 2016-03-19 21:24:07 +08:00
tedyu 3a6d683d63 HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun) 2016-03-18 10:21:43 -07:00
tedyu 8c031e9d6b HBASE-15456 Revert due to unit test failure in thrift module 2016-03-17 17:36:44 -07:00
tedyu fbf58f330b HBASE-15325 ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests (Phil Yang) 2016-03-17 11:03:29 -07:00
Elliott Clark ac1a7a4a78 HBASE-15470 Add a setting for Priority queue length
Summary:
Move the config keys to one place
Make Two different config keys. One for default, one for priority

Test Plan: unit tests

Differential Revision: https://reviews.facebook.net/D55575
2016-03-16 16:52:04 -07:00
Elliott Clark ecec35ae4e HBASE-15441 Fix WAL splitting when region has moved multiple times
Summary:
Currently WAL splitting is broken when a region has been opened multiple times in recent minutes.

Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail.

We need to:

It appears that the close event with a sequence id of one is coming from region warm up.

This patch fixes that by making sure the close on warm up doesn't happen. Also splitting will ignore any of the events that are already in the logs.

Test Plan: Unit tests pass

Differential Revision: https://reviews.facebook.net/D55557
2016-03-16 16:26:09 -07:00
Matteo Bertozzi 3bf0945a11 HBASE-15430 Failed taking snapshot - Manifest proto-message too large (JunHo Cho) 2016-03-16 08:52:02 -07:00
stack 9eb25bd5c9 HBASE-15360 Fix flaky TestSimpleRpcScheduler (Duo Zhang) 2016-03-16 08:04:10 -07:00
tedyu f120602f1e HBASE-15456 CreateTableProcedure/ModifyTableProcedure needs to fail when there is no family in table descriptor (huaxiang sun) 2016-03-15 16:15:03 -07:00
Enis Soztutar 51259fe4a5 HBASE-15377 Per-RS Get metric is time based, per-region metric is size-based (Heng Chen) 2016-03-15 11:22:18 -07:00
tedyu 8fcc1e8e95 HBASE-15463 Region normalizer should check whether split/merge is enabled 2016-03-15 09:03:27 -07:00
Enis Soztutar ca816f0780 HBASE-6721 RegionServer Group based Assignment (Francis Liu) 2016-03-14 18:28:50 -07:00
anoopsjohn eea8b38dfa HBASE-15180 Reduce garbage created while reading Cells from Codec Decoder. 2016-03-11 13:58:41 +05:30
Enis Soztutar a979d85582 HBASE-15435 Add WAL (in bytes) written metric (Alicia Ying Shu) 2016-03-10 20:16:30 -08:00
stack bb5bfe82f2 Revert "HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun)"
Not needed afterall

This reverts commit d15ae0e6ab.
2016-03-10 15:41:04 -08:00
tedyu d14b6c3810 HBASE-15425 Failing to write bulk load event marker in the WAL is ignored (Ashish Singhi) 2016-03-09 18:49:41 -08:00
tedyu ad9b91a904 HBASE-15378 Scanner cannot handle heartbeat message with no results (Phil Yang) 2016-03-09 09:28:54 -08:00
Matteo Bertozzi 9e967e5c1d HBASE-15113 Procedure v2 - Speedup eviction of sys operation results 2016-03-08 19:47:15 -08:00
Liu Shaohui 7e4e8dc3e9 HBASE-15420: TestCacheConfig failed after HBASE-15338 2016-03-09 10:15:35 +08:00
Gábor Lipták 14217cef24 HBASE-15364 Fix unescaped < and > characters in Javadoc 2016-03-08 16:44:04 -08:00
Mikhail Antonov 46cc3d4972 HBASE-15137 CallTimeoutException and CallQueueTooBigException should trigger PFFE 2016-03-07 20:54:54 -08:00
stack 4f044cf6be HBASE-15421 Convert TestStoreScanner to junit4 from junit3 and clean up close of scanners 2016-03-07 20:46:46 -08:00
Mikhail Antonov e477c143bc HBASE-15354 Use same criteria for clearing meta cache for all operations (addendum) (Ashu Pachauri) 2016-03-07 18:11:15 -08:00
stack d15ae0e6ab HBASE-15261 Make Throwable t in DaughterOpener volatile (Huaxiang Sun) 2016-03-07 16:34:11 -08:00
stack 0f14856b01 HBASE-15416 TestHFileBackedByBucketCache is flakey since it went in 2016-03-07 16:31:09 -08:00
tedyu ed977fd125 HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT 2016-03-07 16:15:59 -08:00
tedyu dfc650a953 HBASE-15243 Revert due to compilation error - master branch change makes the patch stale 2016-03-07 15:59:29 -08:00
tedyu 05c1309b3c HBASE-15243 Utilize the lowest seek value when all Filters in MUST_PASS_ONE FilterList return SEEK_NEXT_USING_HINT 2016-03-07 15:41:06 -08:00
tedyu 05161fcbfd HBASE-15393 Addendum adds TestReplicationAdminWithTwoDifferentZKClusters (Ashish) 2016-03-07 04:56:00 -08:00
chenheng f30afa05d9 HBASE-15376 ScanNext metric is size-based while every other per-operation metric is time based 2016-03-07 17:36:40 +08:00
Liu Shaohui 4483b3cbed HBASE-15338: Add a option to disable the data block cache for testing the performance of underlying file system 2016-03-07 16:37:07 +08:00
Jesse Yates ef712df944 HBASE-14703 HTable.mutateRow does not collect stats (Heng Chen) 2016-03-05 11:01:45 -08:00
tedyu d083e4f29f HBASE-15393 Enable table replication command will fail when parent znode is not default in peer cluster (Ashish Singhi) 2016-03-05 06:28:09 -08:00
Ashu Pachauri 27cf0c8c36 HBASE-15354 Same criteria to clear metacache across operations (Ashu Pachauri)
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-03-04 17:55:35 -08:00
stack 7dabcf23e8 HBASE-15373 DEPRECATED_NAME_OF_NO_LIMIT_THROUGHPUT_CONTROLLER_CLASS value is wrong in CompactionThroughputControllerFactory 2016-03-03 19:42:42 -08:00
tedyu 4fba1c3627 HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang) 2016-03-03 15:59:37 -08:00
Jonathan M Hsieh f658f3ef83 HBASE-15356 Remove unused imports (Youngjoon Kim) 2016-03-03 11:42:38 -08:00
stack 8ace5bbfce HBASE-15366 Add doc, trace-level logging, and test around hfileblock
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileContext.java
 Make it emit its toString in format that matches the way we log
 elsewhere

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
 Capitalize statics.

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
 Verify and cleanup documentation of hfileblock format at head of class.
 Explain what 'EXTRA_SERIALIZATION_SPACE' is all about.
 Connect how we serialize and deserialize... done in different places
 and one way when pulling from HDFS and another when pulling from cache
 (TO BE FIXED). Shut down a load of public access.

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpl.java
 Add trace-level logging

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileScanner.java
 Make it Closeable
2016-03-03 09:16:30 -08:00
chenheng 4b3e38705c HBASE-15329 Cross-Site Scripting: Reflected in table.jsp (Samir Ahmic) 2016-03-03 12:20:00 +08:00
zhangduo 5e395c4294 HBASE-15375 Do not write to '/tmp' in TestRegionMover 2016-03-02 17:04:19 +08:00
tedyu edc5ab5af9 HBASE-15291 Revert due to the bug Haitao discovered 2016-03-02 00:49:17 -08:00
eshcar dc44943666 HBASE-15359 Simplifying segment hierarchy
Signed-off-by: stack <stack@apache.org>
2016-03-01 23:25:11 -08:00
tedyu bab8d1527b HBASE-15181 Addendum fixes findbugs warning (Clara Xiong) 2016-03-01 18:17:43 -08:00
Elliott Clark 9ad13468a0 HBASE-15315 Remove always set super user call as high priority (Yong Zhang) 2016-03-01 15:34:16 -08:00
Phil Yang 88f775996b HBASE-15358 canEnforceTimeLimitFromScope should use timeScope instead of sizeScope
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-02-29 17:21:42 +08:00
tedyu 03ffb30efe HBASE-15181 adds TestCompactionPolicy which was missing in first commit 2016-02-26 19:58:33 -08:00
tedyu f7f96b9fb7 HBASE-15181 A simple implementation of date based tiered compaction (Clara Xiong) 2016-02-26 17:36:23 -08:00
chenheng 99955a3240 HBASE-15128 Disable region splits and merges switch in master 2016-02-27 08:36:59 +08:00
Elliott Clark e88d943183 HBASE-15348 Disable metrics tests until fixed. 2016-02-26 09:04:51 -08:00
ramkrishna 8f2bd06019 HBASE-15205 Do not find the replication scope for every WAL#append() (Ram) 2016-02-26 22:30:55 +05:30
ramkrishna 538815d82a HBASE-15215 TestBlockEvictionFromClient is flaky in jdk1.7 build (setting
offheap)
2016-02-26 11:43:00 +05:30
chenheng bf4fcc30c6 Revert "HBASE-15128 Disable region splits and merges switch in master"
This reverts commit 24d481c580.
2016-02-26 08:52:12 +08:00
chenheng 24d481c580 HBASE-15128 Disable region splits and merges switch in master 2016-02-26 08:11:16 +08:00
Samir Ahmic 75c57a04dd HBASE-15311 Prevent NPE in BlockCacheViewTmpl.
Signed-off-by: stack <stack@apache.org>
2016-02-25 15:23:28 -08:00
Samir Ahmic 40c55915e7 HBASE-15144 Procedure v2 - Web UI displaying Store state 2016-02-25 10:46:56 -08:00
Mikhail Antonov 43f99def67 HBASE-15136 Explore different queuing behaviors while busy 2016-02-24 20:41:30 -08:00
zhangduo 6e9d355b12 HBASE-15264 Implement a fan out HDFS OutputStream 2016-02-25 10:07:27 +08:00
Elliott Clark 630a65825e HBASE-15222 Use less contended classes for metrics
Summary:
Use less contended things for metrics.
For histogram which was the largest culprit we use FastLongHistogram
For atomic long where possible we now use counter.

Test Plan: unit tests

Reviewers:

Subscribers:

Differential Revision: https://reviews.facebook.net/D54381
2016-02-24 14:34:05 -08:00
Phil Yang 30cec72f9a HBASE-15302 Reenable the other tests disabled by HBASE-14678
Signed-off-by: stack <stack@apache.org>
2016-02-24 07:14:01 -08:00
eshcar 876a6ab73e HBASE-15016 Services a Store needs from a Region
Signed-off-by: stack <stack@apache.org>
2016-02-24 07:07:07 -08:00
stack 28cd48b673 HBASE-15277 TestRegionMergeTransactionOnCluster.testWholesomeMerge fails with no connection to master; ADDING DEBUGGING 2016-02-23 22:43:01 -08:00
Mikhail Antonov f47dba74d4 HBASE-15306 Make RPC call queue length dynamically configurable 2016-02-23 14:20:40 -08:00
tedyu 58283fa1b1 HBASE-15291 FileSystem not closed in secure bulkLoad (Yong Zhang) 2016-02-23 06:11:39 -08:00
ramkrishna 3ba1a7fd23 HBASE-13259 mmap() based BucketCache IOEngine (Zee Chen & Ram) 2016-02-23 17:03:38 +05:30
Josh Elser a8073c4a98 HBASE-15232 Handle region location cache mgmt in AsyncProcess for multi()'s
Further investigation after HBASE-15221 lead to some findings that
AsyncProcess should have been managing the contents of the region
location cache, appropriately clearing it when necessary (e.g. an
RPC to a server fails because the server doesn't host that region)

For multi() RPCs, the tableName argument is null since there is no
single table that the updates are destined to. This inadvertently
caused the existing region location cache updates to fail on 1.x
branches. AsyncProcess needs to handle when tableName is null
and perform the necessary cache evictions.

As such, much of the new retry logic in HTableMultiplexer is
unnecessary and is removed with this commit. Getters which were
added as a part of testing were left since that are mostly
harmless and should contain no negative impact.

Signed-off-by: stack <stack@apache.org>
2016-02-22 22:03:14 -08:00
stack 5e501123ca HBASE-15301 Remove the never-thrown NamingException from TableInputFormatBase#reverseDNS method signature (Yu Li) 2016-02-22 21:58:20 -08:00
anoopsjohn 2d66cd86d0 HBASE-15247 InclusiveStopFilter does not respect reverse Filter property. (Amal Joshy) 2016-02-23 09:21:37 +05:30
Mikhail Antonov e58c0385a7 HBASE-15135 Add metrics for storefile age 2016-02-22 02:21:02 -08:00
tedyu ed290cf829 HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state 2016-02-20 20:25:01 -08:00
chenheng a878b19c4e HBASE-15259 WALEdits under replay will also be replicated 2016-02-20 10:09:27 +08:00
tedyu 8eedc96751 HBASE-15251 During a cluster restart, Hmaster thinks it is a failover by mistake (Clara Xiong) 2016-02-18 23:46:54 -08:00
zhangduo d2ba87509b HBASE-14949 Resolve name conflict when splitting if there are duplicated WAL entries 2016-02-18 19:48:52 +08:00
Samir Ahmic bba4f107c1 HBASE-15270 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon.
Signed-off-by: chenheng <chenheng@apache.org>
2016-02-17 23:55:38 -06:00
Sean Busbey c7eb72a91c Revert "HBASE-15120 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon."
This reverts commit 9f8273e717.
2016-02-17 23:55:20 -06:00
stack 4b1acead42 HBASE-15285 Forward-port respect for isReturnResult from HBASE-15095 2016-02-17 19:26:17 -08:00
Samir Ahmic 9f8273e717 HBASE-15120 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon.
Signed-off-by: chenheng <chenheng@apache.org>
2016-02-17 10:23:06 +08:00
stack a8077080ba HBASE-15277 TestRegionMergeTransactionOnCluster.testWholesomeMerge fails with no connection to master 2016-02-16 13:13:13 -08:00
stack bb881eb80d HBASE-15276 TestFlushSnapshotFromClient hung 2016-02-16 12:58:22 -08:00
chenheng e3aa71fb76 HBASE-15263 TestIPv6NIOServerSocketChannel.testServerSocketFromLocalhostResolution can hang indefinetly
Signed-off-by: stack <stack@apache.org>
2016-02-16 12:53:44 -08:00
stack 7063562bf1 HBASE-13839 Fix AssgnmentManagerTmpl.jamon issues (coloring, content etc.) ; ADDENDUM 2016-02-15 17:50:10 -08:00
chenheng 68b300173f HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic) 2016-02-15 13:53:47 +08:00
Sean Busbey 3897c4e102 Revert "HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT"
This reverts commit c8d133186b.
2016-02-13 11:18:53 -06:00
stack 1419628881 HBASE-13839 Fix AssgnmentManagerTmpl.jamon issues (coloring, content etc.) 2016-02-12 15:06:38 -08:00
Ashish Singhi c8d133186b HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT
Signed-off-by: stack <stack@apache.org>
2016-02-12 13:41:09 -08:00
tedyu 454e45f50d HBASE-15219 Revert pending verification of test result 2016-02-12 12:06:48 -08:00
zhangduo 85e1d9a109 HBASE-15252 Data loss when replaying wal if HDFS timeout 2016-02-12 16:16:37 +08:00
eshcar 25dfc112dd HBASE-14919 Refactoring for in-memory flush and compaction
Signed-off-by: stack <stack@apache.org>
2016-02-11 10:39:01 -08:00
anoopsjohn 29a192ef3c HBASE-15198 RPC client not using Codec and CellBlock for puts by default. 2016-02-11 09:51:11 +05:30
ramkrishna fec9733893 HBASE-15204 Try to estimate the cell count for adding into WALEdit (Ram) 2016-02-11 09:09:25 +05:30
Jerry He 1942a99b83 HBASE-15223 Make convertScanToString public for Spark 2016-02-10 15:02:58 -08:00
Andrew Purtell 2963d59ed2 HBASE-15229 Canary Tools should not call System.Exit on error (Vishal Khandelwal) 2016-02-10 10:21:00 -08:00
Matteo Bertozzi d53318163b HBASE-15239 Remove unused LoadBalancer.immediateAssignment() 2016-02-10 09:16:42 -08:00
tedyu df829ea7d1 HBASE-15219 Canary tool does not return non-zero exit code when one of regions is in stuck state 2016-02-10 02:36:46 -08:00
Andrew Purtell bab812df28 HBASE-15216 Canary does not accept config params from command line (Vishal Khandelwal) 2016-02-09 22:45:37 -08:00
stack b6328eb803 HBASE-15238 HFileReaderV2 prefetch overreaches; runs off the end of the data
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/ChecksumUtil.java
      Cleanup trace message and include offset; makes debug the easier.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/FixedFileTrailer.java
      Fix incorrect data member javadoc.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
      Pass along the offset we are checksumming at.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpljava
      Add trace logging for debugging and set the end of the prefetch to be
      last datablock, not size minus trailersize (there is the root indices
      and file info to be skipped)
2016-02-09 20:31:44 -08:00
Misty Stanley-Jones 7cab24729d HBASE-11792 Organize Performance Evaluation usage output 2016-02-09 11:16:22 -08:00
stack ec92a8a705 HBASE-15158 Change order in which we do write pipeline operations; do all under row locks 2016-02-07 22:56:40 -08:00
stack eacf7bcf97 HBASE-15163 Add sampling code and metrics for get/scan/multi/mutate count separately (Yu Li) 2016-02-06 06:30:56 -08:00
stack d82ae42126 Revert "HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic)"
Revert mistaken commit.

This reverts commit efc7a0d347.
2016-02-06 05:17:29 -08:00
ramkrishna 4e44f4f505 HBASE-15204 Try to estimate the cell count for adding into WALEdit (Revert
for making it more cleaner)
2016-02-06 13:05:13 +05:30
Adrian Muraru 59b03c77de HBASE-14770 RowCounter argument input parse error
Signed-off-by: stack <stack@apache.org>
2016-02-05 21:41:30 -08:00
stack efc7a0d347 HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic) 2016-02-05 21:28:46 -08:00
tedyu 2ce31f8945 HBASE-15220 Change two logs in SimpleRegionNormalizer to INFO level 2016-02-05 20:52:17 -08:00
Apekshit 31f9f2fb67 HBASE-15209 (compatibility) Disable table in HBaseTestingUtility.truncateTable. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2016-02-05 20:41:40 -08:00
stack 81d81c9839 HBASE-15157 Add *PerformanceTest for Append, CheckAnd* 2016-02-05 20:33:55 -08:00
anoopsjohn 7239056c78 HBASE-15214 Valid mutate Ops fail with RPC Codec in use and region moves across. 2016-02-06 02:40:49 +05:30
stack 779bdf1918 HBASE-15218 On RS crash and replay of WAL, loosing all Tags in Cells (Anoop Sam John) 2016-02-05 10:08:20 -08:00
tedyu 64bac770d4 HBASE-11262 Avoid empty columns while doing bulk-load (Ashish Kumar) 2016-02-05 09:00:04 -08:00
ramkrishna 6f6a8ed71f HBASE-15204 Try to estimate the cell count for adding into WALEdit (Ram) 2016-02-05 14:24:38 +05:30
chenheng 8f20bc748d HBASE-15197 Expose filtered read requests metric to metrics framework and Web UI (Eungsop Yoo) 2016-02-05 10:57:14 +08:00
stack f4d9597e1e HBASE-15210 Undo aggressive load balancer logging at tens of lines per millisecond; ADDENDUM changing LOG.debug to LOG.trace -- noticed by matteo 2016-02-04 16:26:04 -08:00
stack 18eff3c1c3 HBASE-15210 Undo aggressive load balancer logging at tens of lines per millisecond 2016-02-04 16:09:26 -08:00
stack 337f483077 Revert "HBASE-15120 Undo aggressive load balancer logging at tens of lines per millisecond"
This reverts commit c177cfed41.
2016-02-04 16:08:41 -08:00
stack c177cfed41 HBASE-15120 Undo aggressive load balancer logging at tens of lines per millisecond 2016-02-04 14:24:05 -08:00
Enis Soztutar a69272efe1 HBASE-15177 Reduce garbage created under high load 2016-02-04 13:27:00 -08:00
ramkrishna 7b33a740b1 HBASE-15202 Reduce garbage while setting response (Ram) 2016-02-04 23:23:31 +05:30
Elliott Clark f5fba2ba0d HBASE-15211 Don't run the CatalogJanitor if there are regions in transition 2016-02-04 08:52:09 -08:00
ramkrishna 2cf8af5bf1 HBASE-HBASE-15203 Reduce garbage created by path.toString() during
Checksum verification (Ram)
2016-02-04 11:44:46 +05:30
Enis Soztutar 2f5767376f HBASE-15129 Set default value for hbase.fs.tmp.dir rather than fully depend on hbase-default.xml (Yu Li) 2016-02-02 17:10:19 -08:00
Jonathan M Hsieh ecf3efadc0 HBASE-15206 Fix flakey testSplitDaughtersNotInMeta test (Huaxiang Sun) 2016-02-02 16:41:43 -08:00
stack ed46591f30 HBASE-15196 HBASE-15158 Preamble 2 of 2:Add Increment tests 2016-02-02 11:27:03 -08:00
tedyu 243e6cc529 HBASE-15192 TestRegionMergeTransactionOnCluster#testCleanMergeReference is flaky 2016-02-02 09:42:15 -08:00
stack fc5e698c0a HBASE-14969 Add throughput controller for flush; ADDENDUM 2016-02-01 08:08:39 -08:00
stack 2cc48e039d HBASE-15158 HBASE-15158 Preamble 1 of 2: fix findbugs, add javadoc, change Region#getReadpoint to #getReadPoint, and some util 2016-01-31 20:21:48 -08:00
stack 9ec408e25b TestStochasticLoadBalancer.testRegionReplicationOnMidClusterSameHosts flaky on trunk 2016-01-30 07:51:21 -04:00
Yu Li b3b1ce99c6 HBASE-14969 Add throughput controller for flush
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-01-29 09:32:01 +08:00
Matteo Bertozzi 14dd959aa2 HBASE-15142 Procedure v2 - Basic WebUI listing the procedures 2016-01-28 10:13:42 -08:00
Matteo Bertozzi 8a217da8fd HBASE-15019 Replication stuck when HDFS is restarted.
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2016-01-28 10:09:02 -08:00
tedyu 1ee07688c8 HBASE-15173 Execute mergeRegions RPC call as the request user 2016-01-28 09:53:24 -08:00
tedyu 37ed0f6d08 HBASE-15171 Addendum removes extra loop (Yu Li) 2016-01-28 07:06:10 -08:00
Elliott Clark 138b754671 HBASE-15146 Don't block on Reader threads queueing to a scheduler queue 2016-01-28 07:58:43 -05:00
tedyu 47c4147940 HBASE-15171 Avoid counting duplicate kv and generating lots of small hfiles in PutSortReducer (Yu Li) 2016-01-27 09:42:56 -08:00
Elliott Clark de62ad150d HBASE-14526 Remove delayed rpc 2016-01-26 12:15:01 -08:00
stack d6b3d838eb HBASE-15123 Remove duplicate code in LocalHBaseCluster and minor formatting (Appy) 2016-01-25 13:00:08 -04:00
tedyu a87d9560fc HBASE-15125 HBaseFsck's adoptHdfsOrphan function creates region with wrong end key boundary (chenrongwei) 2016-01-23 12:35:57 -08:00
tedyu 6ed3c759d0 HBASE-15132 Master region merge RPC should authorize user request 2016-01-23 07:48:20 -08:00
tedyu f9e69b51e1 HBASE-15148 Resolve IS2_INCONSISTENT_SYNC findbugs warning in AuthenticationTokenSecretManager (Yu Li) 2016-01-22 02:47:49 -08:00
tedyu b1df2f8c88 HBASE-15133 Data loss after compaction when a row has more than Integer.MAX_VALUE columns (Toshihiro Suzuki) 2016-01-22 02:39:40 -08:00
Jonathan M Hsieh b6f091e0fd HBASE-15152 Automatically include prefix-tree module in MR jobs if present 2016-01-21 18:55:19 -08:00
tedyu 1d2b0d8311 HBASE-15126 HBaseFsck's checkRegionBoundaries function sets incorrect storesFirstKey (chenrongwei) 2016-01-21 07:46:58 -08:00
stack bd9906736e HBASE-15098 Normalizer switch in configuration is not used 2016-01-20 09:32:38 -08:00
ramkrishna 93e200d52b HBASE-15101 Leaked References to StoreFile.Reader after HBASE-13082
(Deepankar)
2016-01-20 11:42:13 +05:30
Ashu Pachauri 318814de28 HBASE-15102 Fix HeapMemoryTuner overtuning memstore
HeapMemoryTuner often over tunes memstore without looking at
the lower limit of the previous memstore size and causing a
situation in which memstore used size suddenly exceeds the
total memstore size.

Signed-off-by: Elliott Clark <eclark@apache.org>
2016-01-19 12:24:04 -08:00
Matteo Bertozzi 713c6b5b1e HBASE-15106 Procedure v2 - Procedure Queue pass Procedure for better debuggability 2016-01-19 11:54:24 -08:00
tedyu eb17f74b9e HBASE-15073 Revert due to different opinion on usefulness 2016-01-18 17:51:21 -08:00
stack 9bf26f46d1 HBASE-15118 Fix findbugs complaint in hbase-server 2016-01-18 13:02:17 -08:00
stack 47fc696bc6 HBASE-14962 TestSplitWalDataLoss fails on all branches 2016-01-16 15:53:07 -08:00
Andrew Purtell 387eaff316 Amend HBASE-14512 Cache UGI groups
Handle the case where tests might create a call with a null connection
2016-01-15 19:27:18 -08:00
Andrew Purtell 79588240c6 Amend HBASE-14771 RpcServer#getRemoteAddress always returns null
This change has been reported to cause Phoenix's PhoenixIndexRpcSchedulerTest to fail
with a NPE
2016-01-15 19:27:18 -08:00
Enis Soztutar 2d2fdd5a9f HBASE-15114 NPE when IPC server ByteBuffer reservoir is turned off 2016-01-15 16:42:35 -08:00
stack cb17c7a97a HBASE-15117 Resolve ICAST findbugs warnings in current codes (Yu Li) 2016-01-15 06:00:11 -08:00
tedyu 4ac8d4ce61 HBASE-14865 Support passing multiple QOPs to SaslClient/Server via hbase.rpc.protection (Appy) 2016-01-14 16:39:52 -08:00
Matteo Bertozzi ae7cc0c848 HBASE-15105 Procedure V2 - Procedure Queue with Namespaces 2016-01-14 13:45:17 -08:00
Matteo Bertozzi 18a48af242 HBASE-14837 Procedure v2 - Procedure Queue Improvement 2016-01-14 09:24:42 -08:00
tedyu c8b9754a5e HBASE-15099 Move RegionStateListener class out of quotas package 2016-01-13 15:15:37 -08:00
ramkrishna 840f5ea686 HBASE-15085 IllegalStateException was thrown when scanning on bulkloaded
HFiles (Victor Xu)
2016-01-12 14:36:48 +05:30
stack 83c506d9d4 HBASE-15087 Fix hbase-common findbugs complaints 2016-01-12 00:30:42 -08:00
chenheng 8ee9158b54 HBASE-15083 Gets from Multiactions are not counted in metrics for gets 2016-01-12 14:18:36 +08:00
anoopsjohn da932ee38d HBASE-15077 Support OffheapKV write in compaction with out copying data on heap. 2016-01-12 10:02:39 +05:30
Matteo Bertozzi ec47a811a2 HBASE-15052 Use EnvironmentEdgeManager in ReplicationSource 2016-01-11 09:37:08 -08:00
ramkrishna 894ce84b83 HBASE-15027 - Findbug fix (addendum) 2016-01-11 16:50:59 +05:30
tedyu 4a26644245 HBASE-15065 Addendum fixes checkstyle warnings 2016-01-08 14:49:30 -08:00
Elliott Clark 52280b64e6 HBASE-14975 Don't color the total RIT line yellow if it's zero (Pallavi Adusumilli)
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-01-08 14:29:44 -08:00
tedyu 6e781a1f34 HBASE-15065 SimpleRegionNormalizer should return multiple normalization plans in one run 2016-01-08 11:47:34 -08:00
ramkrishna 28c2b18d30 HBASE-15027 Refactor the way the CompactedHFileDischarger threads are
created (Ram)
2016-01-08 11:18:39 +05:30
stack f3ee6df0f2 HBASE-15079 TestMultiParallel.validateLoadedData AssertionError: null 2016-01-07 15:36:49 -08:00
stack 5bde960b95 HBASE-15076 Add getScanner(Scan scan, List<KeyValueScanner> additionalScanners) API into Region interface (Anoop Sam John) 2016-01-07 13:45:01 -08:00
tedyu 5266b07708 HBASE-15068 Add metrics for region normalization plans 2016-01-07 03:13:16 -08:00
tedyu d65978fceb HBASE-15073 Finer grained control over normalization actions for RegionNormalizer 2016-01-06 17:25:41 -08:00
anoopsjohn a9b671b31f HBASE-12593 Tags to work with ByteBuffer. 2016-01-06 21:28:06 +05:30
Enis Soztutar 893a54c3a4 HBASE-15066 Small improvements to Canary tool 2016-01-06 02:47:19 -08:00
ramkrishna 073e00c005 HBASE-14221 Reduce the number of time row comparison is done in a Scan
(Ram)
2016-01-06 10:38:27 +05:30
Lars Hofhansl e8fbc9b43a HBASE-14468 addendum. 2016-01-05 15:54:34 -08:00
stack 46303dfd75 HBASE-14888 ClusterSchema: Add Namespace Operations 2016-01-05 14:35:27 -08:00
tedyu 00656688f7 HBASE-14987 Compaction marker whose region name doesn't match current region's needs to be handled 2016-01-04 07:10:10 -08:00
Gary Helmling 9589a7d8be HBASE-15038 ExportSnapshot should support separate configs for source and destination 2016-01-04 00:10:19 -08:00
stack a82f7fc94a Revert "HBASE-14888 ClusterSchema: Add Namespace Operations"
This reverts commit c5f3d17ae3.
2016-01-03 07:15:18 -08:00
stack c5f3d17ae3 HBASE-14888 ClusterSchema: Add Namespace Operations 2016-01-02 16:16:56 -08:00
Jonathan M Hsieh 92abf8ac57 HBASE-15060 Cull TestHFileV2 and HFileWriterFactory 2015-12-30 13:21:54 -08:00
tedyu c1b6d47e79 HBASE-15044 Region normalization should be allowed when underlying namespace has quota 2015-12-30 08:04:23 -08:00
ramkrishna 07b6236706 HBASE-15050 Block Ref counting does not work in Region Split cases (Ram) 2015-12-30 14:39:03 +05:30
Ashish Singhi 413d663f92 HBASE-15018 Inconsistent way of handling TimeoutException in the rpc client implementations
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-12-29 20:25:47 -06:00
tedyu 1e4992c6ec HBASE-14867 SimpleRegionNormalizer needs to have better heuristics to trigger merge operation 2015-12-29 06:21:57 -08:00
stack 2fba25b66a HBASE-15023 Reenable TestShell and TestStochasticLoadBalancer 2015-12-28 13:27:17 -08:00
tedyu 449fb81286 HBASE-14030 Revert due to pending review comments 2015-12-28 01:08:02 -08:00
tedyu de69f0df34 HBASE-14030 HBase Backup/Restore Phase 1 (Vladimir Rodionov) 2015-12-27 10:02:09 -08:00
tedyu 1c7e9ec124 HBASE-15039 HMaster and RegionServers should try to refresh token keys from zk when facing InvalidToken (Yong Zhang) 2015-12-25 10:32:51 -08:00
Jonathan M Hsieh 3de0b0417c HBASE-15035 bulkloading hfiles with tags that require splits do not preserve tags 2015-12-25 09:51:34 -08:00
Lars Hofhansl dfada43e90 HBASE-14822; addendum - handle callSeq. 2015-12-24 12:55:39 -08:00
tedyu a1a19d9405 HBASE-14717 enable_table_replication command should only create specified table for a peer cluster (Ashish) 2015-12-24 11:07:49 -08:00
Matteo Bertozzi 8e0854c64b HBASE-15030 Deadlock in master TableNamespaceManager while running IntegrationTestDDLMasterFailover 2015-12-23 09:46:18 -08:00
tedyu 2439f7a688 HBASE-15028 Minor fix on RegionGroupingProvider (Yu Li) 2015-12-22 06:47:33 -08:00
Elliott Clark 6e2c5d216e HBASE-15014 Fix filterCellByStore in WALsplitter is awful for performance 2015-12-21 22:50:38 -08:00
chenheng f018c371b5 HBASE-14654 Reenable TestMultiParallel#testActiveThreadsCount 2015-12-22 11:33:25 +08:00
Pallavi Adusumilli f56abf730f HBASE-14976 fix tests
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2015-12-21 11:35:59 -08:00
Mikhail Antonov 8c921ea94f HBASE-14976 Add RPC call queues to the web ui (Pallavi Adusumilli) 2015-12-19 12:44:30 -08:00
Lars Hofhansl 86a417eead HBASE-14822 Renewing leases of scanners doesn't work. 2015-12-19 09:55:03 -08:00
Ashu Pachauri 48113d7572 HBASE-15001 Fix thread-safety issues with replication
ReplicationSinkManager and HBaseInterClusterReplicationEndpoint
perform certain unsafe operations which might lead to undesirable
behavior with multiwal enabled.

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-18 11:48:55 -08:00
Sean Busbey ba04e0372d HBASE-15003 remove BoundedConcurrentLinkedQueue.
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-12-18 12:26:38 -06:00
Elliott Clark 4bfeccb87a HBASE-15005 Use value array in computing block length for 1.2 and 1.3 2015-12-18 00:23:02 -08:00
anoopsjohn 408666a06d HBASE-13158 When client supports CellBlock, return the result Cells as controller payload for get(Get) API also. 2015-12-18 09:50:53 +05:30
chenheng 27160950ca HBASE-14990 Tests in BaseTestHBaseFsck are run by its subclasses redundantly 2015-12-18 11:37:58 +08:00
Elliott Clark 217036d816 HBASE-14978 Don't allow Multi to retain too many blocks 2015-12-17 16:13:50 -08:00
anoopsjohn 80fc18d2e1 HBASE-15000 Fix javadoc warn in LoadIncrementalHFiles. (Ashish) 2015-12-17 22:47:48 +05:30
anoopsjohn cf458d3023 HBASE-14999 Remove ref to org.mortbay.log.Log. 2015-12-17 18:01:16 +05:30
tedyu d78eddfdc8 HBASE-14995 Revert according to Ram's feedback 2015-12-16 21:54:48 -08:00
tedyu 546ac1cbb3 HBASE-14995 Optimize setting tagsPresent in DefaultMemStore.java (huaxiang sun) 2015-12-16 18:16:38 -08:00
Enis Soztutar 3dec8582f5 HBASE-14951 Make hbase.regionserver.maxlogs obsolete 2015-12-16 14:57:59 -08:00
Mikhail Antonov e965b614b3 HBASE-14974 Total number of Regions in Transition number on UI incorrect 2015-12-16 14:10:32 -08:00
Josh Elser ca7a82fb57 HBASE-14838 Add clarification docs to SimpleRegionNormalizer.
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-12-16 08:58:48 -06:00
Mikhail Antonov abe30b52a8 HBASE-14534 Bump yammer/coda/dropwizard metrics dependency version 2015-12-15 12:11:27 -08:00
Enis Soztutar 3e26063161 HBASE-14968 ConcurrentModificationException in region close resulting in the region staying in closing state 2015-12-15 11:49:34 -08:00
ramkrishna 1822bb5d95 HBASE-14895 Seek only to the newly flushed file on scanner reset on flush
- Addendum (Ram)
2015-12-15 10:34:25 +05:30
Jonathan M Hsieh 10d86c7dae HBASE-14929 There is a space missing from table "foo" is not currently available (Carlos A. Morillo) 2015-12-14 16:07:05 -08:00
chenheng 04622254f7 HBASE-14936 CombinedBlockCache should overwrite CacheStats#rollMetricsPeriod() (Jianwei Cui) 2015-12-14 17:20:50 +08:00
ramkrishna 555d9b70bd HBASE-14895 Seek only to the newly flushed file on scanner reset on flush
(Ram)
2015-12-14 10:13:53 +05:30
stack f34d3e1d26 HBASE-14701 Fix flakey Failed tests: TestMobFlushSnapshotFromClient>TestFlushSnapshotFromClient.testSkipFlushTableSnapshot:199 null (Jingcheng Du) 2015-12-12 19:34:23 -08:00
Ashu Pachauri 453a66c3b9 HBASE-14953 Replication: retry on RejectedExecutionException
In HBaseInterClusterReplicationEndpoint, we fail the whole batch
in case of a RejectedExecutionException on an individual sub-batch.
We should let the submitted sub-batches finish and retry only for
the remaining ones.

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-11 13:15:22 -08:00
Enis Soztutar cff664c5e2 HBASE-14960 Fallback to using default RPCControllerFactory if class cannot be loaded 2015-12-10 19:11:57 -08:00
Elliott Clark 48e217a7db HBASE-14946 Don't allow multi's to over run the max result size.
Summary:
* Add VersionInfoUtil to determine if a client has a specified version or better
* Add an exception type to say that the response should be chunked
* Add on client knowledge of retry exceptions
* Add on metrics for how often this happens

Test Plan: Added a unit test

Differential Revision: https://reviews.facebook.net/D51771
2015-12-10 18:10:32 -08:00
stack c15e0af84a HBASE-14906 Improvements on FlushLargeStoresPolicy (Yu Li) 2015-12-10 16:49:23 -08:00
stack bebcc09fb3 HBASE-14769 Remove unused functions and duplicate javadocs from HBaseAdmin 2015-12-10 15:02:21 -08:00
Nate Edel 9511150bd6 HBASE-14901 Remove duplicate code to create/manage encryption keys
Signed-off-by: Gary Helmling <garyh@apache.org>
2015-12-10 14:38:43 -08:00
ramkrishna 26ac60b03f HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi) 2015-12-10 13:07:46 +05:30
Gary Helmling c1e0fcc26d HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection 2015-12-09 15:52:27 -08:00
Elliott Clark ba3aa9a9b1 HBASE-14942 Allow turning off BoundedByteBufferPool 2015-12-09 15:29:25 -08:00
tedyu 0e147a9d6e HBASE-14954 IllegalArgumentException was thrown when doing online configuration change in CompactSplitThread (Victor Xu) 2015-12-09 07:18:08 -08:00
Lars Hofhansl 7bfbb6a3c9 HBASE-14869 Better request latency and size histograms. (Vikas Vishwakarma and Lars Hofhansl) 2015-12-08 17:02:27 -08:00
Mikhail Antonov 2430efc2b2 HBASE-7171 Initial web UI for region/memstore/storefiles details 2015-12-08 13:53:21 -08:00
Vrishal Kulkarni 1f999c1e2b HBASE-14719 Add metrics for master WAL count (numMasterWALs). Metric numMasterWALs appears as follows in metrics dump
{
    "name" : "Hadoop:service=HBase,name=Master,sub=Procedure",
    "modelerType" : "Master,sub=Procedure",
    "tag.Context" : "master",
    "tag.Hostname" : "vrishal-mbp",
    "numMasterWALs" : 1
},

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-12-07 11:14:29 -08:00
Andrew Purtell c9a0148628 HBASE-14923 VerifyReplication should not mask the exception during result comparison (Vishal Khandelwal) 2015-12-04 18:53:05 -08:00
Elliott Clark cd5ddc5fec HBASE-14922 Delayed flush doesn't work causing flush storms. 2015-12-04 16:54:01 -08:00
stack c6b8e6f1ac HBASE-14907 NPE of MobUtils.hasMobColumns in Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513 (Jingcheng Du)
Put back HBASE-14907 but with right JIRA number (by doing a revert of a revert)

This reverts commit 35a7b56e53.
2015-12-04 16:40:27 -08:00
stack a4a44587b3 Revert "Revert "HBASE-14909 NPE testing for RIT""
Reverted the wrong patch... putting it back (revert of a revert)

This reverts commit 157a60f1b3.
2015-12-04 16:38:33 -08:00
stack 157a60f1b3 Revert "HBASE-14909 NPE testing for RIT"
This reverts commit da0cc598fe.
2015-12-04 16:37:14 -08:00
stack 35a7b56e53 Revert "HBASE-4907 NPE of MobUtils.hasMobColumns in Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513 (Jingcheng Du)"
Revert because I pitched this against the wrong JIRA number!

This reverts commit 03e4712f0c.
2015-12-04 16:36:46 -08:00
stack 03e4712f0c HBASE-4907 NPE of MobUtils.hasMobColumns in Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513 (Jingcheng Du) 2015-12-04 10:53:09 -08:00
ramkrishna 8b3d1f1444 HBASE-13082 Coarsen StoreScanner locks to RegionScanner (Ram) 2015-12-04 10:20:46 +05:30
Enis Soztutar b3260423b1 HBASE-14904 Mark Base[En|De]coder LimitedPrivate and fix binary compat issue 2015-12-03 18:18:20 -08:00
stack 51503efcf0 HBASE-13857 Slow WAL Append count in ServerMetricsTmpl.jamon is hardcoded to zero (Vrishal Kulkarni) 2015-12-03 17:00:29 -08:00
tedyu 67ba6598b1 HBASE-14905 VerifyReplication does not honour versions option (Vishal Khandelwal) 2015-12-03 16:09:22 -08:00
Enis Soztutar bbd53b846e Revert "HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts"
This reverts commit 756e6de2a0.
2015-12-03 13:28:33 -08:00
stack 91945d7f49 HBASE-14749 Make changes to region_mover.rb to use RegionMover Java tool (Abhishek Singh Chouhan) 2015-12-02 18:14:10 -08:00
stack da0cc598fe HBASE-14909 NPE testing for RIT 2015-12-02 10:37:32 -08:00
stack 08f90f30b3 HBASE-14908 TestRowCounter flakey especially on branch-1 2015-12-02 10:19:13 -08:00
ramkrishna aa41232a87 HBASE-14832 Ensure write paths work with ByteBufferedCells in case of
compaction (Ram)
2015-12-02 10:28:30 +05:30
tedyu d8b30b8925 HBASE-14575 Relax region read lock for compactions (Nick and Ted) 2015-12-01 16:44:59 -08:00
stack 92e178df28 Revert "HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)"
Reverting. The conversation on issues to do with this patch was not done (Appy brought it to my attention).

This reverts commit 6adce67572.
2015-12-01 11:30:39 -08:00
stack a7673ed755 HBASE-14896 Resolve Javadoc warnings in WALKey and RegionMover 2015-12-01 09:35:15 -08:00
Apekshit(Appy) Sharma 6adce67572 HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-30 20:44:11 -08:00
chenheng 47082579a8 HBASE-14897 TestTableLockManager.testReapAllTableLocks is flakey 2015-12-01 10:31:00 +08:00
Enis Soztutar 756e6de2a0 HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts 2015-11-30 16:48:52 -08:00
chenheng 999ae69155 HBASE-14891 Add log for uncaught exception in RegionServerMetricsWrapperRunnable(Yu Li) 2015-11-30 22:30:09 +08:00
Apekshit 3bac31b2a4 HBASE-14890 Fix broken checkstyle tool. Some javadocs had parsing errors because of wrongly formatted HTML tags. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-28 21:57:52 -08:00
tedyu 2317ec583d HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:08:38 -08:00
tedyu 001eb0694a HBASE-14893 Race between mutation on region and region closing operation leads to NotServingRegionException 2015-11-27 15:32:05 -08:00
chenheng b280a41ba6 HBASE-14884 TestSplitTransactionOnCluster.testSSHCleanupDaugtherRegionsOfAbortedSplit is flakey 2015-11-27 11:24:15 +08:00
rahulgidwani 0d72849581 HBASE-14355 Scan different TimeRange for each column family - fixing memstore bug
Signed-off-by: stack <stack@apache.org>
2015-11-25 22:01:32 -08:00
Lars Hofhansl 6531b465a7 HBASE-14777 second addendum, better fix using CompletionService. 2015-11-25 21:17:56 -08:00
tedyu e73a9594c2 HBASE-14885 NullPointerException in HMaster#normalizeRegions() due to missing TableDescriptor 2015-11-25 16:06:27 -08:00
Enis Soztutar 90bdb0dc74 HBASE-14689 Addendum and unit test for HBASE-13471 2015-11-24 19:15:09 -08:00
tedyu 1178c4b89b HBASE-14861 HBASE_ZNODE_FILE on master server is overwritten by regionserver process in case of master-rs collocation (Samir Ahmic) 2015-11-24 15:02:47 -08:00
Daniel Vimont 6a493ddff7 Commit for HBASE-14825 -- corrections of typos, misspellings, and mangled links
Commit for HBASE-14825 -- corrections of typos, misspellings, and mangled links - addition commit for line lengths
2015-11-25 07:12:36 +10:00
Gary Helmling 8b67df6948 HBASE-14821 Allow configuration overrides in TableOutputFormat 2015-11-24 12:13:51 -08:00
ramkrishna afc5439be5 HBASE-14826 Small improvement in KVHeap seek() API (Ram) 2015-11-24 10:17:28 +05:30
anoopsjohn daba867734 HBASE-13347 Deprecate FirstKeyValueMatchingQualifiersFilter. (Abhishek) 2015-11-24 09:50:56 +05:30
tedyu 9a91f5ac81 HBASE-14737 Clear cachedMaxVersions when HColumnDescriptor#setValue(VERSIONS, value) is called (Pankaj Kumar) 2015-11-23 20:13:00 -08:00
stack 52edd83baf HBASE-14807 TestWALLockup is flakey Second attempt at stabilizing this test.
Patch includes loosening of the test so we continue when threads
run in not-expected order. Also includes minor clean ups in
FSHLog -- a formatting change, removal of an unused trace logging,
and a check so we don't create a new exception when not needed --
but it also includes a subtle so we check if we need to get to safe
point EVEN IF an outstanding exception. Previous we could by-pass
the safe point check. This should make us even more robust against
lockup (though this is a change that comes of code reading, not of
any issue seen in test).

Here is some detail on how I loosened the test:

The test can run in an unexpected order. Attempts at dictating the
order in which threads fire only had me deadlocking one latch
against another (the test latch vs the WAL zigzag latch) so I
gave up trying and instead, if we happen to go the unusual route of
rolling WALs and failing flush before the scheduled log roll
latch goes into place, just time out the run after a few seconds
and exit the test (but do not fail it); just log a WARN.

This is less than ideal but allows us keep some coverage of the
tricky scenario that was bringing on deadlock (a broken WAL that
is throwing exceptions getting stuck waiting on a sync to clear
out the ring buffer getting overshadowed by a subsequent append
added in by a concurrent flush).
2015-11-20 12:06:48 -08:00
ramkrishna 86be690b07 HBASE-14840 Sink cluster reports data replication request as success
though the data is not replicated (Ashish Singhi)
2015-11-20 15:57:10 +05:30
Ashu Pachauri 8dbbe96e04 HBASE-14777 ADDENDUM Fix failing TestReplicationEndpoint test
Signed-off-by: stack <stack@apache.org>
2015-11-20 00:10:03 -06:00
Sean Busbey 3a1874f5c4 Revert "Fix failing TestReplicationEndpoint test"
This reverts commit f0dc556b71.
2015-11-20 00:09:46 -06:00
Ashu Pachauri f0dc556b71 Fix failing TestReplicationEndpoint test
Signed-off-by: stack <stack@apache.org>
2015-11-19 13:26:13 -08:00
ramkrishna c92737c0e9 HBASE-14761 Deletes with and without visibility expression do not delete
the matching mutation (Ram)
2015-11-19 11:21:50 +05:30
Enis Soztutar cf81b45f37 HBASE-14468 Compaction improvements: FIFO compaction policy (Vladimir Rodionov) 2015-11-18 19:33:11 -08:00
chenheng ebe5801e00 HBASE-14782 FuzzyRowFilter skips valid rows (Vladimir Rodionov) 2015-11-19 11:28:18 +08:00
Ashu Pachauri c8fbaf0c96 HBASE-14777 Fix Inter Cluster Replication Future ordering issues
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-11-18 16:38:41 -08:00
tedyu d738aade2e HBASE-14824 HBaseAdmin.mergeRegions should recognize both full region names and encoded region names (Eungsop Yoo) 2015-11-18 14:24:47 -08:00
stack b2187c31ab HBASE-14815 TestMobExportSnapshot.testExportFailure timeout occasionally (Heng Chen) 2015-11-18 09:05:50 -08:00
Enis Soztutar 5ebd7660a9 Revert "HBASE-14689 Addendum and unit test for HBASE-13471"
This reverts commit 4c04e8065f.
2015-11-17 20:36:18 -08:00
tedyu 1b13bfcd43 HBASE-14771 RpcServer#getRemoteAddress always returns null (Abhishek Kumar) 2015-11-17 18:46:08 -08:00
Elliott Clark a48d30984a HBASE-14793 Allow limiting size of block into L1 block cache. 2015-11-17 10:37:49 -08:00
tedyu f218e499ae HBASE-14809 Grant / revoke Namespace admin permission to group 2015-11-16 09:27:32 -08:00
stack dd5f454b03 HBASE-14802 Replaying server crash recovery procedure after a failover causes incorrect handling of deadservers; Reapply of slightly different patch... see issue 2015-11-15 14:47:07 -08:00
stack bb6581345f Revert "HBASE-14802 Replaying server crash recovery procedure after a failover causes incorrect handling of deadservers"
This reverts commit 7c3c9ac9c6.
2015-11-14 16:59:35 -08:00
stack 43506320a1 HBASE-14798 NPE reporting server load causes regionserver abort; causes TestAcidGuarantee to fail 2015-11-14 09:07:39 -08:00
stack 1fa7b71cf8 HBASE-14807 TestWALLockup is flakey 2015-11-13 22:40:27 -08:00
stack 7c3c9ac9c6 HBASE-14802 Replaying server crash recovery procedure after a failover causes incorrect handling of deadservers 2015-11-13 22:06:23 -08:00
stack 290ecbe829 HBASE-14355 Scan different TimeRange for each column family (Churro Morales) 2015-11-12 10:54:16 -10:00
Jerry He 1f62a48728 HBASE-13982 Add info for visibility labels/cell TTLs to ImportTsv (NIDHI GAMBHIR) 2015-11-10 22:10:13 -08:00
tedyu ffb1e78c08 HBASE-14788 Splitting a region does not support the hbase.rs.evictblocksonclose config when closing source region 2015-11-10 18:35:00 -08:00
stack e82ccb900e HBASE-14794 Cleanup TestAtomicOperation
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMetaWithReplicas.java
  Fix a few missing table closes (This suite seems to leave loads of threads
  when test is done but have not figured the how yet).

hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
  Fix some missing table closes. We were leaving around client
  resources.

hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
  Close up WALs when done.
2015-11-10 15:08:18 -10:00
tedyu 867a5ea188 HBASE-14766 In WALEntryFilter, cell.getFamily() needs to be replaced with the new low-cost implementation (huaxiang sun) 2015-11-10 14:18:59 -08:00
Matteo Bertozzi 24580ace5e HBASE-14786 TestProcedureAdmin hangs 2015-11-10 13:15:25 -08:00
Elliott Clark ea795213b2 HBASE-14778 Make block cache hit percentages not integer in the metrics system 2015-11-10 12:25:59 -08:00
stack 1a6ec1bac6 HBASE-14784 Port conflict is not resolved in HBaseTestingUtility.randomFreePort() (Youngjoon Kim) 2015-11-10 09:53:30 -10:00
Enis Soztutar 23ec9e290e HBASE-14387 Compaction improvements: Maximum off-peak compaction size (Vladimir Rodionov) 2015-11-10 11:26:52 -08:00
stack 32de06f663 HBASE-14787 Remove obsolete ConnectionImplementation.refCount (Appy) 2015-11-09 17:08:17 -10:00
chenheng 086bacd12d HBASE-14693 Add client-side metrics for received pushback signals
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-11-09 18:03:30 -08:00
tedyu 6b9d30d913 HBASE-14784 Port conflict is not resolved in HBaseTestingUtility.randomFreePort() (Youngjoon Kim) 2015-11-08 08:50:41 -08:00
Apekshit(Appy) Sharma 08963189a2 HBASE-14767 - Remove deprecated functions from HBaseAdmin Deprecated in HBASE-12083 (1.0.0, 2.0.0, 0.99.2) - HBaseAdmin(Configuration)
Deprecated in HBASE-10479 (0.99.0, hbase-10070)
  - HBaseAdmin(Connection)

  Deprecated in HBASE-11826 (0.99.0, 1.0.0, 2.0.0)
  - flush()
  - compact()
  - majorCompact()
  - split()
  - getCompactionState()

- Changes many declarations from HBaseAdmin to Admin
(Apekshit)

Signed-off-by: stack <stack@apache.org>
2015-11-06 16:23:55 -10:00
zhangduo 9cce912de0 HBASE-14759 Avoid using Math.abs when selecting SyncRunner in FSHLog 2015-11-07 08:44:25 +08:00
tedyu 263a0adf79 HBASE-14463 Severe performance downgrade when parallel reading a single key from BucketCache (Yu Li) 2015-11-06 13:12:10 -08:00
tedyu 6ec4a96814 HBASE-14632 Region server aborts due to unguarded dereference of Reader 2015-11-06 12:06:19 -08:00
Misty Stanley-Jones bfa3689190 HBASE-14755 Fix some broken links and HTML problems 2015-11-06 11:11:30 +10:00
Elliott Clark 86da57f498 HBASE-14765 Remove snappy profile 2015-11-05 10:20:40 -08:00
Jonathan M Hsieh 48be35cb7e HBASE-14713 Remove simple deprecated-since-1.0 code in hbase-server from hbase 2.0 2015-11-04 15:28:06 -08:00
tedyu 9fc7858c6b HBASE-14706 RegionLocationFinder should return multiple servernames by top host (Guanghao Zhang) 2015-11-04 14:20:34 -08:00
stack ceddec9141 HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets 2015-11-03 20:47:20 -08:00
chenheng 6871724104 HBASE-12986 Compaction pressure based client pushback
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-11-03 18:32:08 -08:00
Misty Stanley-Jones c575e18ab8 HBASE-14481 Deprecate HBase Wiki
We have an awesome community resource in our online book. It's maintained and looked after with
diligence. We also have an HBase section on the hadoop wiki that hasn't been updated since 2012.
Let's sift through the pages of the wiki, bring over any content that's still relevant and
not already present in the book, and kill the wiki.
2015-11-04 09:09:02 +10:00
Elliott Clark ca4d27c700 HBASE-14742 Fix TestHeapMemoryManager being flakey 2015-11-02 17:01:40 -08:00
stack f0176d942a HBASE-13014 Java Tool For Region Moving (Abhishek Singh Chouhan) 2015-11-02 13:45:41 -08:00
stack 87cc38f9ab Revert "HBASE-13014 Java Tool For Region Moving"
Breaks the build. I applied wrong patch?

This reverts commit a9a56ad508.
2015-11-02 13:31:34 -08:00
stack a9a56ad508 HBASE-13014 Java Tool For Region Moving 2015-11-02 10:20:38 -08:00
stack 9630fec2d5 Revert "HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets"
Revert. Seems to have destabilized the build

This reverts commit 6dbb5a8052.
2015-11-02 08:17:41 -08:00
stack 6c5da91b18 HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan) -- REAPPLY 2015-11-02 08:08:01 -08:00
stack 950050e9d6 Revert "HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan)"
Revert because I overcommitted, included files from another patch.

This reverts commit 47659200ac.
2015-11-02 08:06:34 -08:00
stack 6dbb5a8052 HBASE-14725 Vet categorization of tests so they for sure go into the right small/medium/large buckets 2015-11-01 22:26:43 -08:00
stack 47659200ac HBASE-14728 TestRowCounter is broken in master (Abhishek Singh Chouhan) 2015-11-01 22:22:59 -08:00
Jonathan M Hsieh 4c25549e9f HBASE-14711 Remove or annotate deprecated methods in HRegionInfo 2015-11-01 04:29:51 -08:00
Gary Helmling 683f84e6a2 HBASE-14700 Support a permissive mode for secure clusters to allow SIMPLE auth clients 2015-10-30 19:45:46 -07:00
anoopsjohn b0ad82191c HBASE-14557 MapReduce WALPlayer issue with NoTagsKeyValue. 2015-10-30 21:18:09 +05:30
anoopsjohn 23fa18184c HBASE-14721 Memstore add cells - Avoid many garbage. 2015-10-30 18:39:42 +05:30
stack 84f4cceb48 HBASE-14650 Reenable TestNamespaceAuditor (Heng Chen) 2015-10-29 21:44:23 -07:00
stack eb4e2ee9e2 Revert "HBASE-13014 Java Tool For Region Moving (Abhishek Singh Chouhan)"
This reverts commit 939697b415.
2015-10-29 16:51:00 -07:00
Matteo Bertozzi 4b91a6425e HBASE-14714 some cleanup to snapshot code 2015-10-29 13:48:59 -07:00
Jonathan M Hsieh 094d65e6f5 HBASE-14673 Exorcise deprecated Delete#delete* api 2015-10-29 11:15:34 -07:00
Jonathan M Hsieh de9555cec4 HBASE-14675 Exorcise deprecated Put#add(...) and replace with Put#addColumn(...) 2015-10-29 11:15:31 -07:00
stack 452e38ff80 HBASE-14720 Make TestHCM and TestMetaWithReplicas large tests rather than mediums 2015-10-29 10:28:40 -07:00
stack 2288742c10 HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs; REMOVED TestWALSplitCompressed and TestWALSplit 2015-10-28 21:59:18 -07:00
stack 273beceae2 HBASE-14710 Add category-based timeouts to MR tests 2015-10-28 16:35:41 -07:00
stack 4b018d2a39 HBASE-14701 Fix flakey Failed tests: TestMobFlushSnapshotFromClient>TestFlushSnapshotFromClient.testSkipFlushTableSnapshot:199 null; DISABLING 2015-10-28 10:56:37 -07:00
ramkrishna 51538c5ff8 HBASE-14660 AssertionError found when using offheap BucketCache with
assertion enabled (ram)
2015-10-28 15:20:41 +05:30
ramkrishna bae94ca972 HBASE-14529 - Addendum to avoid SIGHUP call for WINDOWS OS 2015-10-28 11:52:20 +05:30
tedyu 210c3dd937 HBASE-12769 Replication fails to delete all corresponding zk nodes when peer is removed (Jianwei Cui) 2015-10-27 19:40:40 -07:00
Misty Stanley-Jones e24d03b10c HBASE-14695 Fix some easy HTML warnings and bad links 2015-10-28 12:12:40 +10:00
Andrew Purtell 939697b415 HBASE-13014 Java Tool For Region Moving (Abhishek Singh Chouhan) 2015-10-27 22:46:15 +00:00
Enis Soztutar d5d81d675a HBASE-14674 Rpc handler / task monitoring seems to be broken after 0.98 (Heng Chen) 2015-10-27 14:59:29 -07:00
Enis Soztutar 16ff57bea9 HBASE-14680 Two configs for snapshot timeout and better defaults (Heng Chen) 2015-10-27 14:01:01 -07:00
Matteo Bertozzi c91bfff586 HBASE-14688 Cleanup MOB tests 2015-10-27 11:37:39 -07:00
tedyu e04e7402cd HBASE-14655 Addendum passes User to store#compact() 2015-10-27 11:17:30 -07:00
anoopsjohn 4269c7fe69 HBASE-14257 Periodic flusher only handles hbase:meta, not other system tables. (Abhishek) 2015-10-27 11:52:03 +05:30
stack ac746e0905 HBASE-14702 TestZKProcedureControllers.testZKCoordinatorControllerWithSingleMemberCohort is a flakey 2015-10-26 22:35:22 -07:00
stack 496d20cfca HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs; ADDENDUM 2015-10-26 20:21:01 -07:00
Ben Lau 5c56e239c3 HBASE-14283 Reverse scan doesn’t work with HFile inline index/bloom blocks
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-10-26 15:12:21 -07:00
Andrew Purtell efb82957da HBASE-13318 RpcServer.getListenerAddress should handle when the accept channel is closed 2015-10-26 15:11:12 -07:00
stack 928dade1da HBASE-14661 RegionServer link is not opening, in HBase Table page (Y. SREENIVASULU REDDY) 2015-10-26 14:57:28 -07:00
stack d0944f8219 HBASE-14698 Set category timeouts on TestScanner and TestNamespaceAuditor; ADDENDUM 2015-10-26 13:28:41 -07:00
stack 0f6ec611e6 HBASE-14698 Set category timeouts on TestScanner and TestNamespaceAuditor 2015-10-26 13:05:58 -07:00
Enis Soztutar 4c04e8065f HBASE-14689 Addendum and unit test for HBASE-13471 2015-10-26 11:56:51 -07:00
stack 899857609c HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests; REAPPLY 2015-10-26 08:40:32 -07:00
stack 46c646d615 HBASE-14648 Reenable TestWALProcedureStoreOnHDFS#testWalRollOnLowReplication (Heng Chen) 2015-10-24 20:55:47 -07:00
tedyu 95978477f8 HBASE-14624 BucketCache.freeBlock is too expensive 2015-10-24 18:45:21 -07:00
stack f8528f66ec HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs; ADD TestDistributedLogSplitting to the mix; ADDENDUM added TestMobSnapshotCloneIndependence to removed set of dodgy tests 2015-10-24 17:42:16 -07:00
stack 996866d3ae HBASE-14266 RegionServers have a lock contention of Configuration.getProps 2015-10-24 14:43:53 -07:00
stack df36aef23c HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs; ADD TestDistributedLogSplitting to the mix; ADDENDUM added TestSnapshotCloneIndependence to removed set of dodgy tests 2015-10-24 14:26:39 -07:00
stack 80a6fd01a1 HBASE-14676 HBaseTestCase clean out: Purge Incommon Interface and Table and Region implementations: ADDENDUM -- forgot to add file 2015-10-24 11:09:18 -07:00
Elliott Clark 9925e9a182 HBASE-14690 Fix css so there's no left/right scroll bar 2015-10-24 10:27:12 -07:00
stack 604ff56ef3 HBASE-14676 HBaseTestCase clean out: Purge Incommon Interface and Table and Region implementations 2015-10-24 10:20:52 -07:00
Elliott Clark caae3b2e5f HBASE-14683 Fix Batching in buffered mutator is awful when adding lists of mutations.
Summary: Send the list of mutations to AsyncProcess only after done adding the list otherwise there's a lot of contention

Test Plan: UnitTests.

Differential Revision: https://reviews.facebook.net/D49251
2015-10-24 10:05:39 -07:00
stack f9efeaad1d Revert "HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests (Heng Chen)"
This reverts commit ef7f8467af.
2015-10-24 10:00:27 -07:00
Jonathan M Hsieh 418c4422f7 HBASE-14670 Remove deprecated HBaseTestCase from TestBlocksRead 2015-10-24 05:35:00 -07:00
Lars George 6875e6d4d4 HBASE-14343 Fix debug message in SimpleRegionNormalizer for small regions (Lars Francke) 2015-10-24 11:19:32 +02:00
tedyu 8b7796b0b6 HBASE-14655 Narrow the scope of doAs() calls to region observer notifications for compaction 2015-10-23 14:48:04 -07:00
Ashish Singhi f34011860e HBASE-14685 Procedure Id is not set for MasterRpcServices#modifyTable
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-10-23 11:37:10 -07:00
stack ef7f8467af HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests (Heng Chen) 2015-10-23 11:29:48 -07:00
stack 129c48430e HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs; ADD TestDistributedLogSplitting to the mix 2015-10-22 17:01:58 -07:00
stack c21e8ed1d8 HBASE-14657 Remove unneeded API from EncodedSeeker (Heng Chen) 2015-10-22 14:20:28 -07:00
Ashish Singhi 467bc098a9 HBASE-13538 Procedure v2 - client add/delete/modify column family sync (incompatible with branch-1.x)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-10-22 13:12:35 -07:00
stack 93023f544b HBASE-14678 Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs 2015-10-22 12:31:04 -07:00
Matteo Bertozzi 619a240ebd HBASE-14667 HBaseFsck constructors have diverged 2015-10-22 09:28:33 -07:00
Matteo Bertozzi 36a196722c HBASE-14669 remove unused import and fix javadoc 2015-10-22 09:25:26 -07:00
stack ab677a19fc HBASE-14663 HStore::close does not honor config hbase.rs.evictblocksonclose (Vladimir Rodionov) 2015-10-21 21:57:41 -07:00
Jonathan M Hsieh f9df3e9229 HBASE-14671 Remove deprecated HBaseTestCase/Put/Delete apis from TestGetClosestAtOrBefore 2015-10-21 21:56:54 -07:00
stack 81e2aba1f9 HBASE-14662 Fix NPE in HFileOutputFormat2 (Heng Chen) 2015-10-21 21:48:47 -07:00
Jonathan M Hsieh 5363f371bb HBASE-14666 Remove deprecated HBaseTestingUtility#deleteTable(...) methods 2015-10-21 21:34:23 -07:00
Jonathan M Hsieh 7b73899e95 HBASE-14665 Remove deprecated HBaseTestingUtility#createTable methods 2015-10-21 21:28:27 -07:00
Jonathan M Hsieh 39521068e8 HBASE-14668 Remove deprecated HBaseTestCase dependency from TestHFile 2015-10-21 21:04:11 -07:00
stack b3afdb8de1 HBASE-14427 Fix 'should' assertions in TestFastFail (Abhishek Singh Chouhan) 2015-10-21 09:53:27 -07:00
ramkrishna 6e3b7af0ef HBASE-14643 - Avoid Splits from once again opening a closed reader for
fetching the first and last key (Heng Chen)
2015-10-21 10:12:38 +05:30
Elliott Clark 5a5b854c2a HBASE-14633 Try fluid width UI 2015-10-20 17:45:47 -07:00
stack a532ed73d8 HBASE-14634 Disable flakey TestSnapshotCloneIndependence.testOnlineSnapshotDeleteIndependent; ADDENDUM 2015-10-20 12:19:10 -07:00
tedyu 6046596403 HBASE-14604 Improve MoveCostFunction in StochasticLoadBalancer (Guanghao Zhang) 2015-10-20 02:35:40 -07:00
anoopsjohn c9523a569d HBASE-14636 Clear HFileScannerImpl#prevBlocks in between Compaction flow. 2015-10-20 13:06:09 +05:30
stack c1f0442045 HBASE-14647 Disable TestWALProcedureStoreOnHDFS#testWalRollOnLowReplication 2015-10-19 10:39:09 -07:00
stack ea0cf399b4 HBASE-14646 Move TestCellACLs from medium to large category 2015-10-19 10:34:55 -07:00
Matteo Bertozzi fb583dd1ea HBASE-14541 TestHFileOutputFormat.testMRIncrementalLoadWithSplit failed due to too many splits and few retries 2015-10-19 09:22:59 -07:00
tedyu 57fea77074 HBASE-14631 Region merge request should be audited with request user through proper scope of doAs() calls to region observer notifications 2015-10-19 08:41:16 -07:00
stack f1b6355fc5 HBASE-14642 Disable flakey TestMultiParallel#testActiveThreadsCount 2015-10-18 20:17:01 -07:00
stack 71b38d60bb HBASE-14637 Loosen TestChoreService assert AND have TestDataBlockEncoders do less work (and add timeouts) 2015-10-17 16:14:45 -07:00
stack d9ee191318 HBASE-14634 Disable flakey TestSnapshotCloneIndependence.testOnlineSnapshotDeleteIndependent 2015-10-16 21:14:49 -07:00
Ashu Pachauri 6774f223a4 HBASE-14621 ReplicationLogCleaner stuck on RS crash.
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-10-16 15:26:02 -07:00
Elliott Clark 0ed8b0e5d5 HBASE-14597 Fix Groups cache in multi-threaded env 2015-10-16 15:15:26 -07:00
tedyu 4321b63f6f HBASE-14605 Split fails due to 'No valid credentials' error when SecureBulkLoadEndpoint#start tries to access hdfs 2015-10-16 02:18:47 -07:00
Nicolas Liochon e7defd7d9a HBASE-14521 Unify the semantic of hbase.client.retries.number (Yu Li) 2015-10-15 10:42:40 +02:00
stack d6f3dae7e7 HBASE-14608 testWalRollOnLowReplication has some risk to assert failed after HBASE-14600 (Heng Chen) 2015-10-14 23:02:17 -07:00
stack 58e3e96dbd HBASE-14600 Make #testWalRollOnLowReplication looser still; ADDENDUM 2015-10-14 17:46:41 -07:00
stack 658d25af25 HBASE-14570 Split TestHBaseFsck in order to help with hanging tests: ADDENDUM ADDING LICENSE 2015-10-14 17:02:46 -07:00
tedyu 8c69b0f751 HBASE-14594 Use new DNS API introduced in HADOOP-12437 (Josh Elser) 2015-10-14 14:17:36 -07:00
Elliott Clark fbd2ed2e02 HBASE-14570 Split TestHBaseFsck in order to help with hanging tests 2015-10-14 16:57:41 -04:00
stack 94ce2ed2f9 HBASE-14606 TestSecureLoadIncrementalHFiles tests timed out in trunk build on apache 2015-10-14 09:29:20 -07:00
stack 4850757386 HBASE-14569 Disable hanging test TestNamespaceAuditor 2015-10-13 23:42:29 -07:00
Liu Shaohui 0e41dc18c0 HBASE-14591 Region with reference hfile may split after a forced split in IncreasingToUpperBoundRegionSplitPolicy 2015-10-14 10:14:50 +08:00
stack e6a271a4fb HBASE-14596 TestCellACLs failing... on1.2 builds; FIX 2015-10-13 17:14:12 -07:00
stack 1458798eb5 HBASE-14600 Make #testWalRollOnLowReplication looser still 2015-10-13 15:50:28 -07:00
stack 874437cc58 HBASE-14596 TestCellACLs failing... on1.2 builds; TUNEUP -- ADD DEBUG INFO 2015-10-13 13:33:35 -07:00
Nicolas Liochon 657078b353 HBASE-14580 Make the HBaseMiniCluster compliant with Kerberos 2015-10-13 11:33:40 +02:00
stack a45cb72ef2 HBASE-14588 Stop accessing test resources from within src folder (Andrew Wang) 2015-10-12 23:10:06 -07:00
stack 2428c5f467 HBASE-14596 TestCellACLs failing... on1.2 builds; TUNEUP 2015-10-12 22:50:48 -07:00
Enis Soztutar 2ff6d0fe47 HBASE-14501 NPE in replication with TDE 2015-10-12 20:37:34 -07:00
stack df9ff9f1e9 HBASE-14587 Attach a test-sources.jar for hbase-server (Andrew Wang) 2015-10-12 13:59:56 -07:00
Elliott Clark 6db1134cb7 HBASE-14211 Add more rigorous integration tests of splits
Summary:
Intgration tests don't currently have a lot of splits going on while there is IO.
This changes that by changing the split aglorithm and the max region hfile size. That should make things split more.

Additionally this allows ITBLL to start with just one region if hbase.test.pre-split-table is False.

Test Plan: Test on a cluster with ITBLL slow determinitic monkey and stress am monkey.

Differential Revision: https://reviews.facebook.net/D44181
2015-10-12 13:25:15 -07:00
stack 1aab391424 HBASE-14582 Regionserver status webpage bucketcache list can become huge 2015-10-12 12:45:40 -07:00
Elliott Clark 4d1d88aa15 HBASE-14585 Clean up TestSnapshotCloneIndependence 2015-10-12 11:21:59 -07:00
stack 587f5bc11f HBASE-14567 Tuneup hanging test TestMobCompactor and TestMobSweeper; ADDENDUM (jingcheng du) 2015-10-10 13:31:17 -07:00
tedyu f135912912 HBASE-14578 URISyntaxException during snapshot restore for table with user defined namespace (Pankaj Kumar) 2015-10-10 01:50:56 -07:00
anoopsjohn 4969879df5 HBASE-14366 NPE in case visibility expression is not present in labels table during importtsv run. (Bhupendra) 2015-10-10 12:04:47 +05:30
stack 2e593a9d38 HBASE-13858 RS/MasterDumpServlet dumps threads before its “Stacks” header 2015-10-09 15:46:22 -07:00
stack 445dbd8a0e HBASE-14517 Show regionserver's version in master status page (Liu Shaohui) 2015-10-09 15:06:39 -07:00
stack 2e8e32f746 HBASE-14567 Disable hanging test TestMobCompactor and TestMobSweeper 2015-10-09 14:37:11 -07:00
anoopsjohn 79607bd9f8 HBASE-14525 Append and increment operation throws NullPointerException on non-existing column families.(Abhishek) 2015-10-09 20:52:42 +05:30
Elliott Clark a77f830198 HBASE-14529 Respond to SIGHUP to reload config
Summary: Add a signal handler to reload the config.

Test Plan: Send the command and see that configs get reloaded.

Differential Revision: https://reviews.facebook.net/D47877
2015-10-08 16:38:18 -07:00
tedyu c8e280ec88 HBASE-14565 Make ZK connection timeout configurable in MiniZooKeeperCluster 2015-10-08 14:35:38 -07:00
stack 12cc2005c1 HBASE-14574 TableOutputFormat#getRecordWriter javadoc misleads 2015-10-08 13:02:59 -07:00
Nick Dimiduk 7e30436e3f HBASE-12911 Client-side metrics 2015-10-07 17:01:56 -07:00
stack d80c7e95ec HBASE-14572 TestImportExport#testImport94Table can't find its src data file 2015-10-06 23:28:13 -07:00
stack 298721b259 HBASE-14502 Purge use of jmock and remove as dependency (Gabor Liptak) 2015-10-06 23:09:50 -07:00
stack 406cb58acd HBASE-14571 Purge TestProcessBasedCluster; it does nothing and then fails 2015-10-06 22:49:22 -07:00
stack 0ea1f81227 HBASE-14436 HTableDescriptor#addCoprocessor will always make RegionCoprocessorHost create new Configuration 2015-10-06 14:00:20 -07:00
stack 8fcc815504 HBASE-14563 Disable zombie TestHFileOutputFormat2 2015-10-06 13:37:10 -07:00
tedyu 23079c02bf HBASE-14520 Optimize the number of calls for tags creation in bulk load (Bhupendra Kumar Jain) 2015-10-06 06:43:30 -07:00
Stephen Yuan Jiang ed4c734b15 HBASE-14432 Procedure V2 - enforce ACL on procedure admin tasks (Stephen Yuan Jiang 2015-10-05 20:07:21 -07:00
Elliott Clark 39042b6a07 HBASE-14555 Fix Deadlock in MVCC branch-1.2 toString() 2015-10-05 17:50:22 -07:00
Matteo Bertozzi dd955fa417 HBASE-14547 Add more debug/trace to zk-procedure 2015-10-04 20:55:31 -07:00
Mikhail Antonov 19045a5ea7 HBASE-14367 Add normalization support to shell 2015-10-04 00:29:39 -07:00
stack c5a9895ada HBASE-14545 TestMasterFailover often times out 2015-10-03 13:31:59 -07:00
Lars Hofhansl 3b8039ed0f HBASE-14539 Slight improvement of StoreScanner.optimize. 2015-10-02 20:23:03 -07:00
smaddineni 44b8809726 HBASE-13770 Programmatic JAAS configuration option for secure zookeeper may be broken
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-10-02 17:50:54 -07:00
tedyu de70958417 HBASE-14499 Master coprocessors shutdown will not happen on master abort (Pankaj Kumar) 2015-10-02 16:03:49 -07:00
Andrew Purtell 39c0b8f6db HBASE-13744 TestCorruptedRegionStoreFile is flaky 2015-10-02 15:07:17 -07:00
stack 83f5663a22 HBASE-14519 Purge TestFavoredNodeAssignmentHelper, a test for an abandoned feature that can hang 2015-10-02 13:29:39 -07:00
Andrew Purtell 030ae5f041 HBASE-13143 TestCacheOnWrite is flaky and needs a diet 2015-10-01 18:34:11 -07:00
Andrew Purtell ef7001c0e8 HBASE-14475 Region split requests are always audited with hbase user rather than request user (Ted Yu) 2015-10-01 15:12:32 -07:00
Sanjeev Srivatsa 76463a36f5 HBASE-14459 Add response and request size metrics
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-09-30 18:22:48 -07:00
Elliott Clark a463984945 HBASE-14512 Cache UGI groups
Summary:
Don't create a user for every call. Instead create one user per connection.
Then inside of SecureHadoopUser cache the groupNames. This allows HBase to cache
empty groups.  This is needed since it's much more likely that HBase will be accessed
by a user that's not present on the posix /etc/group file.

Test Plan: Unit Tests

Differential Revision: https://reviews.facebook.net/D47751
2015-09-30 12:46:12 -07:00
chenheng 24370547c5 HBASE-14230 replace reflection in FSHlog with HdfsDataOutputStream#getCurrentBlockReplication() 2015-09-30 16:59:42 +02:00
stack f3dff052a6 HBASE-14518 Give TestScanEarlyTermination the same treatment as 'HBASE-14378 Get TestAccessController* passing again...' -- up priority handlers 2015-09-29 22:44:37 -07:00
Jerry He e6905a1444 HBASE-14394 Properly close the connection after reading records from table: addendum 2015-09-29 20:14:54 -07:00
stack c04d18970e HBASE-14513 TestBucketCache runs obnoxious 1k threads in a unit test 2015-09-29 16:19:34 -07:00
stack 4cb3e029b0 HBASE-14362 org.apache.hadoop.hbase.master.procedure.TestWALProcedureStoreOnHDFS is super duper flaky (Heng Chen) 2015-09-29 14:51:21 -07:00
tedyu 6534583652 HBASE-14497 Reverse Scan threw StackOverflow caused by readPt checking (Yerui Sun) 2015-09-29 14:12:24 -07:00
Elliott Clark dbbef06135 HBASE-14473 Compute region locality in parallel 2015-09-29 13:08:59 -07:00
stack 37877e3f56 HBASE-14495 TestHRegion#testFlushCacheWhileScanning goes zombie 2015-09-29 05:25:10 -07:00
stack 6ad6273dda HBASE-14430 TestHttpServerLifecycle#testStartedServerIsAlive times out 2015-09-28 21:30:05 -07:00
ramkrishna cfce91e514 HBASE-14437 - ArithmeticException in ReplicationInterClusterEndpoint (Ram) 2015-09-28 10:05:12 +05:30
Lars Hofhansl 526520de0a HBASE-14489 postScannerFilterRow consumes a lot of CPU. 2015-09-26 16:17:18 -07:00
chenheng 02699fe967 HBASE-14227 Fold special cased MOB APIs into existing APIs
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-09-25 18:28:13 -07:00
Stephen Yuan Jiang 085fd765aa HBASE-14051 Undo workarounds in IntegrationTestDDLMasterFailover for client double submit (Stephen Yuan jiang) 2015-09-25 14:39:40 -07:00
Andrew Purtell e5d47a976e HBASE-12748 RegionCoprocessorHost.execOperation creates too many iterator objects 2015-09-25 13:27:27 -07:00
ramkrishna bdea8b891f HBASE-14478 - A ThreadPoolExecutor with a LinkedBlockingQueue cannot
execute tasks concurrently (Jingcheng du)
2015-09-25 23:15:06 +05:30
stack 33bbe43cf1 HBASE-14378 Get TestAccessController* passing again on branch-1; ADDENDUM... missed org.apache.hadoop.hbase.security.access.TestWithDisabledAuthorization 2015-09-25 09:34:58 -07:00
stack a33adf2f0b HBASE-14378 Get TestAccessController* passing again on branch-1 2015-09-24 22:21:58 -07:00
stack 8db7a6eb07 HBASE-14486 Disable TestRegionPlacement, a flakey test for an unfinished feature 2015-09-24 15:55:38 -07:00
stack 9557bc7dfa HBASE-14421 Follow-on from HBASE-14421, just disable TestFastFail* until someone digs in and fixes it; ADDENDUM -- missing import 2015-09-24 14:08:45 -07:00
stack d1405322f0 HBASE-14421 Follow-on from HBASE-14421, just disable TestFastFail* until someone digs in and fixes it 2015-09-24 13:51:37 -07:00
Andrew Purtell 20ed465d07 HBASE-14205 RegionCoprocessorHost System.nanoTime() performance bottleneck 2015-09-24 11:16:36 -07:00
Stephen Yuan Jiang 5b7894f92b HBASE-14107 Administrative Task: Provide an API to List all procedures (Stephen Yuan Jiang) 2015-09-23 21:48:32 -07:00
Matteo Bertozzi 5e26ae043d HBASE-14466 Remove duplicated code from MOB snapshot tests 2015-09-23 13:13:46 -07:00
stack 5aab961a72 HBASE-14472 TestHCM and TestRegionServerNoMaster fixes 2015-09-23 10:13:48 -07:00
Matteo Bertozzi 5d9ffffc07 HBASE-14464 Removed unused fs code 2015-09-23 09:40:09 -07:00
stack 2c83d8a263 HBASE-12751 Allow RowLock to be reader writer 2015-09-22 17:23:07 -07:00
tedyu f697d2d312 HBASE-14445 ExportSnapshot does not honor -chmod option 2015-09-22 12:56:48 -07:00
chenheng 487f741721 HBASE-14455 Try to get rid of unused HConnection instance
Signed-off-by: stack <stack@apache.org>
2015-09-22 10:38:32 -07:00
stack 7b9d88f9d7 HBASE-14193 Remove support for direct upgrade from pre-0.96 versions (Lars Francke) 2015-09-22 09:57:28 -07:00
stack 4d8ea10d98 HBASE-14461 Cleanup IncreasingToUpperBoundRegionSplitPolicy (Lars Francke) 2015-09-22 09:40:43 -07:00
tedyu 27bc559681 HBASE-14456 Implement a namespace-based region grouping strategy for RegionGroupingProvider (Yu Li) 2015-09-22 09:26:56 -07:00
tedyu 1592750eb1 HBASE-14280 Bulk Upload from HA cluster to remote HA hbase cluster fails (Ankit Singhal) 2015-09-22 09:21:35 -07:00
Jerry He 45d67435ad Revert: HBASE-14391 Empty regionserver WAL will never be deleted although the coresponding regionserver has been stale 2015-09-21 19:58:17 -07:00
Jerry He 8765ffb0ca HBASE-14391 Empty regionserver WAL will never be deleted although the coresponding regionserver has been stale (Qianxi Zhang) 2015-09-21 15:03:43 -07:00
tedyu 54e8c4bf23 HBASE-14280 Revert due to TestFSHDFSUtils failure 2015-09-21 09:51:53 -07:00
tedyu bf85960131 HBASE-14448 Refine RegionGroupingProvider Phase-2: remove provider nesting and formalize wal group name (Yu Li) 2015-09-21 06:42:39 -07:00
tedyu a7afc132e2 HBASE-14280 Bulk Upload from HA cluster to remote HA hbase cluster fails (Ankit Singhal) 2015-09-19 10:13:00 -07:00
Nick Dimiduk 8cdf4a8e03 Revert "HBASE-14230 replace reflection in FSHlog with HdfsDataOutputStream#getCurrentBlockReplication()"
This reverts commit 21dfb61bbe.

Also reintroduces the NO_ARGS instance that was removed in HBASE-14401
2015-09-18 14:03:27 -07:00
Enis Soztutar 17bdf9fa8c HBASE-14082 Add replica id to JMX metrics names (Lei Chen) 2015-09-16 17:29:57 -07:00
Elliott Clark 7b08f4c8be HBASE-14334 Move Memcached block cache in to it's own optional module. 2015-09-16 15:26:38 -07:00
tedyu 08eabb89f6 HBASE-13250 chown of ExportSnapshot does not cover all path and files (He Liangliang) 2015-09-16 13:04:01 -07:00
stack bd26386dc7 HBASE-14433 Set down the client executor core thread count from 256 in tests: REAPPLY AGAIN (WAS MISSING JIRA) 2015-09-16 10:13:55 -07:00
stack b0aa86a694 Revert "Set down the client executor core thread count from 256 in tests: REAPPLY"
Missing JIRA number.

This reverts commit b00f3d3703.
2015-09-16 10:12:39 -07:00
stack b00f3d3703 Set down the client executor core thread count from 256 in tests: REAPPLY 2015-09-16 08:57:06 -07:00
stack 8633b26ee5 Revert "HBASE-14433 Set down the client executor core thread count from 256 to number of processors"
This reverts commit d2e3381818.
2015-09-16 08:53:34 -07:00
stack d2e3381818 HBASE-14433 Set down the client executor core thread count from 256 to number of processors 2015-09-15 22:36:05 -07:00
Apekshit(Appy) Sharma fe2c4f630d HBASE-14400 Fix HBase RPC protection documentation
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-09-15 17:43:48 -07:00
Sanjeev Srivatsa 903d876f29 HBASE-14145 added flag to canary to try all regions in regionserver mode
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-09-15 16:32:08 -07:00
tedyu 76f4e157ad HBASE-14411 Fix unit test failures when using multiwal as default WAL provider (Yu Li) 2015-09-15 16:12:30 -07:00
Srikanth Srungarapu 938d2a0c9c HBASE-14394 Properly close the connection after reading records from table. 2015-09-15 11:02:00 -07:00
stack d147f8f8f4 HBASE-14361 ReplicationSink should create Connection instances lazily 2015-09-15 05:15:47 -07:00
stack 72b4c906b8 HBASE-14401 Stamp failed appends with sequenceid too.... Cleans up latches 2015-09-14 22:20:40 -07:00
stack 63a2fb5143 HBASE-14421 TestFastFail* are flakey; ADDENDUM 3 Exclude another should assert in TestFastFail 2015-09-14 08:32:52 -07:00
tedyu 99df022f2c HBASE-14306 Refine RegionGroupingProvider: fix issues and make it more scalable (Yu Li) 2015-09-14 07:15:35 -07:00
stack e4e906f436 HBASE-14421 TestFastFail* are flakey; ADDENDUM 2015-09-13 10:12:30 -07:00
stack 439ca071ec HBASE-14423 TestStochasticBalancerJmxMetrics.testJmxMetrics_PerTableMode:183 NullPointer 2015-09-13 07:30:51 -07:00
stack a9157379a3 HBASE-14421 TestFastFail* are flakey 2015-09-12 22:34:04 -07:00
tedyu dff5243c89 HBASE-14370 Use separate thread for calling ZKPermissionWatcher#refreshNodes() 2015-09-11 13:44:48 -07:00
tedyu c94d10952f HBASE-6617 ReplicationSourceManager should be able to track multiple WAL paths (Yu Li) 2015-09-11 09:26:27 -07:00
tedyu a8730c2839 HBASE-14380 Correct data gets skipped along with bad data in importTsv bulk load thru TsvImporterTextMapper (Bhupendra Kumar Jain) 2015-09-11 09:05:17 -07:00
ramkrishna c438052cc2 HBASE-14307 - Incorrect use of positional read api in HFileBlock (Chris
Nauroth)
2015-09-11 16:03:31 +05:30
stack 411b516f51 HBASE-14392 [tests] TestLogRollingNoCluster fails on master from time to time 2015-09-10 20:25:36 -07:00
stack bf26088d7b Revert "HBASE-14361 Investigate unused connection objects"
This reverts commit 6c16d244bb.
2015-09-10 14:18:03 -07:00
Sanjeev Srivatsa 4418f3e025 HBASE-14384 changed Canary to use instance of ExtendedSink
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-09-10 12:05:04 -07:00
chenheng eb8a8c4fd9 HBASE-14361 Investigate unused connection objects
Signed-off-by: stack <stack@apache.org>
2015-09-10 09:18:23 -07:00
chenheng 21dfb61bbe HBASE-14230 replace reflection in FSHlog with HdfsDataOutputStream#getCurrentBlockReplication()
Signed-off-by: stack <stack@apache.org>
2015-09-10 08:27:25 -07:00
Srikanth Srungarapu e770cf3417 HBASE-14385 Close the sockets that is missing in connection closure. -- ADDENDUM 2015-09-09 23:37:10 -07:00
stack 7d018ec789 HBASE-14393 Have TestHFileEncryption clean up after itself so it don't go all zombie on us 2015-09-09 21:25:12 -07:00
stack bada19bb54 HBASE-14368 New TestWALLockup broken by addendum added to parent issue 2015-09-05 08:53:22 -07:00
Srikanth Srungarapu 2969093b5b HBASE-14261 Enhance Chaos Monkey framework by adding zookeeper and datanode fault injections; ADDENDUM 2015-09-04 14:01:15 -07:00
Lars Hofhansl 6a8ba22c16 HBASE-12988 [Replication]Parallel apply edits across regions. 2015-09-04 13:22:14 -07:00
stack de0e72f464 HBASE-14327 TestIOFencing#testFencingAroundCompactionAfterWALSync is flaky (Heng Chen) 2015-09-04 10:27:49 -07:00
tedyu b7a67c6382 HBASE-14314 Metrics for block cache should take region replicas into account 2015-09-04 10:04:29 -07:00
stack ec4d719f19 HBASE-14317 Stuck FSHLog: bad disk (HDFS-8960) and can't roll WAL; addendum2 -- found a fix testing the branch-1 patch 2015-09-04 00:40:32 -07:00
stack 54717a6314 HBASE-14317 Stuck FSHLog: bad disk (HDFS-8960) and can't roll WAL; addendum 2015-09-03 21:34:20 -07:00
stack 661faf6fe0 HBASE-14317 Stuck FSHLog: bad disk (HDFS-8960) and can't roll WAL 2015-09-03 21:32:49 -07:00
Matteo Bertozzi 5152ac0e20 HBASE-14344 Add timeouts to TestHttpServerLifecycle 2015-09-03 12:07:52 -07:00
Srikanth Srungarapu e48991970d HBASE-14261 Enhance Chaos Monkey framework by adding zookeeper and datanode fault injections. 2015-09-03 11:55:36 -07:00
Stephen Yuan Jiang 3341f13e71 HBASE-14108 Procedure V2 Administrative Task: provide an API to abort a procedure (Stephen Yuan Jiang) 2015-09-02 19:18:46 -07:00
tedyu 15a88d2e1b HBASE-14229 Flushing canceled by coprocessor still leads to memstoreSize set down (Yerui Sun) 2015-09-02 07:29:00 -07:00
tedyu f792ede466 HBASE-14332 Show the table state when we encounter exception while disabling / enabling table (Nick Han) 2015-09-01 13:00:28 -07:00
tedyu df341c4299 HBASE-14309 Allow load balancer to operate when there is region in transition by adding force flag 2015-08-29 13:15:53 -07:00
Elliott Clark 0d06d8ddd0 HBASE-14322 Add a master priority function to let master use it's threads 2015-08-28 17:30:03 -07:00
Lars Hofhansl cf4c0fb71c HBASE-14315 Save one call to KeyValueHeap.peek per row. 2015-08-28 15:05:41 -07:00
stack ff86749cae HBASE-14078 improve error message when HMaster can't bind to port 2015-08-26 09:17:46 -07:00
Stephen Yuan Jiang dc79b3c5c9 HBASE-13212: Procedure V2 - master Create/Modify/Delete namespace (Stephen Yuan Jiang) 2015-08-26 08:18:03 -07:00
tedyu 6661f2d025 HBASE-14269 FuzzyRowFilter omits certain rows when multiple fuzzy keys exist (hongbin ma) 2015-08-26 07:23:43 -07:00
stack 3dacee674c HBASE-14290 Spin up less threads in tests 2015-08-25 16:16:03 -07:00
Enis Soztutar 44caba31e4 HBASE-14302 TableSnapshotInputFormat should not create back references when restoring snapshot 2015-08-25 12:10:15 -07:00
stack d0873f5a8c HBASE-14224 Fix coprocessor handling of duplicate classes 2015-08-24 13:47:19 -07:00
Elliott Clark bfae44a952 HBASE-14239 Fix Branch-1.2 AM can get stuck when meta moves 2015-08-24 12:53:09 -07:00
stack d31aedb998 HBASE-13127 Add timeouts on all tests so less zombie sightings 2015-08-24 12:49:55 -07:00
stack b85857cf3c HBASE-13480 ShortCircuitConnection doesn't short-circuit all calls as expected (Jingcheng Du and Josh Elser) 2015-08-24 12:29:46 -07:00
stack 9334a47d45 HBASE-14273 Rename MVCC to MVCC: From MultiVersionConsistencyControl to MultiVersionConcurrencyControl (Lars Francke) 2015-08-24 08:47:26 -07:00
Liu Shaohui eb52529c02 HBASE-14277 TestRegionServerHostname.testRegionServerHostname may fail at host with a case sensitive name 2015-08-24 11:53:58 +08:00
tedyu 9c51a4d0c7 HBASE-14293 TestStochasticBalancerJmxMetrics intermittently fails due to port conflict 2015-08-23 20:11:57 -07:00
tedyu e95cf8fdb4 HBASE-14291 NPE On StochasticLoadBalancer Balance Involving RS With No Regions 2015-08-22 14:49:37 -07:00
Andrew Purtell 902cd172f8 HBASE-13996 Add write sniffing in canary (Liu Shaohui) 2015-08-21 22:45:48 -07:00
Sean Busbey e2a1fc78b8 HBASE-14250 ensure hbase-server test-jar has its own LICENSE file and not the one for the non-test jar. 2015-08-21 16:22:59 -05:00
Sean Busbey 720f2a8815 HBASE-14251 ensure javadoc jars have LICENSE/NOTICE that match content. 2015-08-20 10:52:41 -05:00
Gábor Lipták dc9c2efcc9 HBASE-14148 Default HBase web pages to be non-framable.
* Sends X-Frame-Options header
* configured via hbase.http.filter.xframeoptions.mode
* defaults to DENY

Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-08-19 21:06:52 -05:00
tedyu 32b1064c6c HBASE-14165 The initial size of RWQueueRpcExecutor.queues should be (numWriteQueues + numReadQueues + numScanQueues) (Cui Jianwei) 2015-08-19 14:35:09 -07:00
Ashish Singhi 1bb9e3ae96 HBASE-14210 Create test for cell level ACLs involving user group
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-08-18 16:53:55 -07:00
Jerry He 3fa86a98a0 HBASE-14228 Close BufferedMutator and connection in MultiTableOutputFormat 2015-08-18 13:44:41 -07:00
Elliott Clark ad2c7c6336 HBASE-14166 Per-Region metrics can be stale 2015-08-17 11:22:01 -07:00
Nick Dimiduk ecba08829d HBASE-10844 Coprocessor failure during batchmutation leaves the memstore datastructs in an inconsistent state
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-08-14 15:55:04 -07:00
stack 45aafb25b7 HBASE-13966 Limit column width in table.jsp (Matt Warhaftig) 2015-08-14 09:03:56 -07:00
ramkrishna f2a9dab30e HBASE-14144 - Bloomfilter path to work with Byte buffered cells (Ram) 2015-08-14 12:04:34 +05:30
tedyu 54028140f4 HBASE-13376 Improvements to Stochastic load balancer (Vandana Ayyalasomayajula) 2015-08-13 09:11:59 -07:00
Enis Soztutar d1262331eb HBASE-14054 Acknowledged writes may get lost if regionserver clock is set backwards 2015-08-13 11:03:37 +03:00
Elliott Clark a399ac9c4f HBASE-14098 Allow dropping caches behind compactions
Summary: On large compactions drop the OS level fs cache behind reads and writes.

Test Plan: Test on a loaded cluster.

Differential Revision: https://reviews.facebook.net/D42681
2015-08-12 19:41:02 -07:00
Andrew Purtell d7178aa27c HBASE-13985 Add configuration to skip validating HFile format when bulk loading (Victor Xu) 2015-08-12 18:36:23 -07:00
Andrew Purtell 5e5bcceb53 HBASE-14122 Client API for determining if server side supports cell level security 2015-08-12 13:26:55 -07:00
Andrew Purtell beb1f1d358 HBASE-14209 TestShell visibility tests failing 2015-08-12 13:25:34 -07:00
Simon Law 0c63d415d9 HBASE-14201 hbck should not take a lock unless fixing errors
By default, hbck is run in a read-only checker mode. In this case, it is
sensible to let others run. By default, the balancer is left alone,
which may cause spurious errors, but cannot leave the balancer in a bad
state. It is dangerous to leave the balancer by accident, so it is only
ever enabled after fixing, it will never be forced off because of
racing.

When hbck is run in fixer mode, it must take an exclusive lock and
disable the balancer, or all havoc will break loose.

If you want to stop hbck from running in parallel, the -exclusive flag
will create the lock file. If you want to force -disableBalancer, that
option is available too. This makes more semantic sense than -noLock and
-noSwitchBalancer, respectively.

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-08-12 11:49:47 -07:00
ramkrishna aa3538f802 HBASE-14188- Read path optimizations after HBASE-11425 profiling-
Addendum(Ram)
2015-08-12 09:59:55 +05:30
Elliott Clark 38b94709ee HBASE-14208 Remove yarn dependencies on -common and -client 2015-08-11 13:00:13 -07:00
tedyu a2dbe31b26 HBASE-14206 MultiRowRangeFilter returns records whose rowKeys are out of allowed ranges (Anton Nazaruk) 2015-08-11 09:40:13 -07:00
anoopsjohn d49b1f60f4 HBASE-14202 Reduce garbage we create. 2015-08-11 21:51:17 +05:30
Ashish Singhi 6e8cdec242 HBASE-5878 Use getVisibleLength public api from HdfsDataInputStream from Hadoop-2.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-08-10 17:14:30 -07:00
tedyu ce72ce998f HBASE-14200 Separate RegionReplica subtests of TestStochasticLoadBalancer into TestStochasticLoadBalancer2 2015-08-10 07:35:19 -07:00
tedyu d4fc7cf2ba HBASE-14197 TestRegionServerHostname#testInvalidRegionServerHostnameAbortsServer fails in Jenkins 2015-08-07 18:48:23 -07:00
Andrew Purtell ea8833fd63 HBASE-12865 WALs may be deleted before they are replicated to peers (He Liangliang) 2015-08-07 15:08:30 -07:00
Andrew Purtell f06daaf010 HBASE-13825 Use ProtobufUtil#mergeFrom and ProtobufUtil#mergeDelimitedFrom in place of builder methods of same name 2015-08-06 21:48:09 -07:00
Gábor Lipták 7417835853 HBASE-13865 Increase the default value for hbase.hregion.memstore.block.multipler from 2 to 4 (part 2) 2015-08-06 10:03:23 -07:00
ramkrishna 7a9e10dc11 HBASE-14188 - Read path optimizations after HBASE-11425 profiling (Ram) 2015-08-06 16:49:49 +05:30
chenheng 75a6cb2be6 HBASE-14178 regionserver blocks because of waiting for offsetLock
Signed-off-by: zhangduo <zhangduo@apache.org>
2015-08-06 17:00:45 +08:00
anoopsjohn 5d2708f628 HBASE-14186 Read mvcc vlong optimization. 2015-08-06 10:16:51 +05:30
tedyu 5f6632f801 HBASE-14021 Quota table has a wrong description on the UI (Ashish Singhi) 2015-08-04 18:20:14 -07:00
tedyu a0d72051db HBASE-14185 Incorrect region names logged by MemStoreFlusher (Biju Nair) 2015-08-04 17:20:23 -07:00
Sean Busbey 1b0b67fb7c HBASE-14085 Update LICENSE and NOTICE files.
* corrects license/notice for source distribution
* adds inception year to correct copyright in generated NOTICE files for jars
* updates project names in poms to use "Apache HBase" instead of "HBase" so jar NOTICE files will be correct
* uses append-resources to include supplemental info on jars with 3rd party works in source
* adds an hbase specific resource bundle for jars that include 3rd party works for binaries
** uses supplemental-model to fill in license gaps
** uses the above and a shade plugin transformation to build proper files for shaded jars.
** uses the above and the assembly plugin to build the proper files for bin assembly
* adds a NOTICE item for things copied out of Hadoop (TODO legal-discuss)
2015-08-04 17:16:56 -05:00
tedyu 931e77d450 HBASE-13965 Addendum tries different connector ports if BindException is encountered 2015-08-03 16:23:52 -07:00
tedyu 598cfeb775 HBASE-13965 Stochastic Load Balancer JMX Metrics (Lei Chen) 2015-08-03 12:46:01 -07:00
tedyu 20d1fa36e7 HBASE-13965 Stochastic Load Balancer JMX Metrics (Lei Chen) 2015-08-03 12:45:38 -07:00
Ashish Singhi f504e4b4ed HBASE-14154 DFS Replication should be configurable at column family level
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-31 19:15:48 -07:00
tedyu 11d7beed64 HBASE-14168 Avoid useless retry for DoNotRetryIOException in TableRecordReaderImpl (zhouyingchao) 2015-07-31 09:23:17 -07:00
tedyu f1f0d99662 HBASE-14173 includeMVCCReadpoint parameter in DefaultCompactor#createTmpWriter() represents no-op 2015-07-30 11:12:25 -07:00
Andrew Purtell 5f1129c799 HBASE-14155 StackOverflowError in reverse scan (Ramkrishna S. Vasudevan) 2015-07-29 18:14:31 -07:00
Jerry He e5bf0287e8 HBASE-14153 Typo in ProcedureManagerHost.MASTER_PROCEUDRE_CONF_KEY (Konstantin Shvachko) 2015-07-29 15:43:20 -07:00
tedyu 9f4aeca7c8 HBASE-14164 Display primary region replicas distribution on table.jsp 2015-07-29 14:22:21 -07:00
Sean Busbey 4ce6f486d0 HBASE-14087 Ensure correct ASF headers for docs/code
* adds missing headers
* corrects some old-form headers to current
* restores proper header for guava copied LimitInputStream
* adds proper header for protobuf copied read/writeRawVarint
2015-07-29 14:25:43 -05:00
Jerry He d2fbaf267e HBASE-14024 ImportTsv is not loading hbase-default.xml (Ashish Singhi) 2015-07-28 11:51:25 -07:00
Srikanth Srungarapu 1d4c2452e7 HBASE-14057 HBase shell user_permission should list super users defined on hbase-site.xml 2015-07-28 11:33:52 -07:00
tedyu 34f9a84445 HBASE-14157 Interfaces implemented by subclasses should be checked when registering CoprocessorService 2015-07-28 11:09:41 -07:00
ramkrishna 6b9b7cb8c7 HBASE-14152 Fix the warnings in Checkstyle and FindBugs brought in by merging hbase-11339 (Jingcheng Du)
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-07-28 10:14:29 -05:00
Sean Busbey e36af70835 Revert "Fix the warnings in Checkstyle and FindBugs brought in by merging"
This reverts commit 89d0409462.
2015-07-28 10:13:57 -05:00
ramkrishna 89d0409462 Fix the warnings in Checkstyle and FindBugs brought in by merging
hbase-11339 (Jingcheng Du)
2015-07-28 11:41:41 +05:30
Esteban Gutierrez 1566ec5fdc HBASE-13089 Fix test compilation error on building against htrace-3.2.0-incubating 2015-07-27 12:57:03 -07:00
ramkrishna 3f80e0ea4f HBASE-14063 Use BufferBackedCell in read path after HBASE-12213 and
HBASE-12295 (ram)
2015-07-27 16:55:46 +05:30
anoopsjohn ac08b992c5 HBASE-14156 Fix test failure in TestOpenTableInCoprocessor. 2015-07-27 16:01:23 +05:30
Elliott Clark e087a9ef51 HBASE-14146 Fix Once replication sees an error it slows down forever 2015-07-23 16:12:02 -07:00
ramkrishna 4ec69ccf3a HBASE-12295 - Addendum for multiGets to add the call back(Ram) 2015-07-23 14:30:20 +05:30
Jonathan M Hsieh 493f36c899 HBASE-11339 Merge remote-tracking branch 'apache/hbase-11339' (Jingcheng Du) 2015-07-22 12:51:11 -07:00
abhilak 20739542fd HBASE-14058 Stabilizing default heap memory tuner
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-07-22 11:36:57 -07:00
tedyu 5ec5552be0 HBASE-14115 Fix resource leak in HMasterCommandLine (Yuhao Bi) 2015-07-21 09:18:59 -07:00
ramkrishna ccb22bd80d HBASE-12295 Prevent block eviction under us if reads are in progress from
the BBs (Ram)
2015-07-21 21:15:32 +05:30
anoopsjohn 3b6db26863 HBASE-13954 Remove HTableInterface#getRowOrBefore related server side code. (Ashish) 2015-07-21 09:08:26 +05:30
anoopsjohn cceee1b0c3 HBASE-14116 Change ByteBuff.getXXXStrictlyForward to relative position based reads. 2015-07-21 09:01:20 +05:30
anoopsjohn 0f614a1c44 HBASE-12374 Change DBEs to work with new BB based cell. 2015-07-20 23:28:45 +05:30
ramkrishna 7e4cd59820 HBASE-14099 StoreFile.passesKeyRangeFilter need not create Cells from the
Scan's start and stop Row (Ram)
2015-07-20 22:10:10 +05:30
Elliott Clark 1446d01e98 HBASE-14092 Add -noLock and -noBalanceSwitch options to hbck 2015-07-17 10:58:06 -07:00
tedyu a6e91903ec HBASE-14000 Region server failed to report to Master and was stuck in reportForDuty retry loop (Pankaj Kumar) 2015-07-17 10:48:32 -07:00
tedyu b98598f363 HBASE-14110 Add CostFunction for balancing primary region replicas 2015-07-17 09:56:37 -07:00
Esteban Gutierrez 7ddae3939e HBASE-14076 ResultSerialization and MutationSerialization can throw InvalidProtocolBufferException when serializing a cell larger than 64MB 2015-07-17 09:23:13 -07:00
ramkrishna 834f87b23d HBASE-12213 HFileBlock backed by Array of ByteBuffers (Ram) 2015-07-17 13:27:29 +05:30
Andrew Purtell a249989b93 HBASE-14050 NPE in org.apache.hadoop.hbase.ipc.RpcServer.readAndProcess 2015-07-16 18:27:30 -07:00
zhangduo 257df19cc3 HBASE-14100 Fix high priority findbugs warnings 2015-07-17 08:55:20 +08:00
tedyu 9ebafe6b08 HBASE-13971 Flushes stuck since 6 hours on a regionserver 2015-07-16 13:53:22 -07:00
anoopsjohn ebdac4b52e HBASE-12296 Filters should work with ByteBufferedCell. 2015-07-16 09:36:05 +05:30
Ashish Singhi e6bd0c8c15 HBASE-8642 [Snapshot] List and delete snapshot by table
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-15 15:56:07 -07:00
Sean Busbey 25f7e804cd HBASE-14027 clean up multiple netty jars. 2015-07-15 02:33:28 -05:00
ramkrishna a3d30892b4 HBASE-14047 - Cleanup deprecated APIs from Cell class (Ashish Singhi) 2015-07-13 22:06:16 +05:30
Matteo Bertozzi 951ec7a0b7 HBASE-13415 Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang)
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-13 11:02:30 -05:00
Sean Busbey 60d6435ad8 Revert "Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang)"
This reverts commit 87ee37ceb8.
2015-07-13 11:01:45 -05:00
anoopsjohn d1f7bcbff7 HBASE-12015 Not cleaning Mob data when Mob CF is removed from table.(Pankaj Kumar) 2015-07-13 14:36:44 +05:30
Enis Soztutar c16bbf47cb HBASE-13993 WALProcedureStore fencing is not effective if new WAL rolls 2015-07-10 13:36:45 -07:00
Matteo Bertozzi ae1f485ee8 HBASE-13832 Procedure v2: try to roll the WAL master on sync failure before aborting 2015-07-09 08:34:42 -07:00
Matteo Bertozzi 87ee37ceb8 Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang) 2015-07-09 07:44:36 -07:00
tedyu f8eaa98962 HBASE-12596 bulkload needs to follow locality (Victor Xu) 2015-07-09 07:24:18 -07:00
anoopsjohn d07ff5ec5a HBASE-13387 Add ByteBufferedCell an extension to Cell. 2015-07-09 15:35:24 +05:30
Andrew Purtell 41c8ec7aea HBASE-14042 Fix FATAL level logging in FSHLog where logged for non fatal exceptions 2015-07-08 17:37:56 -07:00
tedyu 1162cbdf15 HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) 2015-07-07 10:54:05 -07:00
Enis Soztutar 7acb061e63 HBASE-13988 Add exception handler for lease thread (Liu Shaohui) 2015-07-06 19:14:54 -07:00
Enis Soztutar c220635c78 HBASE-13352 Add hbase.import.version to Import usage (Lars Hofhansl) 2015-07-06 15:39:19 -07:00
Matteo Bertozzi 1713f1fcaf HBASE-14017 Procedure v2 - MasterProcedureQueue fix concurrency issue on table queue deletion
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-06 15:05:16 -05:00
Matteo Bertozzi d26978a2ff HBASE-13849 Remove restore and clone snapshot from the WebUI
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-06 11:12:30 -05:00
stack cff1a5f1f5 HBASE-14012 Double Assignment and Dataloss when ServerCrashProcedure
runs during Master failover
2015-07-06 07:57:40 -07:00
Lars Hofhansl 1f9bf419c1 HBASE-13329 ArrayIndexOutOfBoundsException in CellComparator#getMinimumMidpointArray. 2015-07-05 12:28:27 -07:00
Ashish Singhi 5b75faefcc HBASE-13925 Use zookeeper multi to clear znodes in ZKProcedureUtil
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-03 12:24:47 -07:00
ramkrishna 74e82c64e5 HBASE-13977 - Convert getKey and related APIs to Cell (Ram) 2015-07-03 22:59:58 +05:30
stack 71a523a619 HBASE-14013 Retry when RegionServerNotYetRunningException rather than go ahead with assign so for sure we don't skip WAL replay 2015-07-02 14:28:26 -07:00
stack 90b51e85c4 HBASE-14010 TestRegionRebalancing.testRebalanceOnRegionServerNumberChange fails; cluster not balanced 2015-07-02 10:05:18 -07:00
tedyu 34dfd6c9b4 HBASE-14005 Set permission to .top hfile in LoadIncrementalHFiles (Francesco MDE) 2015-07-02 08:42:40 -07:00
zhangduo 28a035000f HBASE-13970 NPE during compaction in trunk 2015-07-02 21:36:11 +08:00
anoopsjohn 62f5694491 HBASE-13998 Remove CellComparator#compareRows(byte[] left, int loffset, int llength, byte[] right, int roffset, int rlength). 2015-07-02 11:58:25 +05:30
stack 20e855f282 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) -- REAPPLY 2015-07-01 23:16:30 -07:00
stack f0e29c49a1 Revert "HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis"
This reverts commit fca725a899.
2015-07-01 20:20:08 -07:00
stack fca725a899 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis
Soztutar)
2015-07-01 20:07:26 -07:00
tedyu 5d1be4a317 HBASE-13980 Distinguish blockedFlushCount vs unblockedFlushCount when tuning heap memory (Abhilash) 2015-07-01 13:03:04 -07:00
Bhupendra 7a6f269c4d HBASE-13978: Variable never assigned in SimpleTotalOrderPartitioner.getPartition()
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-01 13:03:21 -05:00
Matt Warhaftig 364205da25 HBASE-13861 Fix UI label for BucketCache free & used bytes.
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-01 12:14:12 -05:00
Matteo Bertozzi 5ee11840f6 HBASE-13995 ServerName is not fully case insensitive 2015-07-01 09:26:15 -07:00
Sean Busbey 6ca337cb3e HBASE-13990 make maven site generation work with jdk8 2015-06-30 21:11:42 -05:00
Sean Busbey 85c278a6a8 HBASE-14003 work around JDK-8044053 2015-06-30 16:21:10 -05:00
anoopsjohn 42d5ef017d HBASE-13943 Get rid of KeyValue#heapSizeWithoutTags. 2015-06-30 23:09:09 +05:30
anoopsjohn 7e7fbdb84b HBASE-14001 Optimize write(OutputStream out, boolean withTags) for SizeCachedNoTagsKeyValue. 2015-06-30 22:50:38 +05:30
Lars Hofhansl f8bd578b80 HBASE-13959 Region splitting uses a single thread in most common cases. (Hari Krishna Dara) 2015-06-29 18:08:46 -07:00
tedyu 4f06279caa HBASE-13989 Threshold for combined MemStore and BlockCache percentages is not checked 2015-06-29 15:00:29 -07:00
anoopsjohn 3f062ee236 HBASE-13922 Do not reset mvcc in compactions for mob-enabled column.(Jingcheng Du) 2015-06-29 13:29:36 +05:30
Ashish Singhi 3efde85614 HBASE-13214 Remove deprecated and unused methods from HTable class 2015-06-26 15:39:53 -07:00
tedyu 183fa5d232 HBASE-13863 Multi-wal feature breaks reported number and size of HLogs (Abhilash) 2015-06-26 08:52:24 -07:00
tedyu f046c4b043 HBASE-13974 TestRateLimiter#testFixedIntervalResourceAvailability may fail (Guanghao Zhang) 2015-06-26 08:27:06 -07:00
ramkrishna 130817b559 HBASE-13939 - Make HFileReaderImpl.getFirstKeyInBlock() to return a Cell
(Ram)
2015-06-26 20:47:30 +05:30
tedyu 2ed058554c HBASE-13969 AuthenticationTokenSecretManager is never stopped in RPCServer (Pankaj Kumar) 2015-06-25 17:42:22 -07:00
tedyu db5dd1ebef HBASE-13923 Addendum fixes NPE in HRegionServer#buildServerLoad() 2015-06-25 16:31:44 -07:00
stack b5b5853043 HBASE-13893 Replace HTable with Table in client tests (Jurriaan Mous) 2015-06-25 14:42:33 -07:00
tedyu e6ed792199 HBASE-13702 ImportTsv: Add dry-run functionality and log bad rows (Apekshit Sharma) 2015-06-25 13:15:07 -07:00
anoopsjohn d9ba4d5bb5 HBASE-13835 KeyValueHeap.current might be in heap when exception happens in pollRealKV. (zhouyingchao) 2015-06-25 23:44:37 +05:30
tedyu edef3d64bc HBASE-13964 Skip region normalization for tables under namespace quota 2015-06-25 03:34:28 -07:00
tedyu b7f241d73b HBASE-13923 Loaded region coprocessors are not reported in shell status command (Ashish Singhi) 2015-06-23 21:25:50 -07:00
ramkrishna ba4ba32b0d HBASE-13932 - Add mob integrity check in HFilePrettyPrinter (Jingcheng du) 2015-06-24 09:22:44 +05:30
ramkrishna d7356667be HBASE-13945 - Prefix_Tree seekBefore() does not work correctly (Ram) 2015-06-24 09:11:05 +05:30
Nick Dimiduk 3e72dc9f08 HBASE-13938 Deletes done during the region merge transaction may get eclipsed (ddas, enis, ndimiduk) 2015-06-23 10:23:38 -07:00
Gábor Lipták b636c6b1cd HBASE-13898 AMMENDMENT Correct Javadoc errors in site
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-06-23 00:05:56 -05:00
Mikhail Antonov fd37ccb63c HBASE-13103 [ergonomics] add region size balancing as a feature of master 2015-06-22 15:52:07 -07:00
ramkrishna f9b17bfd37 HBASE-13614 - Avoid temp KeyOnlyKeyValue temp objects creations in read
hot path (Ram)
2015-06-22 12:30:46 +05:30
anoopsjohn a4bd2b784e HBASE-13448 New Cell implementation with cached component offsets/lengths. 2015-06-22 11:02:45 +05:30
anoopsjohn e4d8fab104 HBASE-13926 Close the scanner only after Call#setResponse. 2015-06-21 20:04:13 +05:30
Nick Dimiduk db08013ebe HBASE-13933 DBE's seekBefore with tags corrupts the tag's offset information thus leading to incorrect results (ramkrishna.s.vasudevan) 2015-06-19 14:41:06 -07:00
anoopsjohn 8ae4b374e3 HBASE-13916 Create MultiByteBuffer an aggregation of ByteBuffers. 2015-06-18 22:38:10 +05:30
Matteo Bertozzi fedfe878f4 HBASE-13917 Remove string comparison to identify request priority 2015-06-18 09:30:39 -07:00
Elliott Clark 623fd63827 HBASE-13876 Improving performance of HeapMemoryManager 2015-06-17 09:58:59 -07:00
Patrick White f469c3bd97 HBASE-13918 Fix hbase:namespace description
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-06-16 12:40:47 -07:00
Lars Hofhansl ce2fd2c58c HBASE-13885 ZK watches leaks during snapshots. 2015-06-16 12:21:49 -07:00
anoopsjohn b889339006 HBASE-13886 Return empty value when the mob file is corrupt instead of throwing exceptions. (Jingcheng) 2015-06-16 17:17:03 +05:30
anoopsjohn 2e2742183f HBASE-13737 [HBase MOB] MOBTable cloned from a snapshot leads to data loss, when that actual snapshot and main table is deleted. (Ashutosh Jindal) 2015-06-16 15:02:50 +05:30
Misty Stanley-Jones b16293b5e2 HBASE-13898 correct additional javadoc failures under java 8 <Gabor Liptak> 2015-06-16 14:18:09 +10:00
Misty Stanley-Jones 5e6373e8ec Revert "Correct Javadoc generation errors"
This reverts commit 0a227b79d6.
2015-06-16 14:18:09 +10:00
Gábor Lipták 0a227b79d6 Correct Javadoc generation errors 2015-06-16 13:27:45 +10:00
Nick Dimiduk cba9ea61dd HBASE-13821 WARN if hbase.bucketcache.percentage.in.combinedcache is set 2015-06-15 19:23:58 -07:00
tedyu 84a50393ee HBASE-13888 Fix refill bug from HBASE-13686 (Guanghao Zhang) 2015-06-15 18:31:28 -07:00
Nick Dimiduk 35a9c509fb HBASE-13905 TestRecoveredEdits.testReplayWorksThoughLotsOfFlushing failing consistently on branch-1.1 2015-06-15 17:15:47 -07:00
Nick Dimiduk 461f5307ba HBASE-13833 LoadIncrementalHFile.doBulkLoad(Path,HTable) doesn't handle unmanaged connections when using SecureBulkLoad 2015-06-15 12:10:23 -07:00
Enis Soztutar c6dd3f965b HBASE-13877 Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL 2015-06-14 11:22:07 -07:00
Gábor Lipták 682b8ab8a5 HBASE-13569 Correct Javadoc (for Java8)
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-06-13 01:10:37 -05:00
Dave Latham 293506c7cd HBASE-13639 SyncTable - rsync for HBase tables
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-06-12 16:00:00 -07:00
Sean Busbey 47a9ff5d1f HBASE-13848 Use Credential Provider when available for SSL passwords in InfoServer. 2015-06-12 09:12:20 -05:00
Srikanth Srungarapu 7595bdfb1a HBASE-13755 Provide single super user check implementation (Mikhail Antonov) 2015-06-11 20:51:05 -07:00
Josh Elser 8cef99e506 HBASE-13892 NPE in ClientScanner on null results array
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2015-06-11 19:03:59 -07:00
Changgeng Li 9d3422ed16 HBASE-13560 large compaction thread pool will steal jobs from small compaction pool when idle
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-06-11 14:23:29 -07:00
anoopsjohn faefb9073f HBASE-13855 Race in multi threaded PartitionedMobCompactor causes NPE. (Jingcheng) 2015-06-11 15:32:19 +05:30
Ashish Singhi 349cbe102a HBASE-13828 Add group permissions testing coverage to AC
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-06-10 17:47:04 -07:00
Enis Soztutar 399fddddc3 HBASE-13878 Set hbase.fs.tmp.dir config in HBaseTestingUtility.java for Phoenix UT to use 2015-06-10 16:30:02 -07:00
Jesse Yates 0f93986015 HBASE-13846 Run MiniCluster on top of other MiniDfsCluster 2015-06-10 11:27:08 -07:00
tedyu 3ada2345d6 HBASE-13873 LoadTestTool addAuthInfoToConf throws UnsupportedOperationException (sunyerui) 2015-06-10 07:32:10 -07:00
anoopsjohn bf3924ed05 HBASE-13871 Change RegionScannerImpl to deal with Cell instead of byte[], int, int. 2015-06-10 18:40:51 +05:30
anoopsjohn 26893aa451 HBASE-13836 Do not reset the mvcc for bulk loaded mob reference cells in reading. (Jingcheng) 2015-06-10 18:05:10 +05:30
Jerry He 14fe23254a HBASE-13845 Expire of one region server carrying meta can bring down the master: test case 2015-06-09 11:46:58 -07:00
tedyu 6cc42c8cd1 HBASE-13829 Add more ThrottleType (Guanghao Zhang) 2015-06-09 06:42:55 -07:00
ramkrishna 487e4aa74f HBASE-13451 - Make the HFileBlockIndex blockKeys to Cells so that it could
be easy to use in the CellComparators (Ram)
2015-06-09 12:03:01 +05:30
stack c62b396f9f HBASE-13847 getWriteRequestCount function in HRegionServer uses int variable to return the count (Abhilash) 2015-06-08 20:35:43 -07:00
anoopsjohn ba348cf5a5 HBASE-13856 Wrong mob metrics names in TestRegionServerMetrics. (Jingcheng) 2015-06-09 08:12:54 +05:30