Commit Graph

5092 Commits

Author SHA1 Message Date
Matteo Bertozzi f06c0060aa HBASE-16649 Truncate table with splits preserved can cause both data loss and truncated data appeared again 2016-09-26 12:58:04 -07:00
anoopsamjohn 43f47a8e73 HBASE-16704 Scan will be broken while working with DBE and KeyValueCodecWithTags. 2016-09-26 22:32:24 +05:30
Matteo Bertozzi 8da0500e7d HBASE-16695 Procedure v2 - Support for parent holding locks 2016-09-26 08:42:48 -07:00
Matteo Bertozzi e01e05cc0e HBASE-16587 Procedure v2 - Cleanup suspended proc execution 2016-09-26 08:08:44 -07:00
tedyu b7e0e15787 HBASE-16645 Wrong range of Cells is caused by CellFlatMap#tailMap, headMap, and SubMap (ChiaPing Tsai) 2016-09-25 06:42:32 -07:00
tedyu 3896d9ed0a HBASE-16692 Make ByteBufferUtils#equals safer and correct (binlijin) 2016-09-25 06:37:40 -07:00
chenheng 21969f5159 HBASE-16665 Check whether KeyValueUtil.createXXX could be replaced by CellUtil without copy 2016-09-25 14:06:55 +08:00
chenheng f7bb6fbf21 HBASE-16677 Add table size (total store file size) to table page (Guang Yang) 2016-09-25 10:48:01 +08:00
chenheng b14fb14886 Revert "HBASE-16677 Add table size (total store file size) to table page"
This reverts commit f5351e2dbd.
2016-09-25 10:47:20 +08:00
chenheng f5351e2dbd HBASE-16677 Add table size (total store file size) to table page 2016-09-25 09:49:50 +08:00
Matteo Bertozzi 7ed93f8f79 HBASE-16697 bump TestRegionServerMetrics to LargeTests 2016-09-23 15:45:56 -07:00
Apekshit Sharma 4082424305 HBASE-16679 Flush throughput controller: Minor perf change and fix flaky TestFlushWithThroughputController.
Change-Id: I79f4a65a67bfdc46868d68ff8a0c32f3a02b8cb1
2016-09-23 11:43:22 -07:00
Enis Soztutar eb112783ae HBASE-16604 Scanner retries on IOException can cause the scans to miss data - RECOMMIT after revert 2016-09-23 11:27:13 -07:00
Enis Soztutar 39db0cac78 Revert "HBASE-16604 Scanner retries on IOException can cause the scans to miss data"
This reverts commit 83cf44cd3f.

Reverting because accidental files are committed with this.
2016-09-23 11:25:23 -07:00
Jerry He 50b051ade1 HBASE-16257 Move staging dir to be under hbase root dir 2016-09-23 10:07:58 -07:00
Matteo Bertozzi d2ed74cbc6 HBASE-16688 Split TestMasterFailoverWithProcedures 2016-09-23 08:42:21 -07:00
tedyu 946c1ed8f8 HBASE-16423 Add re-compare option to VerifyReplication to avoid occasional inconsistent rows (Jianwei Cui) 2016-09-22 21:01:22 -07:00
binlijin 191afc8eb1 HBASE-16680 Reduce garbage in BufferChain
Signed-off-by: Yu Li <liyu@apache.org>
2016-09-23 11:06:23 +08:00
Yu Li 96c5a02217 Revert "HBASE-16880 Reduce garbage in BufferChain (binlijin)" to fix JIRA number
This reverts commit ce493642c0.
2016-09-23 11:03:21 +08:00
Matteo Bertozzi 07ed15598b HBASE-16671 Split TestExportSnapshot 2016-09-22 15:40:29 -07:00
Ben Lau 4b05f40984 HBASE-16662 Fix open POODLE vulnerabilities
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-09-22 14:27:07 -07:00
Enis Soztutar 83cf44cd3f HBASE-16604 Scanner retries on IOException can cause the scans to miss data 2016-09-22 12:06:11 -07:00
anoopsamjohn 1384c9a08d HBASE-16650 Wrong usage of BlockCache eviction stat for heap memory tuning. 2016-09-22 21:28:30 +05:30
tedyu 4bb84f7d0c HBASE-16675 Average region size may be incorrect when there is region whose RegionLoad cannot be retrieved 2016-09-22 07:33:34 -07:00
Ashish Singhi ce493642c0 HBASE-16880 Reduce garbage in BufferChain (binlijin) 2016-09-22 13:59:18 +05:30
Yu Li 2ff2c0ba6e HBASE-16670 Make RpcServer#processRequest logic more robust 2016-09-22 15:43:53 +08:00
anoopsamjohn 19bbf44554 HBASE-16651 LRUBlockCache#returnBlock should try return block to Victim Handler L2 cache. 2016-09-22 11:20:11 +05:30
Jonathan M Hsieh a90d433a2c HBASE-12088 Remove unused hadoop-1.0, hadoop-1.1 profiles from non-root poms 2016-09-21 20:45:03 -07:00
Jonathan M Hsieh 055dde7dfc HBASE-16669 Fix flakey TestAdmin1#testMergeRegions
Has been failing with incorrect region counts
2016-09-21 20:42:34 -07:00
Apekshit Sharma 593fb75083 HBASE-14734 Prevent BindException when setting up MiniKdc.
Port for kdc service gets selected in the constructor, but we bind to it later in MiniKdc.start()-->MiniKdc.initKDCServer() --> KdcServer.start(). In meantime, some other service can capture the port which results in BindException. The solution here is to catch the exception and retry.

Testing methodology:
- Used python and intellij.
- breakpoint on kdc.start(1), in catch block(2) and just after catch block(3).
- used python to bind to the selected port on breakpoint 1 --> run the program --> stops at breakpoint 2 (catch block)
- On breakpoint 1 and after 2 failures, close the port --> run the program --> skips catch block and goes to breakpoint 3.

Change-Id: I4e06e69819d1ec9a0a7fa471bf017f3a72c75cb3
2016-09-21 16:35:43 -07:00
Umesh Agashe 6a4c292a90 HBASE-16294 hbck reporting "No HDFS region dir found" for replicas
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-09-21 14:40:43 -07:00
Jerry He b6b01a790f HBASE-12949 Scanner can be stuck in infinite loop if the HFile is corrupted 2016-09-21 13:25:23 -07:00
chenheng c67983ebf8 HBASE-16659 Use CellUtil.createFirstOnRow instead of KeyValueUtil.createFirstOnRow in some places (binlijin) 2016-09-21 15:25:36 +08:00
Jerry He 66821206b8 HBASE-16647 hbck should do offline reference repair before online repair 2016-09-20 11:49:09 -07:00
tedyu 22dcce571c HBASE-16646 Enhance LoadIncrementalHFiles API to accept store file paths as input - addendum populates filesystem for the new doBulkLoad() 2016-09-20 10:52:38 -07:00
Matteo Bertozzi 181fed4450 HBASE-16551 Cleanup SplitLogManager and CatalogJanitor 2016-09-20 10:33:39 -07:00
tedyu 08d9a2b662 HBASE-16646 Enhance LoadIncrementalHFiles API to accept store file paths as input - addendum adheres to original cleanup logic 2016-09-20 09:38:18 -07:00
tedyu 348eb2834a HBASE-16646 Enhance LoadIncrementalHFiles API to accept store file paths as input 2016-09-20 07:42:01 -07:00
zhangduo 6eb6225456 HBASE-7612 [JDK8] Replace use of high-scale-lib counters with intrinsic facilities 2016-09-19 13:37:24 +08:00
zhangduo 4faa8ea934 HBASE-16165 Decrease RpcServer.callQueueSize before writeResponse causes OOM (Guanghao Zhang) 2016-09-18 10:05:27 +08:00
Apekshit Sharma da3abbcb35 HBASE-16534 Procedure v2 - Perf Tool for Scheduler.
Tool to test performance of locks and queues in procedure scheduler independently from other framework components.
Inserts table and region operations in the scheduler, then polls them and exercises their locks. Number of tables, regions and operations can be set using cli args.

Change-Id: I0fb27e67d3fcab70dd5d0b5197396b117b11eac6
2016-09-17 17:38:51 -07:00
Jerry He edc0ef3fe4 HBASE-16598 Enable zookeeper useMulti always and clean up in HBase code 2016-09-17 16:51:26 -07:00
Enis Soztutar 1a1003a482 HBASE-16447 Replication by namespaces config in peer (Guanghao Zhang) 2016-09-16 11:47:42 -07:00
chenheng 2cf8907db5 HBASE-16631 Extract AsyncRequestFuture related code from AsyncProcess 2016-09-17 00:35:23 +08:00
Matteo Bertozzi b6b72361b6 HBASE-16586 Procedure v2 - Cleanup sched wait/lock semantic 2016-09-16 08:50:17 -07:00
tedyu 2597217ae5 HBASE-16349 TestClusterId may hang during cluster shutdown 2016-09-16 02:32:03 -07:00
Matteo Bertozzi e19632a19a HBASE-16634 Speedup TestExportSnapshot 2016-09-15 18:29:09 -07:00
Nitin Aggarwal 8c4b09dfba HBASE-16624 Fix MVCC DeSerialization bug in the HFileScannerImpl
Change-Id: Ia970619ac7369d24ed432e827319dfdca16143c2

Signed-off-by: stack <stack@apache.org>
2016-09-15 11:01:51 -07:00
anoopsamjohn 56be3ac7c8 HBASE-16626 User customized RegionScanner from 1.X is incompatible with 2.0.0's off-heap part. (Charlie Qiangeng Xu) 2016-09-15 18:07:43 +05:30
Phil Yang 8ef6c76344 HBASE-16388 Prevent client threads being blocked by only one slow region server
Signed-off-by: stack <stack@apache.org>
2016-09-14 09:08:20 -07:00
Matteo Bertozzi 4c6a98bd76 HBASE-16618 Procedure v2 - Add base class for table and ns procedures 2016-09-13 11:37:52 -07:00
zhangduo a602aaf9ba HBASE-16615 Fix flaky TestScannerHeartbeatMessages 2016-09-13 17:41:01 +08:00
anoopsamjohn 77b327320a HBASE-16229 Cleaning up size and heapSize calculation. 2016-09-12 23:23:38 -07:00
chenheng 2566cfeb60 HBASE-16592 Unify Delete request with AP 2016-09-12 23:23:38 -07:00
tedyu 8855670cd7 HBASE-16616 Rpc handlers stuck on ThreadLocalMap.expungeStaleEntry (Tomu Tsuruhara) 2016-09-12 15:49:23 -07:00
chenheng 80d8b2100d HBASE-16086 TableCfWALEntryFilter and ScopeWALEntryFilter should not redundantly iterate over cells (Vincent Poon) 2016-09-11 09:55:08 +08:00
chenheng cc2a40a78f HBASE-16596 Reduce redundant interfaces in AsyncProcess 2016-09-10 11:13:28 +08:00
zhangduo 6c8d1f0ae8 HBASE-16309 TestDefaultCompactSelection.testCompactionRatio is flaky 2016-09-09 14:20:39 +08:00
chenheng e11aafae95 HBASE-16570 Compute region locality in parallel at startup (binlijin) 2016-09-09 10:54:48 +08:00
Andrew Purtell 46c756a4a7 HBASE-16589 Adjust log level for FATAL messages from HBaseReplicationEndpoint that are not fatal 2016-09-08 13:04:18 -07:00
tedyu d7e5c6fa8e HBASE-16505 Add AsyncRegion interface to pass deadline and support async operations - revert due to open questions 2016-09-08 11:55:46 -07:00
tedyu 1574c6ef39 HBASE-16505 Add AsyncRegion interface to pass deadline and support async operations (Phil Yang) 2016-09-08 06:57:03 -07:00
zhangduo c04b389181 HBASE-16445 Refactor and reimplement RpcClient 2016-09-08 20:32:56 +08:00
binlijin fc224ed0ed HBASE-16530 Reduce DBE code duplication
Signed-off-by: Yu Li <liyu@apache.org>
2016-09-08 13:48:27 +08:00
tedyu e9cfbfd107 HBASE-16572 Sync method in RecoverableZooKeeper failed to pass callback function in (Allan Yang) 2016-09-07 11:35:35 -07:00
tedyu b6ba13c377 HBASE-16460 Can't rebuild the BucketAllocator's data structures when BucketCache uses FileIOEngine (Guanghao Zhang) 2016-09-05 06:50:50 -07:00
zhangduo 91227f8f98 HBASE-16516 Revisit the implementation of PayloadCarryingRpcController 2016-09-04 09:16:15 +08:00
tedyu 592245ff13 HBASE-16556 The read/write timeout are not used in HTable.delete(List), HTable.get(List), and HTable.existsAll(List) (ChiaPing Tsai) 2016-09-03 17:14:57 -07:00
Matteo Bertozzi 008091fe8a HBASE-16552 MiniHBaseCluster#getServerWith() does not ignore stopped RSs 2016-09-02 16:49:17 -07:00
Andrew Purtell 5e905c02d9 HBASE-16399 Provide an API to get list of failed regions and servername in Canary (Vishal Khandelwal) 2016-09-02 10:13:35 -07:00
Jerry He 0b6eccf4c3 HBASE-16311 Audit log for delete snapshot operation is missing in case of snapshot owner deleting the same (Yi Liang) 2016-09-02 09:47:28 -07:00
Matteo Bertozzi f6ccae3502 HBASE-16507 Procedure v2 - Force DDL operation to always roll forward 2016-09-01 21:06:32 -07:00
Loknath Priyatham Teja Singamsetty b839d04d8e HBASE-16375 Mapreduce mini cluster using HBaseTestingUtility not setting correct resourcemanager and jobhistory webapp address of MapReduceTestingShim
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-09-01 15:57:39 -07:00
tedyu a1cd601ad7 HBASE-16527 IOExceptions from DFS client still can cause CatalogJanitor to delete referenced files (Vladimir Rodionov) 2016-09-01 12:31:20 -07:00
chenheng 3892550484 HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response 2016-09-01 10:33:24 +08:00
Matteo Bertozzi 8479554275 HBASE-16519 Procedure v2 - Avoid sync wait on DDLs operation (addendum) 2016-08-31 13:48:25 -07:00
Stephen Yuan Jiang 605af95132 HBASE-16528 Procedure-V2: ServerCrashProcedure misses owner information (Stephen Yuan Jiang) 2016-08-31 09:25:51 -07:00
zhangduo 45af3831fe HBASE-16526 Add more ipc tests 2016-08-31 20:44:56 +08:00
zhangduo 647a65ce01 HBASE-16531 Move cell block related code out of IPCUtil 2016-08-31 13:09:22 +08:00
tedyu 7b95ac117d HBASE-16502 Reduce garbage in BufferedDataBlockEncoder - addendum adopts Hiroshi's suggestion (binlijin) 2016-08-30 18:04:34 -07:00
Matteo Bertozzi af33f94513 HBASE-16522 Procedure v2 - Cache system user and avoid IOException 2016-08-30 15:39:49 -07:00
Matteo Bertozzi 4a4f8e7049 HBASE-16519 Procedure v2 - Avoid sync wait on DDLs operation 2016-08-30 09:45:56 -07:00
Matteo Bertozzi 2acd788dce HBASE-16082 Procedure v2 - Move out helpers from MasterProcedureScheduler 2016-08-30 09:44:35 -07:00
tedyu 9cb0094bdb HBASE-16509 Add option to LoadIncrementalHFiles which allows skipping unmatched column families 2016-08-30 03:00:59 -07:00
zhangduo 0d05c75184 HBASE-16510 Reset RpcController before retry 2016-08-30 16:56:28 +08:00
chenheng c000f29e47 HBASE-16224 Reduce the number of RPCs for the large PUTs (ChiaPing Tsai) 2016-08-30 06:35:33 +08:00
anoopsamjohn 950d547dae HBASE-16407 Handle MemstoreChunkPool size when HeapMemoryManager tunes memory. 2016-08-29 10:22:27 +05:30
chenheng 7eaba369e7 HBASE016490 Fix race condition between SnapshotManager and SnapshotCleaner 2016-08-27 10:48:21 +08:00
Matteo Bertozzi 1b9af2a2fa HBASE-16508 Move UnexpectedStateException to common 2016-08-26 16:40:30 -07:00
anoopsamjohn 0d99e827b2 HBASE-16213 A new HFileBlock structure for fast random get. (binlijin) 2016-08-26 10:50:36 +05:30
tedyu b1ee8a88c3 HBASE-16502 Reduce garbage in BufferedDataBlockEncoder (binlijin) 2016-08-25 20:35:30 -07:00
tedyu 3fd59b0ba9 HBASE-16409 Addendum fixes the case where delimiter is not specified by user 2016-08-25 11:53:49 -07:00
zhangduo a1f760ff76 HBASE-16433 Remove AsyncRpcChannel related stuffs 2016-08-25 08:15:46 +08:00
Stephen Yuan Jiang 8a692ff189 HBASE-16486 Unify system table creation using the same createSystemTable API (Stephen Yuan Jiang) 2016-08-24 15:21:20 -07:00
tedyu bf7015d320 HBASE-16304 HRegion#RegionScannerImpl#handleFileNotFoundException may lead to deadlock when trying to obtain write lock on updatesLock 2016-08-24 09:04:47 -07:00
Enis Soztutar dda8f67b2c HBASE-16270 Handle duplicate clearing of snapshot in region replicas (Robert Yokota) 2016-08-24 06:33:46 -07:00
Ashish Singhi 31f16d6aec HBASE-16471 Region Server metrics context will be wrong when machine hostname contain "master" word (Pankaj Kumar) 2016-08-24 18:59:44 +05:30
Enis Soztutar cbfd6eecbd HBASE-16474 Remove dfs.support.append related code and documentation 2016-08-24 03:41:54 -07:00
chenheng 3909b7c96f HBASE-16464 archive folder grows bigger and bigger due to corrupt snapshot under tmp dir 2016-08-24 13:38:32 +08:00
anoopsamjohn 32c21f4594 HBASE-14921 In-Memory MemStore Flush and Compaction : Memory optimizations. (Anastasia) 2016-08-24 09:25:21 +05:30