Commit Graph

5739 Commits

Author SHA1 Message Date
zhangduo e99ed99bee HBASE-18000 Make sure we always return the scanner id with ScanResponse
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-05 11:38:34 -07:00
huzheng 2026540ea3 HBASE-17667: Implement async flush/compact region methods
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-05-05 21:12:49 +08:00
Zach York 01af27061e HBASE-17990 Refactor TestFSUtils to use Before
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-05-04 14:40:40 -07:00
Sean Busbey 0fb1fd1200 HBASE-17964 ensure hbase-metrics-api is included in mapreduce job classpaths
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2017-05-04 10:39:14 -05:00
tedyu 52119200bc HBASE-17991 Add more details about compaction queue on /dump (Guangxu Cheng) 2017-05-04 08:24:58 -07:00
Sukumar Maddineni 2de6b051f6 HBASE-16466 Snapshots support in VerifyReplication tool
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-03 14:22:18 -07:00
Chinmay Kulkarni 78f6799f4d Addendum patch for HBASE-12870. Added check for null pointer.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-03 14:03:16 -07:00
huzheng ff998ef74f HBASE-17867: Implement async procedure RPC API(list/exec/abort/isFinished)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-05-03 21:46:37 +08:00
Guanghao Zhang 91995749c2 HBASE-17958 Avoid passing unexpected cell to ScanQueryMatcher when optimize SEEK to SKIP 2017-05-03 21:28:43 +08:00
binlijin 4dbd025ccf HBASE-17263 Netty based rpc server impl
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-05-03 17:23:26 +08:00
ckulkarni 30d0c3fdde HBASE-12870 "Major compaction triggered" and "Skipping major compaction" messages lack the region information
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-02 10:54:15 -07:00
Jan Hentschel 17007685c1 HBASE-13074 Cleaned up usage of hbase.master.lease.thread.wakefrequency
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-05-02 23:12:02 +08:00
Gábor Lipták c8a7e80e0a HBASE-14286 Correct typo in argument name for WALSplitter.writeRegionSequenceIdFile
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-05-02 10:01:55 +08:00
yoshida.shinya ef94de3eb7 HBASE-17957 Custom metrics of replicate endpoints don't prepend "source." to global metrics
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-05-01 08:11:59 -07:00
Abhishek Kumar 1848353fd6 HBASE-17879: Avoid NPE in snapshot.jsp when accessing without any request parameter
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-04-29 10:51:46 +08:00
Sean Busbey ba12cdf138 HBASE-17975 TokenUtil should throw remote exception rather than squash it.
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
2017-04-28 13:19:33 -05:00
zhangduo 73d80bb416 HBASE-17970 Set yarn.app.mapreduce.am.staging-dir when starting MiniMRCluster
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-28 12:37:00 -05:00
QilinCao 03e8f6b56e HBASE-17835 Spelling mistakes in the Java source
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-28 11:25:57 -05:00
Jonathan M Hsieh 43f3fccb7b HBASE-17920 TestFSHDFSUtils always fails against hadoop 3.0.0-alpha2
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-28 11:25:14 -05:00
Steen Manniche 635c9db815 HBASE-17817 add table name to output (if available) when removing coprocessors
Amending-Author: Sean Busbey <busbey@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-28 11:24:00 -05:00
tedyu 5411d3ecb1 HBASE-17972 Remove mergePool from CompactSplitThread (Guangxu Cheng) 2017-04-28 06:52:10 -07:00
Ramkrishna b401a35fdc HBASE-17950 Write the chunkId also as Int instead of long into the first
byte of the chunk (Ram)
2017-04-28 14:44:46 +05:30
Allan Yang c4cbb419a3 HBASE-17757 Unify blocksize after encoding to decrease memory fragment
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
2017-04-28 07:25:36 +05:30
huzheng 4bc0eb31c3 HBASE-17865: Implement async listSnapshot/deleteSnapshot methods.
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-04-28 09:09:13 +08:00
Karan Mehta 880db3eee4 HBASE-17965 Canary tool should print the regionserver name on failure
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-04-26 18:30:13 -07:00
Thiruvel Thirumoolan 6bad35e728 HBASE-16942 Add FavoredStochasticLoadBalancer and FN Candidate generators
Signed-off-by: Francis Liu <toffer@apache.org>
2017-04-26 18:11:45 -07:00
Chia-Ping Tsai 053e61541e HBASE-15583 Any HTableDescriptor we give out should be immutable 2017-04-27 03:22:29 +08:00
zhangduo 8973582bc6 HBASE-17956 Raw scan should ignore TTL 2017-04-26 15:03:53 +08:00
Balazs Meszaros 2557506415 HBASE-15143 Procedure v2 - Web UI displaying queues
Signed-off-by: Michael Stack <stack@apache.org>
2017-04-25 09:39:28 -07:00
zhangduo 72fac37981 HBASE-17952 The new options for PE tool do not work 2017-04-25 09:34:49 +08:00
tedyu 435104af70 HBASE-17302 The region flush request disappeared from flushQueue - addendum (Guangxu Cheng) 2017-04-23 07:37:34 -07:00
Chia-Ping Tsai 9053ec6fe6 HBASE-17943 Addendum increases the threshold value of in-memory compaction for TestWalAndCompactingMemStoreFlush 2017-04-22 20:47:55 +08:00
tedyu e95cf479c7 HBASE-16314 Retry on table snapshot failure during full backup (Vladimir Rodionov) 2017-04-21 16:15:07 -07:00
huzheng d39f40e787 HBASE-17864: Implement async snapshot/cloneSnapshot/restoreSnapshot methods
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-04-21 18:57:43 +08:00
s9514171 33dadc1a94 HBASE-17941 CellArrayMap#getCell may throw IndexOutOfBoundsException
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-04-21 11:35:39 +08:00
Chia-Ping Tsai ea3a27b18d HBASE-17943 The in-memory flush size is different for each CompactingMemStore located in the same region 2017-04-21 11:20:20 +08:00
Abhishek Singh Chouhan 49cba2c237 HBASE-17937 Memstore size becomes negative in case of expensive postPut/Delete Coprocessor call
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-04-21 08:50:09 +08:00
Guanghao Zhang 40cc666ac9 HBASE-17915 Implement async replication admin methods 2017-04-20 18:13:03 +08:00
tedyu b1ef8dd43a HBASE-17542 Move backup system table into separate namespace 2017-04-20 02:57:24 -07:00
zhangduo 0953c14470 HBASE-17940 HMaster can not start due to Jasper related classes conflict 2017-04-20 16:06:50 +08:00
zhangduo 3acd8e4644 HBASE-17929 addendum fix typo and modify printUsage 2017-04-19 21:03:09 +08:00
Ramkrishna 972e8c8c29 HBASE-16438 Create a cell type so that chunk id is embedded in it (Ram) 2017-04-19 15:28:03 +05:30
zhangduo 6e962d6f65 HBASE-17929 addendum add scan read type option 2017-04-19 11:58:44 +08:00
zhangduo 66b616d7a3 HBASE-17914 Create a new reader instead of cloning a new StoreFile when compaction 2017-04-19 09:26:33 +08:00
zhangduo 75d1e0361a HBASE-17930 Avoid using Canary.sniff in HBaseTestingUtility 2017-04-18 18:07:25 +08:00
gjacoby 5eda5fb9d7 HBASE-17912 - Avoid major compactions on region server startup
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-17 19:41:19 -07:00
zhangduo 3c32032f5c HBASE-17929 Add more options for PE tool 2017-04-18 09:52:34 +08:00
Ramkrishna ecdfb82326 Revert "HBASE-16438 Create a cell type so that chunk id is embedded in it (Ram)"
This reverts commit c2c2178b2e.
2017-04-18 00:00:12 +05:30
Ramkrishna c2c2178b2e HBASE-16438 Create a cell type so that chunk id is embedded in it (Ram) 2017-04-17 09:28:24 +05:30
huaxiang sun c1ac3f7739 HBASE-17366 Run TestHFile#testReaderWithoutBlockCache failes
Signed-off-by: CHIA-PING TSAI <chia7712@gmail.com>
2017-04-17 10:34:17 +08:00
huzheng 8db9760363 HBASE-17866: Implement async setQuota/getQuota methods
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-04-17 09:49:30 +08:00
Michael Stack 7678855fac HBASE-17904 Get runs into NoSuchElementException when using Read Replica, with hbase. ipc.client.specificThreadForWriting
to be true and hbase.rpc.client.impl to be org.apache.hadoop.hbase.ipc.RpcClientImpl (Huaxiang Sun)
2017-04-16 11:01:06 -07:00
Umesh Agashe c8461456d0 HBASE-17888: Added generic methods for updating metrics on submit and finish of a procedure execution
Signed-off-by: Michael Stack <stack@apache.org>
2017-04-14 11:51:08 -07:00
Apekshit Sharma da5fb27eab HBASE-16775 Fix flaky TestExportSnapshot#testExportRetry.
Reason for flakyness: Current test is probability based fault injection and triggers failure 3% of the time. Earlier when test used LocalJobRunner which didn't honor "mapreduce.map.maxattempts", it'd pass 97% time (when no fault is injected) and fail 3% time (when fault was injected). Point being, even when the test was complete wrong, we couldn't catch it because it was probability based.

This change will inject fault in a deterministic manner.
On design side, it encapsulates all testing hooks in ExportSnapshot.java into single inner class.

Change-Id: Icba866e1d56a5281748df89f4dd374bc45bad249
2017-04-12 11:11:31 -07:00
CHIA-PING TSAI cf3215d343 HBASE-17897 StripeStoreFileManager#nonOpenRowCompare use the wrong comparison function 2017-04-12 11:54:42 +08:00
CHIA-PING TSAI 3aadc675b0 HBASE-17896 The FIXED_OVERHEAD of Segment is incorrect 2017-04-12 11:26:43 +08:00
Nemo Chen 0b5bd78d6e HBASE-16469 Several log refactoring/improvement suggestions
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-11 14:16:12 -05:00
Enis Soztutar 82d554e378 HBASE-16477 Remove Writable interface and related code from WALEdit/WALKey 2017-04-10 02:31:42 -07:00
CHIA-PING TSAI df96d328fb HBASE-17872 The MSLABImpl generates the invaild cells when unsafe is not availble 2017-04-09 23:28:34 +08:00
Chia-Ping Tsai 18c5ecf6ed HBASE-17881 Remove the ByteBufferCellImpl 2017-04-07 21:14:19 +08:00
Chia-Ping Tsai 1a701ce444 HBASE-17836 CellUtil#estimatedSerializedSizeOf is slow when input is ByteBufferCell 2017-04-07 09:30:15 +08:00
Jerry He 48b2502a5f HBASE-17816 HRegion#mutateRowWithLocks should update writeRequestCount metric (Weizhan Zeng) 2017-04-06 16:45:45 -07:00
Umesh Agashe 9109803891 HBASE-17863: Procedure V2: Some cleanup around Procedure.isFinished() and procedure executor
Signed-off-by: Michael Stack <stack@apache.org>
2017-04-06 12:05:23 -07:00
Tomu Tsuruhara ec5188df30 HBASE-17871 scan#setBatch(int) call leads wrong result of VerifyReplication
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-04-06 07:00:13 -07:00
Yu Li cbcbcf4dcd HBASE-17854 Use StealJobQueue in HFileCleaner after HBASE-17215 2017-04-05 17:53:21 +08:00
zhangduo a66d491892 HBASE-17857 Remove IS annotations from IA.Public classes 2017-04-05 15:34:06 +08:00
tedyu 910b68082c HBASE-14141 HBase Backup/Restore Phase 3: Filter WALs on backup to include only edits from backed up tables (Vladimir Rodionov) 2017-04-04 18:20:11 -07:00
Yu Li 9facfa550f HBASE-17215 Separate small/large file delete threads in HFileCleaner to accelerate archived hfile cleanup speed 2017-04-01 10:59:11 +08:00
huzheng 5f98ad2053 HBASE-17668: Implement async assgin/offline/move/unassign methods
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-04-01 08:19:14 +08:00
Karan Mehta 80381f3944 HBASE-17698 ReplicationEndpoint choosing sinks
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-03-31 16:12:10 -07:00
Michael Stack 7700a7fac1 HBASE-16780 Since move to protobuf3.1, Cells are limited to 64MB where previous they had no limit Update internal pb to 3.2 from 3.1. 2017-03-31 12:44:59 -07:00
zhangduo 0ec1459467 HBASE-17855 Fix typo in async client implementation 2017-03-31 13:00:27 +08:00
Michael Stack d033cbb715 HBASE-17844 Subset of HBASE-14614, Procedure v2: Core Assignment Manager (non-critical changes)
Minor changes related to HBASE-14614. Added comments. Changed logging.
Added toString formatting. Removed imports. Removed unused code.
2017-03-30 10:31:04 -07:00
Guanghao Zhang 752b258b7c HBASE-17520 Implement isTableEnabled/Disabled/Available methods 2017-03-30 13:37:17 +08:00
tedyu f159557ede HBASE-17287 Master becomes a zombie if filesystem object closes 2017-03-28 20:41:46 -07:00
tedyu 0345fc8775 HBASE-14417 Incremental backup and bulk loading 2017-03-28 16:23:36 -07:00
anastas cb4fac1d18 HBASE-17765 Reviving the merge of the compacting pipeline
making the limit on the number of the segments in the pipeline configurable, adding merge test, fixing bug in sizes counting
2017-03-28 10:54:57 -05:00
Sean Busbey 046d4e183b Revert "Reviving the merge of the compacting pipeline: making the limit on the number of the segments in the pipeline configurable, adding merge test, fixing bug in sizes counting"
This reverts commit c77e2135db.

Bad commit message
2017-03-28 10:53:41 -05:00
Ashu Pachauri 4b62a52ebc HBASE-16755 Honor flush policy under global memstore pressure
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-27 11:47:20 -07:00
anastas c77e2135db Reviving the merge of the compacting pipeline: making the limit on the number of the segments in the pipeline configurable, adding merge test, fixing bug in sizes counting 2017-03-27 15:41:32 +03:00
Chia-Ping Tsai 6bd3109062 HBASE-17623 Reuse the bytes array when building the hfile block 2017-03-25 23:49:32 +08:00
huzheng faf81d5133 HBASE-17669: Implement async mergeRegion/splitRegion methods
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-03-24 21:25:24 +08:00
zhangduo f1c1f258e5 HBASE-17595 addendum fix the problem for mayHaveMoreCellsInRow 2017-03-23 20:34:10 +08:00
CHIA-PING TSAI fe3c32ebd5 HBASE-17809 cleanup unused class 2017-03-23 14:15:28 +08:00
tedyu 1cfd22bf43 HBASE-17798 RpcServer.Listener.Reader can abort due to CancelledKeyException (Guangxu Cheng) 2017-03-21 06:59:29 -07:00
eshcar 8f4ae0a0dc HBASE-17655 Removing MemStoreScanner and SnapshotScanner 2017-03-21 12:35:47 +02:00
Apekshit Sharma e39e0e634a HBASE-17582 Fix broken drop page cache hint (broken by HBASE-15236).
Change-Id: I2947ab979979f977db7b0c282c4aaf4eb1f26482
2017-03-20 11:19:51 -07:00
Jan Hentschel 55d6dcaf87 HBASE-16084 Cleaned up the stale references in Javadoc
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-20 10:55:36 -07:00
zhangduo 5b4bb8217d HBASE-17691 Add ScanMetrics support for async scan 2017-03-20 20:54:04 +08:00
Chia-Ping Tsai 261aa9445c HBASE-17803 Addendum fix NPE 2017-03-19 19:05:25 +08:00
CHIA-PING TSAI 23abc90068 HBASE-17803 PE always re-creates table when we specify the split policy 2017-03-19 18:27:54 +08:00
tedyu 75d0f49dcd HBASE-14123 HBase Backup/Restore Phase 2 (Vladimir Rodionov) 2017-03-18 03:04:19 -07:00
tedyu 0ed50f42e7 HBASE-17707 New More Accurate Table Skew cost function/generator - revert due to test failure 2017-03-16 19:08:45 -07:00
tedyu a69c23abfe HBASE-17706 TableSkewCostFunction improperly computes max skew - revert due to test failure 2017-03-16 19:07:59 -07:00
Andrew Purtell 7f0e6f1c9e HBASE-17758 [RSGROUP] Add shell command to move servers and tables at the same time (Guangxu Cheng) 2017-03-16 18:37:40 -07:00
Michael Stack 7c19490bac HBASE-17792 Use a shared thread pool for AtomicityWriter, AtomicGetReader, AtomicScanReader's connections in TestAcidGuarantees (Huaxiang Sun) 2017-03-16 15:15:28 -07:00
Michael Stack 6fb44f7eb8 HBASE-17501 Revert "Revert "guard against NPE while reading FileTrailer and HFileBlock""
This reverts commit 9a4068dcf8.

This is a revert of a revert -- i.e. a restore -- just so I can add the
JIRA issue to the commit message.
2017-03-16 14:54:17 -07:00
Michael Stack 9a4068dcf8 Revert "guard against NPE while reading FileTrailer and HFileBlock"
This reverts commit 201c838250.

Reverted because missing JIRA number. Fixing...
2017-03-16 14:53:25 -07:00
Kahlil Oppenheimer edbd0e494d HBASE-17706 TableSkewCostFunction improperly computes max skew
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-16 11:57:25 -07:00
Ramkrishna e67eb6c424 HBSE-15314 Allow more than one backing file in bucketcache (Chunhui Shen) 2017-03-16 16:28:58 +05:30
Guanghao Zhang 6a6fff103e HBASE-17790 Mark ReplicationAdmin's peerAdded and listReplicationPeers as Deprecated 2017-03-16 16:55:18 +08:00
Kahlil Oppenheimer 53e9a1c43a HBASE-17707 New More Accurate Table Skew cost function/generator - re-enable with test fix
This reverts commit 9214ad69af.

Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-15 20:42:40 -07:00
zhangduo 1849e8a5a7 HBASE-17740 Correct the semantic of batch and partial for async client 2017-03-16 09:44:23 +08:00
Chia-Ping Tsai 0ecb678259 HBASE-17723 ClientAsyncPrefetchScanner may end prematurely when the size of the cache is one 2017-03-16 03:07:20 +08:00
zhangduo a49bc58a54 HBASE-17584 Expose ScanMetrics with ResultScanner rather than Scan 2017-03-15 17:48:58 +08:00
Yu Li aace02a230 HBASE-17782 Extend IdReadWriteLock to support using both weak and soft reference 2017-03-15 11:07:42 +08:00
tedyu 777fea552e HBASE-17779 disable_table_replication returns misleading message and does not turn off replication (Janos Gub) 2017-03-14 12:13:34 -07:00
Yu Li 44b255889c HBASE-17747 Support both weak and soft object pool 2017-03-14 11:07:52 +08:00
James Moore 201c838250 guard against NPE while reading FileTrailer and HFileBlock
guard against NPE from FSInputStream#seek

Signed-off-by: Michael Stack <stack@apache.org>
2017-03-13 14:53:35 -07:00
Tom Tsuruhara fee67bcf14 HBASE-17773 VerifyReplication tool wrongly emits Invalid arguments error
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-03-13 17:46:58 +08:00
Chia-Ping Tsai 31bc94ae60 HBASE-17746 TestSimpleRpcScheduler.testCoDelScheduling is broken
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-03-13 10:13:42 +08:00
zhangduo e0365df9d6 HBASE-17712 Addendum modify log message 2017-03-10 16:01:35 +08:00
zhangduo ed6e5d6999 HBASE-17763 IPCUtil.wrapException will wrap DoNotRetryIOException with IOException 2017-03-10 15:37:59 +08:00
anoopsamjohn ab5970773a HBASE-17338 Treat Cell data size under global memstore heap size only when that Cell can not be copied to MSLAB. 2017-03-10 11:12:59 +05:30
Andrew Purtell 7da0feea8d HBASE-17731 Fractional latency reporting in MultiThreadedAction 2017-03-09 16:54:23 -08:00
Ashu Pachauri d4cbff58cc HBASE-16977 VerifyReplication should log a printable representation of the row keys
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-09 16:31:02 -08:00
Esteban Gutierrez 1160315e2f HBASE-15941 HBCK repair should not unsplit healthy splitted region
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-08 22:02:14 -08:00
Umesh Agashe 2b89748432 HBASE-17761: Test TestRemoveRegionMetrics.testMoveRegion fails intermittently because of race condition
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-03-08 21:18:05 -08:00
Guanghao Zhang 4ff838df13 HBASE-17600 Implement get/create/modify/delete/list namespace admin operations 2017-03-09 10:32:46 +08:00
tedyu 9214ad69af HBASE-17707 New More Accurate Table Skew cost function/generator - revert due to test failure 2017-03-08 16:09:34 -08:00
Michael Stack 6a57050c24 HBASE-17718 Difference between RS's servername and its ephemeral node cause SSH stop working; AMENDMENT.
Make test tighter by extending ServerListener so can find when Master
is in the waiting-on-regionservers state and making more assertions
about state.

Fix error where I would move on from waiting-on-regionservers if
we had waited max time.
2017-03-08 08:14:24 -08:00
zhangduo 58c76192bd HBASE-17712 Remove/Simplify the logic of RegionScannerImpl.handleFileNotFound 2017-03-08 14:39:29 +08:00
Kahlil Oppenheimer ee1549cc97 HBASE-17707 New More Accurate Table Skew cost function/generator - adendum ensure testTableSkewConvergesToZero finishes before timeout
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-07 12:37:16 -08:00
Jan Hentschel b53f354763 HBASE-17532 Replaced explicit type with diamond operator
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-07 11:22:51 -08:00
Karan Mehta fee86ebd7b HBASE-17716 Formalize Scan Metric names
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-07 07:41:54 -08:00
Phil Yang b635414e83 HBASE-15484 Correct the semantic of batch and partial - amend to fix bug and revise the JavaDoc for related APIs. 2017-03-07 22:23:56 +08:00
Kahlil Oppenheimer 93b0cdeaaf HBASE-17707 New More Accurate Table Skew cost function/generator
This reverts commit 3b914df949.

Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-06 20:27:48 -08:00
tedyu dfc6cf3076 HBASE-17707 New More Accurate Table Skew cost function/generator - revert due to missing JIRA number 2017-03-06 20:26:59 -08:00
Phil Yang 0d3e986f7e HBASE-15484 Correct the semantic of batch and partial 2017-03-07 11:52:04 +08:00
ChiaPing Tsai 81cb298014 HBASE-17734 Guard against possibly copying the qualifier in the ScanDeleteTracker
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-06 18:01:06 -08:00
Michael Stack 7fa7156f2c HBASE-17718 Difference between RS's servername and its ephemeral node cause SSH stop working
This patch reverts HBASE-9593 -- i.e. registering in zk before we
register with master putting it back to how it was where we register
in zk AFTER we report for duty with the master (because then we'll
register in zk with the name the master gave us). It then fixes the
problem reported in HBASE-9593 in an alternate fashion by checking
for a RS znode if we failed a connect on assign; if none found, we
remove a server from online servers list.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Make move method available to tests.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
 Correct method name changing moveFromOnelineToDeadServers to
 moveFromOnlineToDeadServers

 Add actual fix which is call to checkForRSznode if exception trying to
 open a region; if none found, call expire on the server so it gets
 removed from the list of online servers.

 This patch exposes sloppyness in the waitForRegionServers around our
 current case where Master is hosting regions but ONLY hbase:meta;
 in this case we need to wait on at least another server to report
 in beyond Master (we weren't but stuff was 'working' because of the
 early registration of RS nodes in zk).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 Make 'killed' available to tests.

 Put registry of ephemeral node back to where it was originally,
 so it is AFTER we get response from Master on registering for duty
 so we can put our znode up in zk with the name the Master gave us
 rather than local name (which could be unknown to the Master).
   private boolean stopping = false;

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRSKilledWhenInitializing.java
 Cleanup and test of new cleanup.
2017-03-06 13:14:23 -08:00
Kahlil Oppenheimer de25fcbd93 Fixed flaky test failure for TestStochasticLoadBalancer
This reverts commit 3b914df949.

Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-03-06 12:15:33 -08:00
tedyu 3b914df949 HBASE-17707 New More Accurate Table Skew cost function/generator - revert due to TestDefaultLoadBalancer failure 2017-03-05 15:03:29 -08:00
Andrew Purtell 404a2883f2 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging 2017-03-03 12:40:06 -08:00
tedyu 06e984b086 HBASE-17707 New More Accurate Table Skew cost function/generator (Kahlil Oppenheimer) 2017-03-02 09:46:38 -08:00
tedyu 0b3ecc5ee7 HBASE-17710 HBase in standalone mode creates directories with 777 permission 2017-03-02 08:11:53 -08:00
huzheng 697a55a878 HBASE-17646: Implement Async getRegion method
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-03-02 11:52:05 +08:00
anastas 613bcb3622 HBASE-17662 Disable in-memory flush when replaying from WAL
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
2017-03-01 20:37:54 +05:30
tedyu 4a5eba5e59 HBASE-17673 Monitored RPC Handler not shown in the WebUI (Allan Yang) 2017-02-28 07:43:32 -08:00
Jingcheng Du f4e0ea24e6 HBASE-17688 MultiRowRangeFilter not working correctly if given same start and stop RowKey 2017-02-28 11:38:35 +08:00
Jingcheng Du 5a8f1e8aaa HBASE-17690 Clean up MOB code 2017-02-28 09:57:34 +08:00
Jan Hentschel 84a9eb3f5c HBASE-17634 Cleaned up the usage of Result.isPartial
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-27 20:44:35 +08:00
Apekshit Sharma 4d90425031 HBASE-17699 Fix TestLockProcedure.
Earlier when queues had locks, clearQueue() also cleaned up old locks when AbstractProcedureScheduler.clear() was called to reset scheduler for testing failure and recovery.
Now with locks decoupled from queues, they need to be separately cleaned up.
We can't have clearLocks() as abstract method in AbstractProcedureScheduler because at that level, a procedure scheduler is just a queue. It's only in MasterProcedureScheduler that locks come into picture. So directly overriding clear() method in MPS.

Earlier when queues had locks, clearQueue() also cleaned up old locks when AbstractProcedureScheduler.clear() was called.
Now with locks decoupled from queues, they need to be separately cleaned up.
We can't have clearLocks() as abstract method in AbstractProcedureScheduler because at that level, a procedure scheduler is just a queue. It's only in MasterProcedureScheduler that locks come into picture. So directly overriding clear() method in MPS.

Change-Id: If1a0acb418a79f98ce6155541edb0c1e621638e3
2017-02-26 15:32:31 -08:00
tedyu f4bf375ea1 HBASE-17674 Major compaction may be cancelled in CompactionChecker (Guangxu Cheng) 2017-02-25 09:45:11 -08:00
Apekshit Sharma f444b3b542 HBASE-17312 Use 'default' keyword in coprocessor Observer interfaces to get rid of 'Base...Observer' implementations. Some javadoc improvements too.
Reason for refactor:
In cases where one might need to use multiple observers, say region, master and regionserver; and the fact that only one class can be extended, it gives rise to following pattern:

public class BaseMasterAndRegionObserver
  extends BaseRegionObserver
  implements MasterObserver

class AccessController
  extends BaseMasterAndRegionObserver
  implements RegionServerObserver

were BaseMasterAndRegionObserver is full copy of BaseMasterObserver.

There is an example of simple case too where the current design fails.
Say only one observer is needed by the coprocessor, but the design doesn't permit extending even that single observer (see RSGroupAdminEndpoint), that leads to copy of full Bas
e...Observer class into coprocessor class leading to 1000s of lines of code and this ugly mix of 5 main functions with 100 useless functions.

Javadocs changes:
- Adds class comments on 'default' methods and expectations.
- Adds explanaiton of Exception handling in Observers' class comment. Removes redundant @throws before each function.
- Improves javadocs for a bunch of functions
- deletes empty @params in a bunch of places

Change-Id: I265738d47e8554e7b4678e88bb916a0cc7d00ab3
2017-02-25 02:49:01 -08:00
Ashu Pachauri e7d16db2ac HBASE-17057 Minor compactions should also drop page cache (Ashu Pachauri)
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-24 14:42:10 -08:00
dvdreddy a8fd1119ce HBASE-16630 Handle Fragmentation in bucket cache
Currently whenever a compaction/bulkload happen and the
blocks are evicted from theirs buckets the buckets become
fragmented and are not available to be used by other
BucketSizes

Bug Fix : Added Memory block type also to the list of
evictions that need to happen when there is a needForExtra

Improvement : Inorder to fix the non availabilty of Buckets and force
the movement of buckets to transformed sizes, whenever we encounter a
situation where an allocation cant be made for a BucketSize, we will
forcefully free the entire buckets that have least occupancy ratio. This
is the same strategy used by MemCached when they encounter a similar
issue going by the name 'Slab Calcification'. Only improvement is that
we use a heuristic to evict from the buckets that are least occupied
and also avoid the BucketSizes where there is a single Bucket

Change-Id: I9e3b4deb8d893953003ddf5f1e66312ed97ea9cb

Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
2017-02-24 15:02:07 +05:30
zhangduo 62de29e6f2 HBASE-16991 Make the initialization of AsyncConnection asynchronous 2017-02-24 15:36:54 +08:00
Abhishek Singh Chouhan c90d484f61 HBASE-17682 Region stuck in merging_new state indefinitely
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-23 15:30:17 -08:00
zhangduo 8fb44fae35 HBASE-17595 Add partial result support for small/limited scan 2017-02-23 16:03:42 +08:00