Commit Graph

4120 Commits

Author SHA1 Message Date
Enis Soztutar c16bbf47cb HBASE-13993 WALProcedureStore fencing is not effective if new WAL rolls 2015-07-10 13:36:45 -07:00
Matteo Bertozzi ae1f485ee8 HBASE-13832 Procedure v2: try to roll the WAL master on sync failure before aborting 2015-07-09 08:34:42 -07:00
Matteo Bertozzi 87ee37ceb8 Procedure v2 - Use nonces for double submits from client (Stephen Yuan Jiang) 2015-07-09 07:44:36 -07:00
tedyu f8eaa98962 HBASE-12596 bulkload needs to follow locality (Victor Xu) 2015-07-09 07:24:18 -07:00
anoopsjohn d07ff5ec5a HBASE-13387 Add ByteBufferedCell an extension to Cell. 2015-07-09 15:35:24 +05:30
Andrew Purtell 41c8ec7aea HBASE-14042 Fix FATAL level logging in FSHLog where logged for non fatal exceptions 2015-07-08 17:37:56 -07:00
tedyu 1162cbdf15 HBASE-13897 OOM may occur when Import imports a row with too many KeyValues (Liu Junhong) 2015-07-07 10:54:05 -07:00
Enis Soztutar 7acb061e63 HBASE-13988 Add exception handler for lease thread (Liu Shaohui) 2015-07-06 19:14:54 -07:00
Enis Soztutar c220635c78 HBASE-13352 Add hbase.import.version to Import usage (Lars Hofhansl) 2015-07-06 15:39:19 -07:00
Matteo Bertozzi 1713f1fcaf HBASE-14017 Procedure v2 - MasterProcedureQueue fix concurrency issue on table queue deletion
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-06 15:05:16 -05:00
Matteo Bertozzi d26978a2ff HBASE-13849 Remove restore and clone snapshot from the WebUI
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-06 11:12:30 -05:00
stack cff1a5f1f5 HBASE-14012 Double Assignment and Dataloss when ServerCrashProcedure
runs during Master failover
2015-07-06 07:57:40 -07:00
Lars Hofhansl 1f9bf419c1 HBASE-13329 ArrayIndexOutOfBoundsException in CellComparator#getMinimumMidpointArray. 2015-07-05 12:28:27 -07:00
Ashish Singhi 5b75faefcc HBASE-13925 Use zookeeper multi to clear znodes in ZKProcedureUtil
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-03 12:24:47 -07:00
ramkrishna 74e82c64e5 HBASE-13977 - Convert getKey and related APIs to Cell (Ram) 2015-07-03 22:59:58 +05:30
stack 71a523a619 HBASE-14013 Retry when RegionServerNotYetRunningException rather than go ahead with assign so for sure we don't skip WAL replay 2015-07-02 14:28:26 -07:00
stack 90b51e85c4 HBASE-14010 TestRegionRebalancing.testRebalanceOnRegionServerNumberChange fails; cluster not balanced 2015-07-02 10:05:18 -07:00
tedyu 34dfd6c9b4 HBASE-14005 Set permission to .top hfile in LoadIncrementalHFiles (Francesco MDE) 2015-07-02 08:42:40 -07:00
zhangduo 28a035000f HBASE-13970 NPE during compaction in trunk 2015-07-02 21:36:11 +08:00
anoopsjohn 62f5694491 HBASE-13998 Remove CellComparator#compareRows(byte[] left, int loffset, int llength, byte[] right, int roffset, int rlength). 2015-07-02 11:58:25 +05:30
stack 20e855f282 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) -- REAPPLY 2015-07-01 23:16:30 -07:00
stack f0e29c49a1 Revert "HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis"
This reverts commit fca725a899.
2015-07-01 20:20:08 -07:00
stack fca725a899 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis
Soztutar)
2015-07-01 20:07:26 -07:00
tedyu 5d1be4a317 HBASE-13980 Distinguish blockedFlushCount vs unblockedFlushCount when tuning heap memory (Abhilash) 2015-07-01 13:03:04 -07:00
Bhupendra 7a6f269c4d HBASE-13978: Variable never assigned in SimpleTotalOrderPartitioner.getPartition()
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-01 13:03:21 -05:00
Matt Warhaftig 364205da25 HBASE-13861 Fix UI label for BucketCache free & used bytes.
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-07-01 12:14:12 -05:00
Matteo Bertozzi 5ee11840f6 HBASE-13995 ServerName is not fully case insensitive 2015-07-01 09:26:15 -07:00
Sean Busbey 6ca337cb3e HBASE-13990 make maven site generation work with jdk8 2015-06-30 21:11:42 -05:00
Sean Busbey 85c278a6a8 HBASE-14003 work around JDK-8044053 2015-06-30 16:21:10 -05:00
anoopsjohn 42d5ef017d HBASE-13943 Get rid of KeyValue#heapSizeWithoutTags. 2015-06-30 23:09:09 +05:30
anoopsjohn 7e7fbdb84b HBASE-14001 Optimize write(OutputStream out, boolean withTags) for SizeCachedNoTagsKeyValue. 2015-06-30 22:50:38 +05:30
Lars Hofhansl f8bd578b80 HBASE-13959 Region splitting uses a single thread in most common cases. (Hari Krishna Dara) 2015-06-29 18:08:46 -07:00
tedyu 4f06279caa HBASE-13989 Threshold for combined MemStore and BlockCache percentages is not checked 2015-06-29 15:00:29 -07:00
anoopsjohn 3f062ee236 HBASE-13922 Do not reset mvcc in compactions for mob-enabled column.(Jingcheng Du) 2015-06-29 13:29:36 +05:30
Ashish Singhi 3efde85614 HBASE-13214 Remove deprecated and unused methods from HTable class 2015-06-26 15:39:53 -07:00
tedyu 183fa5d232 HBASE-13863 Multi-wal feature breaks reported number and size of HLogs (Abhilash) 2015-06-26 08:52:24 -07:00
tedyu f046c4b043 HBASE-13974 TestRateLimiter#testFixedIntervalResourceAvailability may fail (Guanghao Zhang) 2015-06-26 08:27:06 -07:00
ramkrishna 130817b559 HBASE-13939 - Make HFileReaderImpl.getFirstKeyInBlock() to return a Cell
(Ram)
2015-06-26 20:47:30 +05:30
tedyu 2ed058554c HBASE-13969 AuthenticationTokenSecretManager is never stopped in RPCServer (Pankaj Kumar) 2015-06-25 17:42:22 -07:00
tedyu db5dd1ebef HBASE-13923 Addendum fixes NPE in HRegionServer#buildServerLoad() 2015-06-25 16:31:44 -07:00
stack b5b5853043 HBASE-13893 Replace HTable with Table in client tests (Jurriaan Mous) 2015-06-25 14:42:33 -07:00
tedyu e6ed792199 HBASE-13702 ImportTsv: Add dry-run functionality and log bad rows (Apekshit Sharma) 2015-06-25 13:15:07 -07:00
anoopsjohn d9ba4d5bb5 HBASE-13835 KeyValueHeap.current might be in heap when exception happens in pollRealKV. (zhouyingchao) 2015-06-25 23:44:37 +05:30
tedyu edef3d64bc HBASE-13964 Skip region normalization for tables under namespace quota 2015-06-25 03:34:28 -07:00
tedyu b7f241d73b HBASE-13923 Loaded region coprocessors are not reported in shell status command (Ashish Singhi) 2015-06-23 21:25:50 -07:00
ramkrishna ba4ba32b0d HBASE-13932 - Add mob integrity check in HFilePrettyPrinter (Jingcheng du) 2015-06-24 09:22:44 +05:30
ramkrishna d7356667be HBASE-13945 - Prefix_Tree seekBefore() does not work correctly (Ram) 2015-06-24 09:11:05 +05:30
Nick Dimiduk 3e72dc9f08 HBASE-13938 Deletes done during the region merge transaction may get eclipsed (ddas, enis, ndimiduk) 2015-06-23 10:23:38 -07:00
Gábor Lipták b636c6b1cd HBASE-13898 AMMENDMENT Correct Javadoc errors in site
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-06-23 00:05:56 -05:00
Mikhail Antonov fd37ccb63c HBASE-13103 [ergonomics] add region size balancing as a feature of master 2015-06-22 15:52:07 -07:00
ramkrishna f9b17bfd37 HBASE-13614 - Avoid temp KeyOnlyKeyValue temp objects creations in read
hot path (Ram)
2015-06-22 12:30:46 +05:30
anoopsjohn a4bd2b784e HBASE-13448 New Cell implementation with cached component offsets/lengths. 2015-06-22 11:02:45 +05:30
anoopsjohn e4d8fab104 HBASE-13926 Close the scanner only after Call#setResponse. 2015-06-21 20:04:13 +05:30
Nick Dimiduk db08013ebe HBASE-13933 DBE's seekBefore with tags corrupts the tag's offset information thus leading to incorrect results (ramkrishna.s.vasudevan) 2015-06-19 14:41:06 -07:00
anoopsjohn 8ae4b374e3 HBASE-13916 Create MultiByteBuffer an aggregation of ByteBuffers. 2015-06-18 22:38:10 +05:30
Matteo Bertozzi fedfe878f4 HBASE-13917 Remove string comparison to identify request priority 2015-06-18 09:30:39 -07:00
Elliott Clark 623fd63827 HBASE-13876 Improving performance of HeapMemoryManager 2015-06-17 09:58:59 -07:00
Patrick White f469c3bd97 HBASE-13918 Fix hbase:namespace description
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-06-16 12:40:47 -07:00
Lars Hofhansl ce2fd2c58c HBASE-13885 ZK watches leaks during snapshots. 2015-06-16 12:21:49 -07:00
anoopsjohn b889339006 HBASE-13886 Return empty value when the mob file is corrupt instead of throwing exceptions. (Jingcheng) 2015-06-16 17:17:03 +05:30
anoopsjohn 2e2742183f HBASE-13737 [HBase MOB] MOBTable cloned from a snapshot leads to data loss, when that actual snapshot and main table is deleted. (Ashutosh Jindal) 2015-06-16 15:02:50 +05:30
Misty Stanley-Jones b16293b5e2 HBASE-13898 correct additional javadoc failures under java 8 <Gabor Liptak> 2015-06-16 14:18:09 +10:00
Misty Stanley-Jones 5e6373e8ec Revert "Correct Javadoc generation errors"
This reverts commit 0a227b79d6.
2015-06-16 14:18:09 +10:00
Gábor Lipták 0a227b79d6 Correct Javadoc generation errors 2015-06-16 13:27:45 +10:00
Nick Dimiduk cba9ea61dd HBASE-13821 WARN if hbase.bucketcache.percentage.in.combinedcache is set 2015-06-15 19:23:58 -07:00
tedyu 84a50393ee HBASE-13888 Fix refill bug from HBASE-13686 (Guanghao Zhang) 2015-06-15 18:31:28 -07:00
Nick Dimiduk 35a9c509fb HBASE-13905 TestRecoveredEdits.testReplayWorksThoughLotsOfFlushing failing consistently on branch-1.1 2015-06-15 17:15:47 -07:00
Nick Dimiduk 461f5307ba HBASE-13833 LoadIncrementalHFile.doBulkLoad(Path,HTable) doesn't handle unmanaged connections when using SecureBulkLoad 2015-06-15 12:10:23 -07:00
Enis Soztutar c6dd3f965b HBASE-13877 Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL 2015-06-14 11:22:07 -07:00
Gábor Lipták 682b8ab8a5 HBASE-13569 Correct Javadoc (for Java8)
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-06-13 01:10:37 -05:00
Dave Latham 293506c7cd HBASE-13639 SyncTable - rsync for HBase tables
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-06-12 16:00:00 -07:00
Sean Busbey 47a9ff5d1f HBASE-13848 Use Credential Provider when available for SSL passwords in InfoServer. 2015-06-12 09:12:20 -05:00
Srikanth Srungarapu 7595bdfb1a HBASE-13755 Provide single super user check implementation (Mikhail Antonov) 2015-06-11 20:51:05 -07:00
Josh Elser 8cef99e506 HBASE-13892 NPE in ClientScanner on null results array
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2015-06-11 19:03:59 -07:00
Changgeng Li 9d3422ed16 HBASE-13560 large compaction thread pool will steal jobs from small compaction pool when idle
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-06-11 14:23:29 -07:00
anoopsjohn faefb9073f HBASE-13855 Race in multi threaded PartitionedMobCompactor causes NPE. (Jingcheng) 2015-06-11 15:32:19 +05:30
Ashish Singhi 349cbe102a HBASE-13828 Add group permissions testing coverage to AC
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-06-10 17:47:04 -07:00
Enis Soztutar 399fddddc3 HBASE-13878 Set hbase.fs.tmp.dir config in HBaseTestingUtility.java for Phoenix UT to use 2015-06-10 16:30:02 -07:00
Jesse Yates 0f93986015 HBASE-13846 Run MiniCluster on top of other MiniDfsCluster 2015-06-10 11:27:08 -07:00
tedyu 3ada2345d6 HBASE-13873 LoadTestTool addAuthInfoToConf throws UnsupportedOperationException (sunyerui) 2015-06-10 07:32:10 -07:00
anoopsjohn bf3924ed05 HBASE-13871 Change RegionScannerImpl to deal with Cell instead of byte[], int, int. 2015-06-10 18:40:51 +05:30
anoopsjohn 26893aa451 HBASE-13836 Do not reset the mvcc for bulk loaded mob reference cells in reading. (Jingcheng) 2015-06-10 18:05:10 +05:30
Jerry He 14fe23254a HBASE-13845 Expire of one region server carrying meta can bring down the master: test case 2015-06-09 11:46:58 -07:00
tedyu 6cc42c8cd1 HBASE-13829 Add more ThrottleType (Guanghao Zhang) 2015-06-09 06:42:55 -07:00
ramkrishna 487e4aa74f HBASE-13451 - Make the HFileBlockIndex blockKeys to Cells so that it could
be easy to use in the CellComparators (Ram)
2015-06-09 12:03:01 +05:30
stack c62b396f9f HBASE-13847 getWriteRequestCount function in HRegionServer uses int variable to return the count (Abhilash) 2015-06-08 20:35:43 -07:00
anoopsjohn ba348cf5a5 HBASE-13856 Wrong mob metrics names in TestRegionServerMetrics. (Jingcheng) 2015-06-09 08:12:54 +05:30
stack c19bc6d6e0 HBASE-13811 Splitting WALs, we are filtering out too many edits -> DATALOSS; ADDENDUM 2015-06-08 12:56:41 -07:00
Enis Soztutar 5f92b91e60 HBASE-13853 ITBLL improvements after HBASE-13811 (ADDENDUM to fix logging) 2015-06-08 12:43:45 -07:00
Enis Soztutar fe5712f9b4 HBASE-13853 ITBLL improvements after HBASE-13811 2015-06-08 12:17:50 -07:00
stack 5c16b34e32 HBASE-13811 Splitting WALs, we are filtering out too many edits -> DATALOSS 2015-06-08 10:55:53 -07:00
anoopsjohn 13fe542bcc HBASE-13806 Check the mob files when there are mob-enabled columns in HFileCorruptionChecker. (Jingcheng) 2015-06-08 11:17:43 +05:30
ramkrishna 9f43a3bea6 HBASE-13686 - Fail to limit rate in RateLimiter (Ashish Singhi) 2015-06-07 16:34:44 +05:30
anoopsjohn c1d970b04d HBASE-13834 Evict count not properly passed to HeapMemoryTuner. (Abhilash) 2015-06-06 08:07:45 +05:30
anoopsjohn fef6d7f48c HBASE-13827 Delayed scanner close in KeyValueHeap and StoreScanner. 2015-06-06 08:02:35 +05:30
tedyu e8e5a9f639 HBASE-13831 TestHBaseFsck#testParallelHbck is flaky against hadoop 2.6+ (Stephen Jiang) 2015-06-03 15:46:22 -07:00
Srikanth Srungarapu fad545652f HBASE-13826 Unable to create table when group acls are appropriately set. 2015-06-02 22:37:41 -07:00
tedyu 722fd17069 HBASE-13356 HBase should provide an InputFormat supporting multiple scans in mapreduce jobs over snapshots (Andrew Mains) 2015-06-02 19:29:15 -07:00
Enis Soztutar de01553bc4 HBASE-13732 TestHBaseFsck#testParallelWithRetriesHbck fails intermittently (Stephen Yuan Jiang, ADDENDUM for failing tests) 2015-06-02 17:26:35 -07:00
tedyu b7c0ac7cd7 HBASE-13824 TestGenerateDelegationToken: Master fails to start in Windows environment (Stephen Jiang) 2015-06-02 10:01:23 -07:00
anoopsjohn 841c7cf264 HBASE-13820 Zookeeper is failing to start. (Ashish Singhi) 2015-06-02 12:21:04 +05:30
Enis Soztutar 1895f99faf HBASE-13812 Deleting of last Column Family of a table should not be allowed (ADDENDUM for failing unit test) 2015-06-01 11:43:47 -07:00
ramkrishna 7693e15b2b HBASE-13803 - Disable the MobCompactionChore when the interval is not
larger than 0 (Jingcheng Du)
2015-06-01 10:37:54 +05:30
Enis Soztutar 0e6102a68c HBASE-13809 TestRowTooBig should use HDFS directory for its region directory (Stephen Yuan Jiang) 2015-05-30 17:13:05 -07:00
Enis Soztutar ae803d72fe HBASE-13812 Deleting of last Column Family of a table should not be allowed 2015-05-30 16:30:48 -07:00
Matteo Bertozzi 8ac8fb4476 HBASE-13789 ForeignException should not be sent to the client 2015-05-29 19:32:42 +01:00
Matteo Bertozzi d86f2fa3b2 HBASE-13759 Procedure v2 - Improve procedure yielding 2015-05-29 19:29:29 +01:00
Sean Busbey a016b23e85 HBASE-13728 Remove direct use of Hadoop's GenericOptionParser.
* In most cases, just shift to proper use of ToolRunner
* Fix timing issue in TestImportExport
** add some diagnostic logs to Import and TestImportExport
** when testing for WAL use under different durability requests, ignore meta edits.
* In the case of TestImportTsv make a local anonymous class so we can get at internals.
2015-05-29 12:38:52 -05:00
Matteo Bertozzi 18fef46901 HBASE-13779 Calling table.exists() before table.get() end up with an empty Result 2015-05-29 16:39:03 +01:00
tedyu f35b6c6b77 HBASE-13776 Setting illegal versions for HColumnDescriptor does not throw IllegalArgumentException (Yuhao Bi) 2015-05-29 07:35:02 -07:00
tedyu cca687d718 HBASE-13802 Addendum fixes checkstyle warning by removing the whitespace before the right parenthesis 2015-05-29 02:47:54 -07:00
tedyu 5646071c73 HBASE-13802 Procedure V2: Master fails to come up due to rollback of create namespace table (Stephen Jiang) 2015-05-29 02:37:22 -07:00
anoopsjohn a84e829e12 HBASE-13790 Remove the DeleteTableHandler. (Jingcheng) 2015-05-29 12:12:40 +05:30
stack 325614220f HBASE-13616 Move ServerShutdownHandler to Pv2 2015-05-28 20:45:38 -07:00
tedyu 63d617a0cc HBASE-13800 TestStore#testDeleteExpiredStoreFiles should create unique data/log directory for each call (Stephen Jiang) 2015-05-28 19:30:36 -07:00
tedyu 365ddfaf58 HBASE-13797 Fix resource leak in HBaseFsck 2015-05-28 19:18:27 -07:00
Enis Soztutar eea28a334c HBASE-13801 Hadoop src checksum is shown instead of HBase src checksum in master / RS UI 2015-05-28 18:42:59 -07:00
Joao Girao d16d3afb60 HBASE-13718 added columns schema to table description in web view
Summary:
 * added a new table "Table Schema" on the table description page
 * per column, list all the key/values on the column description

Test Plan:
 * mvn test # and wait..
 * create a new table using hbase shell:
   * create 'mytesttable', {NAME=>'CF1'}, {NAME=>'CF2'}
 * open http://localhost:16010/table.jsp?name=mytesttable
 * check the "Table Schema" appears and lists the columns correctly

Reviewers: eclark, vicka.dudin

Differential Revision: https://reviews.facebook.net/D38649

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-05-28 17:07:42 -07:00
Matteo Bertozzi 4aa7209826 HBASE-13476 Procedure v2 - Add Replay Order logic for child procedures 2015-05-28 19:33:22 +01:00
Nick Dimiduk f0a1ca4a6f HBASE-13761 Optimize FuzzyRowFilter (Vladimir Rodionov) 2015-05-28 10:12:21 -07:00
anoopsjohn b31a6acf4c HBASE-13763 Handle the rename, annotation and typo stuff in MOB. (Jingcheng) 2015-05-28 13:43:12 +05:30
Lars George 91a5090365 HBASE-13777 Table fragmentation display triggers NPE on master status page 2015-05-28 08:14:36 +02:00
Sean Busbey 353b046d6c HBASE-13710 Remove dependency on Hadoop's ReflectionUtil.
* copies ReflectionUtils.logThreadInfo and needed private methods from Hadoop
  branch-2, fixes minor issues specific to our use.
* updates HttpServer's use of RU.newInstance to use the HBase version.
  Side effect: previously, FilterInitializer instances that happened to also
  implement Configurable would have setConfiguration called. Such uses should
  instead rely on the mandatory FilterInitializer.initFilter method call.
2015-05-27 23:51:11 -05:00
ramkrishna eeb11b5327 HBASE-13393 - Optimize memstore flushing to avoid writing tag information
to hfiles when no tags are present. (Ram)
2015-05-28 10:00:59 +05:30
Enis Soztutar ef18d75d00 HBASE-13732 TestHBaseFsck#testParallelWithRetriesHbck fails intermittently (Stephen Yuan Jiang) 2015-05-27 17:06:58 -07:00
Sean Busbey 6529d8833d HBASE-13716 use HdfsConstants instead of deprecated FSConstants. 2015-05-27 16:15:23 -05:00
Sean Busbey 4cab6963b0 HBASE-13726 Use commons-io to cleanup Closeables instead of hadoop IOUtils. 2015-05-27 16:04:55 -05:00
Andrew Purtell 4070770243 HBASE-13780 Default to 700 for HDFS root dir permissions for secure deployments (Enis Soztutar) 2015-05-27 13:15:32 -07:00
Andrew Purtell 942e09b71e HBASE-13768 ZooKeeper znodes are bootstrapped with insecure ACLs in a secure configuration (Enis Soztutar) 2015-05-27 12:23:14 -07:00
anoopsjohn 6388b3baf6 HBASE-13762 Use the same HFileContext with store files in mob files. (Jingcheng) 2015-05-25 23:27:45 +05:30
anoopsjohn 9ee184b673 HBASE-13760 Cleanup Findbugs keySet iterator warnings. (Gabor Liptak) 2015-05-25 22:11:49 +05:30
anoopsjohn d45e0a7d41 HBASE-13734 Improper timestamp checking with VisibilityScanDeleteTracker. 2015-05-25 13:53:13 +05:30
ramkrishna 5428c9fdd3 HBASE-13720 - Mob files are not encrypting in mob compaction and Sweeper
(Jingcheng du)
2015-05-25 10:05:20 +05:30
anoopsjohn f28e395290 HBASE-13375 Provide HBase superuser higher priority over other users in the RPC handling. (Mikhail Antonov) 2015-05-23 21:12:47 +05:30
tedyu e93e1ea73c HBASE-13671 More classes to add to org.apache.hadoop.hbase.mapreduce.driver (li xiang) 2015-05-22 19:32:51 -07:00
Srikanth Srungarapu 7662980798 HBASE-13658 Improve the test run time for TestAccessController class (Ashish Singhi) 2015-05-22 14:25:16 -07:00
stack c2d73f02eb HBASE-13745 Say why a flush was requested in log message 2015-05-22 11:41:22 -07:00
anoopsjohn 132f65ea1f HBASE-13739 Remove KeyValueUtil.ensureKeyValue(cell) from MOB code.(Jingcheng) 2015-05-22 20:15:22 +05:30
Lars Hofhansl f8893e0012 HBASE-13703 ReplicateContext should not be a member of ReplicationSource. 2015-05-21 21:56:21 -07:00
tedyu b886bac53c HBASE-13733 Failed MiniZooKeeperCluster startup did not shutdown ZK servers (Stephen Jiang) 2015-05-21 14:04:31 -07:00
tedyu a9cf353c75 HBASE-13741 Disable TestRegionObserverInterface#testRecovery and testLegacyRecovery (Stephen Jiang) 2015-05-21 13:59:09 -07:00
stack e1e8434340 HBASE-5980 Scanner responses from RS should include metrics on rows/KVs filtered 2015-05-21 11:06:27 -07:00
tedyu cb1ef915df HBASE-13731 TestReplicationAdmin should clean up MiniZKCluster resource (Stephen Jiang) 2015-05-21 10:27:21 -07:00
Lars Francke d16f349a63 HBASE-13645: Rename *column methods in MasterObserver to *columnFamily
Signed-off-by: stack <stack@apache.org>
2015-05-21 10:11:56 -07:00
anoopsjohn 6c3fd34475 HBASE-13641 Deperecate Filter#filterRowKey(byte[] buffer, int offset, int length) in favor of filterRowKey(Cell firstRowCell). 2015-05-21 16:50:42 +05:30
anoopsjohn 5098f365b4 HBASE-13736 Add delay for the first execution of ExpiredMobFileCleanerChore and MobFileCompactorChore.(Jingcheng) 2015-05-21 13:40:25 +05:30
anoopsjohn d69807663c HBASE-13642 Deprecate RegionObserver#postScannerFilterRow CP hook with byte[],int,int args in favor of taking Cell arg. 2015-05-21 13:36:12 +05:30
anoopsjohn 5e06ede3f7 HBASE-13679 Change ColumnTracker and SQM to deal with Cell instead of byte[], int, int. 2015-05-21 10:24:08 +05:30
Enis Soztutar eddabdd353 HBASE-13709 Updates to meta table server columns may be eclipsed 2015-05-20 17:42:32 -07:00
stack e2e9ea5bd5 Revert "HBASE-5980 Scanner responses from RS should include metrics on rows/KVs filtered"
Committed by mistake. Backing out till sure it good.

This reverts commit dc72dad7cd.
2015-05-20 13:25:49 -07:00
stack dc72dad7cd HBASE-5980 Scanner responses from RS should include metrics on rows/KVs filtered 2015-05-20 11:55:06 -07:00
anoopsjohn 88f19ab697 HBASE-13722 Avoid non static method from BloomFilterUtil. 2015-05-20 22:18:45 +05:30
tedyu 132573792d HBASE-13704 Hbase throws OutOfOrderScannerNextException when MultiRowRangeFilter is used (Aleksandr Maksymenko) 2015-05-19 20:22:53 -07:00
Enis Soztutar 0ef4a10882 HBASE-13717 TestBoundedRegionGroupingProvider#setMembershipDedups need to set HDFS diretory for WAL (Stephen Yuan Jiang) 2015-05-19 19:03:19 -07:00
Lars Francke 1fcee86978 HBASE-13636 Remove deprecation for HBASE-4072 (Reading of zoo.cfg)
Signed-off-by: stack <stack@apache.org>
2015-05-19 16:32:32 -07:00
Jonathan M Hsieh 09a00efc0b Merge remote-tracking branch 'apache/master' (5/19/15) into hbase-11339
Patches that caused deltas:
HBASE-10810 - around HColumnDescriptor 'should' vs 'is' api.
HBASE-11677 - LOG was made private
HBASE-11927 - Checksum constant changed
HBASE-10800 - CellComparator instead of KVComparator

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultStoreEngine.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/DefaultCompactor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/LoadTestTool.java
2015-05-19 16:30:21 -07:00
Jonathan M Hsieh 8a09d95c46 HBASE-13693 [HBase MOB] Mob files are not encrypting (Ashutosh Jindai) 2015-05-19 16:11:45 -07:00
Jonathan M Hsieh 4da0149ee4 HBASE-13531 Flakey failure of TestAcidGuarantees#testMobScanAtomicity (Jingcheng Du)
rd point was not properly handled in the mob scanner case.
2015-05-19 16:11:37 -07:00
Esteban Gutierrez 74e5b26e57 HBASE-13694 CallQueueSize is incorrectly decremented until the response is sent
Signed-off-by: stack <stack@apache.org>
2015-05-19 09:22:31 -07:00
ramkrishna 5e7e626ef5 HBASE-13510 - Purge ByteBloomFilter (Ram) 2015-05-19 10:22:56 +05:30
Nick Dimiduk 92e66ef522 HBASE-13609 TestFastFail is still failing 2015-05-18 12:46:52 -07:00
Andrew Purtell f49111e5f8 HBASE-13668 TestFlushRegionEntry is flaky 2015-05-16 16:28:10 -07:00
Patrick White 3fa0bf3cb6 HBASE-13684 Allow mlockagent to be used when not starting as root
Fixes for mlockall_agent
changed init_str to options, to match the JVMTI docs
added support for running with no user (allow via adding user to limits.conf)

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-05-16 12:38:20 -07:00
Apekshit(Appy) Sharma 988593857f HBASE-11927 Use Native Hadoop Library for HFile checksum. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-05-15 11:40:23 -07:00
Matteo Bertozzi fec091a807 HBASE-13651 Handle StoreFileScanner FileNotFoundException 2015-05-15 18:57:58 +01:00
Andrey Stepachev 9ba7337ac8 HBASE-13646 HRegion#execService should not try to build incomplete messages 2015-05-14 13:21:48 +01:00
stack 94937ddaf2 HBASE-11830 TestReplicationThrottler.testThrottling failed on virtual boxes 2015-05-13 09:43:16 -07:00
eshcar 86b91997d0 HBASE-13071 Hbase Streaming Scan Feature
Signed-off-by: stack <stack@apache.org>
2015-05-13 08:23:39 -07:00
Lars Hofhansl 220ac141bf HBASE-13618 ReplicationSource is too eager to remove sinks. 2015-05-12 21:27:55 -07:00
Matteo Bertozzi befb46c4d5 HBASE-13662 RSRpcService.scan() throws an OutOfOrderScannerNext if the scan has a retriable failure 2015-05-12 17:47:04 +01:00
tedyu 89688d4a43 HBASE-13663 HMaster fails to restart 'HMaster: Failed to become active master' 2015-05-12 09:04:56 -07:00
Srikanth Srungarapu 9e131dfa8e HBASE-13571 Procedure v2 - client modify table sync 2015-05-11 23:07:15 -07:00
Enis Soztutar 59a6e031fb HBASE-13661 Correct binary compatibility issues discovered in 1.1.0RC0 2015-05-11 18:28:29 -07:00
Matteo Bertozzi 30ecf990fe HBASE-13606 AssignmentManager.assign() is not sync in both path 2015-05-12 00:13:29 +01:00
Elliott Clark c3f83a9eff HBASE-13635 Regions stuck in transition because master is incorrectly assumed dead
Summary:
Requests to tell master that meta is moved can be blocked behind other requests that are trying to mutate meta.
This causes a dead lock and the master is assumed dead. However the master stays up the whole time.

This patch adds prioritization onto reporting meta moves. It should allow meta to make progress.

Test Plan: unit tests.

Differential Revision: https://reviews.facebook.net/D38109
2015-05-11 15:21:17 -07:00
Jerry He 174632111c HBASE-13217 Procedure fails due to ZK issue 2015-05-11 14:19:13 -07:00
Lars Francke fa6dc9c44e HBASE-13634 Avoid unsafe reference equality checks to EMPTY byte[]
Add comment

Signed-off-by: stack <stack@apache.org>
2015-05-11 10:55:48 -07:00
Lars Francke ec51d7b2e6 HBASE-1989 Admin (et al.) not accurate with Column vs. Column-Family
usage

Fix check style issues & rename parameter

Incorporate comments

Signed-off-by: stack <stack@apache.org>
2015-05-11 09:46:28 -07:00
stack b03ff8ccca Revert "Rename & deprecate everything in Admin"
Revert because does not cite associated JIRA in commit message (my
fault)

This reverts commit 2ad4114149.
2015-05-11 09:45:33 -07:00
Sean Busbey 9aeafe30b7 HBASE-13611 update clover profile to work with clover 4.x and maven 3.
* change pom to use a maven 3 compat version of clover
* add clover to javadoc plugin deps so that instrumented doclet works
* modify IA annotation test to filter out clover instrumentation
* make splitlog counters check for atomiclong before casting
2015-05-11 01:01:57 -05:00
Lars Francke 8e5a183256 HBASE-13655 Deprecate duplicate getCompression methods in HColumnDescriptor (Lars Francke <lars.francke@gmail.com>)
Recommit after commit missing JIRA
Signed-off-by: stack <stack@apache.org>
2015-05-10 22:52:10 -07:00
stack 17b6f59a98 Revert "Deprecate old methods"
Revert commit of HBASE-13655 Deprecate duplicate getCompression methods in HColumnDescriptor
I committed with bad commit message.

This reverts commit 5732bdb483.
2015-05-10 22:48:09 -07:00
Lars Francke 2ad4114149 Rename & deprecate everything in Admin
Fix check style issues & rename parameter

Incorporate comments

Signed-off-by: stack <stack@apache.org>
2015-05-10 20:47:12 -07:00
Lars Francke 5732bdb483 Deprecate old methods
Add proper JIRA

Signed-off-by: stack <stack@apache.org>
2015-05-10 20:11:12 -07:00
tedyu 7bdacf53f4 HBASE-13653 Uninitialized HRegionServer#walFactory may result in NullPointerException at region server startup​ 2015-05-10 07:37:07 -07:00
Sean Busbey 5a2ca43fa1 HBASE-13612 TestRegionFavoredNodes should guard against setup failure. 2015-05-09 14:13:54 -07:00
tedyu c90da7a81c HBASE-13593 Quota support for namespace should take snapshot restore and clone into account (Ashish Singhi) 2015-05-09 11:11:11 -07:00
Enis Soztutar 11b76732c0 HBASE-13576 HBCK enhancement: Failure in checking one region should not fail the entire HBCK operation. (Stephen Yuan Jiang) 2015-05-06 12:08:36 -07:00
tedyu a93ba89b5b HBASE-13625 Use HDFS for HFileOutputFormat2 partitioner's path (Stephen Yuan Jiang) 2015-05-06 07:31:15 -07:00
zhangduo 652929c0ff HBASE-13628 Use AtomicLong as size in BoundedConcurrentLinkedQueue 2015-05-06 14:51:22 +08:00
Josh Elser 2e132db85c HBASE-13591 Attempt to stabilize TestHBaseFsck 2015-05-05 15:37:19 -07:00
ramkrishna 977f867439 HBASE-10800 - Use CellComparator instead of KVComparator (Ram) 2015-05-05 11:38:10 +05:30
stack 25b5098da7 HBASE-13617 TestReplicaWithCluster.testChangeTable timeout (Stephen Yuan Jiang) 2015-05-04 17:15:35 -07:00
stack 2ee5f8f5fd HBASE-13464 Remove deprecations for 2.0.0 - Part 1 (Lars Francke) 2015-05-04 14:42:58 -07:00
Lars Hofhansl a4799acd6b HBASE-13333 Renew Scanner Lease without advancing the RegionScanner. 2015-05-02 17:48:32 -07:00
tedyu 807eba3e1a HBASE-13607 TestSplitLogManager.testGetPreviousRecoveryMode consistently failing (Josh Elser) 2015-05-02 07:14:10 -07:00
Andrew Purtell a6027aedb3 HBASE-13312 SmallScannerCallable does not increment scan metrics 2015-05-01 16:33:14 -07:00
Nick Dimiduk 9925e6df39 HBASE-13604 bin/hbase mapredcp does not include yammer-metrics jar 2015-05-01 09:15:16 -07:00
Jonathan M Hsieh 0e20bbf6a3 Merge branch 'apache/master' (4/16/15) into hbase-11339
API conflicts and test fixes
Update LoadTestTool.COLUMN_FAMILY -> DEFAULT_COLUMN_FAMILY due HBASE-11842
Use new 1.0+ api in some tests
Use updated Scanners internal api
Fix to take into account  HBASE-13203 - procedure v2 table delete

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
2015-05-01 08:18:51 -07:00
Matt Warhaftig d50d6d967d HBASE-13358 - Update VisibilityClient to accept Connection objects.
Signed-off-by: Srikanth Srungarapu <ssrungarapu@cloudera.com>
2015-04-30 21:28:01 -07:00
Lars Hofhansl 235dc9734f HBASE-13601 Connection leak during log splitting. (Abhishek Singh Chouhan) 2015-04-30 17:05:05 -07:00
Lars Hofhansl aabf6ea2f6 HBASE-13497 Remove MVCC stamps from HFile when that is safe. 2015-04-30 16:47:55 -07:00
Andrew Purtell 81e793e582 HBASE-13420 RegionEnvironment.offerExecutionLatency Blocks Threads under Heavy Load 2015-04-30 12:54:28 -07:00
ramkrishna 3a9c2b0c55 HBASE-13579 Avoid isCellTTLExpired() for NO-TAG cases (Ram) 2015-04-30 15:14:41 +05:30
stack 4120f657b9 HBASE-13564 Master MBeans are not published (Ashish Singhi) + Addendum 2015-04-29 11:35:31 -07:00
Nick Dimiduk 167f0f0480 Revert "HBASE-13564 Master MBeans are not published"
This reverts commit a725044644.
2015-04-29 09:14:59 -07:00
Devaraj Das b27e9e70be HBASE-13351. Annotate internal MasterRpcServices methods with admin priority (Josh Elser) 2015-04-28 23:38:28 -07:00
Rajeshbabu Chintaguntla e2f7508afd HBASE-13431 Allow to skip store file range check based on column family while creating reference files in HRegionFileSystem#splitStoreFile(Rajeshbabu) 2015-04-29 08:30:03 +05:30
Enis Soztutar 7348a05e99 HBASE-13585 HRegionFileSystem#splitStoreFile() finishes without closing the file handle in some situation (Stephen Yuan Jiang) 2015-04-28 17:27:46 -07:00
Matteo Bertozzi ee562faeb3 HBASE-13578 Remove Arrays.asList().subList() from FSHLog.offer() 2015-04-28 20:43:08 +01:00
Usha Kuchibhotla 94a00bea07 HBASE-11677 Making Logger instance modifiers consistent.
* IA.Public accessible logger instances deprecated
* logger instances modified by tests left in place
* all others made private static final

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-04-28 09:20:34 -05:00
Ashish Singhi 84dd84fc58 HBASE-13572 Procedure v2 - client truncate table sync
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-04-28 12:46:06 +01:00
Ashish Singhi a725044644 HBASE-13564 Master MBeans are not published 2015-04-27 21:23:59 -07:00
Josh Elser 01188f0e86 HBASE-13255 Fix grammar in Regions description paragraph 2015-04-27 15:51:15 -07:00
Matteo Bertozzi b96952beef HBASE-13394 Failed to recreate a table when quota is enabled 2015-04-27 21:43:39 +01:00
Andrey Stepachev d5ff2b587c HBASE-13322 Replace explicit HBaseAdmin creation with connection#getAdmin() 2015-04-27 16:28:53 +01:00
Srikanth Srungarapu 75507af9f8 HBASE-13563 Add missing table owner to AC tests. 2015-04-26 16:40:40 -07:00
Nick Dimiduk ba6ba16bc0 HBASE-13466 Document deprecations in 1.x - Part 1 (Lars Francke) 2015-04-26 13:13:02 -07:00
tedyu 8a18cf3c01 HBASE-13555 StackServlet produces 500 error 2015-04-24 16:40:32 -07:00
Srikanth Srungarapu b5fb861f76 HBASE-13536 Cleanup the handlers that are no longer being used. 2015-04-24 12:25:25 -07:00
Sean Busbey 9eecd43013 HBASE-13546 handle nulls in MasterAddressTracker when there is no master active. 2015-04-24 13:49:15 -05:00
ramkrishna 40a80c1fe0 HBASE-13450 - Addendum to remove an Unused import 2015-04-24 16:13:54 +05:30
ramkrishna a4fa930843 HBASE-13450 - Purge RawBytescomparator from the writers and readers for
HBASE-10800 (Ram)
2015-04-24 16:01:38 +05:30
tedyu e1cb405adc HBASE-13528 A bug on selecting compaction pool (Shuaifeng Zhou) 2015-04-24 02:16:41 -07:00
Apekshit(Appy) Sharma 031dd3638c HBASE-13534 Changed Master UI to promptly display if it is a backup master. (Apekshit)
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-04-23 15:06:53 -07:00
ramkrishna bcb2a279c4 HBASE-13501 - Deprecate/Remove getComparator() in HRegionInfo. (Ram) 2015-04-23 12:12:36 +05:30
Jerry He 6c427175b8 HBASE-13526 TestRegionServerReportForDuty can be flaky: hang or timeout 2015-04-22 21:19:10 -07:00
Jonathan Lawlor afd7a8f474 HBASE-13527 The default value for hbase.client.scanner.max.result.size is never actually set on Scans
Signed-off-by: stack <stack@apache.org>
2015-04-22 13:29:18 -07:00
tedyu 2bf8cda4f6 HBASE-13437 ThriftServer leaks ZooKeeper connections (Winger Pun) 2015-04-22 07:52:23 -07:00
Elliott Clark 07b8a7b264 HBASE-13524 TestReplicationAdmin fails on JDK 1.8 2015-04-21 17:06:10 -07:00
Matt Warhaftig ddab4726f6 HBASE-13350 Log warnings for sanity check failures when checks disabled.
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-04-16 09:51:47 +01:00
Josh Elser 682a29a57f HBASE-12987 Pare repeated hbck output and increase verbosity in long-running tasks. 2015-04-15 14:35:43 -07:00
Devaraj Das 14261bc9e5 HBASE-13453. Master should not bind to region server ports (Srikanth Srungarapu) 2015-04-15 11:02:08 -07:00
Andrew Purtell 2da1bf10b8 HBASE-12006 [JDK 8] KeyStoreTestUtil#generateCertificate fails due to "subject class type invalid"
This is a port of the fix from HADOOP-10847
2015-04-15 09:47:34 -07:00
Matteo Bertozzi 4788c6d1a8 HBASE-13455 Procedure V2 - master truncate table 2015-04-15 10:35:41 +01:00
zhangduo fe9180d79e HBASE-13499 AsyncRpcClient test cases failure in powerpc 2015-04-14 23:00:07 +08:00
Rajesh Nishtala 0b4e32a206 HBASE-13471 Fix a possible infinite loop in doMiniBatchMutation
Summary: in doMiniBatchMutation it is possible to get into an infinite loop when a query has a row that is not in the region. If the batch had an invalid row, the row lock further down the function would fail to acquire because it was an invalid row. However we'd catch the exception and improperly treat it as if we had not acquired the lock and then try acquiring the lock again. Thus once we got into this state we'd be stuck in an infinite loop. Worse yet, this infiite loop would occur with the readLock held. So any other opertaions such as doClose() would be locked out and stuck. The patch is to check whether the row is valid and short circuit the failure when it doesn't work.

Test Plan: IntegrationTestReplication would consistently fail when trying to disable large tables before the fix. After the test the tests pass consistently.

Reviewers: eclark

Subscribers: asameet

Differential Revision: https://reviews.facebook.net/D37437

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-04-21 15:24:52 -07:00
Enis Soztutar 4e0de088c5 HBASE-13515 Handle FileNotFoundException in region replica replay for flush/compaction events 2015-04-21 11:55:35 -07:00
anoopsjohn 2ba4c4eb9f HBASE-13520 NullPointerException in TagRewriteCell.(Josh Elser) 2015-04-21 17:34:09 +05:30
tedyu eb82b8b309 HBASE-13514 Fix test failures in TestScannerHeartbeatMessages caused by incorrect setting of hbase.rpc.timeout (Jonathan Lawlor) 2015-04-20 14:48:10 -07:00
Sean Busbey 702aea5b38 HBASE-13498 Add more docs and a basic check for storage policy handling. 2015-04-20 10:45:14 -05:00
Devaraj Das 3bf69761e1 HBASE-13482. Phoenix is failing to scan tables on secure environments. (Alicia Shu) 2015-04-19 22:17:38 -07:00
tedyu 3baab26d0b HBASE-13481 Addendum sets MASTER_HOSTNAME_KEY config 2015-04-19 15:16:21 -07:00
Tobi Vollebregt 176261af78 HBASE-13430 HFiles that are in use by a table cloned from a snapshot may be deleted when that snapshot is deleted
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-04-18 09:48:08 +01:00
Enis Soztutar 92e922e11d HBASE-13491 Issue in FuzzyRowFilter#getNextForFuzzyRule (Anoop Sam John) 2015-04-17 21:54:41 -07:00
Enis Soztutar 66e55ff388 HBASE-13481 Master should respect master (old) DNS/bind related configurations 2015-04-17 18:11:26 -07:00
Jonathan Lawlor abe3796a99 HBASE-13090 Progress heartbeats for long running scanners
Signed-off-by: stack <stack@apache.org>
2015-04-17 15:42:46 -07:00
Elliott Clark 2c5dc53a32 HBASE-13477 Create metrics on failed requests
Summary: Add metrics on how many requests are exceptions and what type.

Test Plan: behold unit tests.

Differential Revision: https://reviews.facebook.net/D37167
2015-04-17 15:37:31 -07:00
Jerry He 3ccae37866 HBASE-13456 Improve HFilePrettyPrinter first hbase:meta region processing (Samir Ahmic) 2015-04-17 11:29:33 -07:00
stack 92af695ea1 HBASE-13307 Making methods under ScannerV2#next inlineable, faster 2015-04-17 08:15:07 -07:00