Commit Graph

4917 Commits

Author SHA1 Message Date
Guanghao Zhang ae502a9d5c HBASE-16910 Avoid NPE when starting StochasticLoadBalancer
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2016-10-25 11:58:41 +05:30
binlijin 16823ff55e HBASE-16931 Setting cell's seqId to zero in compaction flow might cause RS down.
Signed-off-by: Yu Li <liyu@apache.org>
2016-10-24 23:33:34 +08:00
Guanghao Zhang d76cc4c1f0 HBASE-16870 Add the metrics of replication sources which were transformed from other dead rs to ReplicationLoad
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-10-22 14:27:01 +08:00
Guanghao Zhang e395bf91db HBASE-16815 Low scan ratio in RPC queue tuning triggers divide by zero exception
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-10-21 17:00:24 -07:00
Ashu Pachauri 0117ed9d78 HBASE-16752 addendum. Do not retry large request for client versions less than 1.3
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-20 10:34:46 -07:00
Yu Li a7a4e17f1d HBASE-16698 Performance issue: handlers stuck waiting for CountDownLatch inside WALKey#getWriteEntry under high writing workload 2016-10-20 15:32:59 +08:00
Ashu Pachauri 33e89fa9cf HBASE-16752 Return error back to rpc client on exceeding rpc request size limit.
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-19 15:50:42 -07:00
Huaxiang Sun a97aef5163 HBASE-16345 RpcRetryingCallerWithReadReplicas#call() should catch some RegionServer Exceptions
Fix logic for
1). how to handle exception while waiting for reply from the primary replica.
2). handle exception from replicas while waiting for a correct response.

Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2016-10-19 14:22:42 -07:00
Gary Helmling ae151334ba HBASE-16754 All WALSplitter OutputSinks should process compaction events 2016-10-19 10:37:35 -07:00
Enis Soztutar 019c7f9303 HBASE-16824 Writer.flush() can be called on already closed streams in WAL roll 2016-10-18 19:14:20 -07:00
Guanghao Zhang 66941910bd HBASE-16653 Backport HBASE-11393 to branches which support namespace
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-18 09:12:47 +08:00
tedyu 08498c6848 HBASE-16856 Exception message in SyncRunner.run() should print currentSequence (Allan Yang) 2016-10-17 07:23:02 -07:00
tedyu a4cbdede31 HBASE-16853 Regions are assigned to Region Servers in /hbase/draining after HBase Master failover (David Pope) 2016-10-16 18:54:59 -07:00
Pankaj Kumar b7f283c6f6 HBASE-16724 Snapshot owner can't clone
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2016-10-15 11:57:00 +05:30
tedyu 57d3e9e756 HBASE-16816 HMaster.move() should throw exception if region to move is not online (Allan Yang) 2016-10-13 11:11:11 -07:00
tedyu ca581874b9 HBASE-16810 HBase Balancer throws ArrayIndexOutOfBoundsException when regionservers are in /hbase/draining znode and unloaded (David Pope) 2016-10-13 08:42:49 -07:00
Pankaj Kumar 27398ea525 HBASE-16807, RegionServer will fail to report new active Hmaster until HMaster/RegionServer failover.
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-13 22:17:28 +08:00
Phil Yang 8f9fadf021 HBASE-16664 Timeout logic in AsyncProcess is broken
Signed-off-by: chenheng <chenheng@apache.org>
2016-10-13 17:14:52 +08:00
tedyu e2278f9544 HBASE-16716 OfflineMetaRepair leaves empty directory inside /hbase/WALs which remains forever (Pankaj Kumar) 2016-10-12 19:42:18 -07:00
Phil Yang a3c29da0b6 HBASE-16505 Pass deadline to HRegion operations
Signed-off-by: Michael Stack <stack@apache.org>
2016-10-12 12:17:38 -07:00
tedyu 3830890635 HBASE-16801 The Append/Increment may return the data from future (ChiaPing Tsai) 2016-10-12 10:07:37 -07:00
tedyu bf03827196 HBASE-15109 HM/RS failed to start when "fs.hdfs.impl.disable.cache" is set to true (Pankaj Kumar) 2016-10-12 07:35:50 -07:00
Pankaj Kumar 6db4ef8479 HBASE-16663 JMX ConnectorServer stopped when unauthorized user try to stop HM/RS/cluster
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:

	hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterCoprocessorHost.java
2016-10-11 16:17:07 -07:00
Gary Helmling 4f29c23038 HBASE-16146 Remove thread local usage in Counter 2016-10-11 14:47:02 -07:00
tedyu b47ded3b42 HBASE-16803 Make hbase:acl table unsplittable - revert pending review comments 2016-10-11 12:51:58 -07:00
tedyu 408a9eb8a3 HBASE-16803 Make hbase:acl table unsplittable 2016-10-11 12:50:05 -07:00
Gary Helmling f13a21696f HBASE-16788 addendum Account for HStore archiveLock in heap size 2016-10-11 11:46:12 -07:00
Gary Helmling 89bef67d0c HBASE-16788 Guard HFile archiving under a separate lock 2016-10-10 16:06:55 -07:00
Dustin Pho 59ca4dad70 HBASE-16661 Add last major compaction age to per-region metrics
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-10 15:21:53 -07:00
Huaxiang Sun 66038b8c1a HBASE-16699 Overflows in AverageIntervalRateLimiter's refill() and getWaitInterval()
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-10-10 14:12:22 -07:00
Sean Busbey acb1392b15 HBASE-16701 rely on test category timeout instead of defining one on a specific test.
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
2016-10-10 00:24:24 -05:00
tedyu 364a57a950 HBASE-16771 VerifyReplication should increase GOODROWS counter if re-comparison passes 2016-10-09 20:51:23 -07:00
tedyu 4b75614a2e HBASE-16773 AccessController should access local region if possible 2016-10-08 21:17:15 -07:00
tedyu e043d450ed HBASE-16768 Inconsistent results from the Append/Increment (ChiaPing Tsai) 2016-10-08 13:12:21 -07:00
Gary Helmling bbaa0e851d HBASE-16657 addendum handle null RegionLoad 2016-10-07 14:05:30 -07:00
Dustin Pho fa98c506d0 HBASE-16657 Expose per-region last major compaction time in RegionServer UI
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-07 14:04:22 -07:00
Ashu Pachauri 7092dc3ec4 HBASE-16681: Flaky TestReplicationSourceManagerZkImpl
Change-Id: I6bf31eb2f3815079d346963ad78045f67e0f44b7
2016-10-06 16:58:08 -07:00
tedyu a8fe9ed64f HBASE-16772 Add verbose option to VerifyReplication for logging good rows 2016-10-06 11:19:58 -07:00
Mikhail Antonov afd3bc856e HBASE-16644 Errors when reading legit HFile Trailer of old (v2.0) format file 2016-10-04 17:52:08 -07:00
tedyu 252d7fae0a HBASE-16739 Timed out exception message should include encoded region name 2016-10-03 06:44:58 -07:00
tedyu a4426a7c2d HBASE-16739 Timed out exception message should include encoded region name - Revert due to misspelled word in subject 2016-10-03 06:44:11 -07:00
tedyu 69a3fd2ebf HBASE-16739) imed out exception message should include encoded region name 2016-10-02 21:10:20 -07:00
Enis Soztutar 06cc123849 HBASE-16721 Concurrency issue in WAL unflushed seqId tracking - ADDENDUM to change WAL to extend Closeable 2016-10-01 14:50:54 -07:00
Enis Soztutar 911f9b9eb7 HBASE-16678 MapReduce jobs do not update counters from ScanMetrics
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestTableMapReduce.java
2016-09-29 17:14:55 -07:00
Enis Soztutar bf5a7aba5c HBASE-16721 Concurrency issue in WAL unflushed seqId tracking 2016-09-29 14:51:14 -07:00
Sean Busbey df25ebf84f HBASE-15984 Handle premature EOF treatment of WALs in replication.
In some particular deployments, the Replication code believes it has
reached EOF for a WAL prior to succesfully parsing all bytes known to
exist in a cleanly closed file.

Consistently this failure happens due to an InvalidProtobufException
after some number of seeks during our attempts to tail the in-progress
RegionServer WAL. As a work-around, this patch treats cleanly closed
files differently than other execution paths. If an EOF is detected due
to parsing or other errors while there are still unparsed bytes before
the end-of-file trailer, we now reset the WAL to the very beginning and
attempt a clean read-through.

In current testing, a single such reset is sufficient to work around
observed dataloss. However, the above change will retry a given WAL file
indefinitely. On each such attempt, a log message like the below will
be emitted at the WARN level:

  Processing end of WAL file '{}'. At position {}, which is too far away
  from reported file length {}. Restarting WAL reading (see HBASE-15983
  for details).

Additionally, this patch adds some additional log detail at the TRACE
level about file offsets seen while handling recoverable errors. It also
add metrics that measure the use of this recovery mechanism.
2016-09-29 10:47:57 -05:00
tedyu df57859258 HBASE-16725 Don't let flushThread hang in TestHRegion 2016-09-29 06:57:02 -07:00
tedyu d4b5645a4e HBASE-16723 RMI registry is not destroyed after stopping JMX Connector Server (Pankaj Kumar) 2016-09-29 01:58:22 -07:00
Abhishek Singh Chouhan 96a8e8dce4 HBASE-16660 ArrayIndexOutOfBounds during the majorCompactionCheck in DateTieredCompaction
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-09-27 11:08:00 -07:00
Andrew Purtell 67a43c3059 HBASE-16694 Reduce garbage for onDiskChecksum in HFileBlock (binlijin) 2016-09-26 13:55:28 -07:00
Matteo Bertozzi 4566e4df58 HBASE-16649 Truncate table with splits preserved can cause both data loss and truncated data appeared again 2016-09-26 13:09:06 -07:00
chenheng d6f9eab4be HBASE-16677 Add table size (total store file size) to table page (Guang Yang) 2016-09-25 10:50:03 +08:00
Apekshit Sharma 9a510e9ba2 HBASE-16679 Flush throughput controller: Minor perf change and fix flaky TestFlushWithThroughputController.
Change-Id: I79f4a65a67bfdc46868d68ff8a0c32f3a02b8cb1
2016-09-23 11:47:12 -07:00
tedyu b503843bae HBASE-16423 Add re-compare option to VerifyReplication to avoid occasional inconsistent rows (Jianwei Cui) 2016-09-23 05:08:19 -07:00
Enis Soztutar 8a797e81b8 HBASE-16604 Scanner retries on IOException can cause the scans to miss data 2016-09-22 18:48:06 -07:00
Ben Lau 6973304026 HBASE-16662 Fix open POODLE vulnerabilities
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-09-22 19:59:08 +00:00
tedyu ba650a8a10 HBASE-16675 Average region size may be incorrect when there is region whose RegionLoad cannot be retrieved 2016-09-22 07:34:29 -07:00
Yu Li 76da21fc59 HBASE-16670 Make RpcServer#processRequest logic more robust 2016-09-22 15:44:45 +08:00
Jonathan M Hsieh 13d6acbc7f HBASE-12088 Remove unused hadoop-1.0, hadoop-1.1 profiles from non-root poms 2016-09-21 20:52:19 -07:00
Apekshit Sharma e7e660d5b2 HBASE-14734 Prevent BindException when setting up MiniKdc.
Port for kdc service gets selected in the constructor, but we bind to it later in MiniKdc.start()-->MiniKdc.initKDCServer() --> KdcServer.start(). In meantime, some other service can capture the port which results in BindException. The solution here is to catch the exception and retry.

Testing methodology:
- Used python and intellij.
- breakpoint on kdc.start(1), in catch block(2) and just after catch block(3).
- used python to bind to the selected port on breakpoint 1 --> run the program --> stops at breakpoint 2 (catch block)
- On breakpoint 1 and after 2 failures, close the port --> run the program --> skips catch block and goes to breakpoint 3.

Change-Id: I4e06e69819d1ec9a0a7fa471bf017f3a72c75cb3
2016-09-21 16:44:14 -07:00
Umesh Agashe 23c5ea39bd HBASE-16294 hbck reporting "No HDFS region dir found" for replicas
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-09-21 14:43:15 -07:00
Jerry He c80d671a06 HBASE-12949 Scanner can be stuck in infinite loop if the HFile is corrupted 2016-09-21 13:31:18 -07:00
Jerry He abfb20206d HBASE-16647 hbck should do offline reference repair before online repair 2016-09-20 11:53:01 -07:00
zhangduo 91d03697d9 HBASE-16165 Decrease RpcServer.callQueueSize before writeResponse causes OOM (Guanghao Zhang) 2016-09-18 10:05:48 +08:00
tedyu 591cc4cfb8 HBASE-16349 TestClusterId may hang during cluster shutdown 2016-09-16 06:57:42 -07:00
Phil Yang 069d1f73fa HBASE-16388 Prevent client threads being blocked by only one slow region server
Signed-off-by: stack <stack@apache.org>
2016-09-14 09:28:20 -07:00
tedyu 8ad14bac67 HBASE-16616 Rpc handlers stuck on ThreadLocalMap.expungeStaleEntry (Tomu Tsuruhara) 2016-09-12 16:29:24 -07:00
chenheng 94026d0d09 HBASE-16086 TableCfWALEntryFilter and ScopeWALEntryFilter should not redundantly iterate over cells (Vincent Poon)
Conflicts:
    hbase-server/src/main/java/org/apache/hadoop/hbase/replication/ScopeWALEntryFilter.java
    hbase-server/src/main/java/org/apache/hadoop/hbase/replication/TableCfWALEntryFilter.java
    hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWALEntryFilters.java
2016-09-11 10:48:00 +08:00
binlijin ad67fd0816 HBASE-16530 Reduce DBE code duplication
Signed-off-by: Yu Li <liyu@apache.org>
2016-09-09 16:25:56 +08:00
zhangduo bc4ab47147 HBASE-16309 TestDefaultCompactSelection.testCompactionRatio is flaky 2016-09-09 14:21:31 +08:00
chenheng b4086795f2 HBASE-16570 Compute region locality in parallel at startup (binlijin) 2016-09-09 14:16:37 +08:00
Andrew Purtell 52963b3428 HBASE-16589 Adjust log level for FATAL messages from HBaseReplicationEndpoint that are not fatal 2016-09-08 13:03:49 -07:00
tedyu 354706a7d8 HBASE-16572 Sync method in RecoverableZooKeeper failed to pass callback function in (Allan Yang) 2016-09-07 11:36:18 -07:00
tedyu b694b63ed7 HBASE-16460 Can't rebuild the BucketAllocator's data structures when BucketCache uses FileIOEngine (Guanghao Zhang) 2016-09-05 06:52:03 -07:00
tedyu e1aab356b3 HBASE-16556 The read/write timeout are not used in HTable.delete(List), HTable.get(List), and HTable.existsAll(List) (ChiaPing Tsai) 2016-09-04 21:15:10 -07:00
Matteo Bertozzi fa7731de6e HBASE-16552 MiniHBaseCluster#getServerWith() does not ignore stopped RSs 2016-09-02 16:52:57 -07:00
Andrew Purtell 8691520e33 HBASE-16399 Provide an API to get list of failed regions and servername in Canary (Vishal Khandelwal) 2016-09-02 10:43:20 -07:00
Jerry He 8be6f95f99 HBASE-16311 Audit log for delete snapshot operation is missing in case of snapshot owner deleting the same (Yi Liang) 2016-09-02 10:09:44 -07:00
Loknath Priyatham Teja Singamsetty 84b2431472 HBASE-16375 Mapreduce mini cluster using HBaseTestingUtility not setting correct resourcemanager and jobhistory webapp address of MapReduceTestingShim
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestHBaseTestingUtility.java
2016-09-01 15:57:18 -07:00
tedyu a034a2bdcb HBASE-16527 IOExceptions from DFS client still can cause CatalogJanitor to delete referenced files (Vladimir Rodionov) 2016-09-01 12:39:08 -07:00
Stephen Yuan Jiang d91edc2ac4 HBASE-16528 Procedure-V2: ServerCrashProcedure misses owner information (Stephen Yuan Jiang)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
2016-08-31 09:51:52 -07:00
tedyu 9907a7e2a2 HBASE-16502 Reduce garbage in BufferedDataBlockEncoder - addendum adopts Hiroshi's suggestion (binlijin) 2016-08-30 18:06:24 -07:00
Matteo Bertozzi 57c6384b09 HBASE-16522 Procedure v2 - Cache system user and avoid IOException 2016-08-30 15:35:08 -07:00
chenheng ce9b6c0abf HBASE-16224 Reduce the number of RPCs for the large PUTs (ChiaPing Tsai) 2016-08-30 13:30:23 +08:00
anoopsamjohn c899897bc8 HBASE-16213 A new HFileBlock structure for fast random get. (binlijin) 2016-08-29 12:11:46 +05:30
Matteo Bertozzi 35fa341913 HBASE-16508 Move UnexpectedStateException to common 2016-08-26 18:37:59 -07:00
tedyu b59f18c2af HBASE-16502 Reduce garbage in BufferedDataBlockEncoder (binlijin) 2016-08-25 20:39:42 -07:00
tedyu c78a5fd650 HBASE-16409 Addendum fixes the case where delimiter is not specified by user 2016-08-25 11:54:42 -07:00
Stephen Yuan Jiang 86d570b959 HBASE-16486 Unify system table creation using the same createSystemTable API (Stephen Yuan Jiang) 2016-08-24 21:59:33 -07:00
tedyu f9490aaf43 HBASE-16304 HRegion#RegionScannerImpl#handleFileNotFoundException may lead to deadlock when trying to obtain write lock on updatesLock 2016-08-24 10:57:14 -07:00
Enis Soztutar f0385b4b83 HBASE-16270 Handle duplicate clearing of snapshot in region replicas (Robert Yokota) 2016-08-24 06:43:19 -07:00
Ashish Singhi 3606b890f8 HBASE-16471 Region Server metrics context will be wrong when machine hostname contain "master" word (Pankaj Kumar) 2016-08-24 19:01:58 +05:30
chenheng de2f653caf HBASE-16464 archive folder grows bigger and bigger due to corrupt snapshot under tmp dir 2016-08-24 13:43:18 +08:00
Geoffrey 6e9b49cac7 HBASE-16448 Custom metrics for custom replication endpoints
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-08-23 17:17:42 -07:00
Matteo Bertozzi a1e57d942e HBASE-16360 TableMapReduceUtil addHBaseDependencyJars has the wrong class name for PrefixTreeCodec (Jing Pu Chen) 2016-08-23 14:31:58 -07:00
Apekshit Sharma a8909f5cba HBASE-16467 Move AbstractHBaseTool to hbase-common.
Change-Id: Ifb81c15b89b308f53e6ee8a76e18189b5b526cd3
2016-08-22 16:32:46 -07:00
tedyu 2a35019a31 HBASE-16455 Provide API for obtaining all the WAL files 2016-08-22 06:56:14 -07:00
tedyu d260108e39 HBASE-16409 Row key for bad row should be properly delimited in VerifyReplication 2016-08-20 17:18:27 -07:00
Yu Li e05b002ed5 HBASE-16429 FSHLog: deadlock if rollWriter called when ring buffer filled with appends 2016-08-18 10:03:46 +08:00
chenheng 3d7bcd020e HBASE-15635 Mean age of Blocks in cache (seconds) on webUI should be greater than zero
Signed-off-by: stack <stack@apache.org>
2016-08-17 10:59:58 -07:00
tedyu a944a19879 HBASE-16419 check REPLICATION_SCOPE's value more stringently (Guangxu Cheng) 2016-08-17 09:01:54 -07:00
stack 6976a7b312 HBASE-16341 Missing bit on "Regression: Random Read/WorkloadC slower in 1.x than 0.98" 2016-08-15 13:29:36 -07:00
Phil Yang e51df6723c HBASE-16368 test*WhenRegionMove in TestPartialResultsFromClientSide is flaky
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-10 18:13:20 +08:00
Phil Yang 38044ada32 HBASE-16285 Drop RPC requests if it must be considered as timeout at client
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-10 16:16:15 +08:00
Phil Yang 441bc050b9 HBASE-9465 Push entries to peer clusters serially
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-09 15:26:15 +08:00
stack 25c4ff5404 HBASE-9899 for idempotent operation dups, return the result instead of throwing conflict exception (Guanghao Zhang) 2016-08-08 21:44:37 -07:00
tedyu 0a1a0a6883 HBASE-16367 Race between master and region server initialization may lead to premature server abort - addendum shortens the waiting duration 2016-08-08 10:41:14 -07:00
tedyu 225383d321 HBASE-16367 Race between master and region server initialization may lead to premature server abort 2016-08-08 08:42:05 -07:00
Phil Yang 0354dbf1ec HBASE-12770 Don't transfer all the queued hlogs of a dead server to the same alive server
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-08 16:32:43 +08:00
Vivek ec99838b9c HBASE-15866 Split hbase.rpc.timeout into *.read.timeout and *.write.timeout
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncProcess.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Table.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/client/HTableWrapper.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestHCM.java
2016-08-06 10:38:41 -07:00
Sean Busbey 6b233c4332 HBASE-8386 deprecate TableMapReduce.addDependencyJars(Configuration, class<?> ...)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
2016-08-05 14:08:50 -05:00
Sean Busbey a5f98c3f9e HBASE-16321 ensure no findbugs-jsr305
Signed-off-by: Esteban Gutierrez <esteban@apache.org>

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-rsgroup/pom.xml
	hbase-server/pom.xml
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/ObserverContext.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSTableDescriptors.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-spark/pom.xml
	src/main/asciidoc/_chapters/developer.adoc
2016-08-05 14:08:50 -05:00
tedyu b1c60940da HBASE-16359 Addendum fixes TestZKBasedOpenCloseRegion 2016-08-05 10:54:20 -07:00
tedyu 00f6af2e85 HBASE-16359 NullPointerException in RSRpcServices.openRegion() 2016-08-05 03:21:23 -07:00
Ramkrishna 6278ece8b6 HBASE-16303 FilterList with MUST_PASS_ONE optimization (Ram) 2016-08-05 10:59:19 +05:30
chenheng 9c8cbd44ed HBASE-16287 LruBlockCache size should not exceed acceptableSize too many(Yu Sun) 2016-08-04 21:23:27 +08:00
Lim Chee Hau 96cce2dcc5 HBASE-15574 Fix typo in HRegionServerCommandLine
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-03 23:45:55 -05:00
Nick Dimiduk 92b2973b62 HBASE-16317 revert all ESAPI changes
Revert "HBASE-15270 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon."

This reverts commit ab1b2c6603.

Revert "HBASE-15122 Servlets generate XSS_REQUEST_PARAMETER_TO_SERVLET_WRITER findbugs warnings (Samir Ahmic)"

This reverts commit 29ce46a67f.

 Conflicts:
	hbase-server/pom.xml
2016-08-03 20:53:46 -07:00
Enis Soztutar d14ec71323 HBASE-16350 Undo server abort from HBASE-14968 2016-08-03 19:38:04 -07:00
Enis Soztutar 12549de43c HBASE-16301 Trigger flush without waiting when compaction is disabled on a table (huaxiang sun)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactSplitThread.java
2016-08-03 10:55:08 -07:00
Andrew Purtell b06119edef HBASE-16319 Fix TestCacheOnWrite after HBASE-16288 2016-08-02 16:53:27 -07:00
Deokwoo Han 1b5f8c7123 HBASE-16284 Unauthorized client can shutdown the cluster 2016-08-02 11:37:56 -07:00
zhangduo dc56aa2d4f HBASE-16225 Refactor ScanQueryMatcher 2016-08-02 14:04:49 +08:00
Andrew Purtell c8903cc20a HBASE-16296 Reverse scan performance degrades when using filter lists (Ted Yu) 2016-08-01 17:41:06 -07:00
Enis Soztutar 1983126216 HBASE-16288 HFile intermediate block level indexes might recurse forever creating multi TB files 2016-08-01 11:06:27 -07:00
zhangduo 1b303ad75d HBASE-16209 addendum fix region move delay 2016-08-01 15:57:28 +08:00
zhangduo 51c8c1891a Revert "HBASE-16209 addendum fix region move delay"
This reverts commit c46f56b382.
2016-08-01 15:52:25 +08:00
zhangduo c46f56b382 HBASE-16209 addendum fix region move delay 2016-08-01 11:29:50 +08:00
Joseph Hwang 39153b8824 HBASE-16209 Removed unnecessary method and method calls from AssignmentManager and AssignmentManager UI (addendum)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-07-29 15:55:11 -07:00
Joseph Hwang 7c97acf6e3 Back port HBASE-16209 Provide an exponential back off policy in reattempting failed region opens
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-29 09:47:30 -07:00
Yu Sun 08b9e6bee0 HBASE-16300 LruBlockCache.CACHE_FIXED_OVERHEAD should calculate LruBlockCache size correctly
Signed-off-by: Yu Li <liyu@apache.org>
2016-07-29 14:29:39 +08:00
Joseph Hwang d597e29ec5 HBASE-16096 Backport. Cleanly remove replication peers from ZooKeeper.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-28 11:30:20 -07:00
Matteo Bertozzi 7983d2f45b HBASE-16275 Change ServerManager#onlineServers from ConcurrentHashMap to ConcurrentSkipListMap (Huaxiang Sun) 2016-07-28 11:19:06 -07:00
Matteo Bertozzi 968e464aed HBASE-16293 TestSnapshotFromMaster#testSnapshotHFileArchiving flakey (Huaxiang Sun) 2016-07-28 10:42:58 -07:00
Joseph Hwang d349f642c0 HBASE-16262 Backport HBASE-13839: Fix AssgnmentManagerTmpl.jamon issues (coloring, content …etc). Ignoring UI changes provided by HBASE-11344.
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-27 13:09:28 -07:00
zhangduo e06bbe4804 HBASE-16280 Use hash based map in SequenceIdAccounting 2016-07-26 16:36:46 +08:00
Phil Yang 7e5b931096 HBASE-16281 TestMasterReplication is flaky
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-07-26 11:00:43 +08:00
Phil Yang f35b2c45d4 HBASE-16266 Do not throw ScannerTimeoutException when catch UnknownScannerException
Signed-off-by: zhangduo <zhangduo@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannerTimeout.java
2016-07-25 22:37:59 +08:00
Stephen Yuan Jiang a8dd359d7e HBASE-16008 A robust way deal with early termination of HBCK (Stephen Yuan Jiang) 2016-07-23 20:21:32 -07:00
Joseph Hwang 276acdb0b0 HBASE-16221 Have ThriftScanner update the ConnectionCache's last used time overtime getScannerRow() to keep the connection alive for long lived scanners
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-22 17:58:56 -07:00
Matteo Bertozzi 24a3d6952c HBASE-16272 Overflow in ServerName's compareTo method (Huaxiang Sun) 2016-07-22 15:29:19 -07:00
Mikhail Antonov ce651f5c6d HBASE-16024 Revert HBASE-15406 from branch-1.3 2016-07-22 14:50:32 -07:00
tedyu 2e537bc4ad HBASE-15291 Revert due to race condition resulting in closed FileSystem 2016-07-21 03:38:22 -07:00
Enis Soztutar d86f8a4943 HBASE-16244 LocalHBaseCluster start timeout should be configurable (Siddharth Wagle) 2016-07-19 14:12:54 -07:00
Ramkrishna cfc22ec1ec HBASE-16189 [Rolling Upgrade] 2.0 hfiles cannot be opened by 1.x servers
(Ram)
2016-07-18 10:16:23 +05:30
Phil Yang 1e3bce943b HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely 2016-07-18 09:34:45 +08:00
tedyu 40204eb0c1 HBASE-16235 TestSnapshotFromMaster#testSnapshotHFileArchiving will fail if there are too many hfiles (ChiaPing Tsai) 2016-07-16 16:36:55 -07:00
Enis Soztutar 09c7b1e962 HBASE-16095 Add priority to TableDescriptor and priority region open thread pool
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2016-07-13 18:23:05 -07:00
Yu Li 95d141f382 HBASE-16195 Should not add chunk into chunkQueue if not using chunk pool in HeapMemStoreLAB 2016-07-13 09:34:34 +08:00
Andrew Purtell 7c4c51f2c7 HBASE-16220 Demote log level for "HRegionFileSystem - No StoreFiles for" messages to TRACE 2016-07-12 17:00:09 -07:00
Matteo Bertozzi 36a48a3cf9 HBASE-16207 can't restore snapshot without "Admin" permission 2016-07-12 05:55:07 -07:00
Joseph Hwang 7fa311a940 HBASE-16081 Wait for Replication Tasks to complete before killing the ThreadPoolExecutor inside of HBaseInterClusterReplicationEndpoint
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-07-11 17:54:24 -07:00
Gary Helmling 3ff6f45851 HBASE-16160 Support RPC encryption with direct ByteBuffers (Colin Ma via garyh) 2016-07-11 10:45:05 -07:00
Yu Li e03d4fbb0a HBASE-16194 Should count in MSLAB chunk allocation into heap size change when adding duplicate cells 2016-07-11 21:40:30 +08:00
stack 9563ab4ca1 HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken scanning because of a side effect of a clean up in HBASE-15650 to make TimeRange construction consistent exposed a latent issue in TimeRange#compare. See HBASE-16074 for more detail.
Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
 Call through to next constructor (if minStamp was 0, we'd skip setting
 allTime=true). Add asserts that timestamps are not < 0 cos it messes
 us up if they are (we already were checking for < 0 on construction but
 assert passed in timestamps are not < 0).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
 Add constructor override that takes a TimeRangeTracker (set when flushing
 but not when compacting)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
 Add override creating an HFile in tmp that takes a TimeRangeTracker

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
 Add override for HFile Writer that takes a TimeRangeTracker Take it on
 construction instead of having it passed by a setter later (flags and
 reference set by the setter were not volatile... could have been prob
 in concurrent case)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
 Log WARN if bad initial TimeRange value (and then 'fix' it)

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
 A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
 Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
 Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 14:23:23 -07:00
Yu Li 09d9dc4b59 HBASE-16201 NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication 2016-07-09 02:04:54 +08:00
Yu Li 44d2a9bc1c Revert "NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication"
This reverts commit b6d4fc955f.
2016-07-09 02:04:01 +08:00
Yu Li b6d4fc955f NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication 2016-07-09 01:06:55 +08:00
stack 37040bfc42 HBASE-15775 Canary launches two AuthUtil Chores 2016-07-08 09:36:17 -07:00
stack 2d6cdfb10a HBASE-16180 Fix ST_WRITE_TO_STATIC_FROM_INSTANCE_METHOD findbugs introduced by parent 2016-07-06 09:12:00 -07:00
tedyu 368c32e322 HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai) 2016-07-05 13:54:59 -07:00
Elliott Clark ff8c2fcac0 HBASE-16087 Replication shouldn't start on a master if if only hosts system tables 2016-07-05 13:47:49 -07:00
Andrew Purtell 8efc6148b9 HBASE-16091 Canary takes lot more time when there are delete markers in the table (Vishal Khandelwal)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-07-05 10:34:27 -07:00
Yu Li 84dd9cbcb6 HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin) 2016-07-04 21:46:19 +08:00
zhangduo 4807836304 HBASE-16135 addendum format comments 2016-07-04 20:41:06 +08:00
zhangduo 721c5b7128 HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted 2016-07-04 19:52:28 +08:00
chenheng f18ac8157b HBASE-15844 We should respect hfile.block.index.cacheonwrite when write intermediate index Block 2016-07-02 09:09:51 +08:00
tedyu a345aa8707 HBASE-16108 RowCounter should support multiple key ranges (Konstantin Ryakhovskiy) 2016-07-01 09:32:43 -07:00
tedyu 5bc0655529 HBASE-16114 Get regionLocation of required regions only for MR jobs (Thiruvel Thirumoolan) 2016-07-01 03:14:51 -07:00
stack f4d7cd5f58 HBASE-16150 Remove ConcurrentIndex (Hiroshi Ikeda) 2016-06-30 15:04:36 -07:00
Jonathan M Hsieh 9aa40424fe HBASE-16140 bump owasp.esapi from 2.1.0 to 2.1.0.1 2016-06-29 08:58:25 -07:00
Jingcheng Du b93c08d358 HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache. - Addendum 2016-06-29 16:37:23 +08:00
tedyu 96a24aede7 HBASE-16122 PerformanceEvaluation should provide user friendly hint when client threads argument is missing (Konstantin Ryakhovskiy) 2016-06-28 20:28:06 -07:00
Jingcheng Du 7a78d871d0 HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache. 2016-06-28 13:52:30 +08:00
tedyu 1a88673f33 HBASE-16052 Improve HBaseFsck Scalability (Ben Lau) 2016-06-27 20:16:34 -07:00
tedyu 34d62ecfae HBASE-14007 Writing to table through MR should fail upfront if table does not exist/is disabled (Thiruvel Thirumoolan) 2016-06-27 14:47:57 -07:00
Ramkrishna 385a6e878f HBASE-16055 TestHFileOutputFormat2 is broken (Ram) 2016-06-27 11:02:03 +05:30
Elliott Clark f4c1fd1a47 HBASE-16089 Add on FastPath for CoDel 2016-06-25 12:59:18 -07:00
stack 8ef87ce434 Revert "Is this ok... removing synchronizations?"
REVERT MISTAKEN COMMIT

This reverts commit 86242e1f55.
2016-06-25 10:45:10 +01:00
Ramkrishna a02c6da4d3 HBASE-16055 PutSortReducer loses any Visibility/acl attribute set on the
Puts (Ram)
2016-06-24 15:26:51 +05:30
Jingcheng Du 83c0cc109e HBASE-15353 Add metric for number of CallQueueTooBigException's 2016-06-24 14:39:53 +08:00
Gary Helmling 198165ef5b HBASE-16085 Add a metric for failed compactions 2016-06-23 16:04:27 -07:00
Elliott Clark 93d82112f0 HBASE-16093 Fix splits failed before creating daughter regions leave meta inconsistent 2016-06-23 12:21:52 -07:00
tedyu 857ec2f448 HBASE-16090 ResultScanner is not closed in SyncTable#finishRemainingHashRanges() 2016-06-23 07:29:34 -07:00
Matteo Bertozzi 339cb81747 HBASE-16068 Procedure v2 - use consts for conf properties in tests 2016-06-22 23:08:13 -07:00
Ramkrishna 7056b66d37 HBASE-16070 Mapreduce Serialization classes do not have Interface audience
(Ram)
2016-06-23 10:55:54 +05:30
tedyu 9e9c243ed0 HBASE-16049 TestRowProcessorEndpoint is failing on Apache Builds (Guanghao Zhang) 2016-06-22 12:24:39 -07:00
tedyu ba631b4d92 HBASE-16012 Major compaction can't work due to obsolete scanner read point in RegionServer (Guanghao Zhang) 2016-06-22 02:09:35 -07:00
tedyu 6ba67ab8d6 HBASE-16062 Improper error handling in WAL Reader/Writer creation (Vladimir Rodionov) 2016-06-21 20:01:05 -07:00
tedyu 8dea578bcf HBASE-16051 TestScannerHeartbeatMessages fails on some machines (Phil Yang) 2016-06-21 09:28:46 -07:00
Yu Li c6b8c9bb02 HBASE-16032 Possible memory leak in StoreScanner 2016-06-21 20:07:52 +08:00
tedyu 78f5262896 HBASE-16059 Region normalizer fails to trigger merge action where one of the regions is empty 2016-06-20 11:24:33 -07:00
Matteo Bertozzi 6605f8f683 HBASE-14644 Region in transition metric is broken -- addendum (Huaxiang Sun) 2016-06-20 10:45:23 -07:00
stack d34e65327e HBASE-16023 Fastpath for the FIFO rpcscheduler AMENDMENT 2016-06-20 08:28:43 +01:00
stack 86242e1f55 Is this ok... removing synchronizations? 2016-06-20 08:23:49 +01:00
Enis Soztutar 1a989a1964 HBASE-16058 TestHRegion fails on 1.4 builds
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2016-06-17 19:00:01 -07:00
stack 411e3cdb6d HBASE-16023 Fastpath for the FIFO rpcscheduler Adds an executor that does balanced queue and fast path handing off requests directly to waiting handlers if any present. Idea taken from Apace Kudu (incubating). See https://gerrit.cloudera.org/#/c/2938/7/src/kudu/rpc/service_queue.h
M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcExecutor.java
 Refactor which makes a Handler type. Put all 'handler' stuff inside this
 new type. Also make it so subclass can provide its own Handler type.

M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcScheduler.java
 Name the handler threads for their type so can tell if configs are
 having an effect.

Signed-off-by: stack <stack@apache.org>
2016-06-17 17:07:35 -07:00
stack 76cf0d799f HBASE-15224 Undo "hbase.increment.fast.but.narrow.consistency" option; it is not necessary since HBASE-15213 (stack) 2016-06-17 14:39:45 -07:00
chenheng 3723baefe3 HBASE-14915 Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport (Heng Chen) 2016-06-17 12:35:36 -07:00
Matteo Bertozzi 1f37cdfb4b HBASE-14730 region server needs to log warnings when there are attributes configured for cells with hfile v2 (huaxiang sun) 2016-06-17 11:26:53 -07:00
Liu Shaohui 419d15f834 HBASE-14277 TestRegionServerHostname.testRegionServerHostname may fail at host with a case sensitive name 2016-06-17 10:49:21 -07:00
tedyu 755a5de470 HBASE-16048 Tag InternalScanner with LimitedPrivate(HBaseInterfaceAudience.COPROC) 2016-06-17 07:30:43 -07:00
tedyu 45a0fc531a HBASE-5291 Addendum 2 passes correct path to deleteRecursively 2016-06-16 17:01:51 -07:00
tedyu 4c1db3cb03 HBASE-16045 endtime argument for VerifyReplication was incorrectly specified in usage 2016-06-16 15:52:16 -07:00
Mikhail Antonov 560bf74884 HBASE-16047 TestFastFail is broken again 2016-06-16 14:10:32 -07:00
Yu Li 66b2788432 HBASE-16033 Add more details in logging of responseTooSlow/TooLarge 2016-06-16 16:40:38 +08:00
tedyu 0b48adaa30 HBASE-5291 Addendum removes duplicate spnego (Josh Elser) 2016-06-15 14:59:58 -07:00
Enis Soztutar ff5dbf584e HBASE-15950 Fix memstore size estimates to be more tighter 2016-06-15 14:19:28 -07:00
Mikhail Antonov b64d5e5f4b HBASE-16026 Master UI should display status of additional ZK switches 2016-06-15 13:06:52 -07:00
tedyu e417cf6b24 HBASE-5291 Add Kerberos HTTP SPNEGO authentication support to HBase web consoles (Josh Elser) 2016-06-15 10:26:18 -07:00
tedyu cc50bfcc72 HBASE-16017 HBase TableOutputFormat has connection leak in getRecordWriter (Zhan Zhang) 2016-06-15 09:18:18 -07:00
stack 8a0e135a35 HBASE-15971 Regression: Random Read/WorkloadC slower in 1.x than 0.98 Restore FIFO as the default in place of 'deadline' that sorted on request priority. The sort costs us throughput. Enable it if you want it rather than have it as default.
Name threads to include the scheduler type.
2016-06-14 16:13:38 -07:00
Stephen Yuan Jiang e35564ede0 HBASE-15746 Remove extra RegionCoprocessor preClose() in RSRpcServices#closeRegion (Stephen Yuan Jiang) 2016-06-14 13:31:24 -07:00
Stephen Yuan Jiang 286934fc40 HBASE-16016 Fix overflow deadline value in AssignmentManager#waitForAssignment (Stephen Yuan Jiang) 2016-06-13 18:22:35 -07:00
tedyu cb331507b9 HBASE-16007 Job's Configuration should be passed to TableMapReduceUtil#addDependencyJars() in WALPlayer 2016-06-11 07:07:39 -07:00
Matteo Bertozzi d1bec9d0b8 HBASE-14644 Region in transition metric is broken (Huaxiang Sun) 2016-06-10 21:53:14 -07:00
Sean Mackrory 37807b38a3 HBASE-15946 Eliminate possible security concerns in RS web UI's store file metrics (Sean Mackrory) 2016-06-09 18:54:53 -07:00
tedyu a4e2b3856e HBASE-15990 The priority value of subsequent coprocessors in the Coprocessor.Priority.SYSTEM list are not incremented by one (ChiaPing Tsai) 2016-06-09 11:20:33 -07:00
Ashish Singhi a40ec70da9 HBASE-15952 Bulk load data replication is not working when RS user does not have permission on hfile-refs node 2016-06-09 18:46:07 +05:30
stack 867150333c HBASE-15994 Allow selection of RpcSchedulers
Adds logging by the RpcExecutors of their run configs
Adds a FifoRpcSchedulerFactory so you can try Fifo scheduler.
2016-06-08 20:25:38 -07:00
stack e90a6db20b Revert "HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler"
This reverts commit d49b883825.
2016-06-08 20:25:09 -07:00
stack d49b883825 HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler
Signed-off-by: stack <stack@apache.org>
2016-06-08 20:06:22 -07:00
Enis Soztutar 602b2839c6 HBASE-15600 Add provision for adding mutations to memstore or able to write to same region in batchMutate coprocessor hooks (Rajeshbabu and Enis)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2016-06-07 20:32:06 -07:00
stack 3ff082cb87 HBASE-15913 Sasl encryption doesn't work with AsyncRpcChannel 2016-06-07 09:22:09 -07:00
Andrew Purtell 76404238a8 HBASE-15698 Increment TimeRange not serialized to server (Ted Yu) 2016-06-06 22:17:37 -07:00
Enis Soztutar 4a0a9a20dd HBASE-15954 REST server should log requests with TRACE instead of DEBUG
Conflicts:
	hbase-rest/src/main/java/org/apache/hadoop/hbase/rest/RESTServer.java
	hbase-rest/src/main/java/org/apache/hadoop/hbase/rest/ScannerResource.java
2016-06-06 11:06:52 -07:00
Sean Mackrory 878b1ea721 HBASE-15889. String case conversions are locale-sensitive, used without locale
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-06 12:14:20 -05:00
Apekshit Sharma 6d0e8b2a91 Revert "HBASE-15949 Cleanup TestRegionServerMetrics."
This change passes on master but fails on branch-1. Will try to debug.

This reverts commit 520d27b267.
2016-06-03 23:55:53 -07:00
Apekshit 520d27b267 HBASE-15949 Cleanup TestRegionServerMetrics.
@Before and @After to setup/teardown tables using @Rule to set table name based on testname.
Refactor out copy-pasted code fragments to single function.

Change-Id: Ic22e5027cc3952bab5ec30070ed20e98017db65a
2016-06-03 23:27:23 -07:00
Stephen Yuan Jiang fa182c2ea6 HBASE-15955 Disable action in CatalogJanitor#setEnabled should wait for active cleanup scan to finish (Stephen Yuan Jiang) 2016-06-03 15:50:13 -07:00
Lars Hofhansl 9f343b5871 HBASE-15881 Allow BZIP2 compression. 2016-06-03 15:33:05 -07:00
Matteo Bertozzi 7bcdd44be6 HBASE-15927 Remove HMaster.assignRegion() 2016-06-03 12:41:51 -07:00
Ashish Singhi 950a09b03c HBASE-15888 Extend HBASE-12769 for bulk load data replication 2016-06-03 18:47:31 +05:30
tedyu a8c8bfd5ee HBASE-15727 Canary Tool for Zookeeper (churro morales) 2016-06-02 10:17:42 -07:00
tedyu 72dc6fe5d5 HBASE-15933 Addendum - make merge decision when sizes of both regions are known 2016-06-02 09:29:57 -07:00
tedyu 37bb8a5f69 HBASE-15933 NullPointerException may be thrown from SimpleRegionNormalizer#getRegionSize() 2016-06-02 06:33:04 -07:00
Mikhail Antonov d03ffb0788 HBASE-15908 Checksum verification is broken due to incorrect passing of ByteBuffers in DataChecksum (Mikhail Antonov and Appy) 2016-05-28 03:16:05 -07:00
Enis Soztutar 02a641e2b1 HBASE-15837 Memstore size accounting is wrong if postBatchMutate() throws exception
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2016-05-26 11:13:06 -07:00
Apekshit 7af013b267 HBASE-14635 Fix flaky test TestSnapshotCloneIndependence
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-05-25 21:24:09 -07:00
tedyu a049b5f799 HBASE-15884 NPE in StoreFileScanner#skipKVsNewerThanReadpoint during reverse scan (Sergey Soldatov) 2016-05-25 17:29:32 -07:00
Joseph Hwang 2346b5e216 HBASE-15471 Added in Priority, General, and Replication queue sizes for RegionServers to the Web UI
Changed UI labels so that queue "size" refers to size in bytes and queue "length" refers to number of items in queue.

Signed-off-by: Elliott Clark <elliott@fb.com>
2016-05-25 15:15:01 -07:00
stack e50bf9d7a9 HBASE-15878 Deprecate doBulkLoad(Path hfofDir, final HTable table) in branch-1 (even though its 'late') 2016-05-23 09:12:53 -07:00
stack 67c02684c9 Revert "HBASE-15876 Remove doBulkLoad(Path hfofDir, final HTable table) though it has not been through a full deprecation cycle"
Wrong commit message
This reverts commit 04ef799dd0.
2016-05-23 09:11:17 -07:00
stack 04ef799dd0 HBASE-15876 Remove doBulkLoad(Path hfofDir, final HTable table) though it has not been through a full deprecation cycle 2016-05-23 09:07:28 -07:00
tedyu 34ca6f5069 HBASE-15873 ACL for snapshot restore / clone is not enforced 2016-05-22 19:13:13 -07:00
tedyu 6738dbadac HBASE-15802 ConnectionUtils should use ThreadLocalRandom instead of Random (Matt Warhaftig) 2016-05-22 06:47:59 -07:00
Jerry He b7de663580 HBASE-14818 user_permission does not list namespace permissions (li xiang) 2016-05-21 20:32:20 -07:00
tedyu 01d77bf37b HBASE-15529 Override needBalance in StochasticLoadBalancer (Guanghao Zhang) 2016-05-21 14:39:41 -07:00
tedyu 108a130f38 HBASE-15529 Revert due to TestRegionRebalancing failing 2016-05-20 12:56:48 -07:00
tedyu b91a6199e9 HBASE-15529 Override needBalance in StochasticLoadBalancer (Guanghao Zhang) 2016-05-20 10:20:44 -07:00
Gary Helmling df40739ae7 HBASE-15856 Don't cache unresolved addresses for connections 2016-05-20 10:02:05 -07:00
Matteo Bertozzi 6dbc8ebec1 HBASE-15865 Move TestTableDeleteFamilyHandler and TestTableDescriptorModification handler tests to procedure 2016-05-20 07:15:48 -07:00
Matteo Bertozzi 233264bc17 HBASE-15864 Reuse the testing helper to wait regions in transition 2016-05-20 06:49:14 -07:00
Jerry He d038b762a5 HBASE-15465 userPermission returned by getUserPermission() for the selected namespace does not have namespace set (li xiang) 2016-05-19 20:38:24 -07:00
tedyu 696a51d344 HBASE-15847 VerifyReplication prefix filtering (Geoffrey Jacoby) 2016-05-19 10:43:49 -07:00
Vincent 5eed14272b HBASE-15617 Canary in regionserver mode might not enumerate all regionservers
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-05-18 18:42:17 -07:00
Matteo Bertozzi e5eea96ca6 HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set 2016-05-18 12:51:17 -07:00
Jerry He a9972355c4 HBASE-15841 Performance Evaluation tool total rows may not be set correctly 2016-05-18 12:15:18 -07:00
Enis Soztutar 49359a4ee3 HBASE-15824 LocalHBaseCluster gets bind exception in master info port - ADDENDUM 2016-05-18 11:36:16 -07:00
Stephen Yuan Jiang 0078522549 HBASE-15850 Localize the configuration change in testCheckTableLocks to reduce flakiness of TestHBaseFsck test suite (Stephen Yuan Jiang) 2016-05-18 07:13:39 -07:00
tedyu ce43e33876 HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig) 2016-05-17 13:26:45 -07:00
stack c0fcce2bde HBASE-15593 Time limit of scanning should be offered by client (Phil Yang) 2016-05-17 12:51:03 -07:00
Elliott Clark 89146d85ac HBASE-15840 WAL.proto compilation broken for cpp 2016-05-17 12:04:31 -07:00
tedyu cadebe691f HBASE-15842 SnapshotInfo should display ownership information 2016-05-16 20:34:41 -07:00
Enis Soztutar c96227eed1 HBASE-15824 LocalHBaseCluster gets bind exception in master info port 2016-05-16 10:35:45 -07:00
Sean Busbey e365191896 HBASE-15780 Make AuthUtil public and rely on it for talking to secure HBase.
Signed-off-by: Gary Helmling <garyh@apache.org>
Signed-off-by: Mikhail Antonov <antonov@apache.org>
Signed-off-by: stack <stack@apache.org>
2016-05-16 00:53:45 -05:00
Mikhail Antonov 0042d6d4c8 HBASE-15615 Wrong sleep time when RegionServerCallable need retry (Guanghao Zhang) 2016-05-15 20:49:00 -07:00
Apekshit 92f415976e HBASE-13532 Make UnknownScannerException less scary by giving more information in the exception string. (Apekshit)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-05-13 15:03:36 -07:00
Apekshit a6f8214e9b HBASE-15236 Inconsistent cell reads over multiple bulk-loaded HFiles. In KeyValueHeap, if two cells are same i.e. have same key and timestamp, then instead of directly using seq id to determine newer one, we should use StoreFile.Comparater.SEQ_ID because that's what is used to determine order of hfiles. In this patch, we assign each scanner an order based on it's index in storefiles list, which is then used in KeyValueHeap to disambiguate between same cells. Changes the getSequenceId() in KeyValueScanner class to getScannerOrder(). Testing: Adds unit test to TestKeyValueHeap. Manual testing: Three cases (Tables t, t2, t3 in the jira description), single region, 2 hfiles with same seq id, timestamps and duplicate KVs. Made sure that returned kv was same for get and scan. (Apekshit)
Change-Id: I22600c91c0a51fb63eb17db73472839d2f13957c

Signed-off-by: stack <stack@apache.org>
2016-05-12 21:31:13 -07:00
Jerry He cadc4cf15b HBASE-15808 Reduce potential bulk load intermediate space usage and waste 2016-05-12 15:22:56 -07:00
Matteo Bertozzi 98d13c745c HBASE-15415 Improve Master WebUI snapshot information (huaxiang sun) 2016-05-09 20:22:07 -07:00
Apekshit 2f282aca15 HBASE-11625 - Verifies data before building HFileBlock. - Adds HFileBlock.Header class which contains information about location of fields. Testing: Adds CorruptedFSReaderImpl to TestChecksum.
Change-Id: I6777f2ddf8922691c84ca86d0cffa9a37dc879ae

Signed-off-by: stack <stack@apache.org>
2016-05-09 16:29:47 -07:00
Enis Soztutar d07d316113 HBASE-15740 Replication source.shippedKBs metric is undercounting because it is in KB 2016-05-09 10:25:57 -07:00
Gary Helmling e44c360350 HBASE-15773 Improvements to CellCounter job 2016-05-06 11:18:24 -07:00
Ashish Singhi 0964884b92 HBASE-15669 HFile size is not considered correctly in a replication request 2016-05-06 17:28:06 +05:30
tedyu 3a7552a9f3 HBASE-15563 'counter' may overflow in BoundedGroupingStrategy (Matt Warhaftig) 2016-05-05 10:29:10 -07:00
Matteo Bertozzi 686a31fbde HBASE-15755 SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface audience marked 2016-05-05 07:28:52 -07:00
Gary Helmling b36222831d HBASE-15741 Provide backward compatibility for HBase coprocessor service names 2016-05-04 12:37:39 -07:00
Enis Soztutar 12da71b824 HBASE-15613 TestNamespaceCommand times out 2016-05-04 11:37:09 -07:00
tedyu a7b31f74db HBASE-15752 ClassNotFoundException is encountered when custom WAL codec is not found in WALPlayer job 2016-05-03 07:01:08 -07:00
chenheng 0ee3ca2a78 HBASE-15714 We are calling checkRow() twice in doMiniBatchMutation() 2016-05-03 22:34:09 +10:00
Yu Li 330b3b281a HBASE-15675 Add more details about region on table.jsp 2016-05-03 20:29:49 +08:00
Mikhail Antonov 7e0e86072a HBASE-15703 Deadline scheduler needs to return to the client info about skipped calls, not just drop them 2016-05-02 15:27:13 -07:00
Mikhail Antonov 36d634d353 HBASE-15281 Allow the FileSystem inside HFileSystem to be wrapped (Rajesh Nishtala) 2016-05-02 13:26:37 -07:00
tedyu 57ca428c54 HBASE-15357 TableInputFormatBase getSplitKey does not handle signed bytes correctly (Nathan Schile) 2016-04-29 20:55:47 -07:00
Mikhail Antonov e6bcf95da5 HBASE-15551 Make call queue too big exception use servername 2016-04-29 10:26:18 -07:00
tedyu c512750914 HBASE-15686 Add override mechanism for the exempt classes when dynamically loading table coprocessor 2016-04-28 09:21:22 -07:00
Vasudevan 2b0913eea4 HBASE-15697 Excessive TestHRegion running time on branch-1 (Ram) 2016-04-28 14:18:33 +05:30
tedyu 4f2d8dc328 HBASE-15676 FuzzyRowFilter fails and matches all the rows in the table if the mask consists of all 0s (Matt Warhaftig) 2016-04-27 21:03:34 -07:00
chenheng 5f5cdaae9a HBASE-15720 Print row locks at the debug dump page 2016-04-28 11:46:06 +08:00
tedyu 4ba57cb935 HBASE-15707 ImportTSV bulk output does not support tags with hfile.format.version=3 (huaxiang sun) 2016-04-27 13:40:54 -07:00
stack 6b78409eb2 HBASE-15477 Purge 'next block header' from cached blocks
When we read from HDFS, we overread to pick up the next blocks header.
Doing this saves a seek as we move through the hfile; we save having to
do an explicit seek just to read the block header every time we need to
read the body.  We used to read in the next header as part of the
current blocks buffer. This buffer was then what got persisted to
blockcache; so we were over-persisting: our block plus the next blocks'
header (33 bytes).

This patch undoes this over-persisting.

Removes support for version 1 blocks (0.2 was added in hbase-0.92.0).
Not needed any more.

There is an open question on whether checksums should be persisted
when caching. The code seems to say no but if cache is SSD backed or
backed by anything that does not do error correction, we'll want
checksums.

Adds loads of documentation.

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
  (write) Add writing from a ByteBuff.

M hbase-common/src/main/java/org/apache/hadoop/hbase/nio/ByteBuff.java
  (toString) Add one so ByteBuff looks like ByteBuffer when you click on
  it in IDE

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
  Remove support for version 1 blocks.

  Cleaned up handling of metadata added when we serialize a block to
  caches. Metadata is smaller now.

  When we serialize (used when caching), do not persist the next blocks
  header if present.

  Removed a bunch of methods, a few of which had overlapping
  functionality and others that exposed too much of our internals.
  Also removed a bunch of constructors and unified the constructors we
  had left over making them share a common init method.
  Shutdown access to defines that should only be used internally here.

  Renamed all to do w/ 'EXTRA' and 'extraSerialization' to instead talk
  about metadata saved to caches; was unclear previously what EXTRA was
  about.

  Renamed static final declarations as all uppercase.

  (readBlockDataInternal): Redid. Couldn't make sense of it previously.
  Undid heavy-duty parse of header by constructing HFileBlock. Other
  cleanups. Its 1/3rd the length it used to be. More to do in here.

Signed-off-by: stack <stack@apache.org>
2016-04-27 10:41:47 -07:00
Gary Helmling 4272178b1f HBASE-15658 Avoid excess meta cache clearing for RegionServerCallable 2016-04-26 23:02:24 -07:00
Phil Yang d5acbdd1e4 HBASE-15645 hbase.rpc.timeout is not used in operations of HTable
Signed-off-by: stack <stack@apache.org>
2016-04-26 10:52:12 -07:00
tedyu 2562043e23 HBASE-15634 TestDateTieredCompactionPolicy#negativeForMajor is flaky (Duo Zhang and Ted Yu) 2016-04-26 09:24:38 -07:00
tedyu 5a69bc2dcb HBASE-14252 RegionServers fail to start when setting hbase.ipc.server.callqueue.scan.ratio to 0 (Yubao Liu and Ted Yu) 2016-04-25 14:32:53 -07:00
Enis Soztutar 51be6569e6 HBASE-15670 Add missing Snapshot.proto to the maven profile for compiling protobuf
Conflicts:
	hbase-protocol/pom.xml
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestBatchCoprocessorEndpoint.java
2016-04-22 11:44:14 -07:00
stack 27446a5c4a HBASE-15392 Single Cell Get reads two HFileBlocks
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
moreRowsMayExistAfterCell Exploit the fact a Scan is a Get Scan. Also save compares
if no non-default stopRow.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java
optimize Add doc on what is being optimized. Also, if a Get Scan, do not
optimize else we'll keep going after our row is DONE.
Another place to make use of the Get Scan fact is when we are DONE.. if
Get Scan, we can close out the scan.

Signed-off-by: stack <stack@apache.org>
2016-04-22 09:07:09 -07:00
Enis Soztutar 550d253ead HBASE-15671 Add per-table metrics on memstore, storefile and regionsize (Alicia Ying Shu) 2016-04-21 13:33:31 -07:00
stack 0b65f2002b HBASE-15366 Add doc, trace-level logging, and test around No change in operation, just adding doc., and some helpful logging
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileContext.java
 Make it emit its toString in format that matches the way we log
 elsewhere
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
 Capitalize statics.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
 Verify and cleanup documentation of hfileblock format at head of class.
 Explain what 'EXTRA_SERIALIZATION_SPACE' is all about.
 Connect how we serialize and deserialize... done in different places
 and one way when pulling from HDFS and another when pulling from cache
 (TO BE FIXED). Shut down a load of public access.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpl.java
 Add trace-level logging

Signed-off-by: stack <stack@apache.org>
2016-04-21 10:56:07 -07:00
chenheng 5d497d5ba8 HBASE-15674 HRegionLocator#getAllRegionLocations should put the results in cache
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HRegionLocator.java
2016-04-21 14:28:07 +08:00
zhangduo 80e324cdc7 HBASE-15368 Add pluggable window support 2016-04-21 12:02:42 +08:00
Andrew Purtell 780cff5886 HBASE-15614 Report metrics from JvmPauseMonitor 2016-04-20 17:36:59 -07:00
Enis Soztutar 1311e25171 HBASE-15518 Add Per-Table metrics back (Alicia Ying Shu) 2016-04-20 14:35:52 -07:00
stack 71c55d182d HBASE-15640 L1 cache doesn't give fair warning that it is showing partial stats only when it hits limit 2016-04-20 14:19:12 -07:00
stack a331a57ef8 HBASE-15385 PREFETCH_BLOCKS_ON_OPEN in HColumnDescriptor is ignored 2016-04-20 09:41:28 -07:00
tedyu 1aa07404a9 HBASE-15679 Assertion on wrong variable in TestReplicationThrottler#testThrottling 2016-04-20 07:11:50 -07:00
stack 2d99f626d1 HBASE-15672 hadoop.hbase.security.visibility.TestVisibilityLabelsWithDeletes fails (Anoop Sam John) 2016-04-19 21:54:43 -07:00
Apekshit bd64db97c8 HBASE-15673 Fix latency metrics for multiGet. - Also fixes some stuff in help text. (Apekshit)
Change-Id: I95cfa2be74605efab0368417d59c50b94af0facb

Signed-off-by: stack <stack@apache.org>
2016-04-19 17:18:45 -07:00
zhangduo 22b1061044 HBASE-15665 Support using different StoreFileComparators for different CompactionPolicies 2016-04-19 19:35:36 +08:00
Gábor Lipták 2b5da6f7a0 HBASE-13372 Add unit tests for SplitTransaction and RegionMergeTransaction listeners
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-04-18 16:56:59 -07:00
Ashish Singhi 6d40b7a0e4 HBASE-15668 HFileReplicator fails to replicate other hfiles in the request when a hfile in not found in FS anywhere 2016-04-18 22:18:46 +05:30
zhangduo ee78b6da7a HBASE-15664 Use Long.MAX_VALUE instead of HConstants.FOREVER in CompactionPolicy 2016-04-18 20:11:35 +08:00
tedyu 7dacf9f10c HBASE-15287 mapreduce.RowCounter returns incorrect result with binary row key inputs (Matt Warhaftig) 2016-04-16 18:11:27 -07:00
stack fd49923350 HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile
Refactor so we use the immutable, unsynchronized TimeRange when doing
time-based checks at read time rather than use heavily synchronized
TimeRangeTracker; let TimeRangeTracker be for write-time only.

While in here, changed the Segment stuff so that when an immutable
segment, it uses TimeRange rather than TimeRangeTracker too.

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
  Make allTime final.
  Add a includesTimeRange method copied from TimeRangeTracker.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
  Change name of a few methods so they match TimeRange methods that do
  same thing.
  (getTimeRangeTracker, getTimeRange, toTimeRange) add utility methods

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
  Change Reader to use TimeRange-based checks instead of
  TimeRangeTracker.
2016-04-15 16:56:05 -07:00
Matteo Bertozzi 6cf4bfe62c HBASE-15622 Superusers does not consider the keytab credentials 2016-04-15 08:31:46 -07:00
chenheng 96e9c466d2 HBASE-15406 Split / merge switch left disabled after early termination of hbck
Conflicts:
        hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
        hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
        hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
        hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java
        hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
        hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
        hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
        hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestSplitOrMergeStatus.java
        hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsckOneRS.java
2016-04-15 15:34:43 +08:00
Apekshit d378975351 HBASE-15405 Fix PE logging and wrong defaults in help message. (Apekshit)
Change-Id: I81f5f57e1db18df252fa92c0cc14bf950ab17034

Signed-off-by: stack <stack@apache.org>
2016-04-14 09:00:38 -07:00
Elliott Clark 07dc75f4fe HBASE-15504 Fix Balancer in 1.3 not moving regions off overloaded regionserver 2016-04-13 18:07:21 -07:00
tedyu 85f2caf184 HBASE-15633 Backport HBASE-15507 to branch-1 (Geoffrey Jacoby) 2016-04-13 02:25:32 -07:00
Matteo Bertozzi cd84796b39 HBASE-15481 Add pre/post roll to WALObserver
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/AbstractFSWAL.java
2016-04-13 01:06:51 -05:00
Stephen Yuan Jiang 4981d4c207 HBASE-15636 hard coded wait time out value in HBaseTestingUtility#waitUntilAllRegionsAssigned might cause test failure (Stephen Yuan Jiang) 2016-04-12 16:47:21 -07:00
Matteo Bertozzi d896a51291 HBASE-15621 Suppress Hbase SnapshotHFile cleaner error messages when a snaphot is going on (Huaxiang Sun) 2016-04-12 12:23:28 -07:00
Matteo Bertozzi 59bf00562c HBASE-15632 Undo the checking of lastStoreFlushTimeMap.isEmpty() introduced in HBASE-13145 (Huaxiang Sun) 2016-04-12 11:41:00 -07:00
tedyu e31361dcb8 HBASE-14985 TimeRange constructors should set allTime when appropriate (Geoffrey Jacoby) 2016-04-11 17:58:38 -07:00
Matteo Bertozzi 2dbbe8960a HBASE-15627 Miss space and closing quote in AccessController#checkSystemOrSuperUser (Huaxiang Sun) 2016-04-11 08:28:02 -07:00
tedyu b7502feff3 HBASE-15093 Replication can report incorrect size of log queue for the global source when multiwal is enabled (Ashu Pachauri) 2016-04-11 08:23:34 -07:00
Jerry He ff835d5ae6 HBASE-15591 ServerCrashProcedure not yielding 2016-04-10 17:07:39 -07:00
zhangduo 7303c7e479 HBASE-15527 Refactor Compactor related classes 2016-04-10 09:26:42 +08:00
zhangduo 2b75562701 HBASE-15537 Make multi WAL work with WALs other than FSHLog 2016-04-08 10:42:40 +08:00
Enis Soztutar d94c18a0e7 HBASE-15586 Unify human readable numbers in the web UI 2016-04-07 17:07:38 -07:00
tedyu b17350210b HBASE-15400 Use DateTieredCompactor for Date Tiered Compaction (Clara Xiong) 2016-04-07 15:06:22 -07:00
Harsh J ff075fd9df HBASE-15396 Enhance mapreduce.TableSplit to add encoded region name
(cherry picked from commit 7d3a89ce8e)

Signed-off-by: Sean Busbey <busbey@apache.org>
2016-04-06 08:32:32 -07:00
Enis Soztutar e6a32141b3 HBASE-15587 FSTableDescriptors.getDescriptor() logs stack trace erronously 2016-04-05 18:13:47 -07:00
tedyu 8957dc1033 HBASE-15485 Filter.reset() should not be called between batches (Phil Yang) 2016-04-04 20:07:39 -07:00
Ashish Singhi e5fb045aa9 HBASE-15578 Handle HBASE-15234 for ReplicationHFileCleaner 2016-04-04 15:07:56 +05:30
Matteo Bertozzi 4bae771b65 HBASE-15582 SnapshotManifestV1 too verbose when there are no regions 2016-04-01 20:59:08 -07:00
Ashish Singhi bcbef7b401 HBASE-15424 Add bulk load hfile-refs for replication in ZK after the event is appended in the WAL 2016-04-01 15:55:08 +05:30
Gary Helmling d7d12aedd4 HBASE-15234 Don't abort ReplicationLogCleaner on ZooKeeper errors 2016-03-31 22:45:45 -07:00
tedyu b7df66f1a8 HBASE-15571 Make MasterProcedureManagerHost accessible through MasterServices 2016-03-31 15:49:07 -07:00
stack 407e644607 HBASE-15324 Jitter may cause desiredMaxFileSize overflow in ConstantSizeRegionSplitPolicy and trigger unexpected split (Yu Li) 2016-03-30 13:31:34 -07:00
Elliott Clark 75d46e4697 HBASE-14983 Create metrics for per block type hit/miss ratios
Summary: Missing a root index block is worse than missing a data block. We should know the difference

Test Plan: Tested on a local instance. All numbers looked reasonable.

Differential Revision: https://reviews.facebook.net/D55563
2016-03-30 11:53:46 -07:00
Elliott Clark fee0212da0 HBASE-15559 Fix BaseMasterAndRegionObserver doesn't implement all the methods 2016-03-30 11:18:15 -07:00
tedyu e339bec3f1 HBASE-15327 Canary will always invoke admin.balancer() in each sniffing period when writeSniffing is enabled (Jianwei Cui) 2016-03-30 09:00:04 -07:00
Enis Soztutar 1e44dd82eb HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock - ADDENDUM for failing test 2016-03-29 15:02:23 -07:00
tedyu c7ad42867d HBASE-15191 CopyTable and VerifyReplication - Option to specify batch size, versions (Parth Shah) 2016-03-29 10:29:56 -07:00
chenheng 13df653215 HBASE-15384 Avoid using '/tmp' directory in TestBulkLoad 2016-03-29 11:10:44 +08:00
Enis Soztutar 5202d3c25b HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/CoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/MasterCoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionCoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/DistributedHBaseCluster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide3.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannersFromClientSide.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestClockSkewDetection.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestNamespaceCommands.java
2016-03-28 17:00:21 -07:00
tedyu 5851ad0230 HBASE-15548 SyncTable: sourceHashDir is supposed to be optional but won't work without (Dave Latham) 2016-03-28 16:53:27 -07:00
tedyu 87f1af842a HBASE-15496 Throw RowTooBigException only for user scan/get (Guanghao Zhang) 2016-03-25 19:05:15 -07:00