Commit Graph

11225 Commits

Author SHA1 Message Date
Jonathan M Hsieh 8b9840b4a8 HBASE-14877 maven archetype: client application (Daniel Vimont) 2016-06-18 23:24:41 -07:00
Enis Soztutar 1a989a1964 HBASE-16058 TestHRegion fails on 1.4 builds
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2016-06-17 19:00:01 -07:00
Elliott Clark e721aa1a8a HBASE-16061 Allow logging to a buffered console 2016-06-17 17:09:18 -07:00
stack 411e3cdb6d HBASE-16023 Fastpath for the FIFO rpcscheduler Adds an executor that does balanced queue and fast path handing off requests directly to waiting handlers if any present. Idea taken from Apace Kudu (incubating). See https://gerrit.cloudera.org/#/c/2938/7/src/kudu/rpc/service_queue.h
M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcExecutor.java
 Refactor which makes a Handler type. Put all 'handler' stuff inside this
 new type. Also make it so subclass can provide its own Handler type.

M hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/SimpleRpcScheduler.java
 Name the handler threads for their type so can tell if configs are
 having an effect.

Signed-off-by: stack <stack@apache.org>
2016-06-17 17:07:35 -07:00
stack 76cf0d799f HBASE-15224 Undo "hbase.increment.fast.but.narrow.consistency" option; it is not necessary since HBASE-15213 (stack) 2016-06-17 14:39:45 -07:00
Matteo Bertozzi fb9a8a09f7 HBASE-16056 Procedure v2 - fix master crash for FileNotFound 2016-06-17 13:11:07 -07:00
chenheng 3723baefe3 HBASE-14915 Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport (Heng Chen) 2016-06-17 12:35:36 -07:00
Matteo Bertozzi 1f37cdfb4b HBASE-14730 region server needs to log warnings when there are attributes configured for cells with hfile v2 (huaxiang sun) 2016-06-17 11:26:53 -07:00
tedyu d4a842948a HBASE-14581 Znode cleanup throws auth exception in secure mode 2016-06-17 10:57:08 -07:00
Liu Shaohui 419d15f834 HBASE-14277 TestRegionServerHostname.testRegionServerHostname may fail at host with a case sensitive name 2016-06-17 10:49:21 -07:00
tedyu 755a5de470 HBASE-16048 Tag InternalScanner with LimitedPrivate(HBaseInterfaceAudience.COPROC) 2016-06-17 07:30:43 -07:00
tedyu 45a0fc531a HBASE-5291 Addendum 2 passes correct path to deleteRecursively 2016-06-16 17:01:51 -07:00
tedyu 4c1db3cb03 HBASE-16045 endtime argument for VerifyReplication was incorrectly specified in usage 2016-06-16 15:52:16 -07:00
Mikhail Antonov 560bf74884 HBASE-16047 TestFastFail is broken again 2016-06-16 14:10:32 -07:00
Yu Li 66b2788432 HBASE-16033 Add more details in logging of responseTooSlow/TooLarge 2016-06-16 16:40:38 +08:00
tedyu 0b48adaa30 HBASE-5291 Addendum removes duplicate spnego (Josh Elser) 2016-06-15 14:59:58 -07:00
Enis Soztutar ff5dbf584e HBASE-15950 Fix memstore size estimates to be more tighter 2016-06-15 14:19:28 -07:00
Mikhail Antonov b64d5e5f4b HBASE-16026 Master UI should display status of additional ZK switches 2016-06-15 13:06:52 -07:00
Matteo Bertozzi 341ee15ed6 HBASE-16034 Fix ProcedureTestingUtility#LoadCounter.setMaxProcId() 2016-06-15 12:43:46 -07:00
tedyu e417cf6b24 HBASE-5291 Add Kerberos HTTP SPNEGO authentication support to HBase web consoles (Josh Elser) 2016-06-15 10:26:18 -07:00
tedyu cc50bfcc72 HBASE-16017 HBase TableOutputFormat has connection leak in getRecordWriter (Zhan Zhang) 2016-06-15 09:18:18 -07:00
stack 8a0e135a35 HBASE-15971 Regression: Random Read/WorkloadC slower in 1.x than 0.98 Restore FIFO as the default in place of 'deadline' that sorted on request priority. The sort costs us throughput. Enable it if you want it rather than have it as default.
Name threads to include the scheduler type.
2016-06-14 16:13:38 -07:00
Stephen Yuan Jiang e35564ede0 HBASE-15746 Remove extra RegionCoprocessor preClose() in RSRpcServices#closeRegion (Stephen Yuan Jiang) 2016-06-14 13:31:24 -07:00
Stephen Yuan Jiang 286934fc40 HBASE-16016 Fix overflow deadline value in AssignmentManager#waitForAssignment (Stephen Yuan Jiang) 2016-06-13 18:22:35 -07:00
tedyu cb331507b9 HBASE-16007 Job's Configuration should be passed to TableMapReduceUtil#addDependencyJars() in WALPlayer 2016-06-11 07:07:39 -07:00
Matteo Bertozzi d1bec9d0b8 HBASE-14644 Region in transition metric is broken (Huaxiang Sun) 2016-06-10 21:53:14 -07:00
Sean Mackrory 37807b38a3 HBASE-15946 Eliminate possible security concerns in RS web UI's store file metrics (Sean Mackrory) 2016-06-09 18:54:53 -07:00
Sean Busbey e6a46bbb8d HBASE-15925 provide default values for hadoop compat module related properties that match default hadoop profile.
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-06-09 16:31:03 -05:00
tedyu a4e2b3856e HBASE-15990 The priority value of subsequent coprocessors in the Coprocessor.Priority.SYSTEM list are not incremented by one (ChiaPing Tsai) 2016-06-09 11:20:33 -07:00
Ashish Singhi a40ec70da9 HBASE-15952 Bulk load data replication is not working when RS user does not have permission on hfile-refs node 2016-06-09 18:46:07 +05:30
Matteo Bertozzi 13d06a2cc8 HBASE-15975 logic in TestHTableDescriptor#testAddCoprocessorWithSpecStr is wrong (Huaxiang Sun) 2016-06-08 22:44:16 -07:00
stack 867150333c HBASE-15994 Allow selection of RpcSchedulers
Adds logging by the RpcExecutors of their run configs
Adds a FifoRpcSchedulerFactory so you can try Fifo scheduler.
2016-06-08 20:25:38 -07:00
stack e90a6db20b Revert "HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler"
This reverts commit d49b883825.
2016-06-08 20:25:09 -07:00
stack d49b883825 HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler
Signed-off-by: stack <stack@apache.org>
2016-06-08 20:06:22 -07:00
Enis Soztutar 602b2839c6 HBASE-15600 Add provision for adding mutations to memstore or able to write to same region in batchMutate coprocessor hooks (Rajeshbabu and Enis)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2016-06-07 20:32:06 -07:00
Sergey Soldatov 7fed7a8f4e HBASE-15957 RpcClientImpl.close never ends in some circumstances
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-06-07 11:38:11 -07:00
stack 3ff082cb87 HBASE-15913 Sasl encryption doesn't work with AsyncRpcChannel 2016-06-07 09:22:09 -07:00
tedyu fad99a3f68 HBASE-15803 ZooKeeperWatcher's constructor can leak a ZooKeeper instance with throwing ZooKeeperConnectionException when canCreateBaseZNode is true 2016-06-07 09:14:01 -07:00
Andrew Purtell 76404238a8 HBASE-15698 Increment TimeRange not serialized to server (Ted Yu) 2016-06-06 22:17:37 -07:00
Apekshit Sharma c2b4c6f637 HBASE-15965
- Testing by executing a command will cover the exact path users will trigger, so its better then directly calling library functions in tests. Changing the tests to use @shell.command(:<command>, args) to execute them like it's a command coming from shell.

Norm change:
Commands should print the output user would like to see, but in the end, should also return the relevant value. This way:
- Tests can use returned value to check that functionality works
- Tests can capture stdout to assert particular kind of output user should see.
- We do not print the return value in interactive mode and keep the output clean. See Shell.command() function.

Bugs found due to this change:
- Uncovered bug in major_compact.rb with this approach. It was calling admin.majorCompact() which doesn't exist but our tests didn't catch it since they directly tested admin.major_compact()
- Enabled TestReplicationShell. If it's bad, flaky infra will take care of it.

Change-Id: I5d8af16bf477a79a2f526a5bf11c245b02b7d276
2016-06-06 18:00:23 -07:00
Enis Soztutar 4a0a9a20dd HBASE-15954 REST server should log requests with TRACE instead of DEBUG
Conflicts:
	hbase-rest/src/main/java/org/apache/hadoop/hbase/rest/RESTServer.java
	hbase-rest/src/main/java/org/apache/hadoop/hbase/rest/ScannerResource.java
2016-06-06 11:06:52 -07:00
Sean Mackrory 878b1ea721 HBASE-15889. String case conversions are locale-sensitive, used without locale
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-06 12:14:20 -05:00
Apekshit Sharma 6d0e8b2a91 Revert "HBASE-15949 Cleanup TestRegionServerMetrics."
This change passes on master but fails on branch-1. Will try to debug.

This reverts commit 520d27b267.
2016-06-03 23:55:53 -07:00
Apekshit 520d27b267 HBASE-15949 Cleanup TestRegionServerMetrics.
@Before and @After to setup/teardown tables using @Rule to set table name based on testname.
Refactor out copy-pasted code fragments to single function.

Change-Id: Ic22e5027cc3952bab5ec30070ed20e98017db65a
2016-06-03 23:27:23 -07:00
Apekshit Sharma 1972996ffc HBASE-15849 Simplify the way we handle runtime of commands.
Functions format_simple_command and format_and_return_simple_command are used to print runtimes right now. They are called from within every single command and use Ruby's 'yield' magic.  Instead, we can simplify it using 'command_safe' function. Since command_safe wraps all commands, we can simply time before and after we call individual command.
If a command only wants to time a part of its logic, it can set instance variables start_time and end_time accordingly which is far more simpler to understand and work with than 'yield'.

Change-Id: Ibfacf3593175af22fc4f7d80896dd2f6d7c5dde3
2016-06-03 16:59:34 -07:00
Apekshit Sharma 2ee7d2a488 HBASE-15845 Changes:
- Remove omnipresence of formatter object since it is kind of a use-and-throw class. Commands should create
  an instance, use it to format the output and discard it.
- Some refactoring
Tested: Ran TestShell

Change-Id: I12176ee12695df952ee4b0f8397e5d3be8f16a87
2016-06-03 16:35:29 -07:00
Stephen Yuan Jiang fa182c2ea6 HBASE-15955 Disable action in CatalogJanitor#setEnabled should wait for active cleanup scan to finish (Stephen Yuan Jiang) 2016-06-03 15:50:13 -07:00
Lars Hofhansl 9f343b5871 HBASE-15881 Allow BZIP2 compression. 2016-06-03 15:33:05 -07:00
Matteo Bertozzi 7bcdd44be6 HBASE-15927 Remove HMaster.assignRegion() 2016-06-03 12:41:51 -07:00
Ashish Singhi 950a09b03c HBASE-15888 Extend HBASE-12769 for bulk load data replication 2016-06-03 18:47:31 +05:30