Commit Graph

11302 Commits

Author SHA1 Message Date
Stephen Yuan Jiang 286934fc40 HBASE-16016 Fix overflow deadline value in AssignmentManager#waitForAssignment (Stephen Yuan Jiang) 2016-06-13 18:22:35 -07:00
tedyu cb331507b9 HBASE-16007 Job's Configuration should be passed to TableMapReduceUtil#addDependencyJars() in WALPlayer 2016-06-11 07:07:39 -07:00
Matteo Bertozzi d1bec9d0b8 HBASE-14644 Region in transition metric is broken (Huaxiang Sun) 2016-06-10 21:53:14 -07:00
Sean Mackrory 37807b38a3 HBASE-15946 Eliminate possible security concerns in RS web UI's store file metrics (Sean Mackrory) 2016-06-09 18:54:53 -07:00
Sean Busbey e6a46bbb8d HBASE-15925 provide default values for hadoop compat module related properties that match default hadoop profile.
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-06-09 16:31:03 -05:00
tedyu a4e2b3856e HBASE-15990 The priority value of subsequent coprocessors in the Coprocessor.Priority.SYSTEM list are not incremented by one (ChiaPing Tsai) 2016-06-09 11:20:33 -07:00
Ashish Singhi a40ec70da9 HBASE-15952 Bulk load data replication is not working when RS user does not have permission on hfile-refs node 2016-06-09 18:46:07 +05:30
Matteo Bertozzi 13d06a2cc8 HBASE-15975 logic in TestHTableDescriptor#testAddCoprocessorWithSpecStr is wrong (Huaxiang Sun) 2016-06-08 22:44:16 -07:00
stack 867150333c HBASE-15994 Allow selection of RpcSchedulers
Adds logging by the RpcExecutors of their run configs
Adds a FifoRpcSchedulerFactory so you can try Fifo scheduler.
2016-06-08 20:25:38 -07:00
stack e90a6db20b Revert "HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler"
This reverts commit d49b883825.
2016-06-08 20:25:09 -07:00
stack d49b883825 HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler
Signed-off-by: stack <stack@apache.org>
2016-06-08 20:06:22 -07:00
Enis Soztutar 602b2839c6 HBASE-15600 Add provision for adding mutations to memstore or able to write to same region in batchMutate coprocessor hooks (Rajeshbabu and Enis)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2016-06-07 20:32:06 -07:00
Sergey Soldatov 7fed7a8f4e HBASE-15957 RpcClientImpl.close never ends in some circumstances
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-06-07 11:38:11 -07:00
stack 3ff082cb87 HBASE-15913 Sasl encryption doesn't work with AsyncRpcChannel 2016-06-07 09:22:09 -07:00
tedyu fad99a3f68 HBASE-15803 ZooKeeperWatcher's constructor can leak a ZooKeeper instance with throwing ZooKeeperConnectionException when canCreateBaseZNode is true 2016-06-07 09:14:01 -07:00
Andrew Purtell 76404238a8 HBASE-15698 Increment TimeRange not serialized to server (Ted Yu) 2016-06-06 22:17:37 -07:00
Apekshit Sharma c2b4c6f637 HBASE-15965
- Testing by executing a command will cover the exact path users will trigger, so its better then directly calling library functions in tests. Changing the tests to use @shell.command(:<command>, args) to execute them like it's a command coming from shell.

Norm change:
Commands should print the output user would like to see, but in the end, should also return the relevant value. This way:
- Tests can use returned value to check that functionality works
- Tests can capture stdout to assert particular kind of output user should see.
- We do not print the return value in interactive mode and keep the output clean. See Shell.command() function.

Bugs found due to this change:
- Uncovered bug in major_compact.rb with this approach. It was calling admin.majorCompact() which doesn't exist but our tests didn't catch it since they directly tested admin.major_compact()
- Enabled TestReplicationShell. If it's bad, flaky infra will take care of it.

Change-Id: I5d8af16bf477a79a2f526a5bf11c245b02b7d276
2016-06-06 18:00:23 -07:00
Enis Soztutar 4a0a9a20dd HBASE-15954 REST server should log requests with TRACE instead of DEBUG
Conflicts:
	hbase-rest/src/main/java/org/apache/hadoop/hbase/rest/RESTServer.java
	hbase-rest/src/main/java/org/apache/hadoop/hbase/rest/ScannerResource.java
2016-06-06 11:06:52 -07:00
Sean Mackrory 878b1ea721 HBASE-15889. String case conversions are locale-sensitive, used without locale
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-06 12:14:20 -05:00
Apekshit Sharma 6d0e8b2a91 Revert "HBASE-15949 Cleanup TestRegionServerMetrics."
This change passes on master but fails on branch-1. Will try to debug.

This reverts commit 520d27b267.
2016-06-03 23:55:53 -07:00
Apekshit 520d27b267 HBASE-15949 Cleanup TestRegionServerMetrics.
@Before and @After to setup/teardown tables using @Rule to set table name based on testname.
Refactor out copy-pasted code fragments to single function.

Change-Id: Ic22e5027cc3952bab5ec30070ed20e98017db65a
2016-06-03 23:27:23 -07:00
Apekshit Sharma 1972996ffc HBASE-15849 Simplify the way we handle runtime of commands.
Functions format_simple_command and format_and_return_simple_command are used to print runtimes right now. They are called from within every single command and use Ruby's 'yield' magic.  Instead, we can simplify it using 'command_safe' function. Since command_safe wraps all commands, we can simply time before and after we call individual command.
If a command only wants to time a part of its logic, it can set instance variables start_time and end_time accordingly which is far more simpler to understand and work with than 'yield'.

Change-Id: Ibfacf3593175af22fc4f7d80896dd2f6d7c5dde3
2016-06-03 16:59:34 -07:00
Apekshit Sharma 2ee7d2a488 HBASE-15845 Changes:
- Remove omnipresence of formatter object since it is kind of a use-and-throw class. Commands should create
  an instance, use it to format the output and discard it.
- Some refactoring
Tested: Ran TestShell

Change-Id: I12176ee12695df952ee4b0f8397e5d3be8f16a87
2016-06-03 16:35:29 -07:00
Stephen Yuan Jiang fa182c2ea6 HBASE-15955 Disable action in CatalogJanitor#setEnabled should wait for active cleanup scan to finish (Stephen Yuan Jiang) 2016-06-03 15:50:13 -07:00
Lars Hofhansl 9f343b5871 HBASE-15881 Allow BZIP2 compression. 2016-06-03 15:33:05 -07:00
Matteo Bertozzi 7bcdd44be6 HBASE-15927 Remove HMaster.assignRegion() 2016-06-03 12:41:51 -07:00
Ashish Singhi 950a09b03c HBASE-15888 Extend HBASE-12769 for bulk load data replication 2016-06-03 18:47:31 +05:30
tedyu a8c8bfd5ee HBASE-15727 Canary Tool for Zookeeper (churro morales) 2016-06-02 10:17:42 -07:00
tedyu 72dc6fe5d5 HBASE-15933 Addendum - make merge decision when sizes of both regions are known 2016-06-02 09:29:57 -07:00
tedyu 37bb8a5f69 HBASE-15933 NullPointerException may be thrown from SimpleRegionNormalizer#getRegionSize() 2016-06-02 06:33:04 -07:00
Yu Li 36bb496e48 HBASE-15931 Add log for long-running tasks in AsyncProcess 2016-06-02 12:02:19 +08:00
tedyu 0cedd8b344 HBASE-15923 Shell rows counter test fails 2016-05-31 14:19:42 -07:00
Apekshit 32258c2b3a HBASE-15920 Backport submit-patch.py to branch-1 and earlier branches. This is combination of HBASE-15892 and HBASE-15909 and the fact that python-requirements.txt didn't exist in old branches. (Apekshit)
Change-Id: I35dba28c1053f26e1a5823195c22f22923dff007

Signed-off-by: stack <stack@apache.org>
2016-05-30 21:48:12 -07:00
Mikhail Antonov d03ffb0788 HBASE-15908 Checksum verification is broken due to incorrect passing of ByteBuffers in DataChecksum (Mikhail Antonov and Appy) 2016-05-28 03:16:05 -07:00
Ashu Pachauri d07977800b HBASE-15890 Allow setting cacheBlocks for TScan
Signed-off-by: stack <stack@apache.org>
2016-05-27 21:01:53 -07:00
Sean Busbey 77abf73549 HBASE-15895 Remove unmaintained jenkins build analysis tool.
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Dima Spivak <dspivak@cloudera.com>
Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Apekshit <apeksharma@gmail.com>
2016-05-27 16:41:25 -07:00
Enis Soztutar 70c3a7854f HBASE-10358 Shell changes for setting consistency per request (yi liang) 2016-05-26 17:04:18 -07:00
Andrew Purtell 22aa501436 HBASE-15854 Log the cause of SASL connection failures (Robert Yokota) 2016-05-26 14:27:36 -07:00
Enis Soztutar 02a641e2b1 HBASE-15837 Memstore size accounting is wrong if postBatchMutate() throws exception
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2016-05-26 11:13:06 -07:00
Apekshit 7af013b267 HBASE-14635 Fix flaky test TestSnapshotCloneIndependence
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-05-25 21:24:09 -07:00
tedyu a049b5f799 HBASE-15884 NPE in StoreFileScanner#skipKVsNewerThanReadpoint during reverse scan (Sergey Soldatov) 2016-05-25 17:29:32 -07:00
Joseph Hwang 2346b5e216 HBASE-15471 Added in Priority, General, and Replication queue sizes for RegionServers to the Web UI
Changed UI labels so that queue "size" refers to size in bytes and queue "length" refers to number of items in queue.

Signed-off-by: Elliott Clark <elliott@fb.com>
2016-05-25 15:15:01 -07:00
stack 627b48b799 HBASE-4368 Expose processlist in shell (per regionserver and perhaps by cluster) (Talat Uyarer) 2016-05-23 15:47:35 -07:00
Mikhail Antonov 51dfe44174 HBASE-15880 RpcClientImpl#tracedWriteRequest incorrectly closes HTrace span 2016-05-23 12:47:46 -07:00
stack e50bf9d7a9 HBASE-15878 Deprecate doBulkLoad(Path hfofDir, final HTable table) in branch-1 (even though its 'late') 2016-05-23 09:12:53 -07:00
stack 67c02684c9 Revert "HBASE-15876 Remove doBulkLoad(Path hfofDir, final HTable table) though it has not been through a full deprecation cycle"
Wrong commit message
This reverts commit 04ef799dd0.
2016-05-23 09:11:17 -07:00
stack 04ef799dd0 HBASE-15876 Remove doBulkLoad(Path hfofDir, final HTable table) though it has not been through a full deprecation cycle 2016-05-23 09:07:28 -07:00
tedyu 34ca6f5069 HBASE-15873 ACL for snapshot restore / clone is not enforced 2016-05-22 19:13:13 -07:00
tedyu 6738dbadac HBASE-15802 ConnectionUtils should use ThreadLocalRandom instead of Random (Matt Warhaftig) 2016-05-22 06:47:59 -07:00
Jerry He b7de663580 HBASE-14818 user_permission does not list namespace permissions (li xiang) 2016-05-21 20:32:20 -07:00