Commit Graph

139 Commits

Author SHA1 Message Date
stack b94e6738d9 HBASE-10378 Refactor write-ahead-log implementation -- ADDEDNUM 2014-11-18 12:12:35 -08:00
Sean Busbey f5e05eb836 HBASE-10378 Refactor write-ahead-log implementation
Incompatible changes called out in release notes on jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu.

Signed-off-by: stack <stack@apache.org>
2014-11-18 12:04:41 -08:00
Andrew Purtell 1ba615657b HBASE-12382 Restore incremental compilation 2014-11-11 17:45:37 -08:00
stack e287741388 HBASE-12434 Add a command to compact all the regions in a regionserver (Liu Shaohui) 2014-11-11 09:32:55 -08:00
stack c71244c02d HBASE-12329 Table create with duplicate column family names quietly succeeds (Jingcheng Du) 2014-11-05 17:32:21 -08:00
stack 14f4a296b0 HBASE-8572 Enhance delete_snapshot.rb to call snapshot deletion API with regex REVERT TILL TESTED 2014-11-05 07:44:51 -08:00
Lars Hofhansl ecd708671c HBASE-12363 Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS. 2014-11-04 17:08:39 -08:00
Ashish Singhi a5d1832a30 HBASE-8572 Enhance delete_snapshot.rb to call snapshot deletion API with regex
Signed-off-by: stack <stack@apache.org>
2014-11-04 16:49:43 -08:00
Andrew Purtell 70a312e53f HBASE-11912 Catch some bad practices at compile time with error-prone 2014-10-27 09:29:23 -07:00
Andrew Purtell ff5bc351b2 Revert "HBASE-11912 Catch some bad practices at compile time with error-prone"
This reverts commit 7ed0260eff.
2014-10-25 08:33:43 -07:00
Andrew Purtell 7ed0260eff HBASE-11912 Catch some bad practices at compile time with error-prone 2014-10-24 18:15:12 -07:00
Matteo Bertozzi 2908c11371 HBASE-12301 user_permission command does not show global permissions 2014-10-22 10:08:31 +01:00
stack f61df33988 HBASE-12286 [shell] Add server/cluster online load of configuration changes Add doc to the refguide, change command names to drop the _rs_
Signed-off-by: stack <stack@apache.org>
2014-10-21 11:15:09 -07:00
stack 3e073924be HBASE-10082 Describe 'table' output is all on one line, could use better formatting (Srikanth Srungarapu) 2014-10-20 20:18:07 -07:00
Matteo Bertozzi 49056295ef HBASE-12161 Add support for grant/revoke on namespaces in AccessControlClient (Srikanth Srungarapu) 2014-10-18 21:18:42 +01:00
Andrew Purtell 963bd07f68 HBASE-12265 HBase shell 'show_filters' points to internal Facebook URL 2014-10-16 09:01:11 -04:00
stack a47fe89d95 HBASE-12248 broken link in hbase shell help (André Kelpe) 2014-10-13 20:11:43 -07:00
Ted Yu 3d84ccbf9c HBASE-12109 user_permission command for namespace does not return correct result (Vandana Ayyalasomayajula) 2014-10-09 17:45:02 +00:00
Andrew Purtell 3557a32352 HBASE-12106 Move test annotations to test artifact (Enis Soztutar) 2014-10-06 23:16:22 -07:00
Matteo Bertozzi 79b11ae8fe HBASE-12120 HBase shell doesn't allow deleting of a cell by user with W-only permissions to it (Srikanth Srungarapu) 2014-10-02 02:31:02 +01:00
Misty Stanley-Jones 231bc98761 HBASE-12049 Help for alter command is a bit confusing (Ashish Singhi) 2014-10-01 16:24:02 +10:00
stack 02cdcefe4f HBASE-12118 Explain how to grant permission to a namespace in grant command usage 2014-09-30 08:05:18 -07:00
anoopsjohn 375fc1efe3 HBASE-12084 Remove deprecated APIs from Result - shell addendum 2014-09-26 10:04:58 +05:30
Elliott Clark a5bd931682 HBASE-12059 Create hbase-annotations module 2014-09-23 16:44:14 -07:00
Matteo Bertozzi bd8df9ccd4 HBASE-11598 Add simple rpc throttling 2014-09-18 22:38:30 +01:00
stack 3c9bd7d296 HBASE-11911 Break up tests into more fine grained categories (Alex Newman) 2014-09-12 21:37:06 -07:00
stack c0d4b26872 HBASE-11897 Add append and remove peer table-cfs cmds for replication (Liu Shaoqui) 2014-09-12 09:28:52 -07:00
Enis Soztutar 34a5019b42 HBASE-10841 Scan,Get,Put,Delete,etc setters should consistently return this 2014-09-05 18:48:38 -07:00
Sean Busbey f69a1945c6 HBASE-8298 In shell, provide alias of 'desc' for 'describe'.
* Adds ability to alias commands
* map 'desc' alias to 'describe'

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-08-23 10:39:42 -07:00
Enis Soztutar aeecd20373 HBASE-11572 Add support for doing get/scans against a particular replica_id (Jeffrey Zhong) 2014-08-19 18:23:09 -07:00
Andrew Purtell c55ecba071 HBASE-11754 [Shell] Record table property SPLITS_FILE in descriptor (chendihao) 2014-08-18 14:50:52 -07:00
Andrew Purtell 680a6f32f2 HBASE-11713 Adding hbase shell unit test coverage for visibility labels (Srikanth Srungarapu) 2014-08-15 15:20:35 -07:00
Andrew Purtell 865fae8a80 HBASE-11731 Add option to only run a subset of the shell tests (Sean Busbey) 2014-08-14 11:49:59 -07:00
Jonathan M Hsieh 4b8a38ebb5 HBASE-11658 Piped commands to hbase shell should return non-zero if shell command failed (Sean Busbey) 2014-08-08 13:54:53 -07:00
Nicolas Liochon d8faab2fff HBASE-11492 Hadoop configuration overrides some ipc parameters including tcpNoDelay 2014-07-22 14:54:52 +02:00
Nick Dimiduk a32331c02b HBASE-11505 'snapshot' shell command shadows 'snapshot' shell when 'help' is invoked 2014-07-14 09:42:24 -07:00
Andrew Purtell dba294576e HBASE-11057 Improve TestShell coverage of grant and revoke comamnds (Srikanth Srungarapu) 2014-07-11 17:28:17 -07:00
Ramkrishna eafa9f6c1f HBASE-11088 Support Visibility Expression Deletes in Shell (Ram) 2014-07-09 11:43:26 +05:30
stack c6db308977 HBASE-11452 add getUserPermission feature in AccessControlClient as client API (Demai Ni) 2014-07-04 19:47:57 -07:00
Ted Yu 6c102e22f0 HBASE-11422 Specification of scope is missing for certain Hadoop dependencies (Konstantin Boudnik) 2014-07-04 12:40:13 +00:00
Enis Soztutar 92c52a727a Updated version in master to 2.0.0-SNAPSHOT after 'branch-1' is created for 1.x line of releases 2014-06-30 20:26:47 -07:00
Devaraj Das 72355a920a HBASE-10361. Enable/AlterTable support for region replicas (ddas)
git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/hbase-10070@1570008 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 16:39:37 -07:00
Devaraj Das 481a116e26 HBASE-10348. HTableDescriptor changes for region replicas
git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/hbase-10070@1565658 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 16:39:36 -07:00
Enis Soztutar d8ea476bf1 HBASE-10354 Add an API for defining consistency per request
git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/hbase-10070@1565062 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 16:39:36 -07:00
Matteo Bertozzi 86e5db5099 HBASE-10935 support snapshot policy where flush memstore can be skipped to prevent production cluster freeze (Tianying Chang) 2014-06-02 08:03:19 +01:00
Andrew Purtell 58818496da HBASE-9857 Blockcache prefetch option 2014-05-22 10:17:39 -07:00
Michael Stack 6c7af961fa HBASE-6506 Setting CACHE_BLOCKS to false in an hbase shell scan doesn't work
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1595937 13f79535-47bb-0310-9956-ffa450edef68
2014-05-19 15:50:35 +00:00
mbertozzi 788b285e11 HBASE-8332 Add truncate as HMaster method
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1593439 13f79535-47bb-0310-9956-ffa450edef68
2014-05-08 22:25:01 +00:00
Andrew Kyle Purtell 4d1fc21500 HBASE-10892 [Shell] Add support for globs in user_permission (Esteban Gutierrez)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1590172 13f79535-47bb-0310-9956-ffa450edef68
2014-04-25 22:34:16 +00:00
Andrew Kyle Purtell 8ac8a0e56f HBASE-11002 Shell support for changing cell visibility for testing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1589890 13f79535-47bb-0310-9956-ffa450edef68
2014-04-24 21:41:29 +00:00
Andrew Kyle Purtell 639ca70f9c Amend HBASE-11001 Shell support for granting cell permissions for testing; Fix global grants
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1589492 13f79535-47bb-0310-9956-ffa450edef68
2014-04-23 18:55:10 +00:00
Andrew Kyle Purtell 81593ed2bf HBASE-11001 Shell support for granting cell permissions for testing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1589305 13f79535-47bb-0310-9956-ffa450edef68
2014-04-22 23:33:22 +00:00
Andrew Kyle Purtell bdc2d1f831 HBASE-11044 [Shell] Show groups for user in 'whoami' output
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1588945 13f79535-47bb-0310-9956-ffa450edef68
2014-04-21 18:05:24 +00:00
rajeshbabu 95c4e5f22c HBASE-10533 commands.rb is giving wrong error messages on exceptions-format correction(rajeshbabu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1587299 13f79535-47bb-0310-9956-ffa450edef68
2014-04-14 20:00:40 +00:00
rajeshbabu 95974d97eb HBASE-10533 commands.rb is giving wrong error messages on exceptions(rajeshbabu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1587282 13f79535-47bb-0310-9956-ffa450edef68
2014-04-14 18:59:32 +00:00
Andrew Kyle Purtell 81bebaee81 HBASE-10951 Use PBKDF2 to generate test encryption keys in the shell
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1586694 13f79535-47bb-0310-9956-ffa450edef68
2014-04-11 15:47:41 +00:00
Michael Stack b2ef1ce01c HBASE-10886 add htrace-zipkin to the runtime dependencies again -- REVERT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1584935 13f79535-47bb-0310-9956-ffa450edef68
2014-04-04 23:19:35 +00:00
Michael Stack 62908378bc HBASE-10886 add htrace-zipkin to the runtime dependencies again (Masatake Iwasaki)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1584455 13f79535-47bb-0310-9956-ffa450edef68
2014-04-03 23:04:10 +00:00
Zhihong Yu e8f7f46609 HBASE-10879 user_permission shell command on namespace doesn't work
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1583725 13f79535-47bb-0310-9956-ffa450edef68
2014-04-01 16:09:35 +00:00
Michael Stack 300bc2b4ea HBASE-10864 Spelling nit (Alex Newman)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1582946 13f79535-47bb-0310-9956-ffa450edef68
2014-03-29 03:40:10 +00:00
Michael Stack c4610ecab2 HBASE-10746 Bump the version of HTrace to 3.0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1580076 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 22:46:03 +00:00
nkeywal eb38979c80 HBASE-10080 Unnecessary call to locateRegion when creating an HTable instance
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1572525 13f79535-47bb-0310-9956-ffa450edef68
2014-02-27 11:36:28 +00:00
Zhihong Yu 0636414170 HBASE-10621 Unable to grant user permission to namespace
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1572421 13f79535-47bb-0310-9956-ffa450edef68
2014-02-27 03:30:10 +00:00
mbertozzi 57671618b5 HBASE-6642 enable_all,disable_all,drop_all can call 'list' command with regex directly
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1570128 13f79535-47bb-0310-9956-ffa450edef68
2014-02-20 10:08:54 +00:00
Jean-Daniel Cryans 89f1d1a051 HBASE-8751 Enable peer cluster to choose/change the ColumnFamilies/Tables it
really want to replicate from a source cluster (Feng Honghua via JD)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1566944 13f79535-47bb-0310-9956-ffa450edef68
2014-02-11 01:16:39 +00:00
Enis Soztutar f823cca32c HBASE-10389 Add namespace help info in table related shell commands (Jerry He)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1566755 13f79535-47bb-0310-9956-ffa450edef68
2014-02-10 21:39:32 +00:00
Andrew Kyle Purtell 2a0f5b2af2 HBASE-10430. Support compressTags in shell for enabling tag encoding (Ramkrishna S. Vasudevan)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1562318 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 23:57:10 +00:00
Zhihong Yu f24956ee8a HBASE-10426 user_permission in security.rb calls non-existent UserPermission#getTable method
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1561902 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 22:59:41 +00:00
Andrew Kyle Purtell 5e859ec8a7 HBASE-6873. Clean up Coprocessor loading failure handling
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1558869 13f79535-47bb-0310-9956-ffa450edef68
2014-01-16 18:25:31 +00:00
Zhihong Yu 5f9ef02234 HBASE-10324 refactor deferred-log-flush/Durability related interface/code/naming to align with changed semantic of the new write thread model
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1557939 13f79535-47bb-0310-9956-ffa450edef68
2014-01-14 05:36:37 +00:00
ramkrishna 1a8c7ec0a9 HBASE-10228-Support setCellVisibility and setAuthorizations in Shell (Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1554159 13f79535-47bb-0310-9956-ffa450edef68
2013-12-30 07:10:17 +00:00
ramkrishna 9459b605b0 HBASE-10229-Support OperationAttributes in Increment and Append in Shell (Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1553623 13f79535-47bb-0310-9956-ffa450edef68
2013-12-27 04:19:43 +00:00
liangxie 1fc969846c HBASE-10232 Remove native profile from hbase-shell (Elliot Clark)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1553260 13f79535-47bb-0310-9956-ffa450edef68
2013-12-24 08:54:59 +00:00
zjushch fdbe8da2c6 HBASE-10114 _scan_internal() in table.rb should accept argument that specifies reverse scan
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1550022 13f79535-47bb-0310-9956-ffa450edef68
2013-12-11 01:51:38 +00:00
Michael Stack 57b8613688 HBASE_9955 Make hadoop2 the default and deprecate hadoop1; RETRY
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1548374 13f79535-47bb-0310-9956-ffa450edef68
2013-12-06 02:42:20 +00:00
Michael Stack fe5b28625a HBASE-9955 Make hadoop2 the default and deprecate hadoop1; REVERT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1548351 13f79535-47bb-0310-9956-ffa450edef68
2013-12-06 01:16:51 +00:00
Michael Stack 7fbe97470e HBASE-9955 Make hadoop2 the default and deprecate hadoop1
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1548349 13f79535-47bb-0310-9956-ffa450edef68
2013-12-06 01:10:59 +00:00
Andrew Kyle Purtell f8139d1bf5 Update version in POMs to 0.99.0-SNAPSHOT after branching for release 0.98.0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1547743 13f79535-47bb-0310-9956-ffa450edef68
2013-12-04 09:31:02 +00:00
Andrew Kyle Purtell edbf698cc1 HBASE-7544. Transparent CF encryption
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1545536 13f79535-47bb-0310-9956-ffa450edef68
2013-11-26 04:22:33 +00:00
anoopsamjohn 5a6a0fd78b HBASE-7663 [Per-KV security] Visibility labels
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1543314 13f79535-47bb-0310-9956-ffa450edef68
2013-11-19 05:39:47 +00:00
Michael Stack 2eae9d02a2 HBASE-9985 Add HBase shell command to start/stop tracing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1542894 13f79535-47bb-0310-9956-ffa450edef68
2013-11-18 05:19:30 +00:00
Michael Stack 26ea61d39f HBASE-9985 Add HBase shell command to start/stop tracing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1542893 13f79535-47bb-0310-9956-ffa450edef68
2013-11-18 05:19:17 +00:00
jxiang fe5865d9e3 HBASE-9870 HFileDataBlockEncoderImpl#diskToCacheFormat uses wrong format
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1541629 13f79535-47bb-0310-9956-ffa450edef68
2013-11-13 17:31:02 +00:00
ramkrishna 968f83b2ff HBASE-9689-Support using OperationAttributes through shell script (Ram)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1533174 13f79535-47bb-0310-9956-ffa450edef68
2013-10-17 17:34:51 +00:00
ndimiduk 2e5eb8bd0c HBASE-9570 With AccessDeniedException, HBase shell would be better to just display the error message to be user friendly (Yang Wang)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1532163 13f79535-47bb-0310-9956-ffa450edef68
2013-10-15 02:03:26 +00:00
eclark ce7c5b8e03 HBASE-9699 For Downstreamers using HBaseTestingUtility is hard.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1528645 13f79535-47bb-0310-9956-ffa450edef68
2013-10-02 21:59:19 +00:00
eclark 122082955e HBASE-9700 remove htrace-zipkin from the runtime dependencies
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1528622 13f79535-47bb-0310-9956-ffa450edef68
2013-10-02 21:01:37 +00:00
Jonathan Hsieh 2782846450 HBASE-9439 shell command list snows something not meaningful
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1526742 13f79535-47bb-0310-9956-ffa450edef68
2013-09-26 23:10:10 +00:00
nkeywal bba51c29c7 HBASE-9632 Put the shell in a maven sub module (hbase-shell) instead of hbase-server
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1525641 13f79535-47bb-0310-9956-ffa450edef68
2013-09-23 16:40:51 +00:00