Commit Graph

854 Commits

Author SHA1 Message Date
Matteo Bertozzi 9e967e5c1d HBASE-15113 Procedure v2 - Speedup eviction of sys operation results 2016-03-08 19:47:15 -08:00
Stephen Yuan Jiang 1c6beb3dc1 HBASE-15413 Procedure-V2: print out ProcedureInfo during trace (Stephen Yuan Jiang) 2016-03-07 20:28:45 -08:00
Jonathan M Hsieh f658f3ef83 HBASE-15356 Remove unused imports (Youngjoon Kim) 2016-03-03 11:42:38 -08:00
stack 8ace5bbfce HBASE-15366 Add doc, trace-level logging, and test around hfileblock
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileContext.java
 Make it emit its toString in format that matches the way we log
 elsewhere

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
 Capitalize statics.

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
 Verify and cleanup documentation of hfileblock format at head of class.
 Explain what 'EXTRA_SERIALIZATION_SPACE' is all about.
 Connect how we serialize and deserialize... done in different places
 and one way when pulling from HDFS and another when pulling from cache
 (TO BE FIXED). Shut down a load of public access.

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpl.java
 Add trace-level logging

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileScanner.java
 Make it Closeable
2016-03-03 09:16:30 -08:00
zhangduo 69e442efe4 HBASE-15365 Do not write to '/tmp' in TestHBaseConfiguration 2016-03-02 11:05:36 +08:00
stack 8f6e29785a HBASE-15351 Fix description of hbase.bucketcache.size in hbase-default.xml 2016-02-26 13:49:26 -08:00
Elliott Clark 77133fd225 HBASE-15222 Addendum - Use less contended classes for metrics 2016-02-25 09:08:11 -08:00
Mikhail Antonov 43f99def67 HBASE-15136 Explore different queuing behaviors while busy 2016-02-24 20:41:30 -08:00
Elliott Clark 630a65825e HBASE-15222 Use less contended classes for metrics
Summary:
Use less contended things for metrics.
For histogram which was the largest culprit we use FastLongHistogram
For atomic long where possible we now use counter.

Test Plan: unit tests

Reviewers:

Subscribers:

Differential Revision: https://reviews.facebook.net/D54381
2016-02-24 14:34:05 -08:00
eshcar 876a6ab73e HBASE-15016 Services a Store needs from a Region
Signed-off-by: stack <stack@apache.org>
2016-02-24 07:07:07 -08:00
ramkrishna 3ba1a7fd23 HBASE-13259 mmap() based BucketCache IOEngine (Zee Chen & Ram) 2016-02-23 17:03:38 +05:30
stack 6f8c7dca13 HBASE-15279 OrderedBytes.isEncodedValue does not check for int8 and int16 types (Robert Yokota) 2016-02-17 22:10:15 -08:00
Matteo Bertozzi e0fa176f0b HBASE-15100 ProcedureInfo constructor should be InterfaceAudience.Private (addendum) 2016-02-17 12:14:01 -08:00
ramkrishna a975408b7c HBASE-15253 Small bug in CellUtil.matchingRow(Cell, byte[]) (Ram) 2016-02-11 21:51:19 +05:30
Enis Soztutar a69272efe1 HBASE-15177 Reduce garbage created under high load 2016-02-04 13:27:00 -08:00
Enis Soztutar 2f5767376f HBASE-15129 Set default value for hbase.fs.tmp.dir rather than fully depend on hbase-default.xml (Yu Li) 2016-02-02 17:10:19 -08:00
stack ed46591f30 HBASE-15196 HBASE-15158 Preamble 2 of 2:Add Increment tests 2016-02-02 11:27:03 -08:00
stack 2cc48e039d HBASE-15158 HBASE-15158 Preamble 1 of 2: fix findbugs, add javadoc, change Region#getReadpoint to #getReadPoint, and some util 2016-01-31 20:21:48 -08:00
ramkrishna 0de221a19d HBASE-14841 Allow Dictionary to work with BytebufferedCells (Ram) 2016-01-29 10:06:20 +05:30
Misty Stanley-Jones 4ca27a68ef HBASE-15184 Fix broken links found via LinkLint 2016-01-26 10:02:53 -08:00
Matteo Bertozzi 772f30fe2a HBASE-15100 Master WALProcs are deleted out of order ending up with older wals not removed 2016-01-22 15:57:12 -08:00
stack bd9906736e HBASE-15098 Normalizer switch in configuration is not used 2016-01-20 09:32:38 -08:00
Gary Helmling df36178062 HBASE-15111 hbase version should write to stdout
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2016-01-19 22:06:57 -06:00
Matteo Bertozzi 18a48af242 HBASE-14837 Procedure v2 - Procedure Queue Improvement 2016-01-14 09:24:42 -08:00
stack 83c506d9d4 HBASE-15087 Fix hbase-common findbugs complaints 2016-01-12 00:30:42 -08:00
anoopsjohn da932ee38d HBASE-15077 Support OffheapKV write in compaction with out copying data on heap. 2016-01-12 10:02:39 +05:30
anoopsjohn a9b671b31f HBASE-12593 Tags to work with ByteBuffer. 2016-01-06 21:28:06 +05:30
anoopsjohn 7cd09bfb91 HBASE-15064 BufferUnderflowException after last Cell fetched from an HFile Block served from L2 offheap cache. 2016-01-06 10:25:32 +05:30
stack 46303dfd75 HBASE-14888 ClusterSchema: Add Namespace Operations 2016-01-05 14:35:27 -08:00
anoopsjohn 9997e4ee52 HBASE-14524 Short-circuit comparison of rows in CellComparator. (Lars Francke) 2016-01-05 08:47:23 +05:30
stack a82f7fc94a Revert "HBASE-14888 ClusterSchema: Add Namespace Operations"
This reverts commit c5f3d17ae3.
2016-01-03 07:15:18 -08:00
stack c5f3d17ae3 HBASE-14888 ClusterSchema: Add Namespace Operations 2016-01-02 16:16:56 -08:00
anoopsjohn f01a388a35 HBASE-15063 Bug in MultiByteBuf#toBytes. (deepankar) 2016-01-01 23:11:59 +05:30
tedyu 449fb81286 HBASE-14030 Revert due to pending review comments 2015-12-28 01:08:02 -08:00
tedyu de69f0df34 HBASE-14030 HBase Backup/Restore Phase 1 (Vladimir Rodionov) 2015-12-27 10:02:09 -08:00
tedyu f53542c47d HBASE-15026 The default value of "hbase.regions.slop" in docs is obsolete 2015-12-25 15:37:31 -08:00
Jonathan M Hsieh 3de0b0417c HBASE-15035 bulkloading hfiles with tags that require splits do not preserve tags 2015-12-25 09:51:34 -08:00
anoopsjohn 6fc2596ab3 HBASE-14940 Make our unsafe based ops more safe. 2015-12-24 07:54:13 +05:30
Enis Soztutar 95a13b51ee HBASE-14977 ChoreService.shutdown may result in ConcurrentModificationException - ADDENDUM to fix extra concurrency issues 2015-12-22 02:04:09 -08:00
anoopsjohn cf458d3023 HBASE-14999 Remove ref to org.mortbay.log.Log. 2015-12-17 18:01:16 +05:30
Enis Soztutar a4bbc461e3 HBASE-14977 ChoreService.shutdown may result in ConcurrentModificationException (Vladimir Rodionov) 2015-12-15 12:29:43 -08:00
stack c15e0af84a HBASE-14906 Improvements on FlushLargeStoresPolicy (Yu Li) 2015-12-10 16:49:23 -08:00
ramkrishna 26ac60b03f HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi) 2015-12-10 13:07:46 +05:30
Gary Helmling c1e0fcc26d HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection 2015-12-09 15:52:27 -08:00
stack 8bf70144e4 Revert "Revert "HBASE-14922 Delayed flush doesn't work causing flush storms; addendum by Lars Hofhansl""
Push again but with right JIRA number this time.

This reverts commit 9fb53d07c4.
2015-12-05 14:30:25 -08:00
stack 9fb53d07c4 Revert "HBASE-1422 Delayed flush doesn't work causing flush storms; addendum by Lars Hofhansl"
Revert because pushed with wrong JIRA number

This reverts commit b1462679e1.
2015-12-05 14:30:05 -08:00
stack b1462679e1 HBASE-1422 Delayed flush doesn't work causing flush storms; addendum by Lars Hofhansl 2015-12-05 11:39:34 -08:00
Elliott Clark 46198bb9a4 HBASE-14922 Delayed flush doesn't work causing flush storms. -- ADD 2015-12-04 18:37:29 -08:00
Elliott Clark cd5ddc5fec HBASE-14922 Delayed flush doesn't work causing flush storms. 2015-12-04 16:54:01 -08:00
Enis Soztutar b3260423b1 HBASE-14904 Mark Base[En|De]coder LimitedPrivate and fix binary compat issue 2015-12-03 18:18:20 -08:00
ramkrishna aa41232a87 HBASE-14832 Ensure write paths work with ByteBufferedCells in case of
compaction (Ram)
2015-12-02 10:28:30 +05:30
Apekshit 3bac31b2a4 HBASE-14890 Fix broken checkstyle tool. Some javadocs had parsing errors because of wrongly formatted HTML tags. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-28 21:57:52 -08:00
tedyu 2317ec583d HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:08:38 -08:00
stack 5898b95329 HBASE-14860 Improve BoundedByteBufferPool; make lockless 2015-11-24 17:06:46 -08:00
Daniel Vimont 6a493ddff7 Commit for HBASE-14825 -- corrections of typos, misspellings, and mangled links
Commit for HBASE-14825 -- corrections of typos, misspellings, and mangled links - addition commit for line lengths
2015-11-25 07:12:36 +10:00
Gary Helmling 8b67df6948 HBASE-14821 Allow configuration overrides in TableOutputFormat 2015-11-24 12:13:51 -08:00
stack d8f2ac3e6e HBASE-14860 Improve BoundedByteBufferPool; make lockless (Hiroshi Ikeda) 2015-11-21 20:32:13 -08:00
Enis Soztutar cf81b45f37 HBASE-14468 Compaction improvements: FIFO compaction policy (Vladimir Rodionov) 2015-11-18 19:33:11 -08:00
Elliott Clark a591df1073 HBASE-14708 Use copy on write Map for region location cache
Summary:
Create and use a copy on write map for region location.

  - Create a copy on write map backed by a sorted array.
  - Create a test for both comparing each with a jdk provided map.
  - Change MetaCache to use the new map.

Test Plan:
  - org.apache.hadoop.hbase.client.TestFromClientSide
  - TestHCM

Differential Revision: https://reviews.facebook.net/D49545
2015-11-17 10:52:43 -08:00
zhangduo db42fc64f1 HBASE-14806 Missing sources.jar for several modules when building HBase 2015-11-17 08:54:13 +08:00
stack 290ecbe829 HBASE-14355 Scan different TimeRange for each column family (Churro Morales) 2015-11-12 10:54:16 -10:00
Elliott Clark 86da57f498 HBASE-14765 Remove snappy profile 2015-11-05 10:20:40 -08:00
Misty Stanley-Jones e8d6bf7d46 HBASE-14532 Add dfs shortcircuit configs to hbase-default.xml, fix anchor to Compaction subsection 2015-11-02 13:55:57 +10:00
Gary Helmling 683f84e6a2 HBASE-14700 Support a permissive mode for secure clusters to allow SIMPLE auth clients 2015-10-30 19:45:46 -07:00
anoopsjohn b0ad82191c HBASE-14557 MapReduce WALPlayer issue with NoTagsKeyValue. 2015-10-30 21:18:09 +05:30
Andrew Purtell dfa05284cf HBASE-14705 Javadoc for KeyValue constructor is not correct (Jean-Marc Spaggiari) 2015-10-27 14:40:28 -07:00
Enis Soztutar 16ff57bea9 HBASE-14680 Two configs for snapshot timeout and better defaults (Heng Chen) 2015-10-27 14:01:01 -07:00
stack 996866d3ae HBASE-14266 RegionServers have a lock contention of Configuration.getProps 2015-10-24 14:43:53 -07:00
stack c21e8ed1d8 HBASE-14657 Remove unneeded API from EncodedSeeker (Heng Chen) 2015-10-22 14:20:28 -07:00
Matteo Bertozzi 36a196722c HBASE-14669 remove unused import and fix javadoc 2015-10-22 09:25:26 -07:00
Misty Stanley-Jones c4fa88420f HBASE-14326 Clarify that ExploringCompactionPolicy evaluates a selection of StoreFiles, not a single StoreFile 2015-10-22 19:09:38 +10:00
Misty Stanley-Jones fd50b5c033 Revert "HBASE-14326 Clarify that ExploringCompactionPolicy evaluates a selection of StoreFiles, not a single StoreFile"
This reverts commit 6a90e7b43b.
2015-10-22 19:08:31 +10:00
Misty Stanley-Jones 6a90e7b43b HBASE-14326 Clarify that ExploringCompactionPolicy evaluates a selection of StoreFiles, not a single StoreFile 2015-10-22 15:37:37 +10:00
stack 71b38d60bb HBASE-14637 Loosen TestChoreService assert AND have TestDataBlockEncoders do less work (and add timeouts) 2015-10-17 16:14:45 -07:00
Elliott Clark 0ed8b0e5d5 HBASE-14597 Fix Groups cache in multi-threaded env 2015-10-16 15:15:26 -07:00
tedyu 8c69b0f751 HBASE-14594 Use new DNS API introduced in HADOOP-12437 (Josh Elser) 2015-10-14 14:17:36 -07:00
stack 940e5404df HBASE-14598 ByteBufferOutputStream grows its HeapByteBuffer beyond JVM limitations (Ian Friedman) 2015-10-14 13:13:01 -07:00
stack 118ef8b6e5 HBASE-14268 Improve KeyLocker; ADDENDUM: FIX JAVADOC WARNING 2015-10-14 09:26:59 -07:00
Nicolas Liochon b63155eac7 HBASE-14268 Improve KeyLocker - add missing files 2015-10-13 11:22:28 +02:00
stack 99e99f3b54 HBASE-14268 Improve KeyLocker (Hiroshi Ikeda) 2015-10-12 23:13:56 -07:00
Enis Soztutar 2ff6d0fe47 HBASE-14501 NPE in replication with TDE 2015-10-12 20:37:34 -07:00
anoopsjohn 6143b7694c HBASE-13819 Make RPC layer CellBlock buffer a DirectByteBuffer. 2015-10-13 07:57:53 +05:30
stack b9639d1e82 HBASE-14590 Shorten ByteBufferedCell#getXXXPositionInByteBuffer method name (Anoop Sam John) 2015-10-12 12:33:28 -07:00
stack 4e876c59f4 HBASE-14573 Edit on the ByteBufferedCell javadoc 2015-10-07 11:31:15 -07:00
Misty Stanley-Jones 5e60166eac HBASE-14424 Document that DisabledRegionSplitPolicy blocks manual splits 2015-10-07 12:08:22 +10:00
Stephen Yuan Jiang ed4c734b15 HBASE-14432 Procedure V2 - enforce ACL on procedure admin tasks (Stephen Yuan Jiang 2015-10-05 20:07:21 -07:00
Matteo Bertozzi 715e8b0de1 HBASE-14347 Add a switch to DynamicClassLoader to disable it (huaxiang sun) 2015-10-05 16:17:07 -07:00
anoopsjohn b014ba1243 HBASE-14480 Small optimization in SingleByteBuff. 2015-10-05 12:00:19 +05:30
smaddineni 44b8809726 HBASE-13770 Programmatic JAAS configuration option for secure zookeeper may be broken
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-10-02 17:50:54 -07:00
Elliott Clark a463984945 HBASE-14512 Cache UGI groups
Summary:
Don't create a user for every call. Instead create one user per connection.
Then inside of SecureHadoopUser cache the groupNames. This allows HBase to cache
empty groups.  This is needed since it's much more likely that HBase will be accessed
by a user that's not present on the posix /etc/group file.

Test Plan: Unit Tests

Differential Revision: https://reviews.facebook.net/D47751
2015-09-30 12:46:12 -07:00
ramkrishna d5768d4a50 HBASE-14398 - Create the fake keys required in the scan path to avoid copy
to byte[] (Ram)
2015-09-29 16:39:57 +05:30
Apekshit(Appy) Sharma dff86542d5 HBASE-14469 Fix comment, validation and logging in HeapMemorySizeUtil.getGlobalMemStoreLowerMark 2015-09-24 19:12:44 -07:00
Stephen Yuan Jiang 5b7894f92b HBASE-14107 Administrative Task: Provide an API to List all procedures (Stephen Yuan Jiang) 2015-09-23 21:48:32 -07:00
stack 2c83d8a263 HBASE-12751 Allow RowLock to be reader writer 2015-09-22 17:23:07 -07:00
ramkrishna d81fba59cf HBASE-12298 Support BB usage in PrefixTree (Ram) 2015-09-18 10:44:02 +05:30
anoopsjohn ae3176b9c0 HBASE-14395 Short circuit last byte check in CellUtil#matchingXXX methods for ByteBufferedCells. 2015-09-11 10:29:30 +05:30
Nick Dimiduk a11bb2a933 HBASE-14382 TestInterfaceAudienceAnnotations should hadoop-compt module resources 2015-09-09 11:08:28 -07:00
Lars Hofhansl 6a8ba22c16 HBASE-12988 [Replication]Parallel apply edits across regions. 2015-09-04 13:22:14 -07:00
stack d0873f5a8c HBASE-14224 Fix coprocessor handling of duplicate classes 2015-08-24 13:47:19 -07:00
stack d31aedb998 HBASE-13127 Add timeouts on all tests so less zombie sightings 2015-08-24 12:49:55 -07:00