cbf390422b
HBASE-18330 NPE in ReplicationZKLockCleanerChore
2017-07-19 15:46:22 -07:00
594f892c02
HBASE-18308 Eliminate the findbugs warnings for hbase-server
2017-07-20 00:35:35 +08:00
fc362f69cb
HBASE-18390 Sleep too long when finding region location failed
2017-07-19 11:49:58 +08:00
a74d270f7f
HBASE-18377 Error handling for FileNotFoundException should consider RemoteException in openReader()
2017-07-18 06:46:34 -07:00
4663d7b9a7
HBASE-18366 Fix flaky test TestServerCrashProcedure#testRecoveryAndDoubleExecutionOnRsWithMeta (Umesh Agashe)
...
Disabled for now. Will be back here when a more fundamental fix.
2017-07-14 22:39:53 +01:00
a4575704bc
HBASE-18229: create new Async Split API to embrace AM v2
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-07-14 22:26:17 +01:00
9cc9404261
HBASE-18187 update version to 2.0.0-alpha-2-SNAPSHOT
2017-07-14 11:20:32 -05:00
246d42297b
HBASE-17922 Clean TestRegionServerHostname for hadoop3.
...
Change-Id: I6f1514b1bc301be553912539e6a4192c2ccc782b
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-07-13 11:44:49 -07:00
97b649eb93
HBASE-18344 Introduce Append.addColumn as a replacement for Append.add
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-07-13 20:05:22 +08:00
2cde0be393
HBASE-18177 FanOutOneBlockAsyncDFSOutputHelper fails to compile against Hadoop 3
...
Because ClientProtocol::create has API changes between Hadoop 2/3
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-07-12 13:40:34 +08:00
45cabfb406
HBASE-18343 (addendum) Track the remaining unimplemented methods for async admin
2017-07-12 09:58:53 +08:00
f9f1a3a9fb
HBASE-18358 Backport HBASE-18099 'FlushSnapshotSubprocedure should wait for concurrent Region#flush() to finish'
2017-07-11 18:10:07 -07:00
4c699fd821
HBASE-18295 The result contains the cells across different rows
2017-07-12 02:34:01 +08:00
8a8e299eee
HBASE-18343 Track the remaining unimplemented methods for async admin
2017-07-11 14:05:02 +08:00
7acb226eb9
HBASE-18348 The implementation of AsyncTableRegionLocator does not follow the javadoc
2017-07-11 11:44:40 +08:00
6456c8bf84
HBASE-18267 The result from the postAppend is ignored
2017-07-11 10:30:42 +08:00
5d7dfa4d1d
HBASE-17705 Procedure execution must fail fast if procedure is not registered (Vladimir Rodionov)
2017-07-10 09:11:58 -07:00
4ab66aca89
HBASE-18307 Share the same EventLoopGroup for NettyRpcServer, NettyRpcClient and AsyncFSWALProvider at RS side
2017-07-10 21:02:55 +08:00
4368f09057
HBASE-18318 Implement updateConfiguration/stopMaster/stopRegionServer/shutdown methods
2017-07-10 13:49:03 +08:00
da80839ecc
HBASE-18316 Implement async admin operations for draining region servers
2017-07-09 20:22:06 +08:00
53ec9c5bd3
HBASE-18241 Change client.Table, client.Admin, Region, Store, and HBaseTestingUtility to not use HTableDescriptor or HColumnDescriptor
2017-07-08 17:00:15 +08:00
5d4e4f2007
HBASE-18317 Implement async admin operations for Normalizer/CleanerChore/CatalogJanitor
2017-07-08 10:59:01 +08:00
359f97711f
HBASE-18319 Implement getClusterStatus/getRegionLoad/getCompactionState/getLastMajorCompactionTimestamp methods
2017-07-07 16:47:19 +08:00
89d2adfe92
HBASE-18083 Make large/small file clean thread number configurable in HFileCleaner
2017-07-07 15:39:34 +08:00
b2b5cd6de6
Revert "HBASE-17056 Remove checked in PB generated files Selective add of dependency on"
...
Build is unstable and has interesting issues around CLASSPATH. Revert
for now.
This reverts commit 1049025e1d
2017-07-06 21:48:41 -07:00
1ead5f9103
HBASE-17931 Assign system tables to servers with highest version
2017-07-06 17:28:40 +08:00
381a151d14
HBASE-18002 Investigate why bucket cache filling up in file mode in an
...
exisiting file is slower (Ram)
2017-07-06 11:22:11 +05:30
1049025e1d
HBASE-17056 Remove checked in PB generated files Selective add of dependency on
...
hbase-thirdparty jars. Update to READMEs on how protobuf is done (and update to
refguide) Removed all checked in generated protobuf files. They are generatedon
the fly now as part of mainline build.
2017-07-05 21:38:23 -07:00
dcf4b422f2
HBASE-18325 Disable flakey TestMasterProcedureWalLease
2017-07-05 20:12:18 -07:00
92253defae
HBASE-17201 Edit of HFileBlock comments and javadoc
2017-07-05 13:32:54 -07:00
3ac029b822
HBASE-18312 Ineffective handling of FileNotFoundException in FileLink.tryOpen()
2017-07-05 10:38:05 -07:00
8a1ec2a93e
HBASE-18301 Enable TestSimpleRegionNormalizerOnCluster#testRegionNormalizationMergeOnCluster that was disabled by Proc-V2 AM in HBASE-14614 (Stephen Yuan Jiang)
2017-07-05 09:57:07 -07:00
507f5fb844
HBASE-18297 Provide a AsyncAdminBuilder to create new AsyncAdmin instance
2017-07-05 10:10:05 +08:00
590979aac3
HBASE-18310 LoadTestTool unable to write data
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-07-04 13:42:16 -07:00
dcfd319b5b
HBASE-15943 Add page displaying JVM process metrics
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-07-03 21:35:59 -07:00
eacbdb061e
HBASE-18264 Update pom plugins
...
Update plugins in main and subprojects
Unified versions to use variable instead of direct values
Affected plugins:
- apache-rat-plugin 0.11 -> 0.12
- asciidoctor-maven-plugin 1.5.2.1 -> 1.5.5
- asciidoctorj-pdf 1.5.0-alpha.6 -> 1.5.0-alpha.15
- build-helper-maven-plugin 1.9.1 -> 3.0.0
- buildnumber-maven-plugin 1.3 -> 1.4
- exec-maven-plugin 1.2.1/1.4.0 -> 1.6.0
- extra-enforcer-rules 1.0-beta-3 -> 1.0-beta-6
- findbugs-maven-plugin 3.0.0 -> 3.0.4
- jamon-maven-plugin 2.4.1 -> 2.4.2
- maven-bundle-plugin 2.5.3 -> 3.3.0
- maven-compiler-plugin 3.2/3.5.1 -> 3.6.1
- maven-eclipse-plugin 2.9 -> 2.10
- maven-shade-plugin 2.4.1 -> 3.0.0
- maven-surefire-plugin 2.18.1 -> 2.20
- maven-surefire-report-plugin 2.7.2 -> 2.20
- scala-maven-plugin 3.2.0 -> 3.2.2
- spotbugs 3.1.0-RC1 -> 3.1.0-RC3
- wagon-ssh 2.2 -> 2.12
- xml-maven-plugin 1.0 -> 1.0.1
- maven-assembly-plugin 2.4 -> 2.6(inherited)
- maven-dependency-plugin 2.4 -> 2.10 (inherited)
- maven-enforcer-plugin 1.3.1 -> 1.4.1 (inherited)
- maven-javadoc-plugin 2.10.3 -> 2.10.4 (inherited)
- maven-resources-plugin 2.7 (inherited)
- maven-site-plugin 3.4 -> 3.5.1 (inherited)
Change-Id: I84539f555be498dff18caed1e3eea1e1aeb2143a
Signed-off-by: Michael Stack <stack@apache.org>
2017-07-03 19:43:42 -07:00
af36bfb2f7
HBASE-18283 Provide a construct method which accept a thread pool for AsyncAdmin
2017-07-04 10:18:49 +08:00
8005d32943
HBASE-17995 improve log messages during snapshot tests.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-30 09:52:24 -05:00
2d2a1d4e26
HBASE-18288 Declared dependency on specific javax.ws.rs.
...
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2017-06-30 09:52:13 -05:00
d77fccde93
HBASE-16585 Rewrite the delegation token tests with Parameterized pattern
2017-06-30 20:41:21 +08:00
619dcf24f4
Revert "HBASE-18229: create new Async Split API to embrace AM v2"
...
TestShell is failing.
This reverts commit 290fb8965d
2017-06-30 03:30:50 -07:00
926781540c
HBASE-16192 Fix the potential problems in TestAcidGuarantees (Colin Ma)
2017-06-30 03:17:35 -07:00
290fb8965d
HBASE-18229: create new Async Split API to embrace AM v2
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-29 16:21:08 -07:00
f6dd43be70
HBASE-17982 correct spelling error of 'occured'
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-29 15:10:08 -07:00
7e7917ed6d
HBASE-18292 Fixed flaky test hbase.master.locking.TestLockProcedure#testLocalMasterLockRecovery
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-28 21:33:15 -07:00
15bda5d5d4
HBASE-18278 Enable and Fix for unit test hbase.master.procedure.TestServerCrashProcedure#testRecoveryAndDoubleExecutionOnRsWithMeta
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-28 16:02:19 -07:00
1c9f9ed06a
HBASE-18281 created private static pattern matcher for performance
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-28 11:32:57 -07:00
812b383325
HBASE-18164 Fast locality computation in balancer - addendum handles NaN
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-27 14:58:03 -05:00
0ad8f26662
Revert "HBASE-18164 Fast locality computation in balancer - addendum handles NaN"
...
This reverts commit b4c3fe9763
2017-06-27 14:58:03 -05:00
d5e206dfa0
HBASE-18161 Incremental Load support for Multiple-Table HFileOutputFormat (Densel Santhmayor)
2017-06-27 12:33:39 -07:00
4746a1c92b
HBASE-18265 Correct the link unuseful in regionServer's region state UI
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-06-27 10:39:43 +08:00
b4c3fe9763
HBASE-18164 Fast locality computation in balancer - addendum handles NaN
...
-Added new LocalityCostFunction and LocalityCandidateGenerator that
cache localities of every region/rack combination and mappings of every
region to its most local server and to its most local rack.
-Made LocalityCostFunction incremental so that it only computes locality
based on most recent region moves/swaps, rather than recomputing the
locality of every region in the cluster at every iteration of the
balancer
-Changed locality cost function to reflect the ratio of:
(Current locality) / (Best locality possible given current cluster)
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-26 12:39:51 -07:00
289938337b
HBASE-18234 Revisit the async admin api
2017-06-26 17:30:47 +08:00
d9dd319390
HBASE-18023 Log multi-* requests for more than threshold number of rows
...
Signed-off-by: Josh Elser <elserj@apache.org>
2017-06-24 15:34:02 -04:00
a4c26526c0
HBASE-18263 Resolve NPE in backup Master UI when accessing procedures.jsp
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-24 07:16:27 -07:00
49825aec6b
HBASE-18221 Switch from pread to stream should happen under HStore's
...
reentrant lock (Ram)
2017-06-23 10:34:10 +05:30
0357c2266a
HBASE-18254 ServerCrashProcedure checks and waits for meta initialized, instead should check and wait for meta loaded
...
After enabling test hbase.master.procedure.TestServerCrashProcedure#testRecoveryAndDoubleExecutionOnRsWithMeta, this bug is found in ServerCrashProcedure
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-21 21:58:15 -07:00
ff5d497310
HBASE-18235 LoadBalancer.BOGUS_SERVER_NAME should not have a bogus hostname
...
We deliberately use 'localhost' instead of a bogus hostname for
LoadBalancer.BOGUS_SERVER_NAME so the operation will fail fast.
2017-06-21 14:38:38 -07:00
af25940b25
HBASE-18252 Resolve BaseLoadBalancer bad practice warnings
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-21 10:12:57 -07:00
3ff84a2da9
HBASE-18226 Disable reverse DNS lookup at HMaster and use the hostname provided by RegionServer (Duo Xu)
2017-06-21 08:15:27 -07:00
0f5a250ac2
HBASE-18212 reduce log level for unbuffer warning.
...
In Standalone mode with local filesystem HBase logs Warning message:Failed to invoke 'unbuffer' method in class org.apache.hadoop.fs.FSDataInputStream
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-06-20 01:11:17 -05:00
3a79590bb4
HBASE-18164 Fast locality computation in balancer
...
-Added new LocalityCostFunction and LocalityCandidateGenerator that
cache localities of every region/rack combination and mappings of every
region to its most local server and to its most local rack.
-Made LocalityCostFunction incremental so that it only computes locality
based on most recent region moves/swaps, rather than recomputing the
locality of every region in the cluster at every iteration of the
balancer
-Changed locality cost function to reflect the ratio of:
(Current locality) / (Best locality possible given current cluster)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-06-20 01:11:08 -05:00
cfa1bd3265
HBASE-18180 Possible connection leak while closing BufferedMutator in TableOutputFormat
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-19 02:02:54 -07:00
74c6f44877
HBASE-18170 Refactor ReplicationSourceWALReaderThread
2017-06-19 09:34:23 +08:00
fa93c0f59a
HBASE-18104 AMv2: Enabled aggregation of RPCs
...
Unit test (TestAssignmentManager) uses mock which always aggregates. So added trace level log message and verified manually on a single node cluster.
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-16 23:54:11 -07:00
5db63014b0
HBASE-18227 Fixed unit test hbase.coprocessor.TestCoprocessorMetrics#testRegionObserverAfterRegionClosed
...
Calling closeRegion() directly on remote server is not supported post-AMv2. Calling unassign() on master
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-16 20:19:59 -07:00
2ef80ab39a
HBASE-18225 Avoid toString() on an array
2017-06-16 08:55:14 -07:00
7c15e57005
HBASE-18220 - Addendum as per Duo suggestion for readability (Ram)
2017-06-16 12:35:38 +05:30
ac2018e276
HBASE-18220 Compaction scanners need not reopen storefile scanners while
...
trying to switch over from pread to stream (Ram)
2017-06-16 11:04:44 +05:30
4184ae7563
HBASE-18004 getRegionLocations needs to be called once in
...
ScannerCallableWithReplicas#call() (Huaxiang Sun)
2017-06-15 13:41:49 -07:00
8c7bf7b0a9
HBASE-18166 [AMv2] We are splitting already-split files v2 Address Stephen Jiang reivew comments; ADDENDUM TO FIX COMPILE
2017-06-15 11:40:38 -07:00
c02a142143
HBASE-18166 [AMv2] We are splitting already-split files v2 Address Stephen Jiang reivew comments
2017-06-15 10:27:49 -07:00
299850ea70
HBASE-18209 Include httpclient / httpcore jars in build artifacts
2017-06-14 21:00:12 -07:00
6af3ee44c0
HBASE-18219 Fix typo in constant HConstants.HBASE_CLIENT_MEAT_REPLICA_SCAN_TIMEOUT
2017-06-14 16:03:50 -07:00
385b792446
HBASE-18137 Replication gets stuck for empty WALs
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-10 12:45:40 -07:00
1aedc07b52
HBASE-18192: Replication drops recovered queues on region server shutdown
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-09 19:53:31 -07:00
1e4f8491f7
HBASE-18092: Removing a peer does not properly clean up the ReplicationSourceManager state and metrics
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-09 08:23:41 -07:00
922894c96e
HBASE-18193 Master web UI presents the incorrect number of regions
2017-06-09 14:45:20 +08:00
a81577d827
HBASE-18195 Removed redundant single quote from start message for HMaster and HRegionServer
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-08 22:21:25 -07:00
17966525e9
HBASE-18141 Regionserver fails to shutdown when abort triggered during RPC call
2017-06-08 17:30:20 -07:00
ea7d51e129
HBASE-18109: Assign system tables first
...
This issue adds comments and a sort so system tables are queued first
(which will ensure they go out first). This should be good enough
along w/ existing scheduling mechanisms to ensure system/meta get
assigned first.
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-08 13:26:42 -07:00
1e7804634c
HBASE-18008 Any HColumnDescriptor we give out should be immutable
2017-06-08 23:28:33 +08:00
c830a0f47f
HBASE-18184 Add hbase-hadoop2-compat jar as MapReduce dependency
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-07 21:58:17 -07:00
adfb48eeb8
HBASE-18190 Set version in branch-2 to 2.0.0-alpha-1
2017-06-07 21:10:01 -07:00
9c8c749cd3
HBASE-18158 Two running in-memory compaction threads may lose data for flushing
2017-06-07 18:04:30 +08:00
9329a18c2d
HBASE-17849 PE tool random read is not totally random (Ram)
2017-06-07 11:31:30 +05:30
0d0c330401
HBASE-17678 FilterList with MUST_PASS_ONE may lead to redundant cells returned
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-06 21:08:12 -07:00
2f1923a823
HBASE-15576 Scanning cursor to prevent blocking long time on ResultScanner.next()
2017-06-07 11:32:04 +08:00
80e15aac21
HBASE-16392 Backup delete fault tolerance (Vladimir Rodionov)
2017-06-06 20:29:13 -07:00
da3c023635
HBASE-18145 The flush may cause the corrupt data for reading
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-06 18:02:43 -07:00
858bccfcb8
HBASE-18132 Low replication should be checked in period in case of datanode rolling upgrade (Allan Yang)
2017-06-06 17:21:21 -07:00
1950acc67a
HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-06 12:52:46 -07:00
ee0f148c73
HBASE-18038 Rename StoreFile to HStoreFile and add a StoreFile interface for CP
2017-06-06 20:36:38 +08:00
07c38e7165
HBASE-16549 Added new metrics for AMv2 procedures
...
Following AMv2 procedures are modified to override onSubmit(), onFinish() hooks provided by HBASE-17888 to do
metrics calculations when procedures are submitted and finshed:
* AssignProcedure
* UnassignProcedure
* MergeTableRegionProcedure
* SplitTableRegionProcedure
* ServerCrashProcedure
Following metrics is collected for each of the above procedure during lifetime of a process:
* Total number of requests submitted for a type of procedure
* Histogram of runtime in milliseconds for successfully completed procedures
* Total number of failed procedures
As we are moving away from Hadoop's metric2, hbase-metrics-api module is used for newly added metrics.
Modified existing tests to verify count of procedures.
Signed-off-by: Michael Stack <stack@apache.org>
2017-06-05 17:14:14 -07:00
e65d8653e5
HBASE-18155 TestMasterProcedureWalLease is flakey
2017-06-03 12:55:18 -07:00
118429cbac
HBASE-15160 Put back HFile's HDFS op latency sampling code and add metrics for monitoring (Yu Li and Enis Soztutar)
2017-06-02 17:41:53 -07:00
ef46debde8
HBASE-18005 read replica: handle the case that region server hosting both primary replica and meta region is down (huaxiang sun)
2017-06-02 09:29:51 -07:00
549171465d
HBASE-18111 Replication stuck when cluster connection is closed
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-06-01 15:12:15 -07:00
e1f3c89b3b
HBASE-18143 [AMv2] Backoff on failed report of region transition quickly goes to astronomical time scale
...
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
Rather than compound the pause time, just have backoff multiple the
original INIT_PAUSE_TIME_MS so we go 1, 2, 5, 10, ... etc. rather than
1, 2, 30, 600... and so on.
Minor fixup around logging so report of failed transition is no longer
reported as trace-level.
2017-06-01 13:01:36 -07:00
c7a7f880dd
HBASE-16261 MultiHFileOutputFormat Enhancement (Yi Liang)
2017-06-01 10:44:17 -07:00
Andrew Purtell
Chia-Ping Tsai
Phil Yang
tedyu
Michael Stack
Yi Liang
Sean Busbey
Mike Drob
Jan Hentschel
Guanghao Zhang
zhangduo
Yu Li
Ramkrishna
Stephen Yuan Jiang
Samir Ahmic
samirMop
Peter Somogyi
Yi Liang
张世彬10204932
Umesh Agashe
Ben-Epstein
Kahlil Oppenheimer
David Harju
QilinCao
Ashish Singhi
Pankaj Kumar
Josh Elser
Vincent
Ashu Pachauri
Gary Helmling
Alex Araujo
huzheng
Enis Soztutar
Jerry He