Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,363 Commits 326 Branches 371 Tags
Commit Graph

9363 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jason Lowe
a852800d2f MAPREDUCE-6768. TestRecovery.testSpeculative failed with NPE. Contributed by Haibo Chen 
(cherry picked from commit 44d0af2611cb565d8ec68f92e27937342646cca5)
 2016-08-29 20:02:47 +00:00
Mingliang Liu
3112a2447f HDFS-10807. Doc about upgrading to a version of HDFS with snapshots may be confusing. (Contributed by Mingliang Liu) 2016-08-29 10:22:55 -07:00
Zhe Zhang
1d01704060 HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen. Branch-2 patch contributed by Wei-Chiu Chuang. 
(cherry picked from commit dfcbc12026b591745a7d7279f2b840152cb53a91)
(cherry picked from commit 8bc33bf343b7e9005e04f0dc6078bfb06fb22815)
 2016-08-29 10:10:47 -07:00
Zhe Zhang
4f43607311 HDFS-10798. Make the threshold of reporting FSNamesystem lock contention configurable. Contributed by Erik Krogen. 
(cherry picked from commit 407b519fb14f79f19ebc4fbdf08204336a7acf77)
(cherry picked from commit f3a4cbcc60572c73e0d15580bae42a36c92fe247)
(cherry picked from commit 96cf681b5d9aca71548390cb258f8d0ca2131082)
 2016-08-26 14:34:28 -07:00
Kihwal Lee
8593225e85 HDFS-8915. TestFSNamesystem.testFSLockGetWaiterCount fails intermittently. Contributed by Masatake Iwasaki. 
(cherry picked from commit 13fb1b50e608558b2970184908ee5b9fcd7eb7b6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSNamesystem.java
Updated CHANGES.txt
 2016-08-26 10:09:57 -05:00
Jing Zhao
8aa18534d9 HDFS-9467. Fix data race accessing writeLockHeldTimeStamp in FSNamesystem. Contributed by Mingliang Liu. 
(cherry picked from commit e556c35b0596700f9ec9d0a51cf5027259d531b5)
(cherry picked from commit 288cf8437b7e03f071e95eb05e83a26e58fff26b)
 2016-08-25 10:34:43 -07:00
Haohui Mai
0d8a1636ef HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu. 
(cherry picked from commit 5c5362980c429a5ad0b58e0dd1933de9cde7f369)
 2016-08-25 10:18:50 -07:00
Xiaoyu Yao
e5cb9d9e18 HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer. 
(cherry picked from commit a7862d5fe4c505f5d4b0c675438a971733f1f53a)
(cherry picked from commit 27ccbd51f6827d4e4a26c2026c024a3400ab96f2)
 2016-08-25 10:10:18 -07:00
cnauroth
a1d8e421f6 HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R. 
(cherry picked from commit cb03768b1b2250b9b5a7944cf6ef918e8a974e20)
(cherry picked from commit 57d55d40dd41ba4449b91c4676131b6b840052c4)
 2016-08-25 09:39:27 -07:00
Zhe Zhang
5fe29062eb HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh. 
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
(cherry picked from commit 6d4a4e785b254a0761a6373ff1376fe64ecf6398)
 2016-08-23 15:09:05 -07:00
Jason Lowe
cec6083055 HDFS-9745. TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts. Contributed by Xiao Chen 
(cherry picked from commit 126d165efd80e266a8309241f3cf059e358f5019)
 2016-08-23 14:51:29 +00:00
Wei-Chiu Chuang
cdc48c5d5e HDFS-8224. Schedule a block for scanning if its metadata file is 
corrupt. Contributed by Rushabh S Shah.
 2016-08-23 07:28:21 -07:00
Varun Saxena
30a4c0bb63 MAPREDUCE-6763. Shuffle server listen queue is too small (Jason Lowe via Varun Saxena) 2016-08-20 04:18:25 +05:30
Kihwal Lee
d04fd76956 Revert "HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla." 
This reverts commit 25b3531eb40a32a602574e5cfc1ffe028044bcc9.
Reverting HDFS-9395 from branch-2.7 as it is an incompatible change.
 2016-08-18 17:20:20 -05:00
Kihwal Lee
e3b55237b0 Fix misplaced entry in CHANGES.txt 2016-08-18 16:49:53 -05:00
Kihwal Lee
61e1348fe4 HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee. 2016-08-18 16:39:35 -05:00
Mingliang Liu
eae9b691ca HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu) 
(cherry picked from commit 0f51eae0c085ded38216824377acf8122638c3a5)
 2016-08-18 14:23:22 -07:00
Kihwal Lee
6593851fa6 Revert "HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee." 
This reverts commit 71d0e4fca79d4305fe35e44b614703d3b9883017.
 2016-08-18 13:04:20 -05:00
Andrew Wang
d59f688992 HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory. 2016-08-17 13:17:52 -07:00
Zhe Zhang
040a1b7b90 HDFS-7933. fsck should also report decommissioning replicas. Contributed by Xiaoyu Yao. 
(cherry picked from commit 293c763e82586b4f3230771a86734aae593f468d)
 2016-08-16 10:35:52 -07:00
Kihwal Lee
9f5a22ff22 HDFS-10270. TestJMXGet:testNameNode() fails. Contributed by Gergely Novák 
(cherry picked from commit d2f3bbc29046435904ad9418073795439c71b441)
(cherry picked from commit ccaf746eeacfafc7392a994f28ee9dbf595c84af)
 2016-08-16 10:26:33 -07:00
Mingliang Liu
de96efec25 HDFS-10747. o.a.h.hdfs.tools.DebugAdmin usage message is misleading. (Contributed by Mingliang Liu) 2016-08-15 21:10:32 -07:00
Kihwal Lee
71d0e4fca7 HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee. 2016-08-15 17:40:07 -05:00
Kihwal Lee
7519956c30 HDFS-9696. Garbage snapshot records linger forever. Adding an entry to CHANGES.txt. 2016-08-15 15:50:54 -05:00
Kihwal Lee
e3b809a284 HDFS-9696. Garbage snapshot records linger forever. Contributed by Kihwal Lee 
(cherry picked from commit 83e57e083f2cf6c0de8a46966c5492faeabd8f2a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSaveNamespace.java

(cherry picked from commit 4766a3153dd517ac832d4761c884ed88a83a6c09)
 2016-08-15 13:17:02 -05:00
Zhe Zhang
13414be1a1 HDFS-9888. Allow reseting KerberosName in unit tests. Contributed by Xiao Chen. 
(cherry picked from commit 3e8099a45a4cfd4c5c0e3dce4370514cb2c90da9)
(cherry picked from commit 00ff3d737c71e1a228ede64a6b9abd5227ef2117)
(cherry picked from commit 9c1c48c0d44a45c4f96e8d60cfa6453a85523905)
 2016-08-11 16:40:02 -07:00
Akira Ajisaka
1038e6b476 HDFS-10336. TestBalancer failing intermittently because of not reseting UserGroupInformation completely. Contributed by Yiqun Lin. 
(cherry picked from commit 932aed64d77edcc8483a95c1ce31a4c9ae679446)
(cherry picked from commit 0529da723966e03c7dfa8201a515320c904d32a7)
(cherry picked from commit f29d0739d782516079e04ca4d57f268f6d1672f4)
 2016-08-11 16:21:35 -07:00
Zhe Zhang
7f78740885 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen. 
(cherry picked from commit ccff6035f50769eb69701128ae61efc69e82609d)
(cherry picked from commit 7d402692b4b06af0459ea81129e93a5182291a27)
(cherry picked from commit b8b4ea67d8f24403a05c9a1dabc04b0ab59a9136)
 2016-08-11 16:18:40 -07:00
Jason Lowe
c2d3af39f1 YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C 2016-08-10 19:18:02 +00:00
Yuanbo Liu
e88546596d HDFS-10694. processReport() should print blockReportId in each log message. Contributed by Yuanbo Liu. 
(cherry picked from commit 6dfa4fb16e449a248f2f3cf43a6be59dd8e1ac78)
 2016-08-10 11:14:33 -07:00
Jason Lowe
f5754fe5bc YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee 2016-08-10 18:12:07 +00:00
Jason Lowe
5580626ea0 YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat. Contributed by Rohith Sharma K S 
(cherry picked from commit 26b5e6116f392b6be91dca57968259f87554ce33)
 2016-08-09 22:20:22 +00:00
Konstantin V Shvachko
bfc261f2a0 HDFS-10693. metaSave should print blocks, not LightWeightHashSet. Contributed by Yuanbo Liu. 
(cherry picked from commit 4d3af47f2765f6f57936d316ef2a4150b787cc97)
 2016-08-07 15:02:51 -07:00
Jason Lowe
7bbd3cf650 YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit c01bee010832ca31d8e60e5461181cdf05140602)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-08-05 20:12:23 +00:00
Arpit Agarwal
9669779f2c HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 2016-08-03 14:28:44 -07:00
Jason Lowe
2bf4e76370 HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger 
(cherry picked from commit c82745432a962c817a8a7db92bb830fb6af01e33)

Conflicts:

	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ha/ActiveStandbyElector.java
 2016-08-03 20:27:15 +00:00
Jason Lowe
47e1eabf79 YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger 
(cherry picked from commit db4a61dc617954cf448a0d44cb4ac79f2abf9db3)
 2016-08-03 19:55:59 +00:00
Jason Lowe
22b9a6ce4a YARN-4717. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter) 
(cherry picked from commit 22ca176dfe125a4f7bf38cc63ab8106c40a7a7ba)
 2016-08-03 19:37:23 +00:00
Jason Lowe
4948fce1c1 YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger 
(cherry picked from commit db646540f094077941b56ed681a4f3e5853f5b7f)
 2016-08-03 19:21:27 +00:00
Konstantin V Shvachko
a8886dcc20 HDFS-8780. Follow up commit to add missing lines from porting to branch-2.7. 2016-08-02 13:26:36 -07:00
Konstantin V Shvachko
0c3282b35c Revert "HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi." 
This reverts commit a76eb7fa34b5932a4eaceeaf9a7df0f68462b2a1.
 2016-08-02 10:53:06 -07:00
Vinitha Reddy Gankidi
a76eb7fa34 HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi. 2016-07-30 17:01:49 -07:00
Akira Ajisaka
379d587d23 HDFS-10691. FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException. Contributed by Yiqun Lin. 2016-07-30 08:29:55 +09:00
Vinayakumar B
2371ed0551 HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina) 
(cherry picked from commit fdb56f74f38cabb0f94e0781fcedb1594904c026)
 2016-07-29 16:07:33 -07:00
Konstantin V Shvachko
fb00663aaa HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. (Contributed by J.Andreina) 
(cherry picked from commit 2893da4f538e8802fd8d6de774faaed4b88a48c0)
 2016-07-29 15:56:12 -07:00
Wangda Tan
6cb2e9733d Backport Doclet fixes from YARN-3426 2016-07-27 16:41:55 -07:00
Haohui Mai
63711c3960 HADOOP-11814. Reformat hadoop-annotations, o.a.h.classification.tools. Contributed by Li Lu. 
(cherry picked from commit dc0282d64c6528b02aa9f2df49be01223f087081)
 2016-07-27 16:41:55 -07:00
Masatake Iwasaki
b904a7fd00 HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block. (iwasakims) 2016-07-28 00:45:13 +09:00
Jason Lowe
4edff93c7c MAPREDUCE-6744. Increase timeout on TestDFSIO tests. Contributed by Eric Badger 
(cherry picked from commit 703fdf86c6e42d6d555090f670ca5cbd1ef48bf9)
 2016-07-25 21:59:48 +00:00
Rohith Sharma K S
400a6144e2 YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe. 2016-07-22 20:57:35 +05:30