Commit Graph

9658 Commits

Author SHA1 Message Date
Jing Zhao 8aa18534d9 HDFS-9467. Fix data race accessing writeLockHeldTimeStamp in FSNamesystem. Contributed by Mingliang Liu.
(cherry picked from commit e556c35b05)
(cherry picked from commit 288cf8437b)
2016-08-25 10:34:43 -07:00
Haohui Mai 0d8a1636ef HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu.
(cherry picked from commit 5c5362980c)
2016-08-25 10:18:50 -07:00
Xiaoyu Yao e5cb9d9e18 HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer.
(cherry picked from commit a7862d5fe4)
(cherry picked from commit 27ccbd51f6)
2016-08-25 10:10:18 -07:00
cnauroth a1d8e421f6 HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R.
(cherry picked from commit cb03768b1b)
(cherry picked from commit 57d55d40dd)
2016-08-25 09:39:27 -07:00
Zhe Zhang 5fe29062eb HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
(cherry picked from commit 6d4a4e785b)
2016-08-23 15:09:05 -07:00
Jason Lowe cec6083055 HDFS-9745. TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts. Contributed by Xiao Chen
(cherry picked from commit 126d165efd)
2016-08-23 14:51:29 +00:00
Wei-Chiu Chuang cdc48c5d5e HDFS-8224. Schedule a block for scanning if its metadata file is
corrupt. Contributed by Rushabh S Shah.
2016-08-23 07:28:21 -07:00
Varun Saxena 30a4c0bb63 MAPREDUCE-6763. Shuffle server listen queue is too small (Jason Lowe via Varun Saxena) 2016-08-20 04:18:25 +05:30
Kihwal Lee d04fd76956 Revert "HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla."
This reverts commit 25b3531eb4.
Reverting HDFS-9395 from branch-2.7 as it is an incompatible change.
2016-08-18 17:20:20 -05:00
Kihwal Lee e3b55237b0 Fix misplaced entry in CHANGES.txt 2016-08-18 16:49:53 -05:00
Kihwal Lee 61e1348fe4 HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee. 2016-08-18 16:39:35 -05:00
Mingliang Liu eae9b691ca HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu)
(cherry picked from commit 0f51eae0c0)
2016-08-18 14:23:22 -07:00
Kihwal Lee 6593851fa6 Revert "HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee."
This reverts commit 71d0e4fca7.
2016-08-18 13:04:20 -05:00
Andrew Wang d59f688992 HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory. 2016-08-17 13:17:52 -07:00
Zhe Zhang 040a1b7b90 HDFS-7933. fsck should also report decommissioning replicas. Contributed by Xiaoyu Yao.
(cherry picked from commit 293c763e82)
2016-08-16 10:35:52 -07:00
Kihwal Lee 9f5a22ff22 HDFS-10270. TestJMXGet:testNameNode() fails. Contributed by Gergely Novák
(cherry picked from commit d2f3bbc290)
(cherry picked from commit ccaf746eea)
2016-08-16 10:26:33 -07:00
Mingliang Liu de96efec25 HDFS-10747. o.a.h.hdfs.tools.DebugAdmin usage message is misleading. (Contributed by Mingliang Liu) 2016-08-15 21:10:32 -07:00
Kihwal Lee 71d0e4fca7 HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee. 2016-08-15 17:40:07 -05:00
Kihwal Lee 7519956c30 HDFS-9696. Garbage snapshot records linger forever. Adding an entry to CHANGES.txt. 2016-08-15 15:50:54 -05:00
Kihwal Lee e3b809a284 HDFS-9696. Garbage snapshot records linger forever. Contributed by Kihwal Lee
(cherry picked from commit 83e57e083f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSaveNamespace.java

(cherry picked from commit 4766a3153d)
2016-08-15 13:17:02 -05:00
Zhe Zhang 13414be1a1 HDFS-9888. Allow reseting KerberosName in unit tests. Contributed by Xiao Chen.
(cherry picked from commit 3e8099a45a)
(cherry picked from commit 00ff3d737c)
(cherry picked from commit 9c1c48c0d4)
2016-08-11 16:40:02 -07:00
Akira Ajisaka 1038e6b476 HDFS-10336. TestBalancer failing intermittently because of not reseting UserGroupInformation completely. Contributed by Yiqun Lin.
(cherry picked from commit 932aed64d7)
(cherry picked from commit 0529da7239)
(cherry picked from commit f29d0739d7)
2016-08-11 16:21:35 -07:00
Zhe Zhang 7f78740885 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen.
(cherry picked from commit ccff6035f5)
(cherry picked from commit 7d402692b4)
(cherry picked from commit b8b4ea67d8)
2016-08-11 16:18:40 -07:00
Jason Lowe c2d3af39f1 YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C 2016-08-10 19:18:02 +00:00
Yuanbo Liu e88546596d HDFS-10694. processReport() should print blockReportId in each log message. Contributed by Yuanbo Liu.
(cherry picked from commit 6dfa4fb16e449a248f2f3cf43a6be59dd8e1ac78)
2016-08-10 11:14:33 -07:00
Jason Lowe f5754fe5bc YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee 2016-08-10 18:12:07 +00:00
Jason Lowe 5580626ea0 YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat. Contributed by Rohith Sharma K S
(cherry picked from commit 26b5e6116f)
2016-08-09 22:20:22 +00:00
Konstantin V Shvachko bfc261f2a0 HDFS-10693. metaSave should print blocks, not LightWeightHashSet. Contributed by Yuanbo Liu.
(cherry picked from commit 4d3af47f27)
2016-08-07 15:02:51 -07:00
Jason Lowe 7bbd3cf650 YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks)
(cherry picked from commit c01bee0108)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-08-05 20:12:23 +00:00
Arpit Agarwal 9669779f2c HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 2016-08-03 14:28:44 -07:00
Jason Lowe 2bf4e76370 HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger
(cherry picked from commit c82745432a)

Conflicts:

	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ha/ActiveStandbyElector.java
2016-08-03 20:27:15 +00:00
Jason Lowe 47e1eabf79 YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger
(cherry picked from commit db4a61dc61)
2016-08-03 19:55:59 +00:00
Jason Lowe 22b9a6ce4a YARN-4717. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter)
(cherry picked from commit 22ca176dfe)
2016-08-03 19:37:23 +00:00
Jason Lowe 4948fce1c1 YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger
(cherry picked from commit db646540f0)
2016-08-03 19:21:27 +00:00
Konstantin V Shvachko a8886dcc20 HDFS-8780. Follow up commit to add missing lines from porting to branch-2.7. 2016-08-02 13:26:36 -07:00
Konstantin V Shvachko 0c3282b35c Revert "HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi."
This reverts commit a76eb7fa34.
2016-08-02 10:53:06 -07:00
Vinitha Reddy Gankidi a76eb7fa34 HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi. 2016-07-30 17:01:49 -07:00
Akira Ajisaka 379d587d23 HDFS-10691. FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException. Contributed by Yiqun Lin. 2016-07-30 08:29:55 +09:00
Vinayakumar B 2371ed0551 HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina)
(cherry picked from commit fdb56f74f3)
2016-07-29 16:07:33 -07:00
Konstantin V Shvachko fb00663aaa HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. (Contributed by J.Andreina)
(cherry picked from commit 2893da4f53)
2016-07-29 15:56:12 -07:00
Wangda Tan 6cb2e9733d Backport Doclet fixes from YARN-3426 2016-07-27 16:41:55 -07:00
Haohui Mai 63711c3960 HADOOP-11814. Reformat hadoop-annotations, o.a.h.classification.tools. Contributed by Li Lu.
(cherry picked from commit dc0282d64c)
2016-07-27 16:41:55 -07:00
Masatake Iwasaki b904a7fd00 HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block. (iwasakims) 2016-07-28 00:45:13 +09:00
Jason Lowe 4edff93c7c MAPREDUCE-6744. Increase timeout on TestDFSIO tests. Contributed by Eric Badger
(cherry picked from commit 703fdf86c6)
2016-07-25 21:59:48 +00:00
Rohith Sharma K S 400a6144e2 YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe. 2016-07-22 20:57:35 +05:30
Jing Zhao 2a5b8e5b3a HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp.
(cherry picked from commit bd3dcf46e2)
(cherry picked from commit 6a7fe835f1)
2016-07-21 11:30:06 -07:00
Jason Lowe 9938010264 YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan
(cherry picked from commit 446d51591e)
(cherry picked from commit 03af057a47)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-07-21 18:17:29 +00:00
Jason Lowe 5220d4dc27 HADOOP-11149. Increase the timeout of TestZKFailoverController. Contributed by Steve Loughran.
(cherry picked from commit 579f9030da)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
2016-07-21 15:01:56 +00:00
Varun Vasudev 1b8641a3c3 YARN-5309. Fix SSLFactory truststore reloader thread leak in TimelineClientImpl. Contributed by Weiwei Yang. 2016-07-20 13:06:31 +05:30
Akira Ajisaka a6798991f0 HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki.
(cherry picked from commit dc065dd64c)
(cherry picked from commit 8fe2c450b3)
2016-07-19 16:07:40 -07:00