Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,352 Commits 326 Branches 371 Tags
Commit Graph

9352 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wei-Chiu Chuang
cdc48c5d5e HDFS-8224. Schedule a block for scanning if its metadata file is 
corrupt. Contributed by Rushabh S Shah.
 2016-08-23 07:28:21 -07:00
Varun Saxena
30a4c0bb63 MAPREDUCE-6763. Shuffle server listen queue is too small (Jason Lowe via Varun Saxena) 2016-08-20 04:18:25 +05:30
Kihwal Lee
d04fd76956 Revert "HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla." 
This reverts commit 25b3531eb40a32a602574e5cfc1ffe028044bcc9.
Reverting HDFS-9395 from branch-2.7 as it is an incompatible change.
 2016-08-18 17:20:20 -05:00
Kihwal Lee
e3b55237b0 Fix misplaced entry in CHANGES.txt 2016-08-18 16:49:53 -05:00
Kihwal Lee
61e1348fe4 HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee. 2016-08-18 16:39:35 -05:00
Mingliang Liu
eae9b691ca HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu) 
(cherry picked from commit 0f51eae0c085ded38216824377acf8122638c3a5)
 2016-08-18 14:23:22 -07:00
Kihwal Lee
6593851fa6 Revert "HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee." 
This reverts commit 71d0e4fca79d4305fe35e44b614703d3b9883017.
 2016-08-18 13:04:20 -05:00
Andrew Wang
d59f688992 HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory. 2016-08-17 13:17:52 -07:00
Zhe Zhang
040a1b7b90 HDFS-7933. fsck should also report decommissioning replicas. Contributed by Xiaoyu Yao. 
(cherry picked from commit 293c763e82586b4f3230771a86734aae593f468d)
 2016-08-16 10:35:52 -07:00
Kihwal Lee
9f5a22ff22 HDFS-10270. TestJMXGet:testNameNode() fails. Contributed by Gergely Novák 
(cherry picked from commit d2f3bbc29046435904ad9418073795439c71b441)
(cherry picked from commit ccaf746eeacfafc7392a994f28ee9dbf595c84af)
 2016-08-16 10:26:33 -07:00
Mingliang Liu
de96efec25 HDFS-10747. o.a.h.hdfs.tools.DebugAdmin usage message is misleading. (Contributed by Mingliang Liu) 2016-08-15 21:10:32 -07:00
Kihwal Lee
71d0e4fca7 HDFS-10763. Open files can leak permanently due to inconsistent lease update. Contributed by Kihwal Lee. 2016-08-15 17:40:07 -05:00
Kihwal Lee
7519956c30 HDFS-9696. Garbage snapshot records linger forever. Adding an entry to CHANGES.txt. 2016-08-15 15:50:54 -05:00
Kihwal Lee
e3b809a284 HDFS-9696. Garbage snapshot records linger forever. Contributed by Kihwal Lee 
(cherry picked from commit 83e57e083f2cf6c0de8a46966c5492faeabd8f2a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSaveNamespace.java

(cherry picked from commit 4766a3153dd517ac832d4761c884ed88a83a6c09)
 2016-08-15 13:17:02 -05:00
Zhe Zhang
13414be1a1 HDFS-9888. Allow reseting KerberosName in unit tests. Contributed by Xiao Chen. 
(cherry picked from commit 3e8099a45a4cfd4c5c0e3dce4370514cb2c90da9)
(cherry picked from commit 00ff3d737c71e1a228ede64a6b9abd5227ef2117)
(cherry picked from commit 9c1c48c0d44a45c4f96e8d60cfa6453a85523905)
 2016-08-11 16:40:02 -07:00
Akira Ajisaka
1038e6b476 HDFS-10336. TestBalancer failing intermittently because of not reseting UserGroupInformation completely. Contributed by Yiqun Lin. 
(cherry picked from commit 932aed64d77edcc8483a95c1ce31a4c9ae679446)
(cherry picked from commit 0529da723966e03c7dfa8201a515320c904d32a7)
(cherry picked from commit f29d0739d782516079e04ca4d57f268f6d1672f4)
 2016-08-11 16:21:35 -07:00
Zhe Zhang
7f78740885 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen. 
(cherry picked from commit ccff6035f50769eb69701128ae61efc69e82609d)
(cherry picked from commit 7d402692b4b06af0459ea81129e93a5182291a27)
(cherry picked from commit b8b4ea67d8f24403a05c9a1dabc04b0ab59a9136)
 2016-08-11 16:18:40 -07:00
Jason Lowe
c2d3af39f1 YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C 2016-08-10 19:18:02 +00:00
Yuanbo Liu
e88546596d HDFS-10694. processReport() should print blockReportId in each log message. Contributed by Yuanbo Liu. 
(cherry picked from commit 6dfa4fb16e449a248f2f3cf43a6be59dd8e1ac78)
 2016-08-10 11:14:33 -07:00
Jason Lowe
f5754fe5bc YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee 2016-08-10 18:12:07 +00:00
Jason Lowe
5580626ea0 YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat. Contributed by Rohith Sharma K S 
(cherry picked from commit 26b5e6116f392b6be91dca57968259f87554ce33)
 2016-08-09 22:20:22 +00:00
Konstantin V Shvachko
bfc261f2a0 HDFS-10693. metaSave should print blocks, not LightWeightHashSet. Contributed by Yuanbo Liu. 
(cherry picked from commit 4d3af47f2765f6f57936d316ef2a4150b787cc97)
 2016-08-07 15:02:51 -07:00
Jason Lowe
7bbd3cf650 YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit c01bee010832ca31d8e60e5461181cdf05140602)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-08-05 20:12:23 +00:00
Arpit Agarwal
9669779f2c HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 2016-08-03 14:28:44 -07:00
Jason Lowe
2bf4e76370 HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger 
(cherry picked from commit c82745432a962c817a8a7db92bb830fb6af01e33)

Conflicts:

	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ha/ActiveStandbyElector.java
 2016-08-03 20:27:15 +00:00
Jason Lowe
47e1eabf79 YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger 
(cherry picked from commit db4a61dc617954cf448a0d44cb4ac79f2abf9db3)
 2016-08-03 19:55:59 +00:00
Jason Lowe
22b9a6ce4a YARN-4717. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter) 
(cherry picked from commit 22ca176dfe125a4f7bf38cc63ab8106c40a7a7ba)
 2016-08-03 19:37:23 +00:00
Jason Lowe
4948fce1c1 YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger 
(cherry picked from commit db646540f094077941b56ed681a4f3e5853f5b7f)
 2016-08-03 19:21:27 +00:00
Konstantin V Shvachko
a8886dcc20 HDFS-8780. Follow up commit to add missing lines from porting to branch-2.7. 2016-08-02 13:26:36 -07:00
Konstantin V Shvachko
0c3282b35c Revert "HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi." 
This reverts commit a76eb7fa34b5932a4eaceeaf9a7df0f68462b2a1.
 2016-08-02 10:53:06 -07:00
Vinitha Reddy Gankidi
a76eb7fa34 HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi. 2016-07-30 17:01:49 -07:00
Akira Ajisaka
379d587d23 HDFS-10691. FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException. Contributed by Yiqun Lin. 2016-07-30 08:29:55 +09:00
Vinayakumar B
2371ed0551 HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina) 
(cherry picked from commit fdb56f74f38cabb0f94e0781fcedb1594904c026)
 2016-07-29 16:07:33 -07:00
Konstantin V Shvachko
fb00663aaa HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. (Contributed by J.Andreina) 
(cherry picked from commit 2893da4f538e8802fd8d6de774faaed4b88a48c0)
 2016-07-29 15:56:12 -07:00
Wangda Tan
6cb2e9733d Backport Doclet fixes from YARN-3426 2016-07-27 16:41:55 -07:00
Haohui Mai
63711c3960 HADOOP-11814. Reformat hadoop-annotations, o.a.h.classification.tools. Contributed by Li Lu. 
(cherry picked from commit dc0282d64c6528b02aa9f2df49be01223f087081)
 2016-07-27 16:41:55 -07:00
Masatake Iwasaki
b904a7fd00 HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block. (iwasakims) 2016-07-28 00:45:13 +09:00
Jason Lowe
4edff93c7c MAPREDUCE-6744. Increase timeout on TestDFSIO tests. Contributed by Eric Badger 
(cherry picked from commit 703fdf86c6e42d6d555090f670ca5cbd1ef48bf9)
 2016-07-25 21:59:48 +00:00
Rohith Sharma K S
400a6144e2 YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe. 2016-07-22 20:57:35 +05:30
Jing Zhao
2a5b8e5b3a HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp. 
(cherry picked from commit bd3dcf46e263b6e6aa3fca6a5d9936cc49e3280f)
(cherry picked from commit 6a7fe835f19141cc633824cd5d21f1e30f014bce)
 2016-07-21 11:30:06 -07:00
Jason Lowe
9938010264 YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan 
(cherry picked from commit 446d51591e6e99cc60a85c4b9fbac379a8caa49d)
(cherry picked from commit 03af057a477b2a31b66831d66f8a38cff42f2201)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-07-21 18:17:29 +00:00
Jason Lowe
5220d4dc27 HADOOP-11149. Increase the timeout of TestZKFailoverController. Contributed by Steve Loughran. 
(cherry picked from commit 579f9030dadac4bf53f38ae8499a95a3bdd43c97)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-07-21 15:01:56 +00:00
Varun Vasudev
1b8641a3c3 YARN-5309. Fix SSLFactory truststore reloader thread leak in TimelineClientImpl. Contributed by Weiwei Yang. 2016-07-20 13:06:31 +05:30
Akira Ajisaka
a6798991f0 HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki. 
(cherry picked from commit dc065dd64ca3e101b0c0a7bcc7d7a067b77d6c82)
(cherry picked from commit 8fe2c450b38ab51087eea867fd1dd960915a6fed)
 2016-07-19 16:07:40 -07:00
Akira Ajisaka
833117c219 HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki. 
(cherry picked from commit c2bcffb34ebe4399b523a44f69d23761648bd0c4)
(cherry picked from commit 09375baad1ba732b73701cdbd0ee77618ed6f687)
 2016-07-18 11:52:43 -07:00
Tsuyoshi Ozawa
65adabd0d1 HADOOP-13298. Fix the leftover L&N files in hadoop-build-tools/src/main/resources/META-INF/. (ozawa) 
(cherry picked from commit ea9f43781e5a9a4a6121dd3be106ced6b811754d)
 2016-07-16 08:20:43 +09:00
Arpit Agarwal
c35c1e6703 HDFS-10623. Remove unused import of httpclient.HttpConnection from TestWebHdfsTokens. (Contributed by Hanisha Koneru) 2016-07-14 13:01:15 -07:00
Zhe Zhang
45ed97e0d2 HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung. 
(cherry picked from commit 728bf7f6988e13f17f03d2e3a4037b7238c4fd45)
(cherry picked from commit b95f1af8a9aafb3e482c7b8825f2097f2ceb0e8e)
(cherry picked from commit cbd885b6fa26b7a84a4a19d6084d95665f21378a)
 2016-07-13 16:49:54 -07:00
Zhe Zhang
c7e1e92c1a HDFS-10544. Balancer doesn't work with IPFailoverProxyProvider. 
(cherry picked from commit 087290e6b1cb1082646d966b65494082712ebe3e)
(cherry picked from commit 5b4e916b3cae2540267d48716fd9240dfc055288)
(cherry picked from commit af94dfaa53532d7c650478050621d216360e04b5)
 2016-07-13 14:36:26 -07:00
Arpit Agarwal
771033babd HADOOP-12570. HDFS Secure Mode Documentation updates. (Arpit Agarwal) 2016-07-13 13:02:01 -07:00