Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,120 Commits 326 Branches 371 Tags
Commit Graph

12120 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Naganarasimha
b63d3dcac9 YARN-4833. For Queue AccessControlException client retries multiple times on both RM. Contributed by Bibin A Chundatt 2016-08-12 20:16:15 +05:30
Wei-Chiu Chuang
20a8ff0a8d HDFS-10731. FSDirectory#verifyMaxDirItems does not log path name. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 9019606b69bfb7019c8642b6cbcbb93645cc19e3)
 2016-08-12 06:02:47 -07:00
Wei-Chiu Chuang
6d53e096b2 HADOOP-13190. Mention LoadBalancingKMSClientProvider in KMS HA documentation. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit db719ef125b11b01eab3353e2dc4b48992bf88d5)
 2016-08-11 12:27:52 -07:00
Wei-Chiu Chuang
d4501ad0d8 HADOOP-13441. Document LdapGroupsMapping keystore password properties. Contributed by Yuanbo Liu. 
(cherry picked from commit d892ae9576d07d01927443b6dc6c934a6c2f317f)
 2016-08-11 11:58:18 -07:00
Zhe Zhang
00ff3d737c HDFS-9888. Allow reseting KerberosName in unit tests. Contributed by Xiao Chen. 
(cherry picked from commit 3e8099a45a4cfd4c5c0e3dce4370514cb2c90da9)
 2016-08-11 11:32:54 -07:00
Akira Ajisaka
0529da7239 HDFS-10336. TestBalancer failing intermittently because of not reseting UserGroupInformation completely. Contributed by Yiqun Lin. 
(cherry picked from commit 932aed64d77edcc8483a95c1ce31a4c9ae679446)
 2016-08-11 10:55:53 -07:00
Zhe Zhang
7d402692b4 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen. 
(cherry picked from commit ccff6035f50769eb69701128ae61efc69e82609d)
 2016-08-11 10:53:16 -07:00
Rohith Sharma K S
0937715f7f YARN-5492. TestSubmitApplicationWithRMHA is failing sporadically during precommit builds. Contributed by Vrushali C. 
(cherry picked from commit 5199db387d59f7233a0e52ac298df31e8ed8af20)
 2016-08-11 11:51:56 +05:30
Rohith Sharma K S
05b384271c YARN-2398. TestResourceTrackerOnHA crashes. Contributed by Ajith S. 
(cherry picked from commit 666ad0b67b9162860fccddbd1d89c806c70b60ef)
 2016-08-11 11:41:36 +05:30
Wei-Chiu Chuang
f1d5a95cf3 HDFS-8897. Balancer should handle fs.defaultFS trailing slash in HA. Contributed by John Zhuge. 2016-08-10 22:24:21 -07:00
Ray Chiang
372f6f8456 YARN-5137. Make DiskChecker pluggable in NodeManager. (Yufei Gu via rchiang) 
(cherry picked from commit dbe9e70cc084220ea1f68da850cdb092281b5e96)
 2016-08-10 19:26:49 -07:00
Xiao Chen
01fc975ed9 HADOOP-13461. NPE in KeyProvider.rollNewVersion. Contributed by Colm O hEigeartaigh. 
(cherry picked from commit e83be44af530d57d9c49cd989d030052548a068b)
 2016-08-10 16:28:34 -07:00
Xiaoyu Yao
de6eafc696 HDFS-10643. Namenode should use loginUser(hdfs) to generateEncryptedKey. Contributed by Xiaoyu Yao. 
(cherry picked from commit ec289bbeceff064ad24e189db20a3e0a296822c1)
 2016-08-10 15:55:12 -07:00
Xiaoyu Yao
c341280129 Revert "Namenode should use loginUser(hdfs) to generateEncryptedKey. Contributed by Xiaoyu Yao." 
This reverts commit 9f816d7ca74c6e6c43ecfc8770228c518620c9cb.

(cherry picked from commit fdafd0cb4f1626ee41539f4b80711c4e78e3e16c)
 2016-08-10 15:54:59 -07:00
Xiaoyu Yao
d583a357f9 Namenode should use loginUser(hdfs) to generateEncryptedKey. Contributed by Xiaoyu Yao. 
(cherry picked from commit 9f816d7ca74c6e6c43ecfc8770228c518620c9cb)
 2016-08-10 15:15:51 -07:00
Wei-Chiu Chuang
8efd4959f3 HDFS-8224. Schedule a block for scanning if its metadata file is corrupt. Contributed by Rushabh S Shah. 2016-08-10 11:34:59 -07:00
Jason Lowe
2b31f6fb2c YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C 
(cherry picked from commit 5c95bb315ba605b3bed77966a99a63854234e2c5)
 2016-08-10 18:27:25 +00:00
Yuanbo Liu
44162e555a HDFS-10694. processReport() should print blockReportId in each log message. Contributed by Yuanbo Liu. 
(cherry picked from commit 10e84c6a6e831fe2bea061fb21bd0dfe32bc9953)
 2016-08-10 11:10:00 -07:00
Jason Lowe
3d401206cf YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee 2016-08-10 18:06:56 +00:00
Chris Nauroth
f7ac0fd80a HADOOP-13476. CredentialProviderFactory fails at class loading from libhdfs (JNI). Contributed by Aaron Fabbri. 
(cherry picked from commit 4d4fe07c3cdd5c57c455ef91daac3686b753b9be)
 2016-08-10 09:54:39 -07:00
Karthik Kambatla
447ba47640 YARN-5343. TestContinuousScheduling#testSortedNodes fails intermittently. (Yufei Gu via kasha) 
(cherry picked from commit 7992c0b42ceb10fd3ca6c4ced4f59b8e8998e046)
 2016-08-09 16:51:27 -07:00
Karthik Kambatla
2df34ab6e2 HADOOP-13299. JMXJsonServlet is vulnerable to TRACE. (Haibo Chen via kasha) 
(cherry picked from commit 85422bb7c5d3e70a49f620ba1c8800e0ba4b64f2)
 2016-08-09 13:47:19 -07:00
Kihwal Lee
7f1879abe6 HDFS-10738. Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure. Contributed by Rakesh R. 
(cherry picked from commit 0f701f433dd3be233bf53e856864c82349e8274e)
 2016-08-09 14:55:46 -05:00
Kihwal Lee
47293d951f HADOOP-13473. Tracing in IPC Server is broken. Contributed by Daryn Sharp. 
(cherry picked from commit caf800d5290d8618003b764afb0b3ef8d9a5a0a8)
 2016-08-09 14:36:26 -05:00
Varun Saxena
705307eda3 MAPREDUCE-6750. Fix TestHSAdminServer#testRefreshSuperUserGroups (Kihwal Lee via Varun Saxena) 2016-08-09 23:43:27 +05:30
Jason Lowe
f18febd933 MAPREDUCE-6741. Add MR support to redact job conf properties. Contributed by Haibo Chen 
(cherry picked from commit 4aba858750900de25940c16211c21de4addd1926)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryEventHandler.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java
 2016-08-09 16:32:38 +00:00
Varun Vasudev
c599f6215e YARN-5394. Remove bind-mount /etc/passwd for Docker containers. Contributed by Zhankun Tang. 
(cherry picked from commit 522ddbde79cd453cac066b6136f004f54e2123b0)
 2016-08-09 16:05:03 +05:30
Arun Suresh
5f7edb79d1 YARN-5457. Refactor DistributedScheduling framework to pull out common functionality. (asuresh) 
(cherry picked from commit 82c9e061017c32e633e0b0cbb7978749a6df4fb2)
 2016-08-09 00:46:08 -07:00
Masatake Iwasaki
427b54086e HADOOP-13439. Fix race between TestMetricsSystemImpl and TestGangliaMetrics. Contributed by Chen Liang. 
(cherry picked from commit 8f9b61852bf6600b65e49875fec172bac9e0a85d)
 2016-08-09 09:59:47 +09:00
Naganarasimha
93b768d0d1 YARN-5287. LinuxContainerExecutor fails to set proper permission. Contributed by Ying Zhang. 2016-08-09 06:48:39 +05:30
Sangjin Lee
660e321523 HADOOP-12747. support wildcard in libjars argument (sjlee) 
(cherry picked from commit 0ad48aa2c8f41196743305c711ea19cc48f186da)
 2016-08-08 17:57:33 -07:00
Lei Xu
e7c701586d HDFS-4176. EditLogTailer should call rollEdits with a timeout. (lei) 2016-08-08 16:32:01 -07:00
Lei Xu
9cb6d291ea HDFS-10457. DataNode should not auto-format block pool directory if VERSION is missing. (Wei-Chiu Chuang via lei) 
(cherry picked from commit bb3bcb9397593fc8a2fa63a48eba126609f72c42)
 2016-08-08 16:19:58 -07:00
Wei-Chiu Chuang
cc20316b55 HADOOP-13395. Enhance TestKMSAudit. Contributed by Xiao Chen. 
(cherry picked from commit 070548943a16370a74277d1b1d10b713e2ca81d0)

Conflicts:
hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMSAudit.java
 2016-08-08 15:16:14 -07:00
Lei Xu
2cd4092c81 HADOOP-13380. TestBasicDiskValidator should not write data to /tmp (Yufei Gu via lei) 
(cherry picked from commit 6418edd6feeafc0204536e1860942eeb1cb1a9ce)
 2016-08-08 15:06:45 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
31bb302c91 YARN-5470. Addedum to differentiate exactly matching of log-files with regex in yarn log CLI. Contributed by Xuan Gong. 
(cherry picked from commit 83a2ffec408fc3ebb89ab13ab4788d9f02fae33b)
 2016-08-08 14:29:24 -07:00
Arpit Agarwal
2dbe16c024 HADOOP-13457. Remove hardcoded absolute path for shell executable. (Chen Liang) 2016-08-08 12:36:30 -07:00
Chris Nauroth
287688d6ca HADOOP-13403. AzureNativeFileSystem rename/delete performance improvements. Contributed by Subramanyam Pattipaka. 
(cherry picked from commit 2ed58c40e5dcbf5c5303c00e85096085b1055f85)
 2016-08-08 12:28:46 -07:00
Jitendra Pandey
e9955b1806 HADOOP-10823. TestReloadingX509TrustManager is flaky. Contributed by Mingliang Liu. 2016-08-08 11:02:07 -07:00
Varun Saxena
ce8df272f4 YARN-4910. Fix incomplete log info in ResourceLocalizationService (Jun Gong via Varun Saxena) 2016-08-08 22:14:56 +05:30
Varun Saxena
8b09292f4f MAPREDUCE-6748. Enhance logging for Cluster.java around InetSocketAddress (Vrushali C via Varun Saxena) 2016-08-08 21:53:29 +05:30
Konstantin V Shvachko
ab130f97ca HDFS-10693. metaSave should print blocks, not LightWeightHashSet. Contributed by Yuanbo Liu. 
(cherry picked from commit 4d3af47f2765f6f57936d316ef2a4150b787cc97)
 2016-08-07 14:35:35 -07:00
Masatake Iwasaki
9cdd97a15e HADOOP-13418. Fix javadoc warnings by JDK8 in hadoop-nfs package. Contributed by Kai Sasaki. 
(cherry picked from commit 10ed06a0c96cbb8b70e03deeb5bb94df700f9518)
 2016-08-06 12:25:05 +09:00
Naganarasimha
991823482f YARN-4624. NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI. Contributed by Brahma Reddy Battula 
(cherry picked from commit d81b8163b4e5c0466a6af6e1068f512c5fd24a61)
 2016-08-06 07:04:30 +05:30
Wei-Chiu Chuang
d875dfef3d HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Zhaohao Liang and Wei-Chiu Chuang. 
(cherry picked from commit 49ba09a9221ad1e25e89800f6c455bbaad41483b)
 2016-08-05 16:35:28 -07:00
Varun Saxena
0e48f29937 YARN-5429. Fix return related javadoc warnings in yarn-api (Vrushali C via Varun Saxena) 2016-08-06 01:13:30 +05:30
Junping Du
adcecd417b YARN-5470. Differentiate exactly match with regex in yarn log CLI. Contributed by Xuan Gong. 
(cherry picked from commit e605d47df05619c6b1c18aca59f709899498da75)
 2016-08-05 11:00:13 -07:00
Wangda Tan
a73e118437 YARN-4888. Changes in scheduler to identify resource-requests explicitly by allocation-id. (Subru Krishnan via wangda) 
(cherry picked from commit 3f100d76ff5df020dbb8ecd4f5b4f9736a0a8270)
 2016-08-05 10:44:07 -07:00
Rohith Sharma K S
69da77c357 YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong. 
(cherry picked from commit d9a354c2f39274b2810144d1ae133201e44e3bfc)
 2016-08-05 21:37:05 +05:30
Akira Ajisaka
6863866127 HDFS-10715. NPE when applying AvailableSpaceBlockPlacementPolicy. Contributed by Guangbin Zhu. 
(cherry picked from commit ef432579a7763cc0e482fe049027c6e5325eb034)
 2016-08-05 17:32:23 +09:00