Commit Graph

12056 Commits

Author SHA1 Message Date
Xiaoyu Yao d583a357f9 Namenode should use loginUser(hdfs) to generateEncryptedKey. Contributed by Xiaoyu Yao.
(cherry picked from commit 9f816d7ca7)
2016-08-10 15:15:51 -07:00
Wei-Chiu Chuang 8efd4959f3 HDFS-8224. Schedule a block for scanning if its metadata file is corrupt. Contributed by Rushabh S Shah. 2016-08-10 11:34:59 -07:00
Jason Lowe 2b31f6fb2c YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C
(cherry picked from commit 5c95bb315b)
2016-08-10 18:27:25 +00:00
Yuanbo Liu 44162e555a HDFS-10694. processReport() should print blockReportId in each log message. Contributed by Yuanbo Liu.
(cherry picked from commit 10e84c6a6e)
2016-08-10 11:10:00 -07:00
Jason Lowe 3d401206cf YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee 2016-08-10 18:06:56 +00:00
Chris Nauroth f7ac0fd80a HADOOP-13476. CredentialProviderFactory fails at class loading from libhdfs (JNI). Contributed by Aaron Fabbri.
(cherry picked from commit 4d4fe07c3c)
2016-08-10 09:54:39 -07:00
Karthik Kambatla 447ba47640 YARN-5343. TestContinuousScheduling#testSortedNodes fails intermittently. (Yufei Gu via kasha)
(cherry picked from commit 7992c0b42c)
2016-08-09 16:51:27 -07:00
Karthik Kambatla 2df34ab6e2 HADOOP-13299. JMXJsonServlet is vulnerable to TRACE. (Haibo Chen via kasha)
(cherry picked from commit 85422bb7c5)
2016-08-09 13:47:19 -07:00
Kihwal Lee 7f1879abe6 HDFS-10738. Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure. Contributed by Rakesh R.
(cherry picked from commit 0f701f433d)
2016-08-09 14:55:46 -05:00
Kihwal Lee 47293d951f HADOOP-13473. Tracing in IPC Server is broken. Contributed by Daryn Sharp.
(cherry picked from commit caf800d529)
2016-08-09 14:36:26 -05:00
Varun Saxena 705307eda3 MAPREDUCE-6750. Fix TestHSAdminServer#testRefreshSuperUserGroups (Kihwal Lee via Varun Saxena) 2016-08-09 23:43:27 +05:30
Jason Lowe f18febd933 MAPREDUCE-6741. Add MR support to redact job conf properties. Contributed by Haibo Chen
(cherry picked from commit 4aba858750)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/jobhistory/JobHistoryEventHandler.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestJobHistoryEventHandler.java
2016-08-09 16:32:38 +00:00
Varun Vasudev c599f6215e YARN-5394. Remove bind-mount /etc/passwd for Docker containers. Contributed by Zhankun Tang.
(cherry picked from commit 522ddbde79)
2016-08-09 16:05:03 +05:30
Arun Suresh 5f7edb79d1 YARN-5457. Refactor DistributedScheduling framework to pull out common functionality. (asuresh)
(cherry picked from commit 82c9e06101)
2016-08-09 00:46:08 -07:00
Masatake Iwasaki 427b54086e HADOOP-13439. Fix race between TestMetricsSystemImpl and TestGangliaMetrics. Contributed by Chen Liang.
(cherry picked from commit 8f9b61852b)
2016-08-09 09:59:47 +09:00
Naganarasimha 93b768d0d1 YARN-5287. LinuxContainerExecutor fails to set proper permission. Contributed by Ying Zhang. 2016-08-09 06:48:39 +05:30
Sangjin Lee 660e321523 HADOOP-12747. support wildcard in libjars argument (sjlee)
(cherry picked from commit 0ad48aa2c8)
2016-08-08 17:57:33 -07:00
Lei Xu e7c701586d HDFS-4176. EditLogTailer should call rollEdits with a timeout. (lei) 2016-08-08 16:32:01 -07:00
Lei Xu 9cb6d291ea HDFS-10457. DataNode should not auto-format block pool directory if VERSION is missing. (Wei-Chiu Chuang via lei)
(cherry picked from commit bb3bcb9397593fc8a2fa63a48eba126609f72c42)
2016-08-08 16:19:58 -07:00
Wei-Chiu Chuang cc20316b55 HADOOP-13395. Enhance TestKMSAudit. Contributed by Xiao Chen.
(cherry picked from commit 070548943a)

Conflicts:
hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMSAudit.java
2016-08-08 15:16:14 -07:00
Lei Xu 2cd4092c81 HADOOP-13380. TestBasicDiskValidator should not write data to /tmp (Yufei Gu via lei)
(cherry picked from commit 6418edd6fe)
2016-08-08 15:06:45 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 31bb302c91 YARN-5470. Addedum to differentiate exactly matching of log-files with regex in yarn log CLI. Contributed by Xuan Gong.
(cherry picked from commit 83a2ffec40)
2016-08-08 14:29:24 -07:00
Arpit Agarwal 2dbe16c024 HADOOP-13457. Remove hardcoded absolute path for shell executable. (Chen Liang) 2016-08-08 12:36:30 -07:00
Chris Nauroth 287688d6ca HADOOP-13403. AzureNativeFileSystem rename/delete performance improvements. Contributed by Subramanyam Pattipaka.
(cherry picked from commit 2ed58c40e5)
2016-08-08 12:28:46 -07:00
Jitendra Pandey e9955b1806 HADOOP-10823. TestReloadingX509TrustManager is flaky. Contributed by Mingliang Liu. 2016-08-08 11:02:07 -07:00
Varun Saxena ce8df272f4 YARN-4910. Fix incomplete log info in ResourceLocalizationService (Jun Gong via Varun Saxena) 2016-08-08 22:14:56 +05:30
Varun Saxena 8b09292f4f MAPREDUCE-6748. Enhance logging for Cluster.java around InetSocketAddress (Vrushali C via Varun Saxena) 2016-08-08 21:53:29 +05:30
Konstantin V Shvachko ab130f97ca HDFS-10693. metaSave should print blocks, not LightWeightHashSet. Contributed by Yuanbo Liu.
(cherry picked from commit 4d3af47f27)
2016-08-07 14:35:35 -07:00
Masatake Iwasaki 9cdd97a15e HADOOP-13418. Fix javadoc warnings by JDK8 in hadoop-nfs package. Contributed by Kai Sasaki.
(cherry picked from commit 10ed06a0c9)
2016-08-06 12:25:05 +09:00
Naganarasimha 991823482f YARN-4624. NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI. Contributed by Brahma Reddy Battula
(cherry picked from commit d81b8163b4)
2016-08-06 07:04:30 +05:30
Wei-Chiu Chuang d875dfef3d HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Zhaohao Liang and Wei-Chiu Chuang.
(cherry picked from commit 49ba09a922)
2016-08-05 16:35:28 -07:00
Varun Saxena 0e48f29937 YARN-5429. Fix return related javadoc warnings in yarn-api (Vrushali C via Varun Saxena) 2016-08-06 01:13:30 +05:30
Junping Du adcecd417b YARN-5470. Differentiate exactly match with regex in yarn log CLI. Contributed by Xuan Gong.
(cherry picked from commit e605d47df0)
2016-08-05 11:00:13 -07:00
Wangda Tan a73e118437 YARN-4888. Changes in scheduler to identify resource-requests explicitly by allocation-id. (Subru Krishnan via wangda)
(cherry picked from commit 3f100d76ff)
2016-08-05 10:44:07 -07:00
Rohith Sharma K S 69da77c357 YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong.
(cherry picked from commit d9a354c2f3)
2016-08-05 21:37:05 +05:30
Akira Ajisaka 6863866127 HDFS-10715. NPE when applying AvailableSpaceBlockPlacementPolicy. Contributed by Guangbin Zhu.
(cherry picked from commit ef432579a7)
2016-08-05 17:32:23 +09:00
Kihwal Lee 09b06a6e9e HDFS-10673. Optimize FSPermissionChecker's internal path usage. Contributed by Daryn Sharp.
(cherry picked from commit 438a9f047e)
2016-08-04 16:17:41 -05:00
Kihwal Lee 690ec789f0 HDFS-10343. BlockManager#createLocatedBlocks may return blocks on failed storages. Contributed by Kuhu Shukla.
(cherry picked from commit 57369a678c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
2016-08-04 15:12:21 -05:00
Arpit Agarwal 4f74b5e793 HADOOP-13466. Add an AutoCloseableLock class. (Chen Liang) 2016-08-04 12:32:23 -07:00
Kihwal Lee 6ead6f3bb8 HDFS-10717. Fix findbugs warnings of hadoop-hdfs-client in branch-2. Contributed by Akira Ajisaka. 2016-08-04 12:34:54 -05:00
Arpit Agarwal 365a27099c HADOOP-13467. Shell#getSignalKillCommand should use the bash builtin on Linux. (Arpit Agarwal) 2016-08-04 10:08:23 -07:00
Kihwal Lee 3b2554f3b0 HDFS-10722. Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs. Contributed by Daryn Sharp.
(cherry picked from commit 4a8e6dc02f)
2016-08-04 11:55:52 -05:00
Tsz-Wo Nicholas Sze 5004b0571e In Balancer, the target task should be removed when its size < 0. Contributed by Yiqun Lin 2016-08-04 09:53:15 -07:00
Kihwal Lee c7fe1f5ec5 HADOOP-13442. Optimize UGI group lookups. Contributed by Daryn Sharp.
(cherry picked from commit 9422515239)
2016-08-04 10:48:17 -05:00
Kihwal Lee 77b61d1f4e HDFS-10662. Optimize UTF8 string/byte conversions. Contributed by Daryn Sharp.
(cherry picked from commit 6ae39199da)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java
2016-08-04 09:43:56 -05:00
Kihwal Lee c0166b0743 HDFS-10707. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon. 2016-08-04 09:28:30 -05:00
Akira Ajisaka e54de94e5a MAPREDUCE-6730. Use StandardCharsets instead of String overload in TextOutputFormat. Contributed by Sahil Kang.
This closes #114

(cherry picked from commit 70c2781152)
2016-08-04 20:18:13 +09:00
Varun Vasudev 19d894538d YARN-5459. Add support for docker rm. Contributed by Shane Kumpf.
(cherry picked from commit 08e33381f5)
2016-08-04 14:18:01 +05:30
Xiao Chen bb10750067 HADOOP-13443. KMS should check the type of underlying keyprovider of KeyProviderExtension before falling back to default. Contributed by Anthony Young-Garner.
(cherry picked from commit 05db64913d)
2016-08-04 16:08:25 +08:00
Wei-Chiu Chuang 5964d65a4d HADOOP-13458. LoadBalancingKMSClientProvider#doOp should log IOException stacktrace. Contributed by Chen Liang.
(cherry picked from commit a1f6564d31)
2016-08-03 14:27:33 -07:00