Commit Graph

12018 Commits

Author SHA1 Message Date
Xiao Chen 72863f0049 HDFS-4210. Throw helpful exception when DNS entry for JournalNode cannot be resolved. Contributed by Charles Lamb and John Zhuge.
(cherry picked from commit 046f6bf0f944311fc70de3a96fc6ab8211cbbbd8)
2016-08-29 17:48:49 -07:00
Ray Chiang 3b19bcb8f0 YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)
(cherry picked from commit 05ede00386)
2016-08-29 15:56:30 -07:00
Zhe Zhang 3ad4f0823c YARN-5550. TestYarnCLI#testGetContainers should format according to CONTAINER_PATTERN. Contributed by Jonathan Hung.
(cherry picked from commit ed6ff5cd78)
2016-08-29 14:49:03 -07:00
Yongjun Zhang 4bed2a4b9c HDFS-10625. VolumeScanner to report why a block is found bad. Contributed by Rushabh S Shah and Yiqun Lin.
(cherry picked from commit 5d1609ddf2)
2016-08-29 14:08:36 -07:00
Mingliang Liu d124af1a7c HADOOP-13559. Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes. (Contributed by Aaron Fabbri)
(cherry picked from commit 6fcb04c178)
2016-08-29 13:05:07 -07:00
Jason Lowe 44d0af2611 MAPREDUCE-6768. TestRecovery.testSpeculative failed with NPE. Contributed by Haibo Chen 2016-08-29 19:57:38 +00:00
Mingliang Liu 875c14004d HDFS-10807. Doc about upgrading to a version of HDFS with snapshots may be confusing. (Contributed by Mingliang Liu)
(cherry picked from commit 6742fb6e68)
2016-08-29 10:19:33 -07:00
Jason Lowe eeb18b0a46 YARN-5560. Clean up bad exception catching practices in TestYarnClient. Contributed by Sean Po
(cherry picked from commit 4cbe61407d)
2016-08-29 16:15:55 +00:00
Jason Lowe 039c831f5f HADOOP-13552. RetryInvocationHandler logs all remote exceptions. Contributed by Jason Lowe
(cherry picked from commit 92d8f37155)
2016-08-29 15:56:53 +00:00
Yongjun Zhang e813a3ea4a HDFS-10652. Add a unit test for HDFS-4660. Contributed by Vinayakumar B., Wei-Chiu Chuang, Yongjun Zhang.
(cherry picked from commit c25817159a)
2016-08-27 22:59:19 -07:00
Wangda Tan 07e1527cc1 YARN-4889. Changes in AMRMClient for identifying resource-requests explicitly. (Arun Suresh via wangda)
(cherry picked from commit 19c743c1bb)
2016-08-26 17:23:55 -07:00
Subru Krishnan 3ad7cb3e1c YARN-5327. API changes required to support recurring reservations in the YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru).
(cherry picked from commit b930dc3ec0)
2016-08-26 17:01:37 -07:00
Andrew Wang 1c47a356d8 HDFS-10793. Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184. Contributed by Manoj Govindassamy.
(cherry picked from commit a445b82baa)
2016-08-26 15:40:05 -07:00
Zhe Zhang f3a4cbcc60 HDFS-10798. Make the threshold of reporting FSNamesystem lock contention configurable. Contributed by Erik Krogen.
(cherry picked from commit 407b519fb1)
2016-08-26 14:20:48 -07:00
Kihwal Lee 442dfd1bbe HDFS-10768. Optimize mkdir ops. Contributed by Daryn Sharp.
(cherry picked from commit 8b7adf4ddf)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java
2016-08-26 15:49:56 -05:00
Karthik Kambatla d9b42248de YARN-5373. NPE listing wildcard directory in containerLaunch. (Daniel Templeton via kasha)
(cherry picked from commit cde3a00526)
2016-08-26 11:08:16 -07:00
Junping Du af1502fcab YARN-5557. Add localize API to the ContainerManagementProtocol. Contributed by Jian He.
(cherry picked from commit 9ef632f3b0)
2016-08-26 09:05:33 -07:00
Kihwal Lee 2a6497cc7c HDFS-8915. TestFSNamesystem.testFSLockGetWaiterCount fails intermittently. Contributed by Masatake Iwasaki.
(cherry picked from commit 13fb1b50e6)
2016-08-26 10:00:36 -05:00
Naganarasimha 026027166e YARN-3940. Application moveToQueue should check NodeLabel permission. Contributed by Bibin A Chundatt
(cherry picked from commit 46e02ab719)
2016-08-26 20:23:01 +05:30
Varun Vasudev 49a97a76f5 YARN-5430. Return container's ip and host from NM ContainerStatus call. Contributed by Jian He. 2016-08-26 16:33:21 +05:30
Naganarasimha ee3358402a YARN-5564. Fix typo in RM_SCHEDULER_RESERVATION_THRESHOLD_INCREMENT_MULTIPLE. Contributed by Ray Chiang
(cherry picked from commit 27c3b86252)
2016-08-26 08:53:42 +05:30
Wei-Chiu Chuang 13cbf1677e MAPREDUCE-6764. Teragen LOG initialization bug. Contributed by Yufei Gu.
(cherry picked from commit 1360bd2d54)
2016-08-25 09:51:17 -07:00
Xiaoyu Yao fc67501393 HDFS-10748. TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout. Contributed by Yiqun Lin.
(cherry picked from commit 4da5000dd3)
2016-08-25 09:22:02 -07:00
Jason Lowe 4037b22b7c YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po 2016-08-25 15:10:23 +00:00
Jason Lowe 6de262cdc4 Revert "YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po"
This reverts commit 782aeabcd5.
2016-08-25 14:59:20 +00:00
Jason Lowe 782aeabcd5 YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po
(cherry picked from commit 3d86110a5c)
2016-08-25 14:47:40 +00:00
Varun Vasudev 952c309dd9 YARN-5042. Mount /sys/fs/cgroup into Docker containers as read only mount. Contributed by luhuichun.
(cherry picked from commit 42d9876471ff0bf0ea240cd48fe483cda8aa1ec7)
2016-08-25 14:18:12 +05:30
Varun Saxena 42feab2436 YARN-5537. Fix intermittent failure of TestAMRMClient#testAMRMClientWithContainerResourceChange (Bibin A Chundatt via Varun Saxena) 2016-08-25 14:12:28 +05:30
Kihwal Lee ba3257baf5 HDFS-10772. Reduce byte/string conversions for get listing. Contributed by Daryn Sharp.
(cherry picked from commit a1f3293762)
2016-08-24 15:25:33 -05:00
Xiao Chen e31745e281 HADOOP-13396. Allow pluggable audit loggers in KMS. Contributed by Xiao Chen.
(cherry picked from commit 3476156807)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMSAudit.java
2016-08-24 11:09:54 -07:00
Arun Suresh bd348d20b2 Revert "YARN-5049. Extend NMStateStore to save queued container information. (Konstantinos Karanasos via asuresh)"
This reverts commit 307cda70db.
2016-08-24 10:23:06 -07:00
Wei-Chiu Chuang d19e29bd68 HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen. 2016-08-24 08:49:54 -07:00
Jason Lowe 5cdc4ba9f4 MAPREDUCE-6761. Regression when handling providers - invalid configuration ServiceConfiguration causes Cluster initialization failure. Contributed by Peter Vary
(cherry picked from commit 6fa9bf4407)
2016-08-24 14:42:06 +00:00
Daryn Sharp a30f6a68fa HDFS-10762. Pass IIP for file status related methods
(cherry picked from commit ec252ce0fc)
2016-08-24 08:51:05 -05:00
Akira Ajisaka 2321b73037 HADOOP-13538. Deprecate getInstance and initialize methods with Path in TrashPolicy. Contributed by Yiqun Lin.
(cherry picked from commit 092b4d5bfd)
2016-08-24 16:50:11 +09:00
Zhe Zhang dfcbc12026 HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen. Branch-2 patch contributed by Wei-Chiu Chuang. 2016-08-23 14:46:08 -07:00
Naganarasimha 5fa241daa0 YARN-4491. yarn list command to support filtering by tags. Contributed by Varun Saxena
(cherry picked from commit 143c59e4c5)
2016-08-24 01:55:24 +05:30
Masatake Iwasaki e1d3b8e71f HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu.
(cherry picked from commit 8aae8d6bf0)
2016-08-24 00:09:50 +09:00
Jason Lowe 8cd3996246 HDFS-9745. TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts. Contributed by Xiao Chen
(cherry picked from commit 126d165efd)
2016-08-23 14:48:35 +00:00
Chris Nauroth cda68de9b9 HADOOP-13446. Support running isolated unit tests separate from AWS integration tests. Contributed by Chris Nauroth. 2016-08-23 07:19:20 -07:00
Jian He a318ef7a66 HADOOP-13524. mvn eclipse:eclipse generates .gitignore'able files. Contributed by Vinod Kumar Vavilapalli
(cherry picked from commit dd76238a3b)
2016-08-23 19:13:48 +08:00
Akira Ajisaka 94a844b4f6 HDFS-10783. The option '-maxSize' and '-step' fail in OfflineImageViewer. Contributed by Yiqun Lin.
(cherry picked from commit e90f3359de)
2016-08-23 19:58:13 +09:00
Rohith Sharma K S a19859c3f5 YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G.
(cherry picked from commit 0d5997d2b9)
2016-08-23 14:39:19 +05:30
Akira Ajisaka 41fe85f868 MAPREDUCE-6587. Remove unused params in connection-related methods of Fetcher. Contributed by Yiqun Lin.
(cherry picked from commit 8cc4a67059)
2016-08-23 17:05:45 +09:00
Eric Yang 9faacbec2c HDFS-8312. Added permission check for moving file to Trash. (Weiwei Yang via Eric Yang) 2016-08-22 18:32:06 -07:00
Xiao Chen a4b296734b HADOOP-13526. Add detailed logging in KMS for the authentication failure of proxy user. Contributed by Suraj Acharya.
(cherry picked from commit 98e7be769a7e69bdaec4f67143949f282f6761cf)
2016-08-22 18:08:09 -07:00
Xiao Chen c76e0b93f0 HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen.
(cherry picked from commit 2f21d53e3aaf97f425f954f52b50f36dddb6b886)
2016-08-22 14:42:25 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 8a6a7c82f2 HDFS-10692. Update JDiff report's base version for HDFS from 2.6.0 to 2.7.2. Contributed by Wangda Tan.
(cherry picked from commit dc7a1c54f4)
2016-08-22 11:36:38 -07:00
Akira Ajisaka 62c7d09efa HDFS-10645. Make block report size as a metric and add this metric to datanode web ui. Contributed by Yuanbo Liu. 2016-08-22 14:22:37 +09:00
Mingliang Liu 50a8b0eb6b HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (Contributed by Weiqing Yang) 2016-08-21 09:41:19 -07:00