Commit Graph

11606 Commits

Author SHA1 Message Date
Akira Ajisaka ece3ca0cba YARN-5663. Small refactor in ZKRMStateStore. Contributed by Oleksii Dymytrov.
(cherry picked from commit 14a696f369)
(cherry picked from commit 74f2df16a9)
2016-09-26 15:01:39 +09:00
Naganarasimha 4c2b20ca3e YARN-3877. YarnClientImpl.submitApplication swallows exceptions. Contributed by Varun Saxena
(cherry picked from commit e4e72db5f9)
2016-09-25 17:42:08 +05:30
Brahma Reddy Battula 17b66c894b HDFS-10869. Remove the unused method InodeId#checkId(). Contributed by Jagadesh Kiran N
(cherry picked from commit 3e37e243ee)
2016-09-25 11:07:21 +05:30
Naganarasimha 41169b7c2b YARN-5664. Fix Yarn documentation to link to correct versions. Contributed by Xiao Chen
(cherry picked from commit 4d16d2d72f)
2016-09-24 23:24:56 +05:30
Naganarasimha fa2025316d YARN-3692. Allow REST API to set a user generated message when killing an application. Contributed by Rohith Sharma K S 2016-09-24 22:42:28 +05:30
Wei-Chiu Chuang 6ca5ffe4b5 HADOOP-13535. Add jetty6 acceptor startup issue workaround to branch-2. Contributed by Min Shen.
(cherry picked from commit 23984e1787)
2016-09-23 14:28:00 -07:00
Wei-Chiu Chuang 367d5b2a7e HDFS-10876. Dispatcher#dispatch should log IOException stacktrace. Contributed by Manoj Govindassamy.
(cherry picked from commit 74b3dd514c)
(cherry picked from commit 6c98455728)
2016-09-23 13:28:59 -07:00
Kihwal Lee 9269225522 YARN-5622. TestYarnCLI.testGetContainers fails due to mismatched date formats. Contributed by Eric Badger.
(cherry picked from commit 6e849cb658)
2016-09-23 14:15:31 -05:00
Konstantin V Shvachko 20540df80d HDFS-10843. Update space quota when a UC block is completed rather than committed. Contributed by Erik Krogen.
(cherry picked from commit a5bb88c8e0)
2016-09-23 10:49:26 -07:00
Brahma Reddy Battula aa967869a5 HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document.
(cherry picked from commit bbdf350ff9)
2016-09-23 19:35:34 +05:30
Steve Loughran a2ce4d0503 HADOOP-13643. Math error in AbstractContractDistCpTest. Contributed by Aaron Fabbri. 2016-09-23 10:00:54 +01:00
Varun Saxena 42f6f68c78 YARN-5539. TimelineClient failed to retry on java.net.SocketTimeoutException: Read timed out (Junping Du via Varun Saxena) 2016-09-23 13:34:18 +05:30
Masatake Iwasaki 1524e63206 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims)
(cherry picked from commit 964e546ab1)

 Conflicts:
  hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFSStriped.java

(cherry picked from commit 1b91ebb714)
2016-09-21 10:52:00 +09:00
Wangda Tan 6f6e62ad86 YARN-4591. YARN Web UIs should provide a robots.txt. (Sidharta Seethana via wangda)
(cherry picked from commit 5a58bfee30)
2016-09-20 17:29:27 -07:00
Xiao Chen 11ed4f5d40 HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit d31bef575478fe78c0600fb602e117e4b81c9887)
2016-09-20 16:57:44 -07:00
Mingliang Liu c7bd564b79 HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager. Contributed by Mehran Hassani.
(cherry picked from commit e80386d69d)
2016-09-20 13:24:02 -07:00
Jason Lowe 4782390eb1 YARN-5655. TestContainerManagerSecurity#testNMTokens is asserting. Contributed by Robert Kanter
(cherry picked from commit c6d1d742e7)
2016-09-20 14:17:26 +00:00
Xiao Chen e7daeea711 HDFS-10875. Optimize du -x to cache intermediate result. Contributed by Xiao Chen.
(cherry picked from commit e52d6e7a46)
2016-09-19 21:45:09 -07:00
Xiao Chen 900dc70a01 HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen.
(cherry picked from commit ea839bd48e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/HdfsConfiguration.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml

(cherry picked from commit 20585ade1d9d7fbd8b9df8b1e3db5a74fd4441a6)
2016-09-19 16:38:00 -07:00
Andrew Wang 8c24388af0 HDFS-10832. Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions.
(cherry picked from commit cba973f036)
(cherry picked from commit f448ce2a89)
2016-09-19 16:38:00 -07:00
Chris Nauroth 911ae15f69 HADOOP-13169. Randomize file list in SimpleCopyListing. Contributed by Rajesh Balamohan.
(cherry picked from commit 98bdb51397)
(cherry picked from commit e19f910245)
2016-09-19 15:17:50 -07:00
Jason Lowe 564d9e6101 YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe 2016-09-19 20:34:46 +00:00
Xiao Chen a7f1dc8aa8 HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen.
(cherry picked from commit 680be58aac)
(cherry picked from commit d157733082)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUserGroupInformation.java
2016-09-19 12:52:58 -07:00
Naganarasimha a1cc90bca1 YARN-4232. TopCLI console support for HA mode. Contributed by Bibin A Chundatt
(cherry picked from commit ade7c2bc9c)
2016-09-17 10:01:11 +05:30
Wei-Chiu Chuang c7b79e8d91 HADOOP-13580. If user is unauthorized, log "unauthorized" instead of "Invalid signed text:". Contributed by Wei-Chiu Chuang.
(cherry picked from commit f6f3a447bf)
(cherry picked from commit 031d5f6c5b)
2016-09-16 14:56:55 -07:00
Akira Ajisaka ab57c869e2 HDFS-10862. Typos in 4 log messages. Contributed by Mehran Hassani.
(cherry picked from commit b09a03cd7d)
(cherry picked from commit 214b6d16d5)
2016-09-16 16:13:00 +09:00
Akira Ajisaka 06d82ffb76 HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki.
(cherry picked from commit 7cad7b7046)
(cherry picked from commit e485ace0dd)
2016-09-15 23:43:57 +09:00
Arpit Agarwal bdc71bd608 HDFS-10805. Reduce runtime for append test. Contributed by Gergely Novak. 2016-09-14 09:31:35 -07:00
Steve Loughran 6a7ce4ee52 HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran 2016-09-14 15:44:20 +01:00
Akira Ajisaka f57599e458 HADOOP-13598. Add eol=lf for unix format files in .gitattributes. Contributed by Yiqun Lin.
(cherry picked from commit 696bc0e0ab)
(cherry picked from commit 3f36ac9f33)
2016-09-14 11:15:42 +09:00
Jing Zhao 26597aa59b HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou.
(cherry picked from commit 08d8e0ba25)
(cherry picked from commit 55600b38a8)
2016-09-13 11:15:51 -07:00
Jason Lowe 1ac8206a85 YARN-5630. NM fails to start after downgrade from 2.8 to 2.7. Contributed by Jason Lowe
(cherry picked from commit e793309735)
2016-09-13 14:43:55 +00:00
Akira Ajisaka c06cf0f89c HDFS-10856. Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport. Contributed by Yiqun Lin.
(cherry picked from commit f0876b8b60)
(cherry picked from commit 764cf431ca)
2016-09-13 14:51:29 +09:00
Yongjun Zhang b96e2cbd20 HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang)
(cherry picked from commit d2466ec3e0)
2016-09-12 22:13:17 -07:00
Xiao Chen 76a18915bf HDFS-9781. FsDatasetImpl#getBlockReports can occasionally throw NullPointerException. Contributed by Manoj Govindassamy.
(cherry picked from commit bb6d866207)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
2016-09-10 23:14:22 -07:00
Arpit Agarwal ed35f99045 HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy) 2016-09-10 18:34:28 -07:00
Arpit Agarwal 04f620c4d0 HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang. 2016-09-10 18:01:37 -07:00
Varun Vasudev d5ea508ca2 YARN-5555. Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested. Contributed by Eric Payne. 2016-09-10 18:28:38 +00:00
Jason Lowe 1742022390 YARN-5632. UPDATE_EXECUTION_TYPE causes UpdateContainerRequestPBImpl to throw. Contributed by Jason Lowe 2016-09-09 22:40:17 +00:00
Steve Loughran 5706754f77 HADOOP-13540 improve section on troubleshooting s3a auth problems. Contributed by Steve Loughran 2016-09-09 18:54:56 +01:00
Kihwal Lee 4b9845bc53 HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp.
(cherry picked from commit d4d076876a)
(cherry picked from commit d234990208)
2016-09-09 10:48:05 -05:00
Karthik Kambatla 7a27b2a82f YARN-5566. Client-side NM graceful decom is not triggered when jobs finish. Addendum to fix test flakiness. (Robert Kanter via kasha) 2016-09-08 21:11:20 -07:00
Andrew Wang 912631a226 HDFS-10831. Add log when URLConnectionFactory.openConnection failed. Contributed by yunjiong zhao.
(cherry picked from commit b07c266dca)
(cherry picked from commit 72ea641468)
2016-09-08 18:30:36 -07:00
Steve Loughran c45f1ec858 HADOOP-13541 explicitly declare the Joda time version S3A depends on. Contributed by Stevel Loughran 2016-09-07 12:19:05 +01:00
Karthik Kambatla f9016dfec3 YARN-5566. Client-side NM graceful decom is not triggered when jobs finish. (Robert Kanter via kasha) 2016-09-06 16:23:06 -07:00
Arpit Agarwal 162ee0f0a4 HDFS-9038. DFS reserved space is erroneously counted towards non-DFS used. (Brahma Reddy Battula) 2016-09-06 13:52:05 -07:00
Xiao Chen e84b5c5e3e HDFS-10841. Remove duplicate or unused variable in appendFile(). Contributed by Kihwal Lee.
(cherry picked from commit f6c0b7543f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirAppendOp.java

(cherry picked from commit 3025992bd3)
2016-09-06 11:54:02 -07:00
Kihwal Lee 56340ac029 HADOOP-13549. Eliminate intermediate buffer for server-side PB encoding. Contributed by Daryn Sharp.
(cherry picked from commit 39d1b1d747)
2016-09-06 10:19:34 -05:00
Ray Chiang 02272a6a77 YARN-5549. AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately. (Daniel Templeton via rchiang)
(cherry picked from commit 4ee1729cb0)
2016-09-02 15:00:24 -07:00
Andrew Wang 9b7e079d4b HDFS-10833. Fix JSON errors in WebHDFS.md examples.
(cherry picked from commit cbd909ce2a)
(cherry picked from commit 40eab77562)
2016-09-02 14:51:12 -07:00