Commit Graph

20412 Commits

Author SHA1 Message Date
Vinayakumar B 7a2a806213 HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena.
(cherry picked from commit 886b935630bf2d46f4c6773de013c093d2e44c38)
2018-11-16 18:01:43 +05:30
Vinayakumar B 71a6ec6058 HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena.
(cherry picked from commit 8571507efa)
2018-11-16 17:29:25 +05:30
Akira Ajisaka a69423d28c
HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia.
(cherry picked from commit af5958f7b6)
2018-11-16 13:17:55 +09:00
Arpit Agarwal 351bfa1bcf HADOOP-12558. distcp documentation is woefully out of date. Contributed by Dinesh Chitlangia.
(cherry picked from commit 914b0cf15f)
2018-11-15 13:58:29 -08:00
Akira Ajisaka 8c9681d7f0
HADOOP-15926. Document upgrading the section in NOTICE.txt when upgrading the version of AWS SDK. Contributed by Dinesh Chitlangia.
(cherry picked from commit 66b1335bb3)
2018-11-15 16:31:05 +09:00
Akira Ajisaka 9f3d42f106
HADOOP-15930. Exclude MD5 checksum files from release artifact.
(cherry picked from commit df5e863fee)
2018-11-15 10:47:13 +09:00
Sammi Chen 37082a664a HADOOP-15917. AliyunOSS: fix incorrect ReadOps and WriteOps in statistics. Contributed by Jinhu Wu.
(cherry picked from commit 3fade865ce)
(cherry picked from commit 64cb97fb44)
(cherry picked from commit 5d532cfc6f)
2018-11-14 13:48:51 +08:00
Da Zhou 4039840510
HADOOP-15876. Use keySet().removeAll() to remove multiple keys from Map in AzureBlobFileSystemStore
Contributed by Da Zhou.

(cherry picked from commit a13be203b7)
2018-11-13 21:48:05 +00:00
Xiao Chen 5afd7efe24 Revert "HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel."
This reverts commit 7dc79a8b5b.
2018-11-13 12:45:55 -08:00
Wangda Tan f214af74b2 MAPREDUCE-7158. Inefficient Flush Logic in JobHistory EventWriter. (Zichen Sun via wangda)
Change-Id: I99ace87980da03bb35a8012cea7218d602a8817a
(cherry picked from commit 762a56cc64)
2018-11-13 11:35:13 -08:00
Wangda Tan ea753046b0 YARN-8918. [Submarine] Correct method usage of str.subString in CliUtils. (Zhankun Tang via wangda)
Change-Id: Id1f11dbab3aa838dee3a0ec8b8fd5dc32f5dd946
(cherry picked from commit 076b795b2e)
2018-11-13 11:35:06 -08:00
Surendra Singh Lilhore 86deff0a06 HADOOP-15869. BlockDecompressorStream#decompress should not return -1 in case of IOException. Contributed by Surendra Singh Lilhore
(cherry picked from commit 75291e6d53)
2018-11-13 21:26:22 +05:30
Brahma Reddy Battula 5e86641265 HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota
(cherry picked from commit e7b63baca1)
2018-11-13 13:09:03 +05:30
Takanobu Asanuma 359b1dd40b HADOOP-15912. start-build-env.sh still creates an invalid /etc/sudoers.d/hadoop-build-${USER_ID} file entry after HADOOP-15802. Contributed by Akira Ajisaka.
(cherry picked from commit a67642c377)
2018-11-13 13:58:29 +09:00
Akira Ajisaka 861105747b
HADOOP-15923. create-release script should set max-cache-ttl as well as default-cache-ttl for gpg-agent.
(cherry picked from commit 703b2860a4)
2018-11-13 13:41:42 +09:00
Arpit Agarwal e6532f7eb2 HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena.
(cherry picked from commit b6d4e19f34)
2018-11-12 15:32:14 -08:00
Steve Loughran d4afeac285
HADOOP-15110. Gauges are getting logged in exceptions from AutoRenewalThreadForUserCreds.
Contributed by LiXin Ge.

(cherry picked from commit 3c9d97b8f7)
2018-11-12 12:58:53 +00:00
Weiwei Yang 2415f8a5be YARN-8987. Usability improvements node-attributes CLI. Contributed by Bibin A Chundatt.
(cherry picked from commit c741109522)
2018-11-12 18:21:11 +08:00
Eric Yang 5399ff8177 YARN-9002. Improve keytab loading for YARN Service.
Contributed by Gour Saha

(cherry picked from commit 2664248797)
2018-11-10 01:54:59 -05:00
Akira Ajisaka 7b62c9684d
HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1.
(cherry picked from commit a736b5da15)
2018-11-10 00:27:30 +09:00
Da Zhou 7440bc5a9c
HADOOP-15812. ABFS: Improve AbfsRestOperationException format to ensure full msg can be displayed on console.
Author:    Da Zhou <da.zhou@microsoft.com>
(cherry picked from commit 9dbb2b67c6)
2018-11-09 11:07:51 +00:00
Kitti Nanasi 57409874bb HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi.
Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 8d99648c20)
2018-11-08 10:08:26 -08:00
Junhua Gu 66715005f9
HADOOP-15846. ABFS: fix mask related bugs in setAcl, modifyAclEntries and removeAclEntries.
Contributed by Junhua Gu.
2018-11-08 17:20:52 +00:00
Weiwei Yang b3321d9933 YARN-8988. Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled. Contributed by Tao Yang.
(cherry picked from commit e1bbf7dcdf)
2018-11-08 17:50:16 +08:00
Weiwei Yang b10ec0aa14 YARN-8977. Remove unnecessary type casting when calling AbstractYarnScheduler#getSchedulerNode. Contributed by Wanqiang Ji.
(cherry picked from commit c96cbe8659)
2018-11-07 22:44:01 +08:00
Takanobu Asanuma 02abd0f80a YARN-8866. Fix a parsing error for crossdomain.xml.
(cherry picked from commit 8dc1f6dbf7)
2018-11-07 18:29:28 +09:00
Weiwei Yang 528615f5d9 Revert "HADOOP-15907. Add missing maven modules in BUILDING.txt. Contributed Wanqiang Ji."
This reverts commit 8720814349.
2018-11-07 16:48:52 +08:00
Weiwei Yang 8720814349 HADOOP-15907. Add missing maven modules in BUILDING.txt. Contributed Wanqiang Ji.
(cherry picked from commit e6444f1c64)
2018-11-07 16:46:41 +08:00
Weiwei Yang 4ff7255d6e YARN-8976. Remove redundant modifiers in interface ApplicationConstants. Contributed by Zhankun Tang.
(cherry picked from commit 482716e5a4)
2018-11-07 10:49:09 +08:00
Akira Ajisaka 41c4e9583d
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
(cherry picked from commit 951c98f890)
2018-11-07 11:18:48 +09:00
Jason Lowe ff5a2cb5c9 MAPREDUCE-7156. NullPointerException when reaching max shuffle connections. Contributed by Peter Bacsko
(cherry picked from commit ba1f9d66d9)
2018-11-06 17:57:09 -06:00
Inigo Goiri e7fba62e6a HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen.
(cherry picked from commit 887244de4a)
2018-11-06 11:20:06 -08:00
Jason Lowe 9265934201 YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg
(cherry picked from commit ab6aa4c726)
2018-11-06 08:47:30 -06:00
Weiwei Yang f00125e2d9 YARN-8970. Improve the debug message in CS#allocateContainerOnSingleNode. Contributed by Zhankun Tang.
(cherry picked from commit 5d6554c722)
2018-11-06 14:52:10 +08:00
Weiwei Yang b474239e0b YARN-8969. AbstractYarnScheduler#getNodeTracker should return generic type to avoid type casting. Contributed by Wanqiang Ji.
(cherry picked from commit c7fcca0d7e)
2018-11-06 13:17:19 +08:00
Inigo Goiri 378f189c4f HDFS-14043. Tolerate corrupted seen_txid file. Contributed by Lukas Majercak.
(cherry picked from commit f3296501e0)
2018-11-05 16:49:12 -08:00
Giovanni Matteo Fumarola 6e1fad299a HDFS-14042. Fix NPE when PROVIDED storage is missing. Contributed by Virajith Jalaparti. 2018-11-05 11:33:32 -08:00
Akira Ajisaka fcd221fed7
HADOOP-15900. Update JSch versions in LICENSE.txt.
(cherry picked from commit d43cc5db0f)
2018-11-05 17:52:04 +09:00
Akira Ajisaka ea6b9d6c61
HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt.
(cherry picked from commit a5e21cd6a4)
2018-11-05 15:29:06 +09:00
Lars Francke a15bcf97a4
HADOOP-15687. Credentials class should allow access to aliases.
Author:    Lars Francke <lars.francke@gmail.com>

(cherry picked from commit cb8d679c95)
2018-11-03 16:29:56 +00:00
Jonathan Hung b9a3c988c0 YARN-7225. Add queue and partition info to RM audit log. Contributed by Eric Payne
(cherry picked from commit 2ab611d48b)
2018-11-01 14:31:09 -07:00
Sunil G 856dd1208e HDFS-14033. [libhdfs++] Disable libhdfs++ build on systems that do not support thread_local. Contributed by Anatoli Shein.
(cherry picked from commit 9c438abe52)
2018-10-31 12:33:55 +05:30
Steve Loughran d79ea3844c
HADOOP-15855. Review hadoop credential doc, including object store details.
Contributed by Steve Loughran.

(cherry picked from commit 62d98ca92a)
2018-10-30 15:58:44 +00:00
Rohith Sharma K S 7920f79049 YARN-8950. Fix compilation issue due to dependency convergence error for hbase.profile=2.0.
(cherry picked from commit 4ec4ec6971)
2018-10-30 11:50:33 +05:30
Xiao Chen 8788489df4 HDFS-14027. DFSStripedOutputStream should implement both hsync methods.
(cherry picked from commit db7e636824)
2018-10-29 19:13:43 -07:00
Weiwei Yang 288bc3f1eb YARN-8915. Update the doc about the default value of maximum-container-assignments for capacity scheduler. Contributed by Zhankun Tang.
(cherry picked from commit 78ea897b67)
2018-10-29 12:05:45 +08:00
Weiwei Yang 5db4272d91 YARN-8944. TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896. Contributed by Wilfred Spiegelenburg.
(cherry picked from commit 1d90a0dd23)
2018-10-29 11:55:22 +08:00
Wei-Chiu Chuang 5f8dd40647 Revert "HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao."
This reverts commit fd02c501c0.
2018-10-28 17:05:45 -07:00
Anu Engineer 3cbb028dd2 HDFS-14028. HDFS OIV temporary dir deletes folder.
Contributed by Adam Antal.

(cherry picked from commit 4f10d7e23f)
2018-10-26 16:47:53 -07:00
Sunil G c61b00f307 HADOOP-15815. Upgrade Eclipse Jetty version to 9.3.24. Cotributed by Boris Vulikh.
(cherry picked from commit e28c00c290)
2018-10-26 13:46:57 +05:30