Commit Graph

12871 Commits

Author SHA1 Message Date
Xiao Chen 1ab279c311 HDFS-11195. Return error when appending files by webhdfs rest api fails. Contributed by Yuanbo Liu.
(cherry picked from commit 5b7acdd206)
2016-12-20 12:27:40 -08:00
Brahma Reddy Battula 7a92345f16 HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1b401f6a73)
2016-12-20 21:02:16 +05:30
Akira Ajisaka a95acbcb6e HDFS-11262. Remove unused variables in FSImage.java. Contributed by Jagadesh Kiran N.
(cherry picked from commit d2026ae9e6)
2016-12-20 14:36:03 +09:00
Sunil G 238863c11b YARN-5650. Render Application Timeout value in web UI. Contributed by Akhil PB. 2016-12-20 11:03:57 +05:30
Naganarasimha e9ce2df1f2 YARN-5524. Yarn live log aggregation does not throw if command line arg is wrong. Contributed by Xuan Gong.
(cherry picked from commit 358341398a)
2016-12-20 06:45:52 +05:30
Wei-Chiu Chuang 0cb99db9d9 HDFS-11160. VolumeScanner reports write-in-progress replicas as corrupt incorrectly. Contributed by Wei-Chiu Chuang and Yongjun Zhang. 2016-12-15 16:35:37 -08:00
Mingliang Liu 012d28a1fa HDFS-11094. Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter. Contributed by Eric Badger 2016-12-15 14:54:40 -08:00
Wei-Chiu Chuang 84ec079911 HADOOP-13508. FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria. 2016-12-15 13:49:02 -08:00
Jason Lowe ee12363f2d HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
(cherry picked from commit 631f1daee3)
2016-12-15 20:54:42 +00:00
Mingliang Liu 867389247f HADOOP-13831. Correct check for error code to detect Azure Storage Throttling and provide retries. Contributed by Gaurav Kanade
(cherry picked from commit f92913c35b)
2016-12-15 12:38:31 -08:00
Akira Ajisaka eaa50a1087 HDFS-11249. Redundant toString() in DFSConfigKeys.java. Contributed by Jagadesh Kiran N.
(cherry picked from commit 36947f79ba)
2016-12-16 00:34:43 +09:00
Jason Lowe 81be6644ce Revert "HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger"
This reverts commit 0af67aa200.
2016-12-15 14:52:43 +00:00
Xuan 236dbe3485 YARN-5999. AMRMClientAsync will stop if any exceptions thrown on allocate call. Contributed by Jian He 2016-12-14 15:05:42 -08:00
Xiaoyu Yao 85083567be HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao.
(cherry picked from commit f5e0bd30fd)
2016-12-14 13:59:24 -08:00
Akira Ajisaka 190b2dca62 HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin.
(cherry picked from commit 72bff192cd)
2016-12-14 18:53:24 +09:00
Andrew Wang 6b795c34d0 HDFS-10684. WebHDFS DataNode calls fail without parameter createparent. Contributed by John Zhuge.
(cherry picked from commit fbdbbd57cd)
2016-12-13 18:01:35 -08:00
Jason Lowe 0af67aa200 HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
(cherry picked from commit 9947aeb60c)
2016-12-13 22:57:41 +00:00
Ravi Prakash d7d9006afc HADOOP-13898. Should set HADOOP_JOB_HISTORYSERVER_HEAPSIZE only if it's empty. Contributed by Fei Hui. 2016-12-13 13:08:54 -08:00
Mingliang Liu 282a562437 HDFS-11226. cacheadmin, cryptoadmin and storagepolicyadmin should support generic options. Contributed by Brahma Reddy Battula
(cherry picked from commit e91494c27a0b9a4a456d92fe7d632a608c4f11f3)
2016-12-12 18:17:54 -08:00
Mingliang Liu 2dbd86bcf4 HADOOP-13871. ITestS3AInputStreamPerformance.testTimeToOpenAndReadWholeFileBlocks performance awful. Contributed by Steve Loughran
(cherry picked from commit c6a3923245)
2016-12-12 15:06:39 -08:00
Vinayakumar B c6fb9f0d0b HDFS-10570. Remove classpath conflicts of netty-all jar in hadoop-hdfs-client (Contributed by Vinayakumar B) 2016-12-12 12:11:11 +05:30
Sunil G 23bd68a4a4 YARN-5970. Validate application update timeout request parameters. Contributed by Rohith Sharma K S. 2016-12-12 11:59:14 +05:30
Xiaoyu Yao 48853c7319 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.
(cherry picked from commit 4c38f11cec)
2016-12-09 21:38:14 -08:00
Xiaoyu Yao 0bdaa23334 Revert "HDFS-10930. Refactor: Wrap Datanode IO related operations. Contributed by Xiaoyu Yao."
This reverts commit 4c9ca47386.
2016-12-09 21:37:13 -08:00
Xiaoyu Yao 4c9ca47386 HDFS-10930. Refactor: Wrap Datanode IO related operations. Contributed by Xiaoyu Yao.
(cherry picked from commit df983b524a)
2016-12-09 21:31:45 -08:00
Akira Ajisaka 1e1ab9bc1b MAPREDUCE-6820. Fix dead links in Job relevant classes. Contributed by Yiqun Lin.
(cherry picked from commit 92a8917ca5)
2016-12-10 10:57:06 +09:00
Jian He 71fdca4600 YARN-5709. Cleanup leader election configs and pluggability. Contribtued by Karthik Kambatla
(cherry picked from commit b817c565c8be1d4a682d119bfac6f43ee09e87f0)
2016-12-09 16:59:52 -08:00
Wei-Chiu Chuang 292bd78b44 HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang. 2016-12-09 16:07:56 -08:00
Wei-Chiu Chuang 6c93c1870c HADOOP-13824. FsShell can suppress the real error if no error message is present. Contributed by John Zhuge.
(cherry picked from commit b606e025f1)

Conflicts:
   hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShell.java
2016-12-09 15:39:12 -08:00
Andrew Wang 215abbdf5f HDFS-8630. WebHDFS : Support get/set/unset StoragePolicy. Contributed by Surendra Singh Lilhore. 2016-12-09 14:29:22 -08:00
Andrew Wang 85adc6677b HDFS-11217. Annotate NameNode and DataNode MXBean interfaces as Private/Stable. Contributed by Jagadesh Kiran N.
(cherry picked from commit 5bd7dece92)
2016-12-09 12:05:45 -08:00
Brahma Reddy Battula 73d5de5594 HADOOP-13883. Add description of -fs option in generic command usage. Contributed By Yiqun Lin.
(cherry picked from commit 80b8023276)
2016-12-09 18:42:49 +05:30
Vinayakumar B 199d8b5594 HDFS-11224. Lifeline message should be ignored for dead nodes (Contributed by Vinayakumar B)
(cherry picked from commit d1d4aba71b)
2016-12-09 14:54:37 +05:30
Xiao Chen e51f32f74c HDFS-11197. Listing encryption zones fails when deleting a EZ that is on a snapshotted directory. Contributed by Wellington Chevreuil.
(cherry picked from commit 401c731872)
2016-12-08 12:41:17 -08:00
Brahma Reddy Battula c73d8399ff HADOOP-13867. FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations. Contributed By Vinayakumar B.
(cherry picked from commit 0ef796174e)
2016-12-08 18:58:54 +05:30
Akira Ajisaka 0478597ea9 HDFS-11223. Fix typos in HttpFs documentations. Contributed by Yiqun Lin.
(cherry picked from commit 4c2cf5560f)
2016-12-08 20:53:09 +09:00
Akira Ajisaka e00a124cb5 HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin.
(cherry picked from commit 9ef89ede2f)
2016-12-08 13:39:58 +09:00
Vinayakumar B 4b21b47f56 HDFS-9057. allow/disallow snapshots via webhdfs (Contributed by Brahma Reddy Battula)
(cherry picked from commit 6d2332ae37)
2016-12-07 15:58:15 -08:00
Robert Kanter 9cba7c6d71 YARN-5963. Spelling errors in logging and exceptions for node manager, client, web-proxy, common, and app history code (gsohn via rkanter)
(cherry picked from commit 72fe546841)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/api/impl/TimelineClientImpl.java
2016-12-07 15:09:37 -08:00
Karthik Kambatla 0aaaeea268 MAPREDUCE-6817. The format of job start time in JHS is different from those of submit and finish time. (Haibo Chen via kasha)
(cherry picked from commit a793cec2c9)
2016-12-07 13:37:12 -08:00
Sunil a636a87270 YARN-5965. Retrospect ApplicationReport#getApplicationTimeouts. Contributed by Rohith Sharma K S
(cherry picked from commit ab923a53fc)
2016-12-08 00:34:45 +05:30
Daniel Templeton d8b4961515 YARN-5136. Error in handling event type APP_ATTEMPT_REMOVED to the scheduler
(Contributed by Wilfred Spiegelenburg via Daniel Templeton)
2016-12-07 11:01:09 -08:00
Rohith Sharma K S 602c998443 YARN-5932. Retrospect moveApplicationToQueue in align with YARN-5611. Contributed by Sunil G. 2016-12-07 22:45:25 +05:30
Ming Ma d2656dc5a6 HDFS-10206. Datanodes not sorted properly by distance when the reader isn't a datanode. (Nandakumar via mingma) 2016-12-07 08:27:17 -08:00
Junping Du 3350d0c080 YARN-5184. Fix up incompatible changes introduced on ContainerStatus and NodeReport. Contributed by Sangjin Lee.
(cherry picked from commit a7288da595)
2016-12-06 14:37:46 -08:00
Karthik Kambatla 8773cd5f76 HADOOP-13859. TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties. (Haibo Chen via kasha)
(cherry picked from commit c8d0a049b0)
2016-12-06 14:16:38 -08:00
Akira Ajisaka 03854f0bc5 MAPREDUCE-6816. Progress bars in Web UI always at 100%. Contributed by Shen Yinjie.
(cherry picked from commit da4ecc9f82)
2016-12-07 06:44:03 +09:00
Robert Kanter 1585b4f7ce MAPREDUCE-6571. JobEndNotification info logs are missing in AM container syslog (haibochen via rkanter)
(cherry picked from commit 6b4a9970f1)
2016-12-06 13:11:20 -08:00
Mingliang Liu eb9e7820a9 HDFS-11211. Add a time unit to the DataNode client trace format. Contributed by Jagadesh Kiran N
(cherry picked from commit 43cb1678cc)
2016-12-06 09:13:38 -08:00
Kihwal Lee f74dad7414 HDFS-11198. NN UI should link DN web address using hostnames. Contributed by Weiwei Yang. 2016-12-06 08:07:54 -06:00