Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,720 Commits 326 Branches 371 Tags
Commit Graph

12720 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Brahma Reddy Battula
7a92345f16 HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1b401f6a734df4e23a79b3bd89c816a1fc0de574)
 2016-12-20 21:02:16 +05:30
Akira Ajisaka
a95acbcb6e HDFS-11262. Remove unused variables in FSImage.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit d2026ae9e6c86f4fd9e48b80e71233181c1853d9)
 2016-12-20 14:36:03 +09:00
Sunil G
238863c11b YARN-5650. Render Application Timeout value in web UI. Contributed by Akhil PB. 2016-12-20 11:03:57 +05:30
Naganarasimha
e9ce2df1f2 YARN-5524. Yarn live log aggregation does not throw if command line arg is wrong. Contributed by Xuan Gong. 
(cherry picked from commit 358341398adfe8f59bb2165472b50751de3ffb98)
 2016-12-20 06:45:52 +05:30
Wei-Chiu Chuang
0cb99db9d9 HDFS-11160. VolumeScanner reports write-in-progress replicas as corrupt incorrectly. Contributed by Wei-Chiu Chuang and Yongjun Zhang. 2016-12-15 16:35:37 -08:00
Mingliang Liu
012d28a1fa HDFS-11094. Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter. Contributed by Eric Badger 2016-12-15 14:54:40 -08:00
Wei-Chiu Chuang
84ec079911 HADOOP-13508. FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria. 2016-12-15 13:49:02 -08:00
Jason Lowe
ee12363f2d HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger 
(cherry picked from commit 631f1daee3507a1adbc68b937cca31c27dbe8d3d)
 2016-12-15 20:54:42 +00:00
Mingliang Liu
867389247f HADOOP-13831. Correct check for error code to detect Azure Storage Throttling and provide retries. Contributed by Gaurav Kanade 
(cherry picked from commit f92913c35bfda0d565606f9fb9a301ddd4105fd8)
 2016-12-15 12:38:31 -08:00
Akira Ajisaka
eaa50a1087 HDFS-11249. Redundant toString() in DFSConfigKeys.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 36947f79ba66bf8ce150813e5dc1d06c789f2b2a)
 2016-12-16 00:34:43 +09:00
Jason Lowe
81be6644ce Revert "HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger" 
This reverts commit 0af67aa20014b355d43d74d52650039cf95c0a54.
 2016-12-15 14:52:43 +00:00
Xuan
236dbe3485 YARN-5999. AMRMClientAsync will stop if any exceptions thrown on allocate call. Contributed by Jian He 2016-12-14 15:05:42 -08:00
Xiaoyu Yao
85083567be HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao. 
(cherry picked from commit f5e0bd30fde654ed48fe73e5c0523030365385a4)
 2016-12-14 13:59:24 -08:00
Akira Ajisaka
190b2dca62 HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin. 
(cherry picked from commit 72bff192cd37ff97442e0f8dd477fbc2e58fc12d)
 2016-12-14 18:53:24 +09:00
Andrew Wang
6b795c34d0 HDFS-10684. WebHDFS DataNode calls fail without parameter createparent. Contributed by John Zhuge. 
(cherry picked from commit fbdbbd57cdc3d8c778fca9266a7cadf298c8ff6c)
 2016-12-13 18:01:35 -08:00
Jason Lowe
0af67aa200 HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger 
(cherry picked from commit 9947aeb60c3dd075544866fd6e4dab0ad8b4afa2)
 2016-12-13 22:57:41 +00:00
Ravi Prakash
d7d9006afc HADOOP-13898. Should set HADOOP_JOB_HISTORYSERVER_HEAPSIZE only if it's empty. Contributed by Fei Hui. 2016-12-13 13:08:54 -08:00
Mingliang Liu
282a562437 HDFS-11226. cacheadmin, cryptoadmin and storagepolicyadmin should support generic options. Contributed by Brahma Reddy Battula 
(cherry picked from commit e91494c27a0b9a4a456d92fe7d632a608c4f11f3)
 2016-12-12 18:17:54 -08:00
Mingliang Liu
2dbd86bcf4 HADOOP-13871. ITestS3AInputStreamPerformance.testTimeToOpenAndReadWholeFileBlocks performance awful. Contributed by Steve Loughran 
(cherry picked from commit c6a39232456fa0c98b2b9b6dbeaec762294ca01e)
 2016-12-12 15:06:39 -08:00
Vinayakumar B
c6fb9f0d0b HDFS-10570. Remove classpath conflicts of netty-all jar in hadoop-hdfs-client (Contributed by Vinayakumar B) 2016-12-12 12:11:11 +05:30
Sunil G
23bd68a4a4 YARN-5970. Validate application update timeout request parameters. Contributed by Rohith Sharma K S. 2016-12-12 11:59:14 +05:30
Xiaoyu Yao
48853c7319 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao. 
(cherry picked from commit 4c38f11cec0664b70e52f9563052dca8fb17c33f)
 2016-12-09 21:38:14 -08:00
Xiaoyu Yao
0bdaa23334 Revert "HDFS-10930. Refactor: Wrap Datanode IO related operations. Contributed by Xiaoyu Yao." 
This reverts commit 4c9ca47386845f55c43c684c7a8250536101ddc3.
 2016-12-09 21:37:13 -08:00
Xiaoyu Yao
4c9ca47386 HDFS-10930. Refactor: Wrap Datanode IO related operations. Contributed by Xiaoyu Yao. 
(cherry picked from commit df983b524ab68ea0c70cee9033bfff2d28052cbf)
 2016-12-09 21:31:45 -08:00
Akira Ajisaka
1e1ab9bc1b MAPREDUCE-6820. Fix dead links in Job relevant classes. Contributed by Yiqun Lin. 
(cherry picked from commit 92a8917ca5a25bf6bee75acbb554aae87766a7e7)
 2016-12-10 10:57:06 +09:00
Jian He
71fdca4600 YARN-5709. Cleanup leader election configs and pluggability. Contribtued by Karthik Kambatla 
(cherry picked from commit b817c565c8be1d4a682d119bfac6f43ee09e87f0)
 2016-12-09 16:59:52 -08:00
Wei-Chiu Chuang
292bd78b44 HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang. 2016-12-09 16:07:56 -08:00
Wei-Chiu Chuang
6c93c1870c HADOOP-13824. FsShell can suppress the real error if no error message is present. Contributed by John Zhuge. 
(cherry picked from commit b606e025f10daed18b90b45ac00cd0c82e818581)

Conflicts:
   hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShell.java
 2016-12-09 15:39:12 -08:00
Andrew Wang
215abbdf5f HDFS-8630. WebHDFS : Support get/set/unset StoragePolicy. Contributed by Surendra Singh Lilhore. 2016-12-09 14:29:22 -08:00
Andrew Wang
85adc6677b HDFS-11217. Annotate NameNode and DataNode MXBean interfaces as Private/Stable. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 5bd7dece920b20da95755cf7fbba9b3f39c7da69)
 2016-12-09 12:05:45 -08:00
Brahma Reddy Battula
73d5de5594 HADOOP-13883. Add description of -fs option in generic command usage. Contributed By Yiqun Lin. 
(cherry picked from commit 80b8023276126353229ab8d6427c1761b2e4bb38)
 2016-12-09 18:42:49 +05:30
Vinayakumar B
199d8b5594 HDFS-11224. Lifeline message should be ignored for dead nodes (Contributed by Vinayakumar B) 
(cherry picked from commit d1d4aba71b21871140b162583a4b94ce118e1fb3)
 2016-12-09 14:54:37 +05:30
Xiao Chen
e51f32f74c HDFS-11197. Listing encryption zones fails when deleting a EZ that is on a snapshotted directory. Contributed by Wellington Chevreuil. 
(cherry picked from commit 401c7318723d8d62c7fc29728f7f4e8d336b4d2f)
 2016-12-08 12:41:17 -08:00
Brahma Reddy Battula
c73d8399ff HADOOP-13867. FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations. Contributed By Vinayakumar B. 
(cherry picked from commit 0ef796174ecb5383f79cfecfcbfc4f309d093cd7)
 2016-12-08 18:58:54 +05:30
Akira Ajisaka
0478597ea9 HDFS-11223. Fix typos in HttpFs documentations. Contributed by Yiqun Lin. 
(cherry picked from commit 4c2cf5560f6d952cfa36ef656f0b04dc3150f8b3)
 2016-12-08 20:53:09 +09:00
Akira Ajisaka
e00a124cb5 HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin. 
(cherry picked from commit 9ef89ede2f18c76c601fd585cb9d47511f5fc3ed)
 2016-12-08 13:39:58 +09:00
Vinayakumar B
4b21b47f56 HDFS-9057. allow/disallow snapshots via webhdfs (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 6d2332ae375e26d024358c6e75fdb3c68a781a66)
 2016-12-07 15:58:15 -08:00
Robert Kanter
9cba7c6d71 YARN-5963. Spelling errors in logging and exceptions for node manager, client, web-proxy, common, and app history code (gsohn via rkanter) 
(cherry picked from commit 72fe54684198b7df5c5fb2114616dff6d17a4402)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/api/impl/TimelineClientImpl.java
 2016-12-07 15:09:37 -08:00
Karthik Kambatla
0aaaeea268 MAPREDUCE-6817. The format of job start time in JHS is different from those of submit and finish time. (Haibo Chen via kasha) 
(cherry picked from commit a793cec2c9a7ad80aaf67be9dec2245e8ecce63c)
 2016-12-07 13:37:12 -08:00
Sunil
a636a87270 YARN-5965. Retrospect ApplicationReport#getApplicationTimeouts. Contributed by Rohith Sharma K S 
(cherry picked from commit ab923a53fcf55d4d75aa027d46e3c4a659015325)
 2016-12-08 00:34:45 +05:30
Daniel Templeton
d8b4961515 YARN-5136. Error in handling event type APP_ATTEMPT_REMOVED to the scheduler 
(Contributed by Wilfred Spiegelenburg via Daniel Templeton)
 2016-12-07 11:01:09 -08:00
Rohith Sharma K S
602c998443 YARN-5932. Retrospect moveApplicationToQueue in align with YARN-5611. Contributed by Sunil G. 2016-12-07 22:45:25 +05:30
Ming Ma
d2656dc5a6 HDFS-10206. Datanodes not sorted properly by distance when the reader isn't a datanode. (Nandakumar via mingma) 2016-12-07 08:27:17 -08:00
Junping Du
3350d0c080 YARN-5184. Fix up incompatible changes introduced on ContainerStatus and NodeReport. Contributed by Sangjin Lee. 
(cherry picked from commit a7288da595fdf56c3ccd45c0b6ed2e3efaa043a4)
 2016-12-06 14:37:46 -08:00
Karthik Kambatla
8773cd5f76 HADOOP-13859. TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties. (Haibo Chen via kasha) 
(cherry picked from commit c8d0a049b00536385f06fad412a2288f005bf2ce)
 2016-12-06 14:16:38 -08:00
Akira Ajisaka
03854f0bc5 MAPREDUCE-6816. Progress bars in Web UI always at 100%. Contributed by Shen Yinjie. 
(cherry picked from commit da4ecc9f8223ac82bff8483594fb29be2f8d4d34)
 2016-12-07 06:44:03 +09:00
Robert Kanter
1585b4f7ce MAPREDUCE-6571. JobEndNotification info logs are missing in AM container syslog (haibochen via rkanter) 
(cherry picked from commit 6b4a9970f187ab399adf7469e494a530f08993b5)
 2016-12-06 13:11:20 -08:00
Mingliang Liu
eb9e7820a9 HDFS-11211. Add a time unit to the DataNode client trace format. Contributed by Jagadesh Kiran N 
(cherry picked from commit 43cb1678cc000b1fbf8b813ee14ecef19b86a55c)
 2016-12-06 09:13:38 -08:00
Kihwal Lee
f74dad7414 HDFS-11198. NN UI should link DN web address using hostnames. Contributed by Weiwei Yang. 2016-12-06 08:07:54 -06:00
Andrew Wang
6bd600eef2 HADOOP-13861. Spelling errors in logging and exceptions for code. Contributed by Grant Sohn. 
(cherry picked from commit 7b988e88992528a0cac2ca8893652c5d4a90c6b9)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/util/GF256.java
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/KDiag.java
 2016-12-05 23:21:03 -08:00