Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,643 Commits 326 Branches 371 Tags
Commit Graph

8643 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Haohui Mai
86c0c6b044 HDFS-7748. Separate ECN flags from the Status in the DataTransferPipelineAck. Contributed by Anu Engineer and Haohui Mai. 2015-03-30 12:16:25 -07:00
Haohui Mai
530c2ef91a HADOOP-11754. RM fails to start in non-secure mode due to authentication filter failure. Contributed by Haohui Mai. 2015-03-30 11:45:11 -07:00
Haohui Mai
3ec1ad9001 HADOOP-11761. Fix findbugs warnings in org.apache.hadoop.security.authentication. Contributed by Li Lu. 2015-03-30 11:09:25 -07:00
Vinod Kumar Vavilapalli
fa30500d72 MAPREDUCE-6288. Changed permissions on JobHistory server's done directory so that user's client can load the conf files directly. Contributed by Robert Kanter. 
(cherry picked from commit 5358b83167777a7108b32c9900fb0d01ca0fe961)
 2015-03-30 10:29:05 -07:00
Vinod Kumar Vavilapalli
35af6f1802 YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla. 
(cherry picked from commit c358368f511963ad8e35f030b9babee541e1bd01)
 2015-03-30 10:11:49 -07:00
Kihwal Lee
a0ed29a058 HDFS-7742. Favoring decommissioning node for replication can cause a block to stay 
underreplicated for long periods. Contributed by Nathan Roberts.
(cherry picked from commit 04ee18ed48ceef34598f954ff40940abc9fde1d2)
 2015-03-30 10:11:47 -05:00
cnauroth
b849a519cb HADOOP-11639. Clean up Windows native code compilation warnings related to Windows Secure Container Executor. Contributed by Remus Rusanu. 
(cherry picked from commit 3836ad6c0b3331cf60286d134157c13985908230)
(cherry picked from commit eb7068c2c9c7edafe283c1ee235a6b940ecf568c)
 2015-03-27 15:03:59 -07:00
cnauroth
ae6a76d4da HADOOP-11691. X86 build of libwinutils is broken. Contributed by Kiran Kumar M R. 
(cherry picked from commit af618f23a70508111f490a24d74fc90161cfc079)
(cherry picked from commit 36371cddd1a6e109fbb58042897f337b772c777b)
 2015-03-26 21:57:43 -07:00
cnauroth
cf2bda8b76 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars, addendum to print warning to stderr. Contributed by Masatake Iwasaki. 
(cherry picked from commit 1fd350fa8ed83e7b99830ec7adf1b02a36c0c11e)
 2015-03-26 21:48:48 -07:00
Haohui Mai
d481a8d79b HADOOP-11748. The secrets of auth cookies should not be specified in configuration in clear text. Contributed by Li Lu and Haohui Mai. 2015-03-26 17:35:54 -07:00
Colin Patrick Mccabe
9411cf9b65 HDFS-7410. Support CreateFlags with append() to support hsync() for appending streams (Vinayakumar B via Colin P. McCabe) 
(cherry picked from commit 61df1b27a797efd094328c7d9141b9e157e01bf4)
(cherry picked from commit 2a750c9aa68ae4f1b1b3ade082ec9362e1f1c5d2)
 2015-03-26 13:29:17 -07:00
Arpit Agarwal
c808d5fe55 HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao) 2015-03-26 10:48:03 -07:00
Kihwal Lee
370c91461f HDFS-7963. Fix expected tracing spans in TestTracing. Contributed by Masatake Iwasaki. 2015-03-26 08:45:39 -05:00
Haohui Mai
2e9c690e90 Addendum for HADOOP-10670. 2015-03-25 12:31:03 -07:00
Haohui Mai
28095c26f7 HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng. 2015-03-25 12:30:58 -07:00
Xuan
646710318c YARN-2213. Change proxy-user cookie log in AmIpFilter to DEBUG. 
Contributed by Varun Saxena

(cherry picked from commit e556198e71df6be3a83e5598265cb702fc7a668b)
 2015-03-25 04:53:31 -07:00
Akira Ajisaka
da6228e320 MAPREDUCE-6292. Use org.junit package instead of junit.framework in TestCombineFileInputFormat. (aajisaka) 
(cherry picked from commit c770df49b4c9d5ac5ddaa4ff2ec541e4bd1a8e56)
(cherry picked from commit 2e509908eed4cf2e365ca1fd94aa2ff3d59193c1)
 2015-03-25 19:02:44 +09:00
Tsuyoshi Ozawa
c8f2880f98 HADOOP-11738. Fix a link of Protocol Buffers 2.5 for download in BUILDING.txt. (ozawa) 
(cherry picked from commit 323945b33a5bccc42e90ed619ea155503cc124b0)
 2015-03-25 18:03:06 +09:00
Tsuyoshi Ozawa
557dfe5c40 HADOOP-11014. Potential resource leak in JavaKeyStoreProvider due to unclosed stream. (ozawa) 
(cherry picked from commit b351086ff66ca279c0550e078e3a9d110f3f36a5)
 2015-03-25 17:00:07 +09:00
Jitendra Pandey
d286673c60 HDFS-6826. Plugin interface to enable delegation of HDFS authorization assertions. Contributed by Arun Suresh. 
(cherry picked from commit 456cec127b23b9195784dd4b35b75a2b69ad2a4a)
 2015-03-24 16:17:06 -07:00
Brandon Li
14d1cccfad HDFS-7977. NFS couldn't take percentile intervals. Contributed by Brandon Li 
(cherry picked from commit 570a83ae80faf2076966acf30588733803327844)
(cherry picked from commit 260dbe96c3d21ea372c728b2cd0f4a6aeb970010)
 2015-03-24 10:53:20 -07:00
Brandon Li
cc5922607a HDFS-7976. Update NFS user guide for mount option 'sync' to minimize or avoid reordered writes. Contributed by Brandon Li 
(cherry picked from commit 51f1f4937402c63392854443ccde18c1579e3348)
(cherry picked from commit 95bde8898636156a442949535fd776ccd638e337)
 2015-03-24 10:30:19 -07:00
Andrew Wang
a7f447d460 HDFS-7961. Trigger full block report after hot swapping disk. Contributed by Eddy Xu. 
(cherry picked from commit 6413d34986f3399023426c89c9a0d401c9557716)
 2015-03-24 09:07:27 -07:00
Tsuyoshi Ozawa
01460c0bc9 MAPREDUCE-6285. ClientServiceDelegate should not retry upon AuthenticationException. Contributed by Jonathan Eagles. 
(cherry picked from commit 4170c99147b0cb6d561ff626cea140e0a061b314)
 2015-03-25 00:57:26 +09:00
Tsuyoshi Ozawa
913fdea4e2 HADOOP-11609. Correct credential commands info in CommandsManual.html#credential. Contributed by Varun Saxena. 
(cherry picked from commit 6e891a921e00b122390a976dfd13838472a7fcc6)
 2015-03-24 20:58:13 +09:00
Plamen Jeliazkov
da318cbbde HDFS-7956. Improve logging for DatanodeRegistration. Contributed by Plamen Jeliazkov. 2015-03-23 23:09:52 -07:00
Andrew Wang
af0af28afc HDFS-7960. The full block report should prune zombie storages even if they're not empty. Contributed by Colin McCabe and Eddy Xu. 
(cherry picked from commit 50ee8f4e67a66aa77c5359182f61f3e951844db6)
 2015-03-23 22:01:37 -07:00
Tsz-Wo Nicholas Sze
87079cde7d HDFS-7884. Fix NullPointerException in BlockSender when the generation stamp provided by the client is larger than the one stored in the datanode. Contributed by Brahma Reddy Battula 2015-03-24 13:52:18 +09:00
Xuan
4dfd84ec08 YARN-3393. Getting application(s) goes wrong when app finishes before 
starting the attempt. Contributed by Zhijie Shen

(cherry picked from commit 9fae455e26e0230107e1c6db58a49a5b6b296cf4)
 2015-03-23 20:34:59 -07:00
cnauroth
8e1c33e703 HDFS-7917. Use file to replace data dirs in test to simulate a disk failure. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 2c238ae4e00371ef76582b007bb0e20ac8455d9c)
(cherry picked from commit 01c0bcb176e22ddefbc8086e382dd1ebd105f9c6)
 2015-03-23 16:30:48 -07:00
Akira Ajisaka
2742f12b58 HDFS-7881. TestHftpFileSystem#testSeek fails in branch-2. Contributed by Brahma Reddy Battula. 
(cherry picked from commit fad8c78173c4b7c55324033720f04a09943deac7)
 2015-03-24 06:25:21 +09:00
cnauroth
57e297208d YARN-3336. FileSystem memory leak in DelegationTokenRenewer. 
(cherry picked from commit 6ca1f12024fd7cec7b01df0f039ca59f3f365dc1)
(cherry picked from commit 342c525eaa0749175f0e3827d245642776d043a5)
 2015-03-23 10:46:22 -07:00
Brandon Li
6b9f2d9f39 HDFS-7942. NFS: support regexp grouping in nfs.exports.allowed.hosts. Contributed by Brandon Li 
(cherry picked from commit 36af4a913c97113bd0486c48e1cb864c5cba46fd)
(cherry picked from commit 503d8e4164ff3da29fcaf56436fe6fab6a450105)
 2015-03-23 10:13:11 -07:00
Tsuyoshi Ozawa
d2e19160dc YARN-3384. TestLogAggregationService.verifyContainerLogs fails after YARN-2777. Contributed by Naganarasimha G R. 
(cherry picked from commit 82eda771e05cf2b31788ee1582551e65f1c0f9aa)
 2015-03-24 00:26:08 +09:00
Harsh J
929b04ce3a MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu. 2015-03-22 10:18:32 +05:30
Kihwal Lee
08f2f7ed34 HDFS-6841. Use Time.monotonicNow() wherever applicable instead of Time.now(). Contributed by Vinayakumar B 
(cherry picked from commit 99a8dcd19528b265d4fda9ae09a17e4af52f2782)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/DatanodeInfo.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
(cherry picked from commit 63b7870aec007081c82427587cb6e1d38e2c70f8)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
 2015-03-20 14:06:02 -05:00
Jing Zhao
03fb9b4ce0 HDFS-7957. Truncate should verify quota before making changes. Contributed by Jing Zhao. 
(cherry picked from commit d368d3647a858644b9fcd3be33d9fea2a6962f69)
(cherry picked from commit 6be52e42a9eb2069cedb12a8311bc36131a3804f)
 2015-03-20 11:56:39 -07:00
Wangda Tan
57a0382f4b YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy Battula via wangda) 
(cherry picked from commit 6bc7710ec7f2592c4c87dd940fbe5827ef81fe72)
 2015-03-20 10:44:34 -07:00
Xuan
b63ff4c36d YARN-2777. Mark the end of individual log in aggregated log. Contributed 
by Varun Saxena

(cherry picked from commit 1a4b52869191b7e39c0101d3585efc12d6362c1c)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-03-20 10:28:24 -07:00
yliu
faeb8b9b53 HDFS-7962. Remove duplicated logs in BlockManager. (yliu) 2015-03-20 05:32:19 +08:00
Jian He
e67bd31ac0 YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM WebUI. Contributed by Xuan Gong 
(cherry picked from commit 4e886eb9cbd2dcb128bbfd17309c734083093a4c)
 2015-03-19 22:34:34 -07:00
yliu
0da3fcb4b0 HDFS-7930. commitBlockSynchronization() does not remove locations. (yliu) 2015-03-19 23:26:26 +08:00
Jason Lowe
0be2461df5 MAPREDUCE-6275. Race condition in FileOutputCommitter v2 for user-specified task output subdirs. Contributed by Gera Shegalov and Siqi Li 
(cherry picked from commit 91baca145a6c16fe13f455d150c05bd73179531b)
 2015-03-19 21:41:49 +00:00
Kihwal Lee
4e967d0bcd HDFS-7932. Speed up the shutdown of datanode during rolling upgrade. Contributed by Kihwal Lee. 
(cherry picked from commit 61a4c7fc9891def0e85edf7e41d74c6b92c85fdb)
 2015-03-19 12:29:16 -05:00
Tsuyoshi Ozawa
4821f0cdb7 HADOOP-11729. Fix link to cgroups doc in site.xml. Contributed by Masatake Iwasaki. 
(cherry picked from commit 522c897146aa4e9588d3c25639750c8ed712ef9e)
 2015-03-19 23:09:22 +09:00
Vinayakumar B
76ce2e8ea0 HDFS.7849. Update documentation for enabling a new feature in rolling upgrade ( Contributed by J.Andreina ) 
(cherry picked from commit 5be5129d93481e9caae6a05b2361c463211a6d55)
 2015-03-19 19:10:23 +05:30
Kihwal Lee
b8f269af9d HDFS-7816. Unable to open webhdfs paths with "+". Contributed by Haohui Mai 
(cherry picked from commit e79be0ee123d05104eb34eb854afcf9fa78baef2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
(cherry picked from commit ceb39c1cc6b52178172c879d96cd743e0dc7a650)
 2015-03-19 08:04:19 -05:00
Haohui Mai
7129287efb HADOOP-10703. HttpServer2 creates multiple authentication filters. Contributed by Benoy Antony. 2015-03-18 22:33:24 -07:00
Colin Patrick Mccabe
84acee00fa HADOOP-9329. document native build dependencies in BUILDING.txt (Vijay Bhat via Colin P. McCabe) 
(cherry picked from commit bf6295bed8b58432ede44e074fa7998d55c4b821)
(cherry picked from commit b02f77540c33650cb856a9dee935d3c873fc94cc)
 2015-03-18 19:15:40 -07:00
Colin Patrick Mccabe
9e61835678 HDFS-7929. inotify unable fetch pre-upgrade edit log segments once upgrade starts (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 43b41f22411439c5e23629197fb2fde45dcf0f0f)
(cherry picked from commit 219eb22c1571f76df32967a930049d983cbf5024)
 2015-03-18 19:08:53 -07:00