Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,057 Commits 326 Branches 371 Tags
Commit Graph

9057 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jing Zhao
b08bc43c9b HDFS-7811. Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage. Contributed by Xiaoyu Yao and Jing Zhao. 
(cherry picked from commit 72f6bd4893dcf10d6dad24753f9be99505a87a1f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 2c1f33d17853bc5e9bd00872d221067f1fa7c9c7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-04-02 21:27:32 -07:00
Junping Du
86e8c9958a MAPREDUCE-6303. Read timeout when retrying a fetch error can be fatal to a reducer. Contributed by Jason Lowe. 
(cherry picked from commit eccb7d46efbf07abcc6a01bd5e7d682f6815b824)
 2015-04-02 12:16:22 -07:00
Tsz-Wo Nicholas Sze
acfe44e5b0 HDFS-7954. TestBalancer#testBalancerWithPinnedBlocks should not be executed on Windows. Contributed by Xiaoyu Yao 2015-04-02 11:14:04 -07:00
Brandon Li
a445f8b675 HDFS-8001 RpcProgramNfs3 : wrong parsing of dfs.blocksize. Contributed by Remi Catherinot 
(cherry picked from commit 4d14816c269f110445e1ad3e03ac53b0c1cdb58b)
(cherry picked from commit 27970b3f46674ef7824a4478141d968ef2c16ebb)
 2015-04-01 17:30:00 -07:00
Brandon Li
1bde06aca2 HADOOP-11757. NFS gateway should shutdown when it can't start UDP or TCP server. Contributed by Brandon Li 
(cherry picked from commit 60ce825a71850fe0622d551159e8d66f32448bb5)
(cherry picked from commit 8e2f1a93e462ed15084c2dfa010086d0112f89bd)
 2015-04-01 17:09:20 -07:00
Haohui Mai
8ebbbc6ebd HDFS-8036. Use snapshot path as source when using snapshot diff report in DistCp. Contributed by Jing Zhao. 2015-04-01 16:51:25 -07:00
Zhijie Shen
cf33bc1050 Revert "YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong." 
This reverts commit e4059b9cce2703c412abeacc08225c3cdfe415c1.
 2015-04-01 16:41:25 -07:00
Zhijie Shen
e4059b9cce YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong. 
(cherry picked from commit 8366a36ad356e6318b8ce6c5c96e201149f811bd)
 2015-04-01 13:49:51 -07:00
cnauroth
aa326086cc HADOOP-11787. OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac. Contributed by Kiran Kumar M R. 
(cherry picked from commit a3a96a07faf0c6f6aa3ed33608271c2b1657e437)
(cherry picked from commit 726024faa5c14bcdb31ee3ca9afd6a700e813f7f)
 2015-04-01 11:40:25 -07:00
Vinod Kumar Vavilapalli
3acfde6d85 YARN-3304. Addendum patch. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. (Junping Du and Karthik Kambatla via vinodkv) 
(cherry picked from commit 7610925e90155dfe5edce05da31574e4fb81b948)
 2015-03-31 17:29:18 -07:00
Vinod Kumar Vavilapalli
ec123abdc9 Revert "MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha)" 
This reverts commit 7bfd9e068d205f752c05d51778a4a4702329d31e.

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2015-03-31 11:30:04 -07:00
Vinod Kumar Vavilapalli
1c050bd135 Revert "MAPREDUCE-6199. AbstractCounters are not reset completely on deserialization (adhoot via rkanter)" 
This reverts commit f9341c1e2cffc4e3ac37cb7da4e535ca5c6d3913.

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2015-03-31 11:28:51 -07:00
Vinod Kumar Vavilapalli
02646ddba2 Revert "MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu." 
This reverts commit 929b04ce3a4fe419dece49ed68d4f6228be214c1.
 2015-03-31 11:26:13 -07:00
Vinod Kumar Vavilapalli
96d04307ff Revert "MAPREDUCE-6288. Changed permissions on JobHistory server's done directory so that user's client can load the conf files directly. Contributed by Robert Kanter." 
This reverts commit 5358b83167777a7108b32c9900fb0d01ca0fe961.

(cherry picked from commit cc0a01c50308fe599b4bdd5a80068d6244062e4f)
 2015-03-30 14:55:17 -07:00
Haohui Mai
86c0c6b044 HDFS-7748. Separate ECN flags from the Status in the DataTransferPipelineAck. Contributed by Anu Engineer and Haohui Mai. 2015-03-30 12:16:25 -07:00
Haohui Mai
530c2ef91a HADOOP-11754. RM fails to start in non-secure mode due to authentication filter failure. Contributed by Haohui Mai. 2015-03-30 11:45:11 -07:00
Haohui Mai
3ec1ad9001 HADOOP-11761. Fix findbugs warnings in org.apache.hadoop.security.authentication. Contributed by Li Lu. 2015-03-30 11:09:25 -07:00
Vinod Kumar Vavilapalli
fa30500d72 MAPREDUCE-6288. Changed permissions on JobHistory server's done directory so that user's client can load the conf files directly. Contributed by Robert Kanter. 
(cherry picked from commit 5358b83167777a7108b32c9900fb0d01ca0fe961)
 2015-03-30 10:29:05 -07:00
Vinod Kumar Vavilapalli
35af6f1802 YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla. 
(cherry picked from commit c358368f511963ad8e35f030b9babee541e1bd01)
 2015-03-30 10:11:49 -07:00
Kihwal Lee
a0ed29a058 HDFS-7742. Favoring decommissioning node for replication can cause a block to stay 
underreplicated for long periods. Contributed by Nathan Roberts.
(cherry picked from commit 04ee18ed48ceef34598f954ff40940abc9fde1d2)
 2015-03-30 10:11:47 -05:00
cnauroth
b849a519cb HADOOP-11639. Clean up Windows native code compilation warnings related to Windows Secure Container Executor. Contributed by Remus Rusanu. 
(cherry picked from commit 3836ad6c0b3331cf60286d134157c13985908230)
(cherry picked from commit eb7068c2c9c7edafe283c1ee235a6b940ecf568c)
 2015-03-27 15:03:59 -07:00
cnauroth
ae6a76d4da HADOOP-11691. X86 build of libwinutils is broken. Contributed by Kiran Kumar M R. 
(cherry picked from commit af618f23a70508111f490a24d74fc90161cfc079)
(cherry picked from commit 36371cddd1a6e109fbb58042897f337b772c777b)
 2015-03-26 21:57:43 -07:00
cnauroth
cf2bda8b76 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars, addendum to print warning to stderr. Contributed by Masatake Iwasaki. 
(cherry picked from commit 1fd350fa8ed83e7b99830ec7adf1b02a36c0c11e)
 2015-03-26 21:48:48 -07:00
Haohui Mai
d481a8d79b HADOOP-11748. The secrets of auth cookies should not be specified in configuration in clear text. Contributed by Li Lu and Haohui Mai. 2015-03-26 17:35:54 -07:00
Colin Patrick Mccabe
9411cf9b65 HDFS-7410. Support CreateFlags with append() to support hsync() for appending streams (Vinayakumar B via Colin P. McCabe) 
(cherry picked from commit 61df1b27a797efd094328c7d9141b9e157e01bf4)
(cherry picked from commit 2a750c9aa68ae4f1b1b3ade082ec9362e1f1c5d2)
 2015-03-26 13:29:17 -07:00
Arpit Agarwal
c808d5fe55 HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao) 2015-03-26 10:48:03 -07:00
Kihwal Lee
370c91461f HDFS-7963. Fix expected tracing spans in TestTracing. Contributed by Masatake Iwasaki. 2015-03-26 08:45:39 -05:00
Haohui Mai
2e9c690e90 Addendum for HADOOP-10670. 2015-03-25 12:31:03 -07:00
Haohui Mai
28095c26f7 HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng. 2015-03-25 12:30:58 -07:00
Xuan
646710318c YARN-2213. Change proxy-user cookie log in AmIpFilter to DEBUG. 
Contributed by Varun Saxena

(cherry picked from commit e556198e71df6be3a83e5598265cb702fc7a668b)
 2015-03-25 04:53:31 -07:00
Akira Ajisaka
da6228e320 MAPREDUCE-6292. Use org.junit package instead of junit.framework in TestCombineFileInputFormat. (aajisaka) 
(cherry picked from commit c770df49b4c9d5ac5ddaa4ff2ec541e4bd1a8e56)
(cherry picked from commit 2e509908eed4cf2e365ca1fd94aa2ff3d59193c1)
 2015-03-25 19:02:44 +09:00
Tsuyoshi Ozawa
c8f2880f98 HADOOP-11738. Fix a link of Protocol Buffers 2.5 for download in BUILDING.txt. (ozawa) 
(cherry picked from commit 323945b33a5bccc42e90ed619ea155503cc124b0)
 2015-03-25 18:03:06 +09:00
Tsuyoshi Ozawa
557dfe5c40 HADOOP-11014. Potential resource leak in JavaKeyStoreProvider due to unclosed stream. (ozawa) 
(cherry picked from commit b351086ff66ca279c0550e078e3a9d110f3f36a5)
 2015-03-25 17:00:07 +09:00
Jitendra Pandey
d286673c60 HDFS-6826. Plugin interface to enable delegation of HDFS authorization assertions. Contributed by Arun Suresh. 
(cherry picked from commit 456cec127b23b9195784dd4b35b75a2b69ad2a4a)
 2015-03-24 16:17:06 -07:00
Brandon Li
14d1cccfad HDFS-7977. NFS couldn't take percentile intervals. Contributed by Brandon Li 
(cherry picked from commit 570a83ae80faf2076966acf30588733803327844)
(cherry picked from commit 260dbe96c3d21ea372c728b2cd0f4a6aeb970010)
 2015-03-24 10:53:20 -07:00
Brandon Li
cc5922607a HDFS-7976. Update NFS user guide for mount option 'sync' to minimize or avoid reordered writes. Contributed by Brandon Li 
(cherry picked from commit 51f1f4937402c63392854443ccde18c1579e3348)
(cherry picked from commit 95bde8898636156a442949535fd776ccd638e337)
 2015-03-24 10:30:19 -07:00
Andrew Wang
a7f447d460 HDFS-7961. Trigger full block report after hot swapping disk. Contributed by Eddy Xu. 
(cherry picked from commit 6413d34986f3399023426c89c9a0d401c9557716)
 2015-03-24 09:07:27 -07:00
Tsuyoshi Ozawa
01460c0bc9 MAPREDUCE-6285. ClientServiceDelegate should not retry upon AuthenticationException. Contributed by Jonathan Eagles. 
(cherry picked from commit 4170c99147b0cb6d561ff626cea140e0a061b314)
 2015-03-25 00:57:26 +09:00
Tsuyoshi Ozawa
913fdea4e2 HADOOP-11609. Correct credential commands info in CommandsManual.html#credential. Contributed by Varun Saxena. 
(cherry picked from commit 6e891a921e00b122390a976dfd13838472a7fcc6)
 2015-03-24 20:58:13 +09:00
Plamen Jeliazkov
da318cbbde HDFS-7956. Improve logging for DatanodeRegistration. Contributed by Plamen Jeliazkov. 2015-03-23 23:09:52 -07:00
Andrew Wang
af0af28afc HDFS-7960. The full block report should prune zombie storages even if they're not empty. Contributed by Colin McCabe and Eddy Xu. 
(cherry picked from commit 50ee8f4e67a66aa77c5359182f61f3e951844db6)
 2015-03-23 22:01:37 -07:00
Tsz-Wo Nicholas Sze
87079cde7d HDFS-7884. Fix NullPointerException in BlockSender when the generation stamp provided by the client is larger than the one stored in the datanode. Contributed by Brahma Reddy Battula 2015-03-24 13:52:18 +09:00
Xuan
4dfd84ec08 YARN-3393. Getting application(s) goes wrong when app finishes before 
starting the attempt. Contributed by Zhijie Shen

(cherry picked from commit 9fae455e26e0230107e1c6db58a49a5b6b296cf4)
 2015-03-23 20:34:59 -07:00
cnauroth
8e1c33e703 HDFS-7917. Use file to replace data dirs in test to simulate a disk failure. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 2c238ae4e00371ef76582b007bb0e20ac8455d9c)
(cherry picked from commit 01c0bcb176e22ddefbc8086e382dd1ebd105f9c6)
 2015-03-23 16:30:48 -07:00
Akira Ajisaka
2742f12b58 HDFS-7881. TestHftpFileSystem#testSeek fails in branch-2. Contributed by Brahma Reddy Battula. 
(cherry picked from commit fad8c78173c4b7c55324033720f04a09943deac7)
 2015-03-24 06:25:21 +09:00
cnauroth
57e297208d YARN-3336. FileSystem memory leak in DelegationTokenRenewer. 
(cherry picked from commit 6ca1f12024fd7cec7b01df0f039ca59f3f365dc1)
(cherry picked from commit 342c525eaa0749175f0e3827d245642776d043a5)
 2015-03-23 10:46:22 -07:00
Brandon Li
6b9f2d9f39 HDFS-7942. NFS: support regexp grouping in nfs.exports.allowed.hosts. Contributed by Brandon Li 
(cherry picked from commit 36af4a913c97113bd0486c48e1cb864c5cba46fd)
(cherry picked from commit 503d8e4164ff3da29fcaf56436fe6fab6a450105)
 2015-03-23 10:13:11 -07:00
Tsuyoshi Ozawa
d2e19160dc YARN-3384. TestLogAggregationService.verifyContainerLogs fails after YARN-2777. Contributed by Naganarasimha G R. 
(cherry picked from commit 82eda771e05cf2b31788ee1582551e65f1c0f9aa)
 2015-03-24 00:26:08 +09:00
Harsh J
929b04ce3a MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu. 2015-03-22 10:18:32 +05:30
Kihwal Lee
08f2f7ed34 HDFS-6841. Use Time.monotonicNow() wherever applicable instead of Time.now(). Contributed by Vinayakumar B 
(cherry picked from commit 99a8dcd19528b265d4fda9ae09a17e4af52f2782)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/DatanodeInfo.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
(cherry picked from commit 63b7870aec007081c82427587cb6e1d38e2c70f8)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
 2015-03-20 14:06:02 -05:00