Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,149 Commits 326 Branches 371 Tags
Commit Graph

10149 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jian He
1ba73169c7 YARN-4170. AM need to be notified with priority in AllocateResponse. Contributed by Sunil G 
(cherry picked from commit f9da5cdb2b2dd071fd60fc01ea1edf0f79c0819b)
 2015-10-16 15:26:46 -07:00
Wangda Tan
204ee6a40f YARN-4162. CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API. (Naganarasimha G R via wangda) 
(cherry picked from commit 4337b263aa23464a01c316336db2319e2858a2b3)
 2015-10-16 15:10:08 -07:00
Haohui Mai
842b3324f2 HDFS-9253. Refactor tests of libhdfs into a directory. Contributed by Haohui Mai. 2015-10-16 11:20:39 -07:00
Tsz-Wo Nicholas Sze
32c810c819 HDFS-9205. Do not schedule corrupt blocks for replication. (szetszwo) 2015-10-16 23:15:16 +08:00
Harsh J
76cfd833f3 HDFS-9257. improve error message for "Absolute path required" in INode.java to contain the rejected path. Contributed by Marcell Szabo 
(cherry picked from commit 52ac73f344e822e41457582f82abb4f35eba9dec)
 2015-10-16 17:13:05 +02:00
Jian He
2862057f11 YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart. Contributed by Varun Saxena 
(cherry picked from commit cf23f2c2b5b4eb9e51de1a66b7aa57dee7ff30b5)
 2015-10-15 17:13:09 -07:00
cnauroth
6774a1732a HADOOP-12481. JWTRedirectAuthenticationHandler doesn't Retain Original Query String. Contributed by Larry McCay. 
(cherry picked from commit a121fa1d39b2eb129bcc0e786d0d24c9ec0cdefc)
 2015-10-15 16:45:08 -07:00
cnauroth
adb015847d HADOOP-12479. ProtocMojo does not log the reason for a protoc compilation failure. Contributed by Chris Nauroth. 
(cherry picked from commit fdd740622459625efe5e12f37577aa3f5746177f)
 2015-10-15 15:55:06 -07:00
Sangjin Lee
afa57f1b48 HADOOP-12475. Replace guava Cache with ConcurrentHashMap for caching Connection in ipc Client (Walter Su via sjlee) 
(cherry picked from commit 8d2d3eb7bb938cc06ea3cc74040cfe0be13a2ba8)
 2015-10-15 11:49:03 -07:00
Jing Zhao
00e2982cd4 Add Apache license header in DatanodeStats.java 
(cherry picked from commit 7a98d94b7b6b730b8ca3ca606fe397adc0d0fc0b)
 2015-10-15 10:33:03 -07:00
Kihwal Lee
06d4d72675 HDFS-9220. Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum. Contributed by Jing Zhao. 
(cherry picked from commit c7c36cbd6218f46c33d7fb2f60cd52cb29e6d720)
 2015-10-15 11:25:39 -05:00
Vinayakumar B
0956aed25a HDFS-9157. [OEV and OIV] : Unnecessary parsing for mandatory arguements if '-h' option is specified as the only option (Contributed by nijel) 
(cherry picked from commit 08f5de1ef55f637b3bbde0ace28b42f155e285a1)
 2015-10-15 17:37:45 +05:30
Varun Vasudev
342870b70f YARN-4258. Add support for controlling capabilities for docker containers. Contributed by Sidharta Seethana. 
(cherry picked from commit 63020c54c12dffe03a1b3712759ec65c49df3e64)
 2015-10-15 13:41:58 +05:30
Lei Xu
b088eee297 HDFS-9188. Make block corruption related tests FsDataset-agnostic. (lei) 
(cherry picked from commit c80b3a804f5222f95a266f84424af9cb9c229483)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileAppend3.java
 2015-10-14 20:30:09 -07:00
Jing Zhao
bd3364e078 HDFS-9223. Code cleanup for DatanodeDescriptor and HeartbeatManager. Contributed by Jing Zhao. 
(cherry picked from commit be7a0add8b6561d3c566237cc0370b06e7f32bb4)
 2015-10-14 16:24:58 -07:00
Xiaoyu Yao
88e67a9583 Revert "HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao." 
This reverts commit c1f68b3cd94154e4029e1a81232a5ca25660de86.
 2015-10-14 14:42:02 -07:00
Xiaoyu Yao
c1f68b3cd9 HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao. 
(cherry picked from commit 3d5085595286c0231f66543d1509247ad4bb5739)
 2015-10-14 14:08:02 -07:00
Lei Xu
8651677446 HDFS-9238. Update TestFileCreation.testLeaseExpireHardLimit() to avoid using DataNodeTestUtils.getFile(). (Tony Wu via lei) 2015-10-14 13:11:09 -07:00
Steve Loughran
0e4fb329ed HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel) 2015-10-14 20:25:33 +01:00
rohithsharmaks
526be695c0 YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks) 
(cherry picked from commit d6c8bad86964dbad3cc810914f786c7c4722227a)
 2015-10-14 16:13:26 +05:30
Varun Vasudev
2dd9c475c4 YARN-4255. container-executor does not clean up docker operation command files. Contributed by Sidharta Seethana. 
(cherry picked from commit da1ee078f9d3c2c25c51d0b392b0925821c42ad3)
 2015-10-14 15:27:18 +05:30
Varun Vasudev
0aeedfd572 YARN-4252. Log container-executor invocation details when exit code is non-zero. Contributed by Sidharta Seethana. 
(cherry picked from commit fb9c1519b30cf8113cf9b8deed9b9901db5e9693)
 2015-10-14 15:19:19 +05:30
Varun Vasudev
a9b03b5afb YARN-4253. Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor. Contributed by Sidharta Seethana. 
(cherry picked from commit  8d5929308998869933982bd425102c3a9488ee8f)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/LinuxContainerExecutor.java
 2015-10-14 15:04:22 +05:30
Jing Zhao
d6fbd4124c HDFS-1172. Blocks in newly completed files are considered under-replicated too quickly. Contributed by Masatake Iwasaki. 
(cherry picked from commit 2a987243423eb5c7e191de2ba969b7591a441c70)
 2015-10-13 23:07:08 -07:00
Colin Patrick Mccabe
fea7e472c8 Add CHANGES.txt entry for HDFS-9187 2015-10-13 16:22:23 -07:00
Colin Patrick Mccabe
d37f88674f HDFS-9187. Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem (cmccabe) 
(cherry picked from commit d286032b715192ddbdd770b07d623fdc396810e2)
 2015-10-13 16:21:13 -07:00
Haohui Mai
ee04add696 HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu. 2015-10-13 15:24:29 -07:00
Haohui Mai
65d41fd896 HDFS-8779. WebUI fails to display block IDs that are larger than 2^53 - 1. Contributed by Haohui Mai. 2015-10-13 13:51:32 -07:00
Steve Loughran
5eab51a24f HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel) 2015-10-13 21:47:54 +01:00
Haohui Mai
016d9fa9b9 HDFS-9235. hdfs-native-client build getting errors when built with cmake 2.6. Contributed by Eric Payne. 2015-10-13 13:42:50 -07:00
Tsuyoshi Ozawa
171e54e12c HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7. (stevel and ozawa) 
(cherry picked from commit 33fefa33e51133aaf1e699e087e3bca2e8065eec)
 2015-10-14 05:32:01 +09:00
Haohui Mai
5c5362980c HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu. 2015-10-13 13:20:17 -07:00
Steve Loughran
38f86c0842 HADOOP-12449. TestDNS and TestNetUtils failing if no network. (stevel) 2015-10-13 21:13:41 +01:00
Haohui Mai
950e8a459e HADOOP-12474. MiniKMS should use random ports for Jetty server by default. Contributed by Mingliang Liu. 2015-10-13 13:08:03 -07:00
Colin Patrick Mccabe
535c903bc6 HADOOP-12344. Improve validateSocketPathSecurity0 error message (Casey Brotherton via Colin P. McCabe) 
(cherry picked from commit 6716f159645639edc669900308250492dfef5641)
 2015-10-13 12:25:48 -07:00
Jitendra Pandey
e7203b6954 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 2015-10-13 09:14:01 -07:00
Kihwal Lee
f203b84cf4 HDFS-8676. Delayed rolling upgrade finalization can cause heartbeat expiration. Contributed by Walter Su. 
(cherry picked from commit 5b43db47a313decccdcca8f45c5708aab46396df)
 2015-10-13 10:07:47 -05:00
Vinayakumar B
b0b97dfbef HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed by Chris Nauroth and Vinayakumar B) 
(cherry picked from commit 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java
 2015-10-13 19:29:51 +05:30
Vinayakumar B
b01eaa3b46 HDFS-9160. [OIV-Doc] : Missing details of 'delimited' for processor options (Contributed by nijel) 
(cherry picked from commit caa711b660ce73c0f6bf97e3499d157a3a2daaea)
 2015-10-13 18:14:04 +05:30
Varun Vasudev
34b8142802 YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana 
(cherry picked from commit 5b6bae00942c495e4be6ea2b8eb0676a48468dc6)
 2015-10-13 12:50:28 +05:30
Vinayakumar B
50253c43f0 HDFS-9224. TestFileTruncate fails intermittently with BindException (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 69b025dbbaa44395e49d1c04b90e1f65f0fc1132)
 2015-10-13 11:43:32 +05:30
Lei Xu
218aa7bba1 HDFS-9006. Provide BlockPlacementPolicy that supports upgrade domain. (Ming Ma via lei) 
(cherry picked from commit 0f5f9846edab3ea7e80f35000072136f998bcd46)
 2015-10-12 16:24:46 -07:00
Haohui Mai
eed61a5eda Addendum patch for HDFS-9215. 2015-10-12 15:52:15 -07:00
Jian He
ee1ce393f5 YARN-4230. RM crashes with NPE when increasing container resource if there is no headroom left. Contributed by Meng Ding 
(cherry picked from commit 9849c8b3865c7c9c9be81ae0ef8f29caa1d5f881)
 2015-10-12 11:52:04 -07:00
yliu
146f297d7d HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via yliu) 2015-10-12 16:05:47 +08:00
Zhihai Xu
9988b57e71 YARN-4201. AMBlacklist does not work for minicluster. Contributed by Jun Gong. 
(cherry picked from commit 049c6e8dc0f952b5ff7d394aa564ab7db13e4f26)
 2015-10-12 00:16:40 -07:00
yliu
85b5481d87 HDFS-8988. Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap. (yliu) 2015-10-12 14:55:58 +08:00
yliu
5e2a44a7fe HDFS-9221. HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array. (Staffan Friberg via yliu) 2015-10-12 14:30:01 +08:00
Devaraj K
28edc7b129 YARN-3964. Support NodeLabelsProvider at Resource Manager side. 
Contributed by Dian Fu.

(cherry picked from commit db9304788187c700647c4d84caeb3b5ad6d868d8)
 2015-10-11 11:24:05 +05:30
Haohui Mai
f6b0fcdc75 Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu." 
This reverts commit a412edf5c4838e007217652e1cb6a24e73b7e735.
 2015-10-10 03:25:16 -07:00