Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,160 Commits 326 Branches 371 Tags
Commit Graph

10160 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kihwal Lee
e86819c91f HADOOP-12464. Interrupted client may try to fail-over and retry. Contributed by Kihwal Lee. 
(cherry picked from commit 6144e0137bb51bd04b46ea5ce42c59c2d4f7657d)
 2015-10-19 10:56:19 -05:00
Varun Vasudev
e4429de86f YARN-4267. Add additional logging to container launch implementations in container-executor. Contributed by Sidharta Seethana. 
(cherry picked from commit 151eab2a12f5a08c00f04803bf18ef8298b98e66)
 2015-10-19 20:56:43 +05:30
Varun Vasudev
196d549e2b YARN-4262. Allow whitelisted users to run privileged docker containers. Contributed by Sidharta Seethana. 
(cherry picked from commit e39ae0e676f77fab216e2281ae946ab8c647733f)
 2015-10-19 20:21:48 +05:30
Vinayakumar B
b6dce3834d HADOOP-12460. Add overwrite option for 'get' shell command (Contributed by Jagadesh Kiran N) 
(cherry picked from commit 7f0e1eb43d3fb173e3c7932739ef20095e28ed7b)
 2015-10-19 12:16:44 +05:30
Tsuyoshi Ozawa
23bd017a7b HDFS-9237. NPE at TestDataNodeVolumeFailureToleration#tearDown. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 4c9c3955ae6cb5c3b67c8127eb7fa5449a0286d9)
 2015-10-19 15:30:37 +09:00
yliu
2c0dbf728a HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu) 2015-10-19 09:52:39 +08:00
Steve Loughran
f7d746a81b HADOOP-10941. Proxy user verification NPEs if remote host is unresolvable (Benoy Antony via stevel). 2015-10-18 14:05:17 +01:00
Steve Loughran
b390aae467 HADOOP-12450. UserGroupInformation should not log at WARN level if no groups are found. (Elliott Clark via stevel) 2015-10-18 12:23:34 +01:00
Steve Loughran
390f29ab99 YARN-4155. TestLogAggregationService.testLogAggregationServiceWithInterval failing. (Bibin A Chundatt via stevel) 2015-10-18 12:03:46 +01:00
Steve Loughran
10932aad29 HADOOP-11628. SPNEGO auth does not work with CNAMEs in JDK8. (Daryn Sharp via stevel). 2015-10-18 11:45:11 +01:00
Sangjin Lee
180efe6677 YARN-2556. Tool to measure the performance of the timeline server (Chang Li via sjlee) 
(cherry picked from commit 58590fef49bf45fc97c81277560e08da6b753f95)
 2015-10-16 16:57:32 -07:00
Jian He
1ba73169c7 YARN-4170. AM need to be notified with priority in AllocateResponse. Contributed by Sunil G 
(cherry picked from commit f9da5cdb2b2dd071fd60fc01ea1edf0f79c0819b)
 2015-10-16 15:26:46 -07:00
Wangda Tan
204ee6a40f YARN-4162. CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API. (Naganarasimha G R via wangda) 
(cherry picked from commit 4337b263aa23464a01c316336db2319e2858a2b3)
 2015-10-16 15:10:08 -07:00
Haohui Mai
842b3324f2 HDFS-9253. Refactor tests of libhdfs into a directory. Contributed by Haohui Mai. 2015-10-16 11:20:39 -07:00
Tsz-Wo Nicholas Sze
32c810c819 HDFS-9205. Do not schedule corrupt blocks for replication. (szetszwo) 2015-10-16 23:15:16 +08:00
Harsh J
76cfd833f3 HDFS-9257. improve error message for "Absolute path required" in INode.java to contain the rejected path. Contributed by Marcell Szabo 
(cherry picked from commit 52ac73f344e822e41457582f82abb4f35eba9dec)
 2015-10-16 17:13:05 +02:00
Jian He
2862057f11 YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart. Contributed by Varun Saxena 
(cherry picked from commit cf23f2c2b5b4eb9e51de1a66b7aa57dee7ff30b5)
 2015-10-15 17:13:09 -07:00
cnauroth
6774a1732a HADOOP-12481. JWTRedirectAuthenticationHandler doesn't Retain Original Query String. Contributed by Larry McCay. 
(cherry picked from commit a121fa1d39b2eb129bcc0e786d0d24c9ec0cdefc)
 2015-10-15 16:45:08 -07:00
cnauroth
adb015847d HADOOP-12479. ProtocMojo does not log the reason for a protoc compilation failure. Contributed by Chris Nauroth. 
(cherry picked from commit fdd740622459625efe5e12f37577aa3f5746177f)
 2015-10-15 15:55:06 -07:00
Sangjin Lee
afa57f1b48 HADOOP-12475. Replace guava Cache with ConcurrentHashMap for caching Connection in ipc Client (Walter Su via sjlee) 
(cherry picked from commit 8d2d3eb7bb938cc06ea3cc74040cfe0be13a2ba8)
 2015-10-15 11:49:03 -07:00
Jing Zhao
00e2982cd4 Add Apache license header in DatanodeStats.java 
(cherry picked from commit 7a98d94b7b6b730b8ca3ca606fe397adc0d0fc0b)
 2015-10-15 10:33:03 -07:00
Kihwal Lee
06d4d72675 HDFS-9220. Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum. Contributed by Jing Zhao. 
(cherry picked from commit c7c36cbd6218f46c33d7fb2f60cd52cb29e6d720)
 2015-10-15 11:25:39 -05:00
Vinayakumar B
0956aed25a HDFS-9157. [OEV and OIV] : Unnecessary parsing for mandatory arguements if '-h' option is specified as the only option (Contributed by nijel) 
(cherry picked from commit 08f5de1ef55f637b3bbde0ace28b42f155e285a1)
 2015-10-15 17:37:45 +05:30
Varun Vasudev
342870b70f YARN-4258. Add support for controlling capabilities for docker containers. Contributed by Sidharta Seethana. 
(cherry picked from commit 63020c54c12dffe03a1b3712759ec65c49df3e64)
 2015-10-15 13:41:58 +05:30
Lei Xu
b088eee297 HDFS-9188. Make block corruption related tests FsDataset-agnostic. (lei) 
(cherry picked from commit c80b3a804f5222f95a266f84424af9cb9c229483)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileAppend3.java
 2015-10-14 20:30:09 -07:00
Jing Zhao
bd3364e078 HDFS-9223. Code cleanup for DatanodeDescriptor and HeartbeatManager. Contributed by Jing Zhao. 
(cherry picked from commit be7a0add8b6561d3c566237cc0370b06e7f32bb4)
 2015-10-14 16:24:58 -07:00
Xiaoyu Yao
88e67a9583 Revert "HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao." 
This reverts commit c1f68b3cd94154e4029e1a81232a5ca25660de86.
 2015-10-14 14:42:02 -07:00
Xiaoyu Yao
c1f68b3cd9 HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao. 
(cherry picked from commit 3d5085595286c0231f66543d1509247ad4bb5739)
 2015-10-14 14:08:02 -07:00
Lei Xu
8651677446 HDFS-9238. Update TestFileCreation.testLeaseExpireHardLimit() to avoid using DataNodeTestUtils.getFile(). (Tony Wu via lei) 2015-10-14 13:11:09 -07:00
Steve Loughran
0e4fb329ed HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel) 2015-10-14 20:25:33 +01:00
rohithsharmaks
526be695c0 YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks) 
(cherry picked from commit d6c8bad86964dbad3cc810914f786c7c4722227a)
 2015-10-14 16:13:26 +05:30
Varun Vasudev
2dd9c475c4 YARN-4255. container-executor does not clean up docker operation command files. Contributed by Sidharta Seethana. 
(cherry picked from commit da1ee078f9d3c2c25c51d0b392b0925821c42ad3)
 2015-10-14 15:27:18 +05:30
Varun Vasudev
0aeedfd572 YARN-4252. Log container-executor invocation details when exit code is non-zero. Contributed by Sidharta Seethana. 
(cherry picked from commit fb9c1519b30cf8113cf9b8deed9b9901db5e9693)
 2015-10-14 15:19:19 +05:30
Varun Vasudev
a9b03b5afb YARN-4253. Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor. Contributed by Sidharta Seethana. 
(cherry picked from commit  8d5929308998869933982bd425102c3a9488ee8f)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/LinuxContainerExecutor.java
 2015-10-14 15:04:22 +05:30
Jing Zhao
d6fbd4124c HDFS-1172. Blocks in newly completed files are considered under-replicated too quickly. Contributed by Masatake Iwasaki. 
(cherry picked from commit 2a987243423eb5c7e191de2ba969b7591a441c70)
 2015-10-13 23:07:08 -07:00
Colin Patrick Mccabe
fea7e472c8 Add CHANGES.txt entry for HDFS-9187 2015-10-13 16:22:23 -07:00
Colin Patrick Mccabe
d37f88674f HDFS-9187. Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem (cmccabe) 
(cherry picked from commit d286032b715192ddbdd770b07d623fdc396810e2)
 2015-10-13 16:21:13 -07:00
Haohui Mai
ee04add696 HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu. 2015-10-13 15:24:29 -07:00
Haohui Mai
65d41fd896 HDFS-8779. WebUI fails to display block IDs that are larger than 2^53 - 1. Contributed by Haohui Mai. 2015-10-13 13:51:32 -07:00
Steve Loughran
5eab51a24f HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel) 2015-10-13 21:47:54 +01:00
Haohui Mai
016d9fa9b9 HDFS-9235. hdfs-native-client build getting errors when built with cmake 2.6. Contributed by Eric Payne. 2015-10-13 13:42:50 -07:00
Tsuyoshi Ozawa
171e54e12c HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7. (stevel and ozawa) 
(cherry picked from commit 33fefa33e51133aaf1e699e087e3bca2e8065eec)
 2015-10-14 05:32:01 +09:00
Haohui Mai
5c5362980c HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu. 2015-10-13 13:20:17 -07:00
Steve Loughran
38f86c0842 HADOOP-12449. TestDNS and TestNetUtils failing if no network. (stevel) 2015-10-13 21:13:41 +01:00
Haohui Mai
950e8a459e HADOOP-12474. MiniKMS should use random ports for Jetty server by default. Contributed by Mingliang Liu. 2015-10-13 13:08:03 -07:00
Colin Patrick Mccabe
535c903bc6 HADOOP-12344. Improve validateSocketPathSecurity0 error message (Casey Brotherton via Colin P. McCabe) 
(cherry picked from commit 6716f159645639edc669900308250492dfef5641)
 2015-10-13 12:25:48 -07:00
Jitendra Pandey
e7203b6954 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 2015-10-13 09:14:01 -07:00
Kihwal Lee
f203b84cf4 HDFS-8676. Delayed rolling upgrade finalization can cause heartbeat expiration. Contributed by Walter Su. 
(cherry picked from commit 5b43db47a313decccdcca8f45c5708aab46396df)
 2015-10-13 10:07:47 -05:00
Vinayakumar B
b0b97dfbef HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed by Chris Nauroth and Vinayakumar B) 
(cherry picked from commit 39581e3be2aaeb1eeb7fb98b6bdecd8d4e3c7269)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestEditLogTailer.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestSeveralNameNodes.java
 2015-10-13 19:29:51 +05:30
Vinayakumar B
b01eaa3b46 HDFS-9160. [OIV-Doc] : Missing details of 'delimited' for processor options (Contributed by nijel) 
(cherry picked from commit caa711b660ce73c0f6bf97e3499d157a3a2daaea)
 2015-10-13 18:14:04 +05:30