Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,179 Commits 326 Branches 371 Tags
Commit Graph

10179 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
ed731f79d9 HDFS-7087. Ability to list /.reserved. Contributed by Xiao Chen. 
(cherry picked from commit 3dadf369d550c2ae393b751cb5a184dbfe2814df)
 2015-10-21 16:58:50 -07:00
cnauroth
faf1c60899 HDFS-9273. ACLs on root directory may be lost after NN restart. Contributed by Xiao Chen. 
(cherry picked from commit 1b525a9c32fabd8919c80717a58afbfa7fdce27e)
 2015-10-21 16:39:13 -07:00
Andrew Wang
7a9b97e6b7 HADOOP-10406. TestIPC.testIpcWithReaderQueuing may fail. Contributed by Xiao Chen. 
(cherry picked from commit d1cdce77faba1a9a69fe7894ecec937d2975499b)
 2015-10-21 15:21:15 -07:00
Andrew Wang
378cb17057 HDFS-9225. Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack. Contributed by Masatake Iwasaki. 
(cherry picked from commit 3e50f478b9f40fccd7b22f8fbd95d2bfda7867d2)
 2015-10-21 14:55:34 -07:00
Jason Lowe
7c002e2416 MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections. Contributed by Chang Li 
(cherry picked from commit ee9b80acf84718b952cbb82380cd0a4dbe22dc79)
 2015-10-21 21:45:51 +00:00
Zhe Zhang
2e55226ef5 HDFS-9274. Default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec should be consistent. Contributed by Yi Liu. 
Change-Id: Iafa2efb8f2eafd193b417690cc8794080b9d745b
 2015-10-21 14:07:08 -07:00
Jonathan Eagles
cc8093e5ac YARN-2513. Host framework UIs in YARN for use with the ATS (jeagles) 
(cherry picked from commit 25f8f801d15e3d9f27f4a2a198262407203e14a5)
 2015-10-21 15:38:48 -05:00
Ming Ma
39e7548cd9 HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. (Brahma Reddy Battula via mingma) 
(cherry picked from commit e27c2ae8bafc94f18eb38f5d839dcef5652d424e)
 2015-10-21 08:24:02 -07:00
Tsuyoshi Ozawa
e2f027dddc Moved CHANGES.txt entries to 2.6.2 
YARN-2019, YARN-4092, YARN-4101, YARN-4087, YARN-3727, YARN-4005,
YARN-3780, YARN-3802, YARN-3896, YARN-3554, YARN-3194, YARN-3798

(cherry picked from commit 14f0e2787c7c590d8ec1fc52f437866f34b098bd)
 2015-10-21 23:25:43 +09:00
Jason Lowe
be72ed1c75 MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk. Contributed by Maysam Yabandeh 2015-10-21 14:11:48 +00:00
Andrew Wang
cb19552fb1 HDFS-3059. ssl-server.xml causes NullPointer. Contributed by Xiao Chen. 2015-10-20 18:00:20 -07:00
Robert Kanter
492142097b MAPREDUCE-6495. Docs for archive-logs tool (rkanter) 
(cherry picked from commit 0c4af0f99811a7138954391df3761aef9ff09155)
 2015-10-20 17:34:56 -07:00
Arun Suresh
f2009dc89c YARN-3985. Make ReservationSystem persist state using RMStateStore reservation APIs. (adhoot via asuresh) 
(cherry picked from commit 506d1b1dbcb7ae5dad4a3dc4d415af241c72887c)
 2015-10-20 16:48:58 -07:00
Kihwal Lee
e327233e80 HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently. Contributed Kihwal Lee. 
(cherry picked from commit 01b103f4ff2e8ee7e71d082885436c5cb7c6be0b)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ipc/TestRPC.java
 2015-10-20 15:19:01 -05:00
Colin Patrick Mccabe
1a4bd5b161 HDFS-9270. TestShortCircuitLocalRead should not leave socket after unit test (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 6381ddc096699d680233db3b9efff9321528eedc)
 2015-10-20 10:57:16 -07:00
Lei Xu
7a8ed154ac HDFS-9251. Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in the tests code. (lei) 
(cherry picked from commit 71e533a153cbe547c99d2bc18c4cd8b7da9b00b7)
 2015-10-20 10:09:16 -07:00
yliu
03bb40612e HDFS-9208. Disabling atime may fail clients like distCp. (Kihwal Lee via yliu) 2015-10-20 11:31:14 +08:00
Arun Suresh
acc0e718d6 YARN-4270. Limit application resource reservation on nodes for non-node/rack specific requests (asuresh) 
(cherry picked from commit 7e2837f830382835838c82398db6fc9823d612a7)
 2015-10-19 20:02:10 -07:00
Andrew Wang
c35771c46e HDFS-9250. Add Precondition check to LocatedBlock#addCachedLoc. Contributed by Xiao Chen. 
(cherry picked from commit 8175c4f6b9fc17ff2e0fc568d798f9b6f2487696)
 2015-10-19 16:13:14 -07:00
Kihwal Lee
e86819c91f HADOOP-12464. Interrupted client may try to fail-over and retry. Contributed by Kihwal Lee. 
(cherry picked from commit 6144e0137bb51bd04b46ea5ce42c59c2d4f7657d)
 2015-10-19 10:56:19 -05:00
Varun Vasudev
e4429de86f YARN-4267. Add additional logging to container launch implementations in container-executor. Contributed by Sidharta Seethana. 
(cherry picked from commit 151eab2a12f5a08c00f04803bf18ef8298b98e66)
 2015-10-19 20:56:43 +05:30
Varun Vasudev
196d549e2b YARN-4262. Allow whitelisted users to run privileged docker containers. Contributed by Sidharta Seethana. 
(cherry picked from commit e39ae0e676f77fab216e2281ae946ab8c647733f)
 2015-10-19 20:21:48 +05:30
Vinayakumar B
b6dce3834d HADOOP-12460. Add overwrite option for 'get' shell command (Contributed by Jagadesh Kiran N) 
(cherry picked from commit 7f0e1eb43d3fb173e3c7932739ef20095e28ed7b)
 2015-10-19 12:16:44 +05:30
Tsuyoshi Ozawa
23bd017a7b HDFS-9237. NPE at TestDataNodeVolumeFailureToleration#tearDown. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 4c9c3955ae6cb5c3b67c8127eb7fa5449a0286d9)
 2015-10-19 15:30:37 +09:00
yliu
2c0dbf728a HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu) 2015-10-19 09:52:39 +08:00
Steve Loughran
f7d746a81b HADOOP-10941. Proxy user verification NPEs if remote host is unresolvable (Benoy Antony via stevel). 2015-10-18 14:05:17 +01:00
Steve Loughran
b390aae467 HADOOP-12450. UserGroupInformation should not log at WARN level if no groups are found. (Elliott Clark via stevel) 2015-10-18 12:23:34 +01:00
Steve Loughran
390f29ab99 YARN-4155. TestLogAggregationService.testLogAggregationServiceWithInterval failing. (Bibin A Chundatt via stevel) 2015-10-18 12:03:46 +01:00
Steve Loughran
10932aad29 HADOOP-11628. SPNEGO auth does not work with CNAMEs in JDK8. (Daryn Sharp via stevel). 2015-10-18 11:45:11 +01:00
Sangjin Lee
180efe6677 YARN-2556. Tool to measure the performance of the timeline server (Chang Li via sjlee) 
(cherry picked from commit 58590fef49bf45fc97c81277560e08da6b753f95)
 2015-10-16 16:57:32 -07:00
Jian He
1ba73169c7 YARN-4170. AM need to be notified with priority in AllocateResponse. Contributed by Sunil G 
(cherry picked from commit f9da5cdb2b2dd071fd60fc01ea1edf0f79c0819b)
 2015-10-16 15:26:46 -07:00
Wangda Tan
204ee6a40f YARN-4162. CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API. (Naganarasimha G R via wangda) 
(cherry picked from commit 4337b263aa23464a01c316336db2319e2858a2b3)
 2015-10-16 15:10:08 -07:00
Haohui Mai
842b3324f2 HDFS-9253. Refactor tests of libhdfs into a directory. Contributed by Haohui Mai. 2015-10-16 11:20:39 -07:00
Tsz-Wo Nicholas Sze
32c810c819 HDFS-9205. Do not schedule corrupt blocks for replication. (szetszwo) 2015-10-16 23:15:16 +08:00
Harsh J
76cfd833f3 HDFS-9257. improve error message for "Absolute path required" in INode.java to contain the rejected path. Contributed by Marcell Szabo 
(cherry picked from commit 52ac73f344e822e41457582f82abb4f35eba9dec)
 2015-10-16 17:13:05 +02:00
Jian He
2862057f11 YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart. Contributed by Varun Saxena 
(cherry picked from commit cf23f2c2b5b4eb9e51de1a66b7aa57dee7ff30b5)
 2015-10-15 17:13:09 -07:00
cnauroth
6774a1732a HADOOP-12481. JWTRedirectAuthenticationHandler doesn't Retain Original Query String. Contributed by Larry McCay. 
(cherry picked from commit a121fa1d39b2eb129bcc0e786d0d24c9ec0cdefc)
 2015-10-15 16:45:08 -07:00
cnauroth
adb015847d HADOOP-12479. ProtocMojo does not log the reason for a protoc compilation failure. Contributed by Chris Nauroth. 
(cherry picked from commit fdd740622459625efe5e12f37577aa3f5746177f)
 2015-10-15 15:55:06 -07:00
Sangjin Lee
afa57f1b48 HADOOP-12475. Replace guava Cache with ConcurrentHashMap for caching Connection in ipc Client (Walter Su via sjlee) 
(cherry picked from commit 8d2d3eb7bb938cc06ea3cc74040cfe0be13a2ba8)
 2015-10-15 11:49:03 -07:00
Jing Zhao
00e2982cd4 Add Apache license header in DatanodeStats.java 
(cherry picked from commit 7a98d94b7b6b730b8ca3ca606fe397adc0d0fc0b)
 2015-10-15 10:33:03 -07:00
Kihwal Lee
06d4d72675 HDFS-9220. Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum. Contributed by Jing Zhao. 
(cherry picked from commit c7c36cbd6218f46c33d7fb2f60cd52cb29e6d720)
 2015-10-15 11:25:39 -05:00
Vinayakumar B
0956aed25a HDFS-9157. [OEV and OIV] : Unnecessary parsing for mandatory arguements if '-h' option is specified as the only option (Contributed by nijel) 
(cherry picked from commit 08f5de1ef55f637b3bbde0ace28b42f155e285a1)
 2015-10-15 17:37:45 +05:30
Varun Vasudev
342870b70f YARN-4258. Add support for controlling capabilities for docker containers. Contributed by Sidharta Seethana. 
(cherry picked from commit 63020c54c12dffe03a1b3712759ec65c49df3e64)
 2015-10-15 13:41:58 +05:30
Lei Xu
b088eee297 HDFS-9188. Make block corruption related tests FsDataset-agnostic. (lei) 
(cherry picked from commit c80b3a804f5222f95a266f84424af9cb9c229483)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileAppend3.java
 2015-10-14 20:30:09 -07:00
Jing Zhao
bd3364e078 HDFS-9223. Code cleanup for DatanodeDescriptor and HeartbeatManager. Contributed by Jing Zhao. 
(cherry picked from commit be7a0add8b6561d3c566237cc0370b06e7f32bb4)
 2015-10-14 16:24:58 -07:00
Xiaoyu Yao
88e67a9583 Revert "HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao." 
This reverts commit c1f68b3cd94154e4029e1a81232a5ca25660de86.
 2015-10-14 14:42:02 -07:00
Xiaoyu Yao
c1f68b3cd9 HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao. 
(cherry picked from commit 3d5085595286c0231f66543d1509247ad4bb5739)
 2015-10-14 14:08:02 -07:00
Lei Xu
8651677446 HDFS-9238. Update TestFileCreation.testLeaseExpireHardLimit() to avoid using DataNodeTestUtils.getFile(). (Tony Wu via lei) 2015-10-14 13:11:09 -07:00
Steve Loughran
0e4fb329ed HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel) 2015-10-14 20:25:33 +01:00
rohithsharmaks
526be695c0 YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks) 
(cherry picked from commit d6c8bad86964dbad3cc810914f786c7c4722227a)
 2015-10-14 16:13:26 +05:30