Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,033 Commits 326 Branches 371 Tags
Commit Graph

10033 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Haohui Mai
3d8f6b9d48 HDFS-9128. TestWebHdfsFileContextMainOperations and TestSWebHdfsFileContextMainOperations fail due to invalid HDFS path on Windows. Contributed by Chris Nauroth. 2015-09-23 19:38:21 -07:00
Haohui Mai
75c70339ab HADOOP-12438. Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystem. Contributed by Chris Nauroth. 2015-09-23 19:34:19 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
f48af332a7 Release process for 2.6.1: Set the release date for 2.6.1 
(cherry picked from commit 1f707ecffd80142c25ef0dee8708da49920646bc)
 2015-09-23 15:12:30 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
48eb28e7e2 YARN-3248. Moving it to improvements section in CHANGES.txt. 
(cherry picked from commit df52ff92ae42977bc743630191d1cbe1e17d00cf)
 2015-09-23 15:02:23 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
23f4cd1c5a CHANGES.txt: Moving YARN-1884, YARN-3171, YARN-3740, YARN-3248, YARN-3544 to 2.6.1 given the backport. 
(cherry picked from commit f3e5bc67661ebc7e14509f2a267131ae314699dc)
 2015-09-23 13:46:00 -07:00
Jason Lowe
b7111449a1 YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is enabled. Contributed by Mit Desai 
(cherry picked from commit 692d51c09d3668cde47cc297296d095ddfa933a3)
 2015-09-23 16:39:50 +00:00
Jason Lowe
c829be5133 YARN-4095. Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService. Contributed by Zhihai Xu 
(cherry picked from commit c890c51a916894a985439497b8a44e8eee82d762)
 2015-09-23 15:44:13 +00:00
Vinayakumar B
017dff9877 HDFS-9013. Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit a2c76e5f26301d4b01e56b347442f3dec171591d)
 2015-09-23 15:45:21 +05:30
Haohui Mai
090b1f6398 HDFS-8733. Keep server related definition in hdfs.proto on server side. Contributed by Mingliang Liu. 2015-09-22 20:57:11 -07:00
Haohui Mai
ed7211563c HDFS-9039. Separate client and server side methods of o.a.h.hdfs.NameNodeProxies. Contributed by Mingliang Liu. 2015-09-22 20:52:46 -07:00
Harsh J
38420754f5 MAPREDUCE-5045. UtilTest#isCygwin method appears to be unused. Contributed by Neelesh Srinivas Salian. 
(cherry picked from commit de1322aa76007832698af682a3b76042116043b9)
 2015-09-22 21:38:31 +05:30
Vinayakumar B
96e3fbf401 HDFS-9043. Doc updation for commands in HDFS Federation (Contributed by J.Andreina) 
(cherry picked from commit 57003fa971658c8482240f70445a6822c7692844)
 2015-09-22 16:33:41 +05:30
Vinayakumar B
2893da4f53 HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. (Contributed by J.Andreina) 
(cherry picked from commit 10ab7d595ece59f2d00b406ba8812c6295a4187f)
 2015-09-22 12:31:02 +05:30
Tsuyoshi Ozawa
52cc2ca488 HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 
(cherry picked from commit dfd807afab0fae3839c9cc5d552aa0304444f956)
 2015-09-22 12:54:44 +09:00
Haohui Mai
4e752a37e7 HDFS-9111. Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient. Contributed by Mingliang Liu. 2015-09-21 19:43:14 -07:00
Chris Douglas
b39b61e356 YARN-4188. Make MoveApplicationAcrossQueues abstract, newInstance static 
Contributed by Giovanni Matteo Fumarola
(cherry picked from commit 8e01b0d97ac3d74b049a801dfa1cc6e77d8f680a)
 2015-09-21 17:54:24 -07:00
Wangda Tan
fafcb4ac4e YARN-4113. RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER. (Sunil G via wangda) 
(cherry picked from commit b00392dd9cbb6778f2f3e669e96cf7133590dfe7)
 2015-09-21 11:15:02 -07:00
Rohith Sharma K S
52f343598e YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit c9cb6a5960ad335a3ee93a6ee219eae5aad372f9)
 2015-09-21 10:06:39 +05:30
Lei Xu
0095936a6a HDFS-9004. Add upgrade domain to DatanodeInfo. Contributed by Ming Ma (via Lei (Eddy) Xu). 
Change-Id: I887c66578eebd61acc34b94f18da6e6851c609f4
(cherry picked from commit 3a9c7076e81c1cc47c0ecf30c60abd9a65d8a501)
 2015-09-19 18:09:56 -07:00
Steve Loughran
a38dceda66 HADOOP-12360. Create StatsD metrics2 sink. (Dave Marion via stevel) 2015-09-19 12:41:29 +01:00
Zhihai Xu
88a3a07636 MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu. 
(cherry picked from commit e3ace31e2b7e3a8dc6cf3dc044d5ef2a9aa12e29)
 2015-09-19 00:12:15 -07:00
Haohui Mai
41f1f1aabf HDFS-9101. Remove deprecated NameNode.getUri() static helper method. Contributed by Mingliang Liu. 2015-09-18 18:24:09 -07:00
Arun Suresh
b70c7b0e51 YARN-3920. FairScheduler container reservation on a node should be configurable to limit it to large containers (adhoot via asuresh) 
(cherry picked from commit 94dec5a9164cd9bc573fbf74e76bcff9e7c5c637)
 2015-09-18 14:04:03 -07:00
Haohui Mai
0971503522 MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials. Contributed by Mingliang Liu. 2015-09-18 13:36:22 -07:00
Jason Lowe
9240a021fc Update CHANGES.txt to reflect commit of MR-5982 to 2.7.2 
(cherry picked from commit f97dc034fe5db5919294465509cfb63d73bcd58e)
 2015-09-18 19:25:09 +00:00
Zhihai Xu
6c66dd4875 HADOOP-12404. Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu 
(cherry picked from commit 88d89267ff6b66e144bfcceb09532191975f2a4a)
 2015-09-18 10:44:53 -07:00
Zhihai Xu
7c429fbaa9 Revert "Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu" 
This reverts commit 7576b4247b9df8e5e39e61e8157d0ac48f55bf30.
 2015-09-18 10:25:38 -07:00
Wangda Tan
6041fc75d8 MAPREDUCE-6478. Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob. (Junping Du via wangda) 2015-09-18 10:19:32 -07:00
Wangda Tan
4a657e9326 YARN-3212. RMNode State Transition Update with DECOMMISSIONING state. (Junping Du via wangda) 
(cherry picked from commit 9bc913a35c46e65d373c3ae3f01a377e16e8d0ca)
 2015-09-18 10:05:04 -07:00
Jing Zhao
b4e1279217 HDFS-9063. Correctly handle snapshot path for getContentSummary. Contributed by Jing Zhao. 
(cherry picked from commit 3f4275310203de4ccfb15337f3c503e25408a265)
 2015-09-18 09:27:10 -07:00
Zhihai Xu
7576b4247b Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu 
(cherry picked from commit e690a32e57bc14b0cca0e2d39da513841d81b4fc)
 2015-09-18 08:27:58 -07:00
Jason Lowe
6641ab83eb Update CHANGES.txt to reflect LineRecordReader fixes committed to 2.7.2 
(cherry picked from commit 288c8854a698c4b8378f0cc9399a0cccef4f9049)
 2015-09-18 15:16:06 +00:00
Yongjun Zhang
9859fd006b HDFS-5802. NameNode does not check for inode type before traversing down a path. (Xiao Chen via Yongjun Zhang) 2015-09-18 07:29:51 -07:00
Vinayakumar B
f40b4f4542 HDFS-6955. DN should reserve disk space for a full block when creating tmp files (Contributed by Kanaka Kumar Avvaru) 2015-09-18 16:42:22 +05:30
Steve Loughran
22dee29857 YARN-2597 MiniYARNCluster should propagate reason for AHS not starting 2015-09-18 09:45:17 +01:00
Rohith Sharma K S
d94c092ad1 YARN-4135. Improve the assertion message in MockRM while failing after waiting for the state.(Nijel S F via rohithsharmaks) 
(cherry picked from commit 723c31d45bc0f64b1d1a67350b108059d2a220a3)
 2015-09-18 08:46:36 +05:30
Wangda Tan
1f75e951f5 HADOOP-12386. RetryPolicies.RETRY_FOREVER should be able to specify a retry interval. (Sunil G via wangda) 
(cherry picked from commit 6b97fa6652da29a203f1537508b43333633eb760)
 2015-09-17 17:47:22 -07:00
Jason Lowe
f27f1ef44c MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li 
(cherry picked from commit ee4ee6af6a5a6299d27462adb6944206039bbbae)
 2015-09-17 21:38:44 +00:00
Haohui Mai
cadde8c1e5 HDFS-9022. Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-17 14:17:30 -07:00
Jason Lowe
4861fadb17 MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li 
(cherry picked from commit 3f82f582e51c514cc0f052c828c2f58c6e8927ad)
 2015-09-17 18:18:28 +00:00
Jason Lowe
316296e35f MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu 
(cherry picked from commit 58d1a02b8d66b1d2a6ac2158be32bd35ad2e69bd)
 2015-09-17 14:31:57 +00:00
Jian He
5d2f85021f YARN-4034. Render cluster Max Priority in scheduler metrics in RM web UI. Contributed by Rohith Sharma K S 
(cherry picked from commit 6c6e734f0baaa7b0f8d6b85963e1ce87bac28b17)
 2015-09-17 14:56:32 +08:00
Haohui Mai
d5936aa48c HADOOP-12417. TestWebDelegationToken failing with port in use. Contributed by Mingliang Liu. 2015-09-16 18:38:54 -07:00
Haohui Mai
ac2ed09be7 MAPREDUCE-6477. Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem. Contributed by Mingliang Liu. 2015-09-16 13:06:38 -07:00
Aaron T. Myers
e533555b57 Fix-up for HDFS-9072 - adding missing import of DFSTestUtil. 2015-09-16 12:30:31 -07:00
Haohui Mai
a343aa928a HDFS-7995. Implement chmod in the HDFS Web UI. Contributed by Ravi Prakash and Haohui Mai. 2015-09-16 11:50:45 -07:00
Steve Loughran
ab09573fcb YARN-3433. Jersey tests failing with Port in Use -again. (Brahma Reddy Battula) 2015-09-16 10:30:49 +01:00
Steve Loughran
9a8d09dada HDFS-9073. Fix failures in TestLazyPersistLockedMemory testReleaseOnEviction(). (J.Andreina via stevel) 2015-09-16 10:11:59 +01:00
Steve Loughran
1f28703d93 HDFS-9072. Fix random failures in TestJMXGet. (J.Andreina via stevel) 2015-09-16 10:08:18 +01:00
Jian He
9eda3ce3fa YARN-4078. Add getPendingResourceRequestForAttempt in YarnScheduler interface. Contributed by Naganarasimha G R 
(cherry picked from commit 452079af8bc56195945e28b8cf76620f0aca01c3)
 2015-09-16 15:01:23 +08:00