Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,273 Commits 326 Branches 371 Tags
Commit Graph

10273 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Harsh J
38420754f5 MAPREDUCE-5045. UtilTest#isCygwin method appears to be unused. Contributed by Neelesh Srinivas Salian. 
(cherry picked from commit de1322aa76007832698af682a3b76042116043b9)
 2015-09-22 21:38:31 +05:30
Vinayakumar B
96e3fbf401 HDFS-9043. Doc updation for commands in HDFS Federation (Contributed by J.Andreina) 
(cherry picked from commit 57003fa971658c8482240f70445a6822c7692844)
 2015-09-22 16:33:41 +05:30
Vinayakumar B
2893da4f53 HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node. (Contributed by J.Andreina) 
(cherry picked from commit 10ab7d595ece59f2d00b406ba8812c6295a4187f)
 2015-09-22 12:31:02 +05:30
Tsuyoshi Ozawa
52cc2ca488 HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 
(cherry picked from commit dfd807afab0fae3839c9cc5d552aa0304444f956)
 2015-09-22 12:54:44 +09:00
Haohui Mai
4e752a37e7 HDFS-9111. Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient. Contributed by Mingliang Liu. 2015-09-21 19:43:14 -07:00
Chris Douglas
b39b61e356 YARN-4188. Make MoveApplicationAcrossQueues abstract, newInstance static 
Contributed by Giovanni Matteo Fumarola
(cherry picked from commit 8e01b0d97ac3d74b049a801dfa1cc6e77d8f680a)
 2015-09-21 17:54:24 -07:00
Wangda Tan
fafcb4ac4e YARN-4113. RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER. (Sunil G via wangda) 
(cherry picked from commit b00392dd9cbb6778f2f3e669e96cf7133590dfe7)
 2015-09-21 11:15:02 -07:00
Rohith Sharma K S
52f343598e YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit c9cb6a5960ad335a3ee93a6ee219eae5aad372f9)
 2015-09-21 10:06:39 +05:30
Lei Xu
0095936a6a HDFS-9004. Add upgrade domain to DatanodeInfo. Contributed by Ming Ma (via Lei (Eddy) Xu). 
Change-Id: I887c66578eebd61acc34b94f18da6e6851c609f4
(cherry picked from commit 3a9c7076e81c1cc47c0ecf30c60abd9a65d8a501)
 2015-09-19 18:09:56 -07:00
Steve Loughran
a38dceda66 HADOOP-12360. Create StatsD metrics2 sink. (Dave Marion via stevel) 2015-09-19 12:41:29 +01:00
Zhihai Xu
88a3a07636 MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu. 
(cherry picked from commit e3ace31e2b7e3a8dc6cf3dc044d5ef2a9aa12e29)
 2015-09-19 00:12:15 -07:00
Haohui Mai
41f1f1aabf HDFS-9101. Remove deprecated NameNode.getUri() static helper method. Contributed by Mingliang Liu. 2015-09-18 18:24:09 -07:00
Arun Suresh
b70c7b0e51 YARN-3920. FairScheduler container reservation on a node should be configurable to limit it to large containers (adhoot via asuresh) 
(cherry picked from commit 94dec5a9164cd9bc573fbf74e76bcff9e7c5c637)
 2015-09-18 14:04:03 -07:00
Haohui Mai
0971503522 MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials. Contributed by Mingliang Liu. 2015-09-18 13:36:22 -07:00
Jason Lowe
9240a021fc Update CHANGES.txt to reflect commit of MR-5982 to 2.7.2 
(cherry picked from commit f97dc034fe5db5919294465509cfb63d73bcd58e)
 2015-09-18 19:25:09 +00:00
Zhihai Xu
6c66dd4875 HADOOP-12404. Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu 
(cherry picked from commit 88d89267ff6b66e144bfcceb09532191975f2a4a)
 2015-09-18 10:44:53 -07:00
Zhihai Xu
7c429fbaa9 Revert "Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu" 
This reverts commit 7576b4247b9df8e5e39e61e8157d0ac48f55bf30.
 2015-09-18 10:25:38 -07:00
Wangda Tan
6041fc75d8 MAPREDUCE-6478. Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob. (Junping Du via wangda) 2015-09-18 10:19:32 -07:00
Wangda Tan
4a657e9326 YARN-3212. RMNode State Transition Update with DECOMMISSIONING state. (Junping Du via wangda) 
(cherry picked from commit 9bc913a35c46e65d373c3ae3f01a377e16e8d0ca)
 2015-09-18 10:05:04 -07:00
Jing Zhao
b4e1279217 HDFS-9063. Correctly handle snapshot path for getContentSummary. Contributed by Jing Zhao. 
(cherry picked from commit 3f4275310203de4ccfb15337f3c503e25408a265)
 2015-09-18 09:27:10 -07:00
Zhihai Xu
7576b4247b Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu 
(cherry picked from commit e690a32e57bc14b0cca0e2d39da513841d81b4fc)
 2015-09-18 08:27:58 -07:00
Jason Lowe
6641ab83eb Update CHANGES.txt to reflect LineRecordReader fixes committed to 2.7.2 
(cherry picked from commit 288c8854a698c4b8378f0cc9399a0cccef4f9049)
 2015-09-18 15:16:06 +00:00
Yongjun Zhang
9859fd006b HDFS-5802. NameNode does not check for inode type before traversing down a path. (Xiao Chen via Yongjun Zhang) 2015-09-18 07:29:51 -07:00
Vinayakumar B
f40b4f4542 HDFS-6955. DN should reserve disk space for a full block when creating tmp files (Contributed by Kanaka Kumar Avvaru) 2015-09-18 16:42:22 +05:30
Steve Loughran
22dee29857 YARN-2597 MiniYARNCluster should propagate reason for AHS not starting 2015-09-18 09:45:17 +01:00
Rohith Sharma K S
d94c092ad1 YARN-4135. Improve the assertion message in MockRM while failing after waiting for the state.(Nijel S F via rohithsharmaks) 
(cherry picked from commit 723c31d45bc0f64b1d1a67350b108059d2a220a3)
 2015-09-18 08:46:36 +05:30
Wangda Tan
1f75e951f5 HADOOP-12386. RetryPolicies.RETRY_FOREVER should be able to specify a retry interval. (Sunil G via wangda) 
(cherry picked from commit 6b97fa6652da29a203f1537508b43333633eb760)
 2015-09-17 17:47:22 -07:00
Jason Lowe
f27f1ef44c MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li 
(cherry picked from commit ee4ee6af6a5a6299d27462adb6944206039bbbae)
 2015-09-17 21:38:44 +00:00
Haohui Mai
cadde8c1e5 HDFS-9022. Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-17 14:17:30 -07:00
Jason Lowe
4861fadb17 MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li 
(cherry picked from commit 3f82f582e51c514cc0f052c828c2f58c6e8927ad)
 2015-09-17 18:18:28 +00:00
Jason Lowe
316296e35f MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu 
(cherry picked from commit 58d1a02b8d66b1d2a6ac2158be32bd35ad2e69bd)
 2015-09-17 14:31:57 +00:00
Jian He
5d2f85021f YARN-4034. Render cluster Max Priority in scheduler metrics in RM web UI. Contributed by Rohith Sharma K S 
(cherry picked from commit 6c6e734f0baaa7b0f8d6b85963e1ce87bac28b17)
 2015-09-17 14:56:32 +08:00
Haohui Mai
d5936aa48c HADOOP-12417. TestWebDelegationToken failing with port in use. Contributed by Mingliang Liu. 2015-09-16 18:38:54 -07:00
Haohui Mai
ac2ed09be7 MAPREDUCE-6477. Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem. Contributed by Mingliang Liu. 2015-09-16 13:06:38 -07:00
Aaron T. Myers
e533555b57 Fix-up for HDFS-9072 - adding missing import of DFSTestUtil. 2015-09-16 12:30:31 -07:00
Haohui Mai
a343aa928a HDFS-7995. Implement chmod in the HDFS Web UI. Contributed by Ravi Prakash and Haohui Mai. 2015-09-16 11:50:45 -07:00
Steve Loughran
ab09573fcb YARN-3433. Jersey tests failing with Port in Use -again. (Brahma Reddy Battula) 2015-09-16 10:30:49 +01:00
Steve Loughran
9a8d09dada HDFS-9073. Fix failures in TestLazyPersistLockedMemory testReleaseOnEviction(). (J.Andreina via stevel) 2015-09-16 10:11:59 +01:00
Steve Loughran
1f28703d93 HDFS-9072. Fix random failures in TestJMXGet. (J.Andreina via stevel) 2015-09-16 10:08:18 +01:00
Jian He
9eda3ce3fa YARN-4078. Add getPendingResourceRequestForAttempt in YarnScheduler interface. Contributed by Naganarasimha G R 
(cherry picked from commit 452079af8bc56195945e28b8cf76620f0aca01c3)
 2015-09-16 15:01:23 +08:00
Eric Yang
b4bb8e1731 HADOOP-12374. Updated expunge command description. 
(WeiWei Yang via eyang)
 2015-09-15 20:05:01 -07:00
Akira Ajisaka
e38e5b56bd HADOOP-12416. Trash messages should be handled by Logger instead of being delivered on System.out. Contributed by Mingliang Liu. 
(cherry picked from commit 77aaf4cf7dd344eb094d9c079e5fb993c6696ebf)
 2015-09-16 10:20:53 +09:00
Haohui Mai
08c2c402cf HDFS-7986. Allow files / directories to be deleted from the NameNode UI. Contributed by Ravi Prakash. 2015-09-15 16:48:33 -07:00
cnauroth
b297a9c95c HDFS-9082. Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG. Contributed by Santhosh Nayak. 
(cherry picked from commit 559c09dc0eba28666c4b16435512cc2d35e31683)
 2015-09-15 15:13:56 -07:00
Xuan
f3c0a210b6 YARN-4149. yarn logs -am should provide an option to fetch all the log 
files. Contributed by Varun Vasudev

(cherry picked from commit 34ef1a092bcab369bb845481efffb8c47adef53a)
 2015-09-15 14:37:59 -07:00
Jason Lowe
181bda0421 YARN-4158. Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers. Contributed by Zhihai Xu 
(cherry picked from commit 8c1cdb17a03fec91bfab172fe92b67bdeb9ebfba)
 2015-09-15 20:22:23 +00:00
Jason Lowe
52f56524d4 MAPREDUCE-6472. MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks. Contributed by Naganarasimha G R 
(cherry picked from commit 62943b8e3aff3b274c439f72a8bb86094c1ab0e8)
 2015-09-15 19:44:17 +00:00
Vinayakumar B
2b78714c68 HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru) 
(cherry picked from commit ce69c9b54c642cfbe789fc661cfc7dcbb07b4ac5)
 2015-09-16 00:18:59 +05:30
Wangda Tan
c31fe79979 YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda) 
(cherry picked from commit ae5308fe1d08479da0f3929cc6a57816411e9121)
 2015-09-15 11:41:57 -07:00
cnauroth
be9354d010 HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu. 
(cherry picked from commit b2017d9b032af20044fdf60ddbd1575a554ccb79)
 2015-09-15 10:42:02 -07:00