Commit Graph

11077 Commits

Author SHA1 Message Date
Zhijie Shen 8d0ef31632 YARN-3787. Allowed generic history service to load a number of applications whose started time is within the given range. Contributed by Xuan Gong. 2015-06-08 23:14:58 -07:00
cnauroth c45784bc90 HADOOP-12073. Azure FileSystem PageBlobInputStream does not return -1 on EOF. Contributed by Ivan Mitic. 2015-06-08 22:42:14 -07:00
Xiaoyu Yao 927577c87c HDFS-8552. Fix hdfs CLI usage message for namenode and zkfc. Contributed by Brahma Reddy Battula 2015-06-08 21:57:26 -07:00
Colin Patrick Mccabe fc2ed4a1f9 HADOOP-11347. RawLocalFileSystem#mkdir and create should honor umask (Varun Saxena via Colin P. McCabe) 2015-06-08 17:49:31 -07:00
cnauroth 025a3a8be0 MAPREDUCE-6392. Document mapred class path options. Contributed by Brahma Reddy Battula. 2015-06-08 16:22:03 -07:00
cnauroth a531b058ae YARN-3786. Document yarn class path options. Contributed by Brahma Reddy Battula. 2015-06-08 16:18:36 -07:00
cnauroth d2832b3d42 HDFS-8553. Document hdfs class path options. Contributed by Brahma Reddy Battula. 2015-06-08 16:15:38 -07:00
Arpit Agarwal 84ba1a75b6 HADOOP-12054. RPC client should not retry for InvalidToken exceptions. (Contributed by Varun Saxena) 2015-06-08 15:45:23 -07:00
Xuan 2b2465dfac YARN-3778. Fix Yarn resourcemanger CLI usage. Contributed by Brahma Reddy Battula 2015-06-08 15:43:03 -07:00
Tsuyoshi Ozawa 6afe20a7a4 MAPREDUCE-6388. Remove deprecation warnings from JobHistoryServer classes. Contributed by Ray Chiang. 2015-06-08 15:06:10 -07:00
Jian He 960b8f19ca YARN-2716. Refactor ZKRMStateStore retry code with Apache Curator. Contributed by Karthik Kambatla 2015-06-08 14:50:58 -07:00
cnauroth 0e80d51983 HDFS-8554. TestDatanodeLayoutUpgrade fails on Windows. Contributed by Chris Nauroth. 2015-06-08 08:39:02 -07:00
Steve Loughran 18f6809776 HADOOP-12052 IPC client downgrades all exception types to IOE, breaks callers trying to use them. (Brahma Reddy Battula via stevel) 2015-06-08 13:02:56 +01:00
Devaraj K 126321eded YARN-3747. TestLocalDirsHandlerService should delete the created test
directory logDir2. Contributed by David Moore.
2015-06-08 15:32:13 +05:30
Devaraj K c7ee6c151c YARN-3780. Should use equals when compare Resource in
RMNodeImpl#ReconnectNodeTransition. Contributed by zhihai xu.
2015-06-08 11:54:55 +05:30
cnauroth a6cb4894b4 HDFS-8539. Hdfs doesnt have class debug in windows. Contributed by Anu Engineer. 2015-06-07 13:01:43 -07:00
Karthik Kambatla bd69ea408f YARN-3655. FairScheduler: potential livelock due to maxAMShare limitation and container reservation. (Zhihai Xu via kasha) 2015-06-07 11:37:52 -07:00
Xiaoyu Yao b61b489995 HDFS-8116. Cleanup uncessary if LOG.isDebugEnabled() from RollingWindowManager. Contributed by Brahma Reddy Battula. 2015-06-06 18:47:45 -07:00
cnauroth 71de367c5e HDFS-8432. Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases. Contributed by Chris Nauroth. 2015-06-06 09:43:47 -07:00
cnauroth e46cb80002 HADOOP-12055. Deprecate usage of NativeIO#link. Contributed by Andrew Wang. 2015-06-06 09:17:03 -07:00
Jason Lowe b3ffa87003 MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections. Contributed by Chang Li 2015-06-05 22:38:31 +00:00
Xiaoyu Yao 3841d09765 HDFS-8522. Change heavily recorded NN logs from INFO to DEBUG level. (Contributed by Xiaoyu Yao) 2015-06-05 15:09:24 -07:00
Andrew Wang bc11e158b1 HADOOP-12056. Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directory. Contributed by Zhihai Xu. 2015-06-05 13:52:21 -07:00
Andrew Wang 2dbc40e608 HADOOP-12059. S3Credentials should support use of CredentialProvider. Contributed by Sean Busbey. 2015-06-05 13:11:01 -07:00
Xuan 3e000a919f YARN-1462. AHS API and other AHS changes to handle tags for completed MR jobs. Contributed by Xuan Gong 2015-06-05 12:48:52 -07:00
Karthik Kambatla 75885852cc YARN-3259. FairScheduler: Trigger fairShare updates on node events. (Anubhav Dhoot via kasha) 2015-06-05 09:39:41 -07:00
Karthik Kambatla 6786daab33 MAPREDUCE-6387. Serialize the recently added Task#encryptedSpillKey field at the end. (Arun Suresh via kasha) 2015-06-05 09:14:06 -07:00
Devaraj K 09b8241e6e MAPREDUCE-6383. Pi job (QuasiMonteCarlo) should not try to read the
results file if its job fails. Contributed by Harsh J.
2015-06-05 21:22:47 +05:30
Devaraj K 790a861766 MAPREDUCE-6377. JHS sorting on state column not working in webUi.
Contributed by zhihai xu.
2015-06-05 15:50:16 +05:30
Andrew Wang b2540f486e HDFS-8535. Clarify that dfs usage in dfsadmin -report output includes all block replicas. Contributed by Eddy Xu. 2015-06-04 15:35:07 -07:00
Zhijie Shen 18dd01d6bf YARN-3766. Fixed the apps table column error of generic history web UI. Contributed by Xuan Gong. 2015-06-04 14:47:08 -07:00
Wangda Tan 405bbcf68c Add missing test file of YARN-3733 2015-06-04 13:18:44 -07:00
Gera Shegalov 9f6d67844d HADOOP-11924. Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init. (Tsuyoshi Ozawa via gera) 2015-06-04 11:38:28 -07:00
Jian He 1970ca7cbc YARN-2392. Add more diags about app retry limits on AM failures. Contributed by Steve Loughran 2015-06-04 11:14:09 -07:00
Andrew Wang 5149dc7b97 HDFS-8532. Make the visibility of DFSOutputStream#streamer member variable to private. Contributed by Rakesh R. 2015-06-04 11:09:19 -07:00
Arpit Agarwal 8266dae0e9 HADOOP-11994. smart-apply-patch wrongly assumes that git is infallible. (Contributed by Kengo Seki) 2015-06-04 10:54:18 -07:00
Jian He 6ad4e59cfc YARN-3764. CapacityScheduler should forbid moving LeafQueue from one parent to another. Contributed by Wangda Tan 2015-06-04 10:52:59 -07:00
Kihwal Lee ade6d9a61e HDFS-8463. Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException. Contributed by Masatake Iwasaki. 2015-06-04 12:51:00 -05:00
Wangda Tan ebd797c48f YARN-3733. Fix DominantRC#compare() does not work as expected if cluster resource is empty. (Rohith Sharmaks via wangda) 2015-06-04 10:22:57 -07:00
Akira Ajisaka dbed757cba HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii. 2015-06-05 01:45:34 +09:00
Junping Du d7e7f6aa03 YARN-41. The RM should handle the graceful shutdown of the NM. Contributed by Devaraj K. 2015-06-04 04:59:27 -07:00
Gera Shegalov e8302071ff MAPREDUCE-6382. Don't escape HTML links in Diagnostics in JHS job overview. (Siqi Li via gera) 2015-06-03 23:46:06 -07:00
Vinayakumar B 1bb79c9d01 HADOOP-12019. update BUILDING.txt to include python for 'mvn site' in windows (Contributed by Vinayakumar B) 2015-06-04 10:42:52 +05:30
Akira Ajisaka b5f0d294f8 HADOOP-12018. smart-apply-patch.sh fails if the patch edits CR+LF files and is created by 'git diff --no-prefix'. Contributed by Kengo Seki. 2015-06-04 11:14:55 +09:00
Robert Kanter cc70df98e7 MAPREDUCE-5965. Hadoop streaming throws error if list of input files is high. Error is: "error=7, Argument list too long at if number of input file is high" (wilfreds via rkanter) 2015-06-03 18:41:45 -07:00
Xuan 5766a04428 YARN-3749. We should make a copy of configuration when init
MiniYARNCluster with multiple RMs. Contributed by Chun Chen
2015-06-03 17:20:15 -07:00
Gera Shegalov d90c13e2da MAPREDUCE-6174. Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput. (Eric Payne via gera) 2015-06-03 16:50:26 -07:00
Zhijie Shen bc85959edd Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
This reverts commit 4a9ec1a824.
2015-06-03 14:15:56 -07:00
Zhijie Shen 4eec2fd132 Revert "YARN-1462. Correct fix version from branch-2.7.1 to branch-2.8 in"
This reverts commit 0b5cfacde6.
2015-06-03 14:15:56 -07:00
Karthik Kambatla edb9cd0f7a YARN-3762. FairScheduler: CME on FSParentQueue#getQueueUserAclInfo. (kasha) 2015-06-03 13:47:24 -07:00